Repository navigation
Cost report is not being uploaded #308
Description
Hi, I integrated fladle and configured it to run with a service account. when i run it i can see the matrix and results is uploaded to the bucket but i can't manage to get the Cost Reporting generated. how to generate the cost reporting like below ?
Physical devices
$0.08 for 1m
Uploading [CostReport.txt] to https://console.developers.google.com/storage/browser/test-lab-v9cn46bb990nx-kz69ymd4nm9aq/test_dir/...
configuration:
fladle {
flankVersion = "22.+"
serviceAccountCredentials = project.layout.projectDirectory.file("test-key.json")
// Project Id is not needed if serviceAccountCredentials are set.
// projectId("flank-gradle")
useOrchestrator = false
environmentVariables = [
"clearPackageData": "true"
]
testTargets = [
"class com.example.test.TestFoo"
]
devices = [
["model": "redfin", "version": "30"], // physical device
]
localResultsDir = "results"
smartFlankGcsPath = "gs://test-lab-etc/flank/test_app_android.xml"
configs {
instrumentationApk.set(project.provider { "${buildDir.toString()}/outputs/apk/androidTest/debugTesting/*.apk" })
debugApk.set(project.provider { "${buildDir.toString()}/outputs/apk/debugTesting/*.apk" })
}
flakyTestAttempts = 1
maxTestShards = 50
filesToDownload = [
'.*/sdcard/tempDir1/.*', '.*/data/local/tmp/tempDir2/.*','/sdcard/Download', '.*/sdcard/[^/]+\\.ec$'
]
directoriesToPull = [
'/sdcard/tempDir1', '/data/local/tmp/tempDir2','/sdcard/Download'
]
testTimeout = "30m"
resultsBucket = "test-lab-etc"
outputStyle = 'multi'
legacyJunitResult = false
fullJunitResult = false
}
output:
Activity
moetouban commentedon Sep 7, 2022
@runningcode and idea how to integrate cost report?
runningcode commentedon Sep 7, 2022
Can you clarify what the difference is between the build that uploaded the cost report and the one that did upload it? Is it working sometimes but not always? Is the file available on the filesystem but not uploaded to the gcloud bucket?
moetouban commentedon Sep 7, 2022
@runningcode it never generated cost report the screenshot for cost report was taken from flank as example but it never generate it through the plugin locally or in the bucket
runningcode commentedon Sep 7, 2022
What version of flank did you use? What is the difference in configuration for that version of flank and this execution of flank via fladle?
moetouban commentedon Sep 7, 2022
@runningcode flank documentation doesn't state anything special configuration needed, seems it's out of the box. ,I was wondering why it wasn't generated through fladle?
I was hoping to use the gradle plugin for easy of use but the cost report is important thing that might be a deal breaker to use the plugin.
Check it out here https://flank.github.io/flank/flank-output-investigation/flank_current_output/#cost-report-section
runningcode commentedon Sep 8, 2022
Can you please share with me the version of flank you used where you saw the report being uploaded?
Please also try running flank directly (without fladle) with the generated yaml file (you can get this with the
printYmltask and let me know if the report is uploaded.