Skip to content

Firefly 1939 tap schema unquoted#1938

Open
loitly wants to merge 3 commits intodevfrom
FIREFLY-1939-tap-schema-unquoted
Open

Firefly 1939 tap schema unquoted#1938
loitly wants to merge 3 commits intodevfrom
FIREFLY-1939-tap-schema-unquoted

Conversation

@loitly
Copy link
Copy Markdown
Contributor

@loitly loitly commented Apr 13, 2026

Ticket: https://jira.ipac.caltech.edu/browse/FIREFLY-1939

The bug described in the ticket is no longer reproducible, but the changes still make sense. We just need to perform regression testing.
Test: https://fireflydev.ipac.caltech.edu/firefly-1939-tap-schema-unquoted/firefly/

The other update includes adding autoscaling to the Helm chart and revamping the Helm documentation.
Please review the docs: https://github.com/Caltech-IPAC/firefly/tree/FIREFLY-1939-tap-schema-unquoted/helm#readme

@loitly loitly requested a review from robyww April 13, 2026 23:24
@loitly loitly self-assigned this Apr 13, 2026
Copy link
Copy Markdown
Contributor

@robyww robyww left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It all look good.

I guess it is OK we go to auto-scaling but I have several concerns. We need to dedicate a meeting to it soon.

f"-XX:MaxRAMPercentage={os.getenv('MAX_RAM_PERCENT', '80')}",
"-XX:+UnlockExperimentalVMOptions",
"-XX:TrimNativeHeapInterval=30000",
"-XX:+UseZGC",
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have not been keeping with gc's. I am glad you noticed this.

@@ -0,0 +1,37 @@
{{- if .Values.autoscaling.enabled }}
apiVersion: autoscaling/v2
kind: HorizontalPodAutoscaler
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would like to understand this. I think I would like to discuss a general concern about pod scaling and losing cache.

I am particularly concerned about long term cache like HiPS or big images like are more common now.

If pod are coming and going it defeats our caching. Should we do more caching outside of the pod?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants