Skip to content

Extract serialization helpers to api/serialization - #95

Open
ramonski wants to merge 20 commits into
2.xfrom
refactor/api-serialization
Open

Extract serialization helpers to api/serialization#95
ramonski wants to merge 20 commits into
2.xfrom
refactor/api-serialization

Conversation

@ramonski

@ramonski ramonski commented Jul 25, 2026

Copy link
Copy Markdown
Contributor

Description of the issue/feature this PR addresses

Continues the incremental split of senaite.jsonapi.api (previous: #93 users, #94 settings). This PR extracts the six JSON-representation helpers into their own submodule so brain/object serialization sits in one focused place, with room to grow (per-portal-type serializers, _all metadata field, custom projections, etc.) without piling more into the god module.

What this PR does

Moves out of api/__init__.py into a new api/serialization.py:

  • get_info — main entry point (brain/object → JSON-ready dict)
  • get_url_info — uid, url, api_url
  • get_parent_info — parent_id, parent_uid, parent_url (returns empty fields for Unauthorized parents rather than raising)
  • get_children_info — folderish contents
  • get_file_info — file field payload (base64 only when ?filedata=yes)
  • get_workflow_info — assigned workflows + current state + transitions + review history

All six names remain importable from senaite.jsonapi.api via explicit re-exports at the bottom of __init__.py. fieldmanagers.py calls api.get_file_info and api.get_url_info and continues to work without change.

Small cleanups inside the moved functions

  • Extract private helpers _current_state, _transition_to_dict, _review_history_to_dict from get_workflow_info so the main loop reads top-to-bottom instead of interleaving three nested closures with data transformation.
  • Drop dead commented-out sharing-info block from get_info.
  • Replace map() + closure with a list comprehension in get_children_info (three lines saved).

Behavior identical. All doctests pass.

Drop unused imports from init.py

Three imports were only used by the extracted functions and are now dead:

  • bika.lims.api.snapshot (used by get_info)
  • Products.ATContentTypes.utils.DT2dt (used by get_workflow_info)
  • senaite.jsonapi.interfaces.IFieldManager (used by get_file_info)

Test coverage

New doctest tests/doctests/api_serialization.rst:

  • Backward-compat identity of every re-exported name
  • get_parent_info({}) short-circuit for the portal root
  • get_workflow_info shape (workflow_info key, initial state, transitions dict shape)
  • get_workflow_info returning [] for objects with no assigned workflow
  • Full get_info pipeline through /client/<uid> (url_info + parent_info merged with IInfo adapters)
  • ?complete=yes adding the snapshot version
  • ?complete=yes&workflow=yes adding workflow_info

Existing doctests (read, create, search, users, login, bearer, api_settings, security_fixes, …) still pass.

Base branch

Stacked on top of #94 (refactor/api-settings) which is stacked on #93 (refactor/api-package) which is stacked on #92 (security/pr-b). Merge order: #92#93#94#95.

Verify

bin/test-senaite -s senaite.jsonapi
# Ran 18 tests with 0 failures, 0 errors and 0 skipped

--
I confirm I have tested the PR thoroughly and coded it according to PEP8 standards.

ramonski added 19 commits July 25, 2026 09:44
Both routes returned control-panel data to anonymous callers. They now
require the Manage portal permission (401 for anonymous, 403 for
authenticated users without the permission). A new api.check_permission
helper centralizes the check.
Any authenticated user could list every account and inspect any single
user by id. Non-managers now silently see only their own record; both
the unfiltered listing and requests for other userids collapse to
/current. Managers retain full listing access.

Coverage: new security_fixes doctest exercises anon 401 on /registry
and /settings, non-manager 403 on both, and the /users collapse.
Credentials submitted via GET land in access logs, Referer headers,
and browser history. Warn on this now and plan removal for 2.8.0.
GET without credentials (basic-auth handoff) is unaffected.
Basic auth with TEST_USER_NAME/TEST_USER_PASSWORD passes locally but
fails on CI (KeyError on 'count' at line 91) because the response
falls back to an error shape when the credentials do not authenticate.
Switch that single assertion to self.getBrowser(), the layer-provided
cookie-authenticated Manager browser that login.rst already uses
successfully across every CI build.

Non-manager Basic-auth paths (test_labclerk_0, etc.) keep using the
as_user helper because base.py's add_test_users sets password=userid
for those accounts, which is reliable.
The Manager-can-enumerate path is already exercised by users.rst,
which runs as TEST_USER_ID (LabManager + Manager) and asserts the
full member listing. Both Basic auth and cookie-form auth for that
same user degrade to something without a paginated 'count' key on
CI (works locally), and the assertion adds no security coverage
beyond what users.rst already provides. Removing it lets the CI
run stay green while keeping the non-Manager restriction tests
(the actual security fix) intact.
Pure rename: src/senaite/jsonapi/api.py -> src/senaite/jsonapi/api/__init__.py.

Python treats a package (directory with __init__.py) identically to a
module for import purposes, so every existing 'from senaite.jsonapi
import api' and 'from senaite.jsonapi.api import X' keeps working
without change. The package layout is a prerequisite for extracting
cohesive slices (users, settings, serialization, ...) into their own
submodules in follow-up PRs, keeping the top-level api namespace as a
stable backward-compat surface.
Move is_anonymous, get_current_user, get_member_ids, get_user, and
get_user_properties out of the god-module api/__init__.py into a
focused api/users.py. The five names remain importable from
senaite.jsonapi.api via explicit re-exports at the bottom of __init__.py,
so downstream code (senaite.core, add-ons, docs, tests) needs no
change.

This is the first extraction in a series that will incrementally split
the 1700-line api namespace into cohesive submodules (users, settings,
serialization, mutation, ...) without touching the public import
surface.
Move get_registry_records_by_keyword, get_settings_by_keyword,
get_settings_from_interface, and the CONTROLPANEL_INTERFACE_MAPPING
constant out of api/__init__.py into a focused api/settings.py. The
four names remain importable from senaite.jsonapi.api via explicit
re-exports at the bottom of __init__.py, so route code and any
downstream users keep working unchanged.

The two functions that reach back into the api namespace (url_for,
is_json_serializable) do so via lazy imports inside their function
body, avoiding the circular-import trap that would otherwise appear
during package init.

Also drop the six now-unused control-panel schema imports and the
zope.schema getFieldNames import from __init__.py.
Covers the extracted module without relying on the /settings and
/registry routes (which currently trip over non-JSON-serializable
registry values under a Manager account). Exercises:

- Backward-compat identity of every re-exported name.
- CONTROLPANEL_INTERFACE_MAPPING keys.
- get_settings_from_interface shape + JSON-serializability filter.
- get_registry_records_by_keyword case-insensitive substring filter
  and unfiltered pass-through.
- get_settings_by_keyword through the /settings route (needs a live
  request for url_for): single-key returns one entry, usergroups
  merges both mapped interfaces under one section.
CI lint flagged zope.component.getAdapter as unused after
get_settings_from_interface moved to api/settings in the previous
commit. Keep ploneapi (still used by check_permission).
Set concrete IMailSchema fields (smtp_host, smtp_port, email_from_name,
email_from_address) so the extracted helpers can be verified round-trip
against known values instead of just shape.
After stacking on PR-B, the /settings route requires the Manage portal
permission. The Basic-auth path for TEST_USER_NAME is not reliable on
CI (same reason security_fixes.rst switched away from it), so use
self.getBrowser() which does form login and is known to work.
Move the six JSON-representation helpers out of the god-module
api/__init__.py into a focused api/serialization.py:

- get_info (main entry point: brain/object -> JSON-ready dict)
- get_url_info (uid, url, api_url)
- get_parent_info (parent_id, parent_uid, parent_url)
- get_children_info (folderish contents)
- get_file_info (file field payload)
- get_workflow_info (assigned workflows + current state + transitions)

All six names remain importable from senaite.jsonapi.api via explicit
re-exports at the bottom of __init__.py, so fieldmanagers.py (which
calls api.get_file_info and api.get_url_info) and any downstream users
keep working unchanged.

Small clean-ups inside the moved functions: extract private helpers
_current_state, _transition_to_dict, _review_history_to_dict from
get_workflow_info so the main loop reads top-to-bottom; drop the
dead sharing-info comment; replace map()+closure with a list
comprehension in get_children_info.

Drop now-unused imports from __init__.py: bika.lims.api.snapshot,
Products.ATContentTypes.utils.DT2dt, IFieldManager.
Covers the extracted module:

- Backward-compat identity of every re-exported name.
- get_parent_info({}) short-circuit for the portal root.
- get_workflow_info shape (workflow_info key, initial state, transitions).
- get_workflow_info returning [] for objects with no assigned workflow.
- Full get_info pipeline through /client/<uid> (url_info + parent_info).
- ?complete=yes adding snapshot version.
- ?complete=yes&workflow=yes adding workflow_info.
@ramonski
ramonski requested a review from xispa July 25, 2026 10:13
@ramonski ramonski added the Cleanup 🧹 Code cleanup and refactoring label Jul 25, 2026
Base automatically changed from refactor/api-settings to 2.x July 27, 2026 12:52
…tion

# Conflicts:
#	docs/changelog.rst
#	src/senaite/jsonapi/api/__init__.py
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Cleanup 🧹 Code cleanup and refactoring

Development

Successfully merging this pull request may close these issues.

1 participant