Skip to content

Administration

The Administration section is available to Super Admins only. It provides platform-wide management capabilities that go beyond team-level settings.

Super Admin access is indicated by a Super Admin badge next to the user's name in the Users list.

Dashboard

The Platform Dashboard (Administration → Dashboard) provides an at-a-glance overview of the entire platform's activity and health.

Overview Cards

Four summary cards at the top show all-time platform totals (not affected by the period selector):

  • Users — total registered users and how many are currently online.
  • Feedback — total graded feedbacks with AI judge contribution count.
  • Evaluations — total evaluations and how many are currently active.
  • AI Judges — active judges and number of distinct LLM providers.

Period Selector

A dropdown below the overview cards lets you choose the time range for all charts and breakdowns below: 7 days, 30 days (default), or 90 days.

Activity Charts

Two time-series charts filtered by the selected period:

  • New Users — bar chart of user registrations per day.
  • Feedback — line chart of graded feedbacks per day.

Evaluations Breakdown

Three widgets filtered by the selected period:

  • Metrics Distribution — doughnut chart of which metric types are most used (e.g., nDCG@10, P@20).
  • Evaluations by Scale — doughnut chart breakdown by grading scale (Binary, Graded, Detail).
  • Feedback Sources — doughnut chart of human vs. AI judge feedback ratio.

Judge Monitoring

All judge monitoring widgets are filtered by the selected period:

  • AI Judge Success Rate by Provider — stacked bar chart of successful/failed API calls per LLM provider.
  • Avg Latency — line chart of average judge API response time per day.
  • Token Usage — summary cards for total tokens consumed, average per request, and top provider.

Top Lists

These lists show all-time data (not affected by the period selector):

  • Most Active Teams — ranked by number of evaluations, with member count.
  • Recent Evaluations — latest evaluations with status and progress indicators.

Users

The Users page (Administration → Users) gives full visibility and control over all registered users across the platform.

Search & Filters

Use the search box to find users by name or email. Three filter groups are available:

  • Role — All / Super Admin / Regular.
  • Verified — All / Verified (green checkmark icon) / Not Verified (red exclamation icon).
  • Online — All / Online (green dot) / Offline (grey dot).

Create User

Click Create User to open a form with the following fields:

  • Name — the user's display name.
  • Email — must be unique across the platform.
  • Password — enter manually or switch to the Generate Password tab to auto-generate a random 16-character password. Use the copy button inside the input field to copy the generated password to the clipboard.

Users created by a Super Admin are automatically email-verified and assigned a personal team.

User Actions

Each user row has a context menu (three-dot icon) with the following actions:

  • Impersonate — log in as the selected user to see the platform from their perspective. Available for all users except yourself.
  • Grant / Revoke Super Admin — toggle the Super Admin role for the selected user. Requires confirmation. You cannot change your own Super Admin status.
  • Delete — permanently remove the user and their data. Requires confirmation.

Email Verification

The Verified column shows whether a user has verified their email:

  • A green checkmark circle icon with a timestamp indicates a verified email.
  • A red exclamation circle icon allows you to manually verify the user's email with one click (requires confirmation).

Settings

The Settings page (Administration → Settings) controls platform-wide authentication features. Changes take effect immediately for all users.

Authentication

SettingDescriptionDefault
RegistrationAllow new users to register accounts. When disabled, the registration page and "Sign Up" links are hidden. New users can only be created by a Super Admin.Enabled
Password ResetAllow users to reset their passwords via email. When disabled, the "Forgot Password?" link is hidden from the login page.Enabled
Email VerificationRequire users to verify their email address before accessing the platform. Unverified users are redirected to a verification prompt.Disabled
Two-Factor AuthenticationAllow users to enable two-factor authentication (TOTP) on their accounts. When disabled, users cannot set up or use 2FA.Enabled

Each setting is a toggle switch. A confirmation toast appears after each change.

TIP

When Registration is disabled, you can still add users via the Create User button on the Users page.

WARNING

Enabling Email Verification will immediately require all unverified users to verify their email before they can access the platform. Make sure existing users have verified emails before turning this on.

Single Sign-On (SSO)

SearchTweak supports authentication via an external OpenID Connect identity provider (Keycloak, Azure AD, Okta, or any OIDC-compatible service) using the socialiteproviders/keycloak package.

Configuration

Before enabling SSO, set the following environment variables in your .env file:

VariableDescriptionExample
OIDC_CLIENT_IDOAuth client ID from your identity providersearchtweak-app
OIDC_CLIENT_SECRETOAuth client secretyour-secret
OIDC_BASE_URLBase URL of your identity provider (without /realms/...)https://idp.example.com
OIDC_REALMRealm name (Keycloak-specific, defaults to master)searchtweak
OIDC_BUTTON_LABELLabel for the SSO button on the login pageSign in with SSO

If OIDC_CLIENT_ID and OIDC_BASE_URL are not configured, the SSO toggles in Settings will be disabled with a warning message.

SSO Settings

SettingDescriptionDefault
SSO (OpenID Connect)Enable the "Sign in with SSO" button on the login page. Users can authenticate via the configured identity provider.Disabled
SSO Only ModeHide the email/password login form entirely. Users must authenticate via SSO. Can only be enabled when SSO is on.Disabled

How SSO Login Works

  1. User clicks Sign in with SSO on the login page.
  2. User is redirected to the identity provider for authentication.
  3. After successful authentication, the user is redirected back to SearchTweak.
  4. If a user with the same email already exists, they are logged in and their account is linked to the OIDC provider.
  5. If no user exists with that email, a new account is created automatically with a verified email and a personal team.

TIP

SSO users receive a random password on creation and cannot use the email/password login form. They must always authenticate via the identity provider.

SSO Only Mode

When SSO Only Mode is enabled:

  • The email/password form is hidden from the login page.
  • The registration page and "Get Started" links are hidden.
  • Only the SSO button is displayed.

Fallback access: Super Admins can always access the email/password form by appending ?fallback=1 to the login URL (e.g., https://your-domain.com/login?fallback=1). This is useful if the identity provider is temporarily unavailable.

Logout Behavior

  • SSO users are redirected to the identity provider's logout endpoint, which ends both the SearchTweak session and the IdP session.
  • Non-SSO users are redirected to the standard login page.

WARNING

Disabling SSO automatically disables SSO Only Mode to prevent users from being locked out of the platform.