Jul 29 23:59:57.811190 ip-10-0-137-198 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 29 23:59:57.811205 ip-10-0-137-198 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 29 23:59:57.811214 ip-10-0-137-198 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 29 23:59:57.811537 ip-10-0-137-198 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 30 00:00:07.987821 ip-10-0-137-198 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 30 00:00:07.987836 ip-10-0-137-198 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 67359fcf47b74481ab9c3c7f66fa53d6 --
Jul 30 00:02:05.599422 ip-10-0-137-198 systemd[1]: Starting Kubernetes Kubelet...
Jul 30 00:02:05.926576 ip-10-0-137-198 kubenswrapper[2527]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 00:02:05.926576 ip-10-0-137-198 kubenswrapper[2527]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 30 00:02:05.926576 ip-10-0-137-198 kubenswrapper[2527]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 00:02:05.926576 ip-10-0-137-198 kubenswrapper[2527]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 30 00:02:05.926576 ip-10-0-137-198 kubenswrapper[2527]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 00:02:05.928106 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.928042    2527 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 30 00:02:05.932419 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932406    2527 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 00:02:05.932419 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932420    2527 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 00:02:05.932482 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932423    2527 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 00:02:05.932482 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932426    2527 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 00:02:05.932482 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932429    2527 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 00:02:05.932482 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932432    2527 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 00:02:05.932482 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932435    2527 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 00:02:05.932482 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932438    2527 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 00:02:05.932482 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932441    2527 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 00:02:05.932482 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932443    2527 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 00:02:05.932482 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932447    2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 00:02:05.932482 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932449    2527 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 00:02:05.932482 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932452    2527 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 00:02:05.932482 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932455    2527 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 00:02:05.932482 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932458    2527 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 00:02:05.932482 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932460    2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 00:02:05.932482 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932463    2527 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 00:02:05.932482 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932469    2527 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 00:02:05.932482 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932472    2527 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 00:02:05.932482 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932474    2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 00:02:05.932482 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932477    2527 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 00:02:05.932949 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932480    2527 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 00:02:05.932949 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932482    2527 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 00:02:05.932949 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932485    2527 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 00:02:05.932949 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932488    2527 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 00:02:05.932949 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932490    2527 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 00:02:05.932949 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932493    2527 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 00:02:05.932949 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932496    2527 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 00:02:05.932949 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932498    2527 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 00:02:05.932949 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932500    2527 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 00:02:05.932949 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932503    2527 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 00:02:05.932949 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932505    2527 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 00:02:05.932949 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932508    2527 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 00:02:05.932949 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932510    2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 00:02:05.932949 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932513    2527 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 00:02:05.932949 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932516    2527 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 00:02:05.932949 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932518    2527 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 00:02:05.932949 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932521    2527 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 00:02:05.932949 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932523    2527 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 00:02:05.932949 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932525    2527 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 00:02:05.932949 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932527    2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 00:02:05.932949 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932530    2527 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 00:02:05.933649 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932532    2527 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 00:02:05.933649 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932535    2527 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 00:02:05.933649 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932537    2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 00:02:05.933649 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932539    2527 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 00:02:05.933649 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932541    2527 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 00:02:05.933649 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932544    2527 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 00:02:05.933649 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932546    2527 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 00:02:05.933649 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932548    2527 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 00:02:05.933649 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932551    2527 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 00:02:05.933649 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932554    2527 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 00:02:05.933649 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932556    2527 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 00:02:05.933649 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932558    2527 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 00:02:05.933649 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932561    2527 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 00:02:05.933649 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932564    2527 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 00:02:05.933649 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932568    2527 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 00:02:05.933649 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932572    2527 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 00:02:05.933649 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932575    2527 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 00:02:05.933649 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932577    2527 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 00:02:05.933649 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932580    2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 00:02:05.933649 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932582    2527 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 00:02:05.934360 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932585    2527 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 00:02:05.934360 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932587    2527 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 00:02:05.934360 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932591    2527 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 00:02:05.934360 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932594    2527 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 00:02:05.934360 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932597    2527 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 00:02:05.934360 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932599    2527 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 00:02:05.934360 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932602    2527 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 00:02:05.934360 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932605    2527 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 00:02:05.934360 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932607    2527 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 00:02:05.934360 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932610    2527 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 00:02:05.934360 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932612    2527 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 00:02:05.934360 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932615    2527 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 00:02:05.934360 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932619    2527 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 00:02:05.934360 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932621    2527 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 00:02:05.934360 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932624    2527 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 00:02:05.934360 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932626    2527 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 00:02:05.934360 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932629    2527 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 00:02:05.934360 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932631    2527 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 00:02:05.934360 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932633    2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 00:02:05.935084 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932636    2527 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 00:02:05.935084 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932638    2527 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 00:02:05.935084 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932641    2527 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 00:02:05.935084 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932643    2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 00:02:05.935084 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932646    2527 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 00:02:05.935084 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932649    2527 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 00:02:05.935084 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932652    2527 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 00:02:05.935084 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932654    2527 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 00:02:05.935084 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932657    2527 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 00:02:05.935084 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932659    2527 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 00:02:05.935084 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932663    2527 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 00:02:05.935084 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932666    2527 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 00:02:05.935084 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932669    2527 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 00:02:05.935084 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932672    2527 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 00:02:05.935084 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932674    2527 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 00:02:05.935084 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932677    2527 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 00:02:05.935084 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932679    2527 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 00:02:05.935084 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.932682    2527 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 00:02:05.935084 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934389    2527 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 00:02:05.935900 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934422    2527 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 00:02:05.935900 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934539    2527 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 00:02:05.935900 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934551    2527 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 00:02:05.935900 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934557    2527 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 00:02:05.935900 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934561    2527 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 00:02:05.935900 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934566    2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 00:02:05.935900 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934570    2527 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 00:02:05.935900 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934575    2527 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 00:02:05.935900 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934580    2527 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 00:02:05.935900 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934585    2527 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 00:02:05.935900 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934589    2527 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 00:02:05.935900 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934593    2527 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 00:02:05.935900 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934599    2527 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 00:02:05.935900 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934603    2527 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 00:02:05.935900 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934607    2527 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 00:02:05.935900 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934612    2527 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 00:02:05.935900 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934616    2527 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 00:02:05.935900 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934620    2527 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 00:02:05.935900 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934625    2527 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 00:02:05.936717 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934629    2527 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 00:02:05.936717 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934633    2527 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 00:02:05.936717 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934640    2527 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 00:02:05.936717 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934646    2527 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 00:02:05.936717 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934651    2527 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 00:02:05.936717 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934655    2527 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 00:02:05.936717 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934659    2527 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 00:02:05.936717 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934663    2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 00:02:05.936717 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934667    2527 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 00:02:05.936717 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934671    2527 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 00:02:05.936717 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934675    2527 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 00:02:05.936717 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934679    2527 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 00:02:05.936717 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934683    2527 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 00:02:05.936717 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934688    2527 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 00:02:05.936717 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934693    2527 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 00:02:05.936717 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934697    2527 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 00:02:05.936717 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934702    2527 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 00:02:05.936717 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934706    2527 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 00:02:05.936717 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934710    2527 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 00:02:05.936717 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934714    2527 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 00:02:05.937567 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934718    2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 00:02:05.937567 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934725    2527 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 00:02:05.937567 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934729    2527 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 00:02:05.937567 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934736    2527 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 00:02:05.937567 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934742    2527 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 00:02:05.937567 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934748    2527 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 00:02:05.937567 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934752    2527 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 00:02:05.937567 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934757    2527 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 00:02:05.937567 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934761    2527 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 00:02:05.937567 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934765    2527 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 00:02:05.937567 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934770    2527 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 00:02:05.937567 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934774    2527 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 00:02:05.937567 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934778    2527 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 00:02:05.937567 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934783    2527 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 00:02:05.937567 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934787    2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 00:02:05.937567 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934791    2527 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 00:02:05.937567 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934796    2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 00:02:05.937567 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934808    2527 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 00:02:05.937567 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934813    2527 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 00:02:05.938013 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934817    2527 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 00:02:05.938013 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934821    2527 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 00:02:05.938013 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934825    2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 00:02:05.938013 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934829    2527 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 00:02:05.938013 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934833    2527 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 00:02:05.938013 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934837    2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 00:02:05.938013 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934841    2527 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 00:02:05.938013 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934845    2527 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 00:02:05.938013 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934850    2527 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 00:02:05.938013 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934854    2527 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 00:02:05.938013 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934858    2527 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 00:02:05.938013 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934862    2527 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 00:02:05.938013 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934866    2527 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 00:02:05.938013 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934870    2527 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 00:02:05.938013 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934874    2527 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 00:02:05.938013 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934880    2527 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 00:02:05.938013 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934887    2527 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 00:02:05.938013 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934892    2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 00:02:05.938013 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934897    2527 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 00:02:05.938013 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934901    2527 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 00:02:05.938603 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934906    2527 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 00:02:05.938603 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934910    2527 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 00:02:05.938603 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934914    2527 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 00:02:05.938603 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934918    2527 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 00:02:05.938603 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934923    2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 00:02:05.938603 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934927    2527 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 00:02:05.938603 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934931    2527 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 00:02:05.938603 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934935    2527 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 00:02:05.938603 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934939    2527 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 00:02:05.938603 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934944    2527 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 00:02:05.938603 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934948    2527 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 00:02:05.938603 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934953    2527 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 00:02:05.938603 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934957    2527 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 00:02:05.938603 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934960    2527 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 00:02:05.938603 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934964    2527 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 00:02:05.938603 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934968    2527 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 00:02:05.938603 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934972    2527 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 00:02:05.938603 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934976    2527 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 00:02:05.938603 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934982    2527 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 00:02:05.938603 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.934986    2527 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 00:02:05.939293 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935580    2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 00:02:05.939293 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935590    2527 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 00:02:05.939293 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935594    2527 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 00:02:05.939293 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935598    2527 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 00:02:05.939293 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935603    2527 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 00:02:05.939293 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935607    2527 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 00:02:05.939293 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935611    2527 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 00:02:05.939293 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935616    2527 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 00:02:05.939293 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935619    2527 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 00:02:05.939293 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935623    2527 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 00:02:05.939293 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935627    2527 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 00:02:05.939293 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935631    2527 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 00:02:05.939293 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935636    2527 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 00:02:05.939293 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935640    2527 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 00:02:05.939293 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935644    2527 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 00:02:05.939293 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935648    2527 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 00:02:05.939293 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935653    2527 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 00:02:05.939293 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935658    2527 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 00:02:05.939293 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935661    2527 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 00:02:05.939293 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935665    2527 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 00:02:05.939774 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935670    2527 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 00:02:05.939774 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935674    2527 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 00:02:05.939774 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935678    2527 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 00:02:05.939774 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935682    2527 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 00:02:05.939774 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935687    2527 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 00:02:05.939774 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935691    2527 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 00:02:05.939774 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935695    2527 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 00:02:05.939774 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935699    2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 00:02:05.939774 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935703    2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 00:02:05.939774 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935707    2527 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 00:02:05.939774 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935711    2527 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 00:02:05.939774 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935715    2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 00:02:05.939774 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935720    2527 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 00:02:05.939774 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935724    2527 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 00:02:05.939774 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935728    2527 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 00:02:05.939774 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935732    2527 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 00:02:05.939774 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935737    2527 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 00:02:05.939774 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935740    2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 00:02:05.939774 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935745    2527 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 00:02:05.939774 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935749    2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 00:02:05.940337 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935753    2527 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 00:02:05.940337 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935757    2527 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 00:02:05.940337 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935761    2527 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 00:02:05.940337 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935765    2527 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 00:02:05.940337 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935769    2527 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 00:02:05.940337 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935773    2527 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 00:02:05.940337 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935777    2527 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 00:02:05.940337 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935780    2527 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 00:02:05.940337 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935784    2527 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 00:02:05.940337 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935789    2527 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 00:02:05.940337 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935793    2527 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 00:02:05.940337 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935797    2527 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 00:02:05.940337 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935801    2527 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 00:02:05.940337 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935805    2527 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 00:02:05.940337 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935809    2527 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 00:02:05.940337 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935813    2527 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 00:02:05.940337 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935818    2527 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 00:02:05.940337 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935822    2527 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 00:02:05.940337 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935826    2527 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 00:02:05.940337 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935830    2527 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 00:02:05.940813 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935835    2527 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 00:02:05.940813 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935839    2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 00:02:05.940813 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935843    2527 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 00:02:05.940813 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935849    2527 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 00:02:05.940813 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935855    2527 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 00:02:05.940813 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935859    2527 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 00:02:05.940813 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935864    2527 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 00:02:05.940813 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935869    2527 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 00:02:05.940813 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935873    2527 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 00:02:05.940813 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935877    2527 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 00:02:05.940813 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935883    2527 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 00:02:05.940813 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935888    2527 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 00:02:05.940813 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935892    2527 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 00:02:05.940813 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935896    2527 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 00:02:05.940813 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935900    2527 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 00:02:05.940813 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935904    2527 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 00:02:05.940813 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935908    2527 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 00:02:05.940813 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935912    2527 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 00:02:05.940813 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935917    2527 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 00:02:05.941296 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935924    2527 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 00:02:05.941296 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935929    2527 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 00:02:05.941296 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935933    2527 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 00:02:05.941296 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935938    2527 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 00:02:05.941296 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935942    2527 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 00:02:05.941296 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935946    2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 00:02:05.941296 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935950    2527 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 00:02:05.941296 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935954    2527 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 00:02:05.941296 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935958    2527 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 00:02:05.941296 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935962    2527 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 00:02:05.941296 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935966    2527 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 00:02:05.941296 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935970    2527 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 00:02:05.941296 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935974    2527 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 00:02:05.941296 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935978    2527 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 00:02:05.941296 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935983    2527 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 00:02:05.941296 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935987    2527 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 00:02:05.941296 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935991    2527 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 00:02:05.941296 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935995    2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 00:02:05.941296 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.935999    2527 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 00:02:05.941296 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.936003    2527 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 00:02:05.941296 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936098    2527 flags.go:64] FLAG: --address="0.0.0.0"
Jul 30 00:02:05.941797 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936109    2527 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 30 00:02:05.941797 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936116    2527 flags.go:64] FLAG: --anonymous-auth="true"
Jul 30 00:02:05.941797 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936123    2527 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 30 00:02:05.941797 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936130    2527 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 30 00:02:05.941797 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936135    2527 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 30 00:02:05.941797 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936141    2527 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 30 00:02:05.941797 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936147    2527 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 30 00:02:05.941797 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936151    2527 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 30 00:02:05.941797 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936156    2527 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 30 00:02:05.941797 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936183    2527 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 30 00:02:05.941797 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936188    2527 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 30 00:02:05.941797 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936193    2527 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 30 00:02:05.941797 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936197    2527 flags.go:64] FLAG: --cgroup-root=""
Jul 30 00:02:05.941797 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936202    2527 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 30 00:02:05.941797 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936206    2527 flags.go:64] FLAG: --client-ca-file=""
Jul 30 00:02:05.941797 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936211    2527 flags.go:64] FLAG: --cloud-provider="external"
Jul 30 00:02:05.941797 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936217    2527 flags.go:64] FLAG: --cluster-dns="[]"
Jul 30 00:02:05.941797 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936224    2527 flags.go:64] FLAG: --cluster-domain=""
Jul 30 00:02:05.941797 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936228    2527 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 30 00:02:05.941797 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936233    2527 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 30 00:02:05.941797 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936239    2527 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 30 00:02:05.941797 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936244    2527 flags.go:64] FLAG: --container-log-max-files="5"
Jul 30 00:02:05.941797 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936250    2527 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 30 00:02:05.941797 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936255    2527 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 30 00:02:05.942374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936260    2527 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 30 00:02:05.942374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936266    2527 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 30 00:02:05.942374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936270    2527 flags.go:64] FLAG: --contention-profiling="false"
Jul 30 00:02:05.942374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936275    2527 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 30 00:02:05.942374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936279    2527 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 30 00:02:05.942374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936284    2527 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 30 00:02:05.942374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936288    2527 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 30 00:02:05.942374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936294    2527 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 30 00:02:05.942374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936299    2527 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 30 00:02:05.942374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936304    2527 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 30 00:02:05.942374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936309    2527 flags.go:64] FLAG: --enable-load-reader="false"
Jul 30 00:02:05.942374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936314    2527 flags.go:64] FLAG: --enable-server="true"
Jul 30 00:02:05.942374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936318    2527 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 30 00:02:05.942374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936327    2527 flags.go:64] FLAG: --event-burst="100"
Jul 30 00:02:05.942374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936331    2527 flags.go:64] FLAG: --event-qps="50"
Jul 30 00:02:05.942374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936336    2527 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 30 00:02:05.942374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936341    2527 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 30 00:02:05.942374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936345    2527 flags.go:64] FLAG: --eviction-hard=""
Jul 30 00:02:05.942374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936357    2527 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 30 00:02:05.942374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936361    2527 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 30 00:02:05.942374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936366    2527 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 30 00:02:05.942374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936370    2527 flags.go:64] FLAG: --eviction-soft=""
Jul 30 00:02:05.942374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936375    2527 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 30 00:02:05.942374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936380    2527 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 30 00:02:05.942374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936385    2527 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 30 00:02:05.943078 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936390    2527 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 30 00:02:05.943078 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936394    2527 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 30 00:02:05.943078 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936398    2527 flags.go:64] FLAG: --fail-swap-on="true"
Jul 30 00:02:05.943078 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936403    2527 flags.go:64] FLAG: --feature-gates=""
Jul 30 00:02:05.943078 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936409    2527 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 30 00:02:05.943078 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936414    2527 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 30 00:02:05.943078 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936419    2527 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 30 00:02:05.943078 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936423    2527 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 30 00:02:05.943078 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936429    2527 flags.go:64] FLAG: --healthz-port="10248"
Jul 30 00:02:05.943078 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936434    2527 flags.go:64] FLAG: --help="false"
Jul 30 00:02:05.943078 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936439    2527 flags.go:64] FLAG: --hostname-override="ip-10-0-137-198.ec2.internal"
Jul 30 00:02:05.943078 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936444    2527 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 30 00:02:05.943078 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936448    2527 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 30 00:02:05.943078 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936453    2527 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 30 00:02:05.943078 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936458    2527 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 30 00:02:05.943078 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936463    2527 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 30 00:02:05.943078 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936467    2527 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 30 00:02:05.943078 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936472    2527 flags.go:64] FLAG: --image-service-endpoint=""
Jul 30 00:02:05.943078 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936476    2527 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 30 00:02:05.943078 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936481    2527 flags.go:64] FLAG: --kube-api-burst="100"
Jul 30 00:02:05.943078 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936487    2527 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 30 00:02:05.943078 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936492    2527 flags.go:64] FLAG: --kube-api-qps="50"
Jul 30 00:02:05.943078 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936496    2527 flags.go:64] FLAG: --kube-reserved=""
Jul 30 00:02:05.943078 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936500    2527 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 30 00:02:05.943680 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936505    2527 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 30 00:02:05.943680 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936509    2527 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 30 00:02:05.943680 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936513    2527 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 30 00:02:05.943680 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936518    2527 flags.go:64] FLAG: --lock-file=""
Jul 30 00:02:05.943680 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936522    2527 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 30 00:02:05.943680 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936527    2527 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 30 00:02:05.943680 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936531    2527 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 30 00:02:05.943680 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936539    2527 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 30 00:02:05.943680 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936544    2527 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 30 00:02:05.943680 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936549    2527 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 30 00:02:05.943680 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936553    2527 flags.go:64] FLAG: --logging-format="text"
Jul 30 00:02:05.943680 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936557    2527 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 30 00:02:05.943680 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936563    2527 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 30 00:02:05.943680 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936567    2527 flags.go:64] FLAG: --manifest-url=""
Jul 30 00:02:05.943680 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936572    2527 flags.go:64] FLAG: --manifest-url-header=""
Jul 30 00:02:05.943680 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936580    2527 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 30 00:02:05.943680 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936584    2527 flags.go:64] FLAG: --max-open-files="1000000"
Jul 30 00:02:05.943680 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936590    2527 flags.go:64] FLAG: --max-pods="110"
Jul 30 00:02:05.943680 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936594    2527 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 30 00:02:05.943680 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936599    2527 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 30 00:02:05.943680 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936604    2527 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 30 00:02:05.943680 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936608    2527 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 30 00:02:05.943680 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936613    2527 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 30 00:02:05.943680 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936617    2527 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 30 00:02:05.943680 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936622    2527 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 30 00:02:05.944285 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936633    2527 flags.go:64] FLAG: --node-status-max-images="50"
Jul 30 00:02:05.944285 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936638    2527 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 30 00:02:05.944285 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936642    2527 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 30 00:02:05.944285 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936648    2527 flags.go:64] FLAG: --pod-cidr=""
Jul 30 00:02:05.944285 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936653    2527 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 30 00:02:05.944285 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936661    2527 flags.go:64] FLAG: --pod-manifest-path=""
Jul 30 00:02:05.944285 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936666    2527 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 30 00:02:05.944285 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936670    2527 flags.go:64] FLAG: --pods-per-core="0"
Jul 30 00:02:05.944285 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936674    2527 flags.go:64] FLAG: --port="10250"
Jul 30 00:02:05.944285 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936679    2527 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 30 00:02:05.944285 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936683    2527 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a6e35841ab0dd243"
Jul 30 00:02:05.944285 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936688    2527 flags.go:64] FLAG: --qos-reserved=""
Jul 30 00:02:05.944285 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936693    2527 flags.go:64] FLAG: --read-only-port="10255"
Jul 30 00:02:05.944285 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936697    2527 flags.go:64] FLAG: --register-node="true"
Jul 30 00:02:05.944285 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936702    2527 flags.go:64] FLAG: --register-with-taints=""
Jul 30 00:02:05.944285 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936707    2527 flags.go:64] FLAG: --registry-burst="10"
Jul 30 00:02:05.944285 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936712    2527 flags.go:64] FLAG: --registry-qps="5"
Jul 30 00:02:05.944285 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936716    2527 flags.go:64] FLAG: --reserved-cpus=""
Jul 30 00:02:05.944285 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936720    2527 flags.go:64] FLAG: --reserved-memory=""
Jul 30 00:02:05.944285 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936725    2527 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 30 00:02:05.944285 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936730    2527 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 30 00:02:05.944285 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936734    2527 flags.go:64] FLAG: --rotate-certificates="false"
Jul 30 00:02:05.944285 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936738    2527 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 30 00:02:05.944285 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936746    2527 flags.go:64] FLAG: --runonce="false"
Jul 30 00:02:05.944285 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936751    2527 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 30 00:02:05.944862 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936755    2527 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 30 00:02:05.944862 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936760    2527 flags.go:64] FLAG: --seccomp-default="false"
Jul 30 00:02:05.944862 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936764    2527 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 30 00:02:05.944862 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936769    2527 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 30 00:02:05.944862 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936773    2527 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 30 00:02:05.944862 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936778    2527 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 30 00:02:05.944862 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936783    2527 flags.go:64] FLAG: --storage-driver-password="root"
Jul 30 00:02:05.944862 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936787    2527 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 30 00:02:05.944862 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936792    2527 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 30 00:02:05.944862 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936796    2527 flags.go:64] FLAG: --storage-driver-user="root"
Jul 30 00:02:05.944862 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936803    2527 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 30 00:02:05.944862 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936807    2527 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 30 00:02:05.944862 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936812    2527 flags.go:64] FLAG: --system-cgroups=""
Jul 30 00:02:05.944862 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936816    2527 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 30 00:02:05.944862 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936824    2527 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 30 00:02:05.944862 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936828    2527 flags.go:64] FLAG: --tls-cert-file=""
Jul 30 00:02:05.944862 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936833    2527 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 30 00:02:05.944862 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936839    2527 flags.go:64] FLAG: --tls-min-version=""
Jul 30 00:02:05.944862 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936844    2527 flags.go:64] FLAG: --tls-private-key-file=""
Jul 30 00:02:05.944862 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936848    2527 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 30 00:02:05.944862 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936853    2527 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 30 00:02:05.944862 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936857    2527 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 30 00:02:05.944862 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936862    2527 flags.go:64] FLAG: --v="2"
Jul 30 00:02:05.944862 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936868    2527 flags.go:64] FLAG: --version="false"
Jul 30 00:02:05.944862 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936875    2527 flags.go:64] FLAG: --vmodule=""
Jul 30 00:02:05.945534 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936881    2527 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 30 00:02:05.945534 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.936886    2527 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 30 00:02:05.945534 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937061    2527 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 00:02:05.945534 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937068    2527 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 00:02:05.945534 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937073    2527 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 00:02:05.945534 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937079    2527 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 00:02:05.945534 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937084    2527 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 00:02:05.945534 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937089    2527 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 00:02:05.945534 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937094    2527 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 00:02:05.945534 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937098    2527 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 00:02:05.945534 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937102    2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 00:02:05.945534 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937107    2527 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 00:02:05.945534 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937111    2527 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 00:02:05.945534 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937116    2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 00:02:05.945534 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937120    2527 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 00:02:05.945534 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937124    2527 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 00:02:05.945534 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937128    2527 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 00:02:05.945534 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937134    2527 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 00:02:05.945534 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937137    2527 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 00:02:05.945534 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937142    2527 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 00:02:05.946010 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937146    2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 00:02:05.946010 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937149    2527 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 00:02:05.946010 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937153    2527 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 00:02:05.946010 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937157    2527 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 00:02:05.946010 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937185    2527 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 00:02:05.946010 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937189    2527 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 00:02:05.946010 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937193    2527 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 00:02:05.946010 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937197    2527 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 00:02:05.946010 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937201    2527 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 00:02:05.946010 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937207    2527 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 00:02:05.946010 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937212    2527 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 00:02:05.946010 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937216    2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 00:02:05.946010 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937221    2527 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 00:02:05.946010 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937225    2527 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 00:02:05.946010 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937229    2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 00:02:05.946010 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937233    2527 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 00:02:05.946010 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937237    2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 00:02:05.946010 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937243    2527 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 00:02:05.946010 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937247    2527 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 00:02:05.946474 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937251    2527 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 00:02:05.946474 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937255    2527 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 00:02:05.946474 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937259    2527 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 00:02:05.946474 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937263    2527 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 00:02:05.946474 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937266    2527 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 00:02:05.946474 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937270    2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 00:02:05.946474 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937275    2527 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 00:02:05.946474 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937279    2527 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 00:02:05.946474 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937282    2527 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 00:02:05.946474 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937286    2527 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 00:02:05.946474 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937292    2527 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 00:02:05.946474 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937296    2527 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 00:02:05.946474 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937300    2527 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 00:02:05.946474 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937304    2527 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 00:02:05.946474 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937310    2527 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 00:02:05.946474 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937315    2527 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 00:02:05.946474 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937320    2527 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 00:02:05.946474 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937325    2527 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 00:02:05.946474 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937329    2527 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 00:02:05.946921 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937333    2527 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 00:02:05.946921 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937338    2527 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 00:02:05.946921 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937343    2527 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 00:02:05.946921 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937347    2527 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 00:02:05.946921 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937351    2527 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 00:02:05.946921 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937355    2527 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 00:02:05.946921 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937359    2527 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 00:02:05.946921 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937363    2527 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 00:02:05.946921 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937367    2527 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 00:02:05.946921 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937371    2527 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 00:02:05.946921 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937375    2527 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 00:02:05.946921 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937381    2527 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 00:02:05.946921 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937385    2527 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 00:02:05.946921 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937389    2527 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 00:02:05.946921 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937393    2527 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 00:02:05.946921 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937397    2527 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 00:02:05.946921 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937401    2527 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 00:02:05.946921 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937405    2527 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 00:02:05.946921 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937409    2527 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 00:02:05.946921 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937413    2527 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 00:02:05.947443 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937416    2527 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 00:02:05.947443 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937420    2527 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 00:02:05.947443 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937425    2527 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 00:02:05.947443 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937430    2527 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 00:02:05.947443 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937434    2527 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 00:02:05.947443 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937438    2527 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 00:02:05.947443 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937442    2527 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 00:02:05.947443 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937446    2527 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 00:02:05.947443 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937450    2527 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 00:02:05.947443 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937454    2527 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 00:02:05.947443 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937460    2527 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 00:02:05.947443 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937465    2527 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 00:02:05.947443 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937470    2527 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 00:02:05.947443 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937475    2527 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 00:02:05.947443 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937479    2527 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 00:02:05.947443 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937483    2527 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 00:02:05.947443 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937488    2527 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 00:02:05.947443 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937492    2527 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 00:02:05.947443 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937497    2527 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 00:02:05.947443 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937502    2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 00:02:05.947910 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937507    2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 00:02:05.947910 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937512    2527 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 00:02:05.947910 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.937516    2527 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 00:02:05.947910 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.938119    2527 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 00:02:05.947910 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.944300    2527 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 30 00:02:05.947910 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.944313    2527 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 30 00:02:05.947910 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.944330    2527 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 30 00:02:05.947910 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.944336    2527 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 30 00:02:05.947910 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944385    2527 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 00:02:05.947910 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944389    2527 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 00:02:05.947910 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944392    2527 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 00:02:05.947910 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944395    2527 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 00:02:05.947910 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944398    2527 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 00:02:05.947910 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944401    2527 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 00:02:05.947910 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944403    2527 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 00:02:05.948291 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944406    2527 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 00:02:05.948291 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944408    2527 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 00:02:05.948291 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944411    2527 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 00:02:05.948291 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944413    2527 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 00:02:05.948291 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944415    2527 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 00:02:05.948291 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944418    2527 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 00:02:05.948291 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944420    2527 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 00:02:05.948291 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944422    2527 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 00:02:05.948291 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944425    2527 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 00:02:05.948291 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944427    2527 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 00:02:05.948291 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944430    2527 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 00:02:05.948291 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944432    2527 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 00:02:05.948291 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944434    2527 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 00:02:05.948291 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944437    2527 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 00:02:05.948291 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944439    2527 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 00:02:05.948291 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944442    2527 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 00:02:05.948291 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944444    2527 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 00:02:05.948291 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944448    2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 00:02:05.948291 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944450    2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 00:02:05.948291 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944453    2527 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 00:02:05.948761 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944455    2527 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 00:02:05.948761 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944458    2527 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 00:02:05.948761 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944461    2527 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 00:02:05.948761 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944463    2527 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 00:02:05.948761 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944466    2527 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 00:02:05.948761 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944468    2527 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 00:02:05.948761 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944470    2527 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 00:02:05.948761 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944473    2527 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 00:02:05.948761 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944475    2527 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 00:02:05.948761 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944478    2527 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 00:02:05.948761 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944480    2527 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 00:02:05.948761 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944482    2527 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 00:02:05.948761 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944485    2527 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 00:02:05.948761 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944487    2527 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 00:02:05.948761 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944489    2527 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 00:02:05.948761 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944492    2527 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 00:02:05.948761 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944494    2527 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 00:02:05.948761 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944497    2527 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 00:02:05.948761 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944499    2527 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 00:02:05.948761 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944502    2527 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 00:02:05.949308 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944504    2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 00:02:05.949308 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944506    2527 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 00:02:05.949308 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944509    2527 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 00:02:05.949308 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944511    2527 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 00:02:05.949308 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944513    2527 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 00:02:05.949308 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944516    2527 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 00:02:05.949308 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944518    2527 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 00:02:05.949308 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944522    2527 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 00:02:05.949308 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944526    2527 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 00:02:05.949308 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944529    2527 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 00:02:05.949308 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944532    2527 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 00:02:05.949308 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944535    2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 00:02:05.949308 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944538    2527 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 00:02:05.949308 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944543    2527 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 00:02:05.949308 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944546    2527 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 00:02:05.949308 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944550    2527 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 00:02:05.949308 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944553    2527 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 00:02:05.949308 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944556    2527 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 00:02:05.949308 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944559    2527 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 00:02:05.949763 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944562    2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 00:02:05.949763 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944564    2527 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 00:02:05.949763 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944567    2527 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 00:02:05.949763 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944570    2527 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 00:02:05.949763 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944572    2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 00:02:05.949763 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944574    2527 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 00:02:05.949763 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944577    2527 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 00:02:05.949763 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944579    2527 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 00:02:05.949763 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944582    2527 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 00:02:05.949763 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944584    2527 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 00:02:05.949763 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944587    2527 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 00:02:05.949763 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944589    2527 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 00:02:05.949763 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944591    2527 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 00:02:05.949763 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944594    2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 00:02:05.949763 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944596    2527 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 00:02:05.949763 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944599    2527 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 00:02:05.949763 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944601    2527 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 00:02:05.949763 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944603    2527 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 00:02:05.949763 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944606    2527 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 00:02:05.949763 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944608    2527 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 00:02:05.950241 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944610    2527 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 00:02:05.950241 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944612    2527 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 00:02:05.950241 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944615    2527 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 00:02:05.950241 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944618    2527 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 00:02:05.950241 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944621    2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 00:02:05.950241 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944624    2527 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 00:02:05.950241 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944626    2527 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 00:02:05.950241 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944629    2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 00:02:05.950241 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944631    2527 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 00:02:05.950241 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944634    2527 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 00:02:05.950241 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944636    2527 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 00:02:05.950241 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944639    2527 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 00:02:05.950241 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944641    2527 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 00:02:05.950241 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.944646    2527 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 00:02:05.950241 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944761    2527 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 00:02:05.950599 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944766    2527 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 00:02:05.950599 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944768    2527 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 00:02:05.950599 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944772    2527 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 00:02:05.950599 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944774    2527 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 00:02:05.950599 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944777    2527 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 00:02:05.950599 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944779    2527 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 00:02:05.950599 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944781    2527 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 00:02:05.950599 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944784    2527 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 00:02:05.950599 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944786    2527 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 00:02:05.950599 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944789    2527 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 00:02:05.950599 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944791    2527 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 00:02:05.950599 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944793    2527 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 00:02:05.950599 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944796    2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 00:02:05.950599 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944798    2527 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 00:02:05.950599 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944800    2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 00:02:05.950599 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944803    2527 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 00:02:05.950599 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944805    2527 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 00:02:05.950599 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944807    2527 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 00:02:05.950599 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944810    2527 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 00:02:05.950599 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944812    2527 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 00:02:05.951094 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944815    2527 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 00:02:05.951094 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944817    2527 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 00:02:05.951094 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944821    2527 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 00:02:05.951094 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944824    2527 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 00:02:05.951094 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944828    2527 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 00:02:05.951094 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944831    2527 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 00:02:05.951094 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944834    2527 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 00:02:05.951094 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944836    2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 00:02:05.951094 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944839    2527 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 00:02:05.951094 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944841    2527 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 00:02:05.951094 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944844    2527 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 00:02:05.951094 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944846    2527 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 00:02:05.951094 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944848    2527 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 00:02:05.951094 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944850    2527 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 00:02:05.951094 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944853    2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 00:02:05.951094 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944855    2527 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 00:02:05.951094 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944858    2527 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 00:02:05.951094 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944860    2527 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 00:02:05.951094 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944862    2527 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 00:02:05.951094 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944865    2527 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 00:02:05.951589 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944867    2527 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 00:02:05.951589 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944870    2527 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 00:02:05.951589 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944872    2527 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 00:02:05.951589 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944874    2527 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 00:02:05.951589 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944877    2527 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 00:02:05.951589 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944879    2527 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 00:02:05.951589 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944882    2527 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 00:02:05.951589 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944884    2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 00:02:05.951589 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944886    2527 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 00:02:05.951589 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944888    2527 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 00:02:05.951589 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944891    2527 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 00:02:05.951589 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944893    2527 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 00:02:05.951589 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944895    2527 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 00:02:05.951589 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944898    2527 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 00:02:05.951589 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944900    2527 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 00:02:05.951589 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944903    2527 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 00:02:05.951589 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944905    2527 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 00:02:05.951589 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944908    2527 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 00:02:05.951589 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944910    2527 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 00:02:05.951589 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944912    2527 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 00:02:05.952048 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944914    2527 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 00:02:05.952048 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944917    2527 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 00:02:05.952048 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944919    2527 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 00:02:05.952048 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944922    2527 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 00:02:05.952048 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944924    2527 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 00:02:05.952048 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944926    2527 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 00:02:05.952048 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944928    2527 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 00:02:05.952048 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944931    2527 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 00:02:05.952048 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944933    2527 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 00:02:05.952048 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944935    2527 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 00:02:05.952048 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944938    2527 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 00:02:05.952048 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944940    2527 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 00:02:05.952048 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944942    2527 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 00:02:05.952048 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944945    2527 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 00:02:05.952048 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944947    2527 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 00:02:05.952048 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944950    2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 00:02:05.952048 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944952    2527 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 00:02:05.952048 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944954    2527 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 00:02:05.952048 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944956    2527 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 00:02:05.952048 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944959    2527 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 00:02:05.952512 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944961    2527 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 00:02:05.952512 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944963    2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 00:02:05.952512 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944966    2527 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 00:02:05.952512 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944968    2527 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 00:02:05.952512 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944971    2527 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 00:02:05.952512 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944973    2527 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 00:02:05.952512 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944975    2527 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 00:02:05.952512 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944978    2527 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 00:02:05.952512 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944980    2527 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 00:02:05.952512 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944983    2527 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 00:02:05.952512 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944986    2527 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 00:02:05.952512 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944989    2527 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 00:02:05.952512 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944992    2527 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 00:02:05.952512 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944995    2527 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 00:02:05.952512 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.944997    2527 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 00:02:05.952512 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.945001    2527 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 00:02:05.952512 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.945004    2527 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 00:02:05.952512 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:05.945007    2527 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 00:02:05.952921 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.945011    2527 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 00:02:05.952921 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.945094    2527 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 30 00:02:05.952921 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.947123    2527 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 30 00:02:05.952921 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.948536    2527 server.go:1019] "Starting client certificate rotation"
Jul 30 00:02:05.952921 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.948632    2527 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 00:02:05.952921 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.949302    2527 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 00:02:05.952921 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.950817    2527 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 00:02:05.952921 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.951974    2527 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 00:02:05.959514 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.959450    2527 log.go:25] "Validated CRI v1 runtime API"
Jul 30 00:02:05.962081 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.962066    2527 log.go:25] "Validated CRI v1 image API"
Jul 30 00:02:05.962829 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.962815    2527 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 30 00:02:05.965212 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.965195    2527 fs.go:135] Filesystem UUIDs: map[17c5d44f-27b8-446d-8917-c0992aac8035:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a92c2f34-134f-4963-a6bd-5b135ce1cdb1:/dev/nvme0n1p4]
Jul 30 00:02:05.965261 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.965212    2527 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 30 00:02:05.970968 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.970871    2527 manager.go:216] Machine: {Timestamp:2026-07-30 00:02:05.969645153 +0000 UTC m=+0.272093487 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3200096 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28ffe088ee3694ec5b24a028b9b906 SystemUUID:ec28ffe0-88ee-3694-ec5b-24a028b9b906 BootID:67359fcf-47b7-4481-ab9c-3c7f66fa53d6 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c3:75:80:73:c3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c3:75:80:73:c3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:b5:36:e4:e6:8d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 30 00:02:05.970968 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.970962    2527 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 30 00:02:05.971141 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.971027    2527 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 30 00:02:05.973818 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.973796    2527 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 30 00:02:05.973990 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.973821    2527 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-198.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 30 00:02:05.975136 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.975124    2527 topology_manager.go:138] "Creating topology manager with none policy"
Jul 30 00:02:05.975213 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.975142    2527 container_manager_linux.go:309] "Creating device plugin manager"
Jul 30 00:02:05.975213 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.975151    2527 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 00:02:05.975731 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.975718    2527 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 00:02:05.977301 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.977290    2527 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 30 00:02:05.979044 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.979029    2527 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 00:02:05.980262 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.980249    2527 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 00:02:05.980389 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.980378    2527 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 30 00:02:05.980452 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.980415    2527 kubelet.go:486] "Attempting to sync node with API server"
Jul 30 00:02:05.980452 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.980427    2527 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 30 00:02:05.980452 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.980441    2527 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 30 00:02:05.980562 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.980454    2527 kubelet.go:398] "Adding apiserver pod source"
Jul 30 00:02:05.980562 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.980465    2527 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 30 00:02:05.980797 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.980784    2527 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 00:02:05.980852 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.980807    2527 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 00:02:05.982639 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.982625    2527 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 30 00:02:05.984156 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.984144    2527 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 30 00:02:05.984214 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.984191    2527 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 30 00:02:05.984909 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.984888    2527 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 30 00:02:05.984961 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.984920    2527 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 30 00:02:05.984961 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.984929    2527 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 30 00:02:05.984961 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.984939    2527 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 30 00:02:05.984961 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.984955    2527 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 30 00:02:05.985070 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.984964    2527 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 30 00:02:05.985070 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.984975    2527 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 30 00:02:05.985070 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.984991    2527 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 30 00:02:05.985070 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.985000    2527 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 30 00:02:05.985070 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.985018    2527 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 30 00:02:05.985070 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.985034    2527 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 30 00:02:05.985070 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.985040    2527 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 30 00:02:05.986455 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.986445    2527 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 30 00:02:05.986455 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.986455    2527 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 30 00:02:05.989608 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.989594    2527 server.go:1268] "Started kubelet"
Jul 30 00:02:05.989709 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.989659    2527 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 30 00:02:05.989762 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.989668    2527 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 30 00:02:05.989808 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.989752    2527 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 30 00:02:05.990302 ip-10-0-137-198 systemd[1]: Started Kubernetes Kubelet.
Jul 30 00:02:05.990999 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.990971    2527 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-198.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 30 00:02:05.991071 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:05.990991    2527 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 30 00:02:05.991226 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:05.991077    2527 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-198.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 30 00:02:05.991346 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.991318    2527 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 30 00:02:05.995821 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:05.995620    2527 server.go:310] "Adding debug handlers to kubelet server"
Jul 30 00:02:05.997047 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:05.997028    2527 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 30 00:02:05.997194 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:05.996395    2527 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-198.ec2.internal.18c6e84e76582ab9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-198.ec2.internal,UID:ip-10-0-137-198.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-198.ec2.internal,},FirstTimestamp:2026-07-30 00:02:05.989563065 +0000 UTC m=+0.292011400,LastTimestamp:2026-07-30 00:02:05.989563065 +0000 UTC m=+0.292011400,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-198.ec2.internal,}"
Jul 30 00:02:06.001289 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.001273    2527 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 30 00:02:06.001368 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.001273    2527 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 30 00:02:06.001430 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:06.001367    2527 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-198.ec2.internal\" not found"
Jul 30 00:02:06.001925 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.001847    2527 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 30 00:02:06.001925 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.001848    2527 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 30 00:02:06.001925 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.001873    2527 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 30 00:02:06.002077 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.001944    2527 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nqq2t"
Jul 30 00:02:06.002077 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.001964    2527 reconstruct.go:97] "Volume reconstruction finished"
Jul 30 00:02:06.002077 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.001971    2527 reconciler.go:29] "Reconciler: start to sync state"
Jul 30 00:02:06.002390 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.002294    2527 factory.go:153] Registering CRI-O factory
Jul 30 00:02:06.002390 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.002309    2527 factory.go:223] Registration of the crio container factory successfully
Jul 30 00:02:06.002390 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.002359    2527 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 30 00:02:06.002390 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.002369    2527 factory.go:55] Registering systemd factory
Jul 30 00:02:06.002390 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.002376    2527 factory.go:223] Registration of the systemd container factory successfully
Jul 30 00:02:06.002629 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.002399    2527 factory.go:103] Registering Raw factory
Jul 30 00:02:06.002629 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.002412    2527 manager.go:1196] Started watching for new ooms in manager
Jul 30 00:02:06.002754 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.002740    2527 manager.go:349] Starting recovery of all containers
Jul 30 00:02:06.007179 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.007139    2527 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nqq2t"
Jul 30 00:02:06.012679 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:06.012522    2527 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-198.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 30 00:02:06.012774 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:06.012724    2527 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 30 00:02:06.012870 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.012851    2527 manager.go:354] Recovery completed
Jul 30 00:02:06.016899 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.016882    2527 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 00:02:06.018532 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.018518    2527 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 00:02:06.018590 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.018544    2527 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 00:02:06.018590 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.018554    2527 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasSufficientPID"
Jul 30 00:02:06.019042 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.019031    2527 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 30 00:02:06.019042 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.019038    2527 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 00:02:06.019140 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.019041    2527 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 30 00:02:06.019140 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.019076    2527 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 00:02:06.019741 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.019729    2527 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 00:02:06.019793 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.019778    2527 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 00:02:06.019825 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.019799    2527 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasSufficientPID"
Jul 30 00:02:06.020264 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.020252    2527 policy_none.go:49] "None policy: Start"
Jul 30 00:02:06.020299 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.020267    2527 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 30 00:02:06.020299 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.020277    2527 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 30 00:02:06.022337 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.022322    2527 policy_none.go:47] "Start"
Jul 30 00:02:06.066276 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.066264    2527 manager.go:337] "Starting Device Plugin manager"
Jul 30 00:02:06.066327 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:06.066290    2527 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 30 00:02:06.066327 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.066301    2527 server.go:87] "Starting device plugin registration server"
Jul 30 00:02:06.066508 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.066496    2527 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 30 00:02:06.066553 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.066510    2527 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 30 00:02:06.066625 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.066602    2527 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 30 00:02:06.066687 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.066678    2527 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 30 00:02:06.066687 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.066687    2527 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 30 00:02:06.067533 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:06.067513    2527 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 30 00:02:06.067631 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:06.067567    2527 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-198.ec2.internal\" not found"
Jul 30 00:02:06.167347 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.167331    2527 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 00:02:06.168296 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.168048    2527 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 00:02:06.168296 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.168076    2527 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 00:02:06.168296 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.168091    2527 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasSufficientPID"
Jul 30 00:02:06.168296 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.168121    2527 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-198.ec2.internal"
Jul 30 00:02:06.176665 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.176631    2527 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-198.ec2.internal"
Jul 30 00:02:06.176665 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:06.176649    2527 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-198.ec2.internal\": node \"ip-10-0-137-198.ec2.internal\" not found"
Jul 30 00:02:06.190248 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:06.190232    2527 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-198.ec2.internal\" not found"
Jul 30 00:02:06.208020 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.208002    2527 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 30 00:02:06.209283 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.209269    2527 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 30 00:02:06.209351 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.209298    2527 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 30 00:02:06.209351 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.209314    2527 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 30 00:02:06.209351 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:06.209348    2527 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 30 00:02:06.211573 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.211554    2527 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 00:02:06.290728 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:06.290710    2527 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-198.ec2.internal\" not found"
Jul 30 00:02:06.310208 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.310186    2527 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-198.ec2.internal"]
Jul 30 00:02:06.310279 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.310243    2527 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 00:02:06.311521 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.311509    2527 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 00:02:06.311590 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.311534    2527 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 00:02:06.311590 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.311546    2527 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasSufficientPID"
Jul 30 00:02:06.312675 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.312663    2527 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 00:02:06.312800 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.312787    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal"
Jul 30 00:02:06.312854 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.312814    2527 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 00:02:06.313290 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.313273    2527 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 00:02:06.313368 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.313298    2527 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 00:02:06.313368 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.313311    2527 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasSufficientPID"
Jul 30 00:02:06.313368 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.313343    2527 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 00:02:06.313458 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.313369    2527 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 00:02:06.313458 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.313381    2527 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasSufficientPID"
Jul 30 00:02:06.314400 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.314385    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-198.ec2.internal"
Jul 30 00:02:06.314480 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.314412    2527 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 00:02:06.315005 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.314991    2527 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 00:02:06.315068 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.315017    2527 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 00:02:06.315068 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.315029    2527 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasSufficientPID"
Jul 30 00:02:06.342555 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:06.342534    2527 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-198.ec2.internal\" not found" node="ip-10-0-137-198.ec2.internal"
Jul 30 00:02:06.346531 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:06.346516    2527 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-198.ec2.internal\" not found" node="ip-10-0-137-198.ec2.internal"
Jul 30 00:02:06.391382 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:06.391366    2527 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-198.ec2.internal\" not found"
Jul 30 00:02:06.404919 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.404901    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/67d41482f2fb87a5260d58a8ce3d03fa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal\" (UID: \"67d41482f2fb87a5260d58a8ce3d03fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal"
Jul 30 00:02:06.404971 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.404928    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67d41482f2fb87a5260d58a8ce3d03fa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal\" (UID: \"67d41482f2fb87a5260d58a8ce3d03fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal"
Jul 30 00:02:06.405007 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.404970    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/07e6b3dc508eb1747236dbb1b614bc57-config\") pod \"kube-apiserver-proxy-ip-10-0-137-198.ec2.internal\" (UID: \"07e6b3dc508eb1747236dbb1b614bc57\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-198.ec2.internal"
Jul 30 00:02:06.491733 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:06.491693    2527 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-198.ec2.internal\" not found"
Jul 30 00:02:06.505045 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.505026    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67d41482f2fb87a5260d58a8ce3d03fa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal\" (UID: \"67d41482f2fb87a5260d58a8ce3d03fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal"
Jul 30 00:02:06.505094 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.505052    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/07e6b3dc508eb1747236dbb1b614bc57-config\") pod \"kube-apiserver-proxy-ip-10-0-137-198.ec2.internal\" (UID: \"07e6b3dc508eb1747236dbb1b614bc57\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-198.ec2.internal"
Jul 30 00:02:06.505094 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.505067    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/67d41482f2fb87a5260d58a8ce3d03fa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal\" (UID: \"67d41482f2fb87a5260d58a8ce3d03fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal"
Jul 30 00:02:06.505155 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.505099    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/67d41482f2fb87a5260d58a8ce3d03fa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal\" (UID: \"67d41482f2fb87a5260d58a8ce3d03fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal"
Jul 30 00:02:06.505155 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.505127    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67d41482f2fb87a5260d58a8ce3d03fa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal\" (UID: \"67d41482f2fb87a5260d58a8ce3d03fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal"
Jul 30 00:02:06.505155 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.505137    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/07e6b3dc508eb1747236dbb1b614bc57-config\") pod \"kube-apiserver-proxy-ip-10-0-137-198.ec2.internal\" (UID: \"07e6b3dc508eb1747236dbb1b614bc57\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-198.ec2.internal"
Jul 30 00:02:06.592210 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:06.592188    2527 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-198.ec2.internal\" not found"
Jul 30 00:02:06.644664 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.644650    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal"
Jul 30 00:02:06.651322 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.651305    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-198.ec2.internal"
Jul 30 00:02:06.692735 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:06.692714    2527 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-198.ec2.internal\" not found"
Jul 30 00:02:06.793228 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:06.793188    2527 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-198.ec2.internal\" not found"
Jul 30 00:02:06.842218 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.842200    2527 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 00:02:06.902022 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.901994    2527 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-198.ec2.internal"
Jul 30 00:02:06.912274 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.912252    2527 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 00:02:06.913653 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.913639    2527 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal"
Jul 30 00:02:06.922942 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.922924    2527 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 00:02:06.948068 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.948051    2527 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 30 00:02:06.948495 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.948138    2527 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 30 00:02:06.948495 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.948193    2527 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 30 00:02:06.981359 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.981340    2527 apiserver.go:52] "Watching apiserver"
Jul 30 00:02:06.995609 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.995583    2527 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 30 00:02:06.998264 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.997275    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-tq4hc","openshift-image-registry/node-ca-2g9tl","openshift-network-diagnostics/network-check-target-h42d5","openshift-ovn-kubernetes/ovnkube-node-9cggv","kube-system/konnectivity-agent-pnbrq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99qf7","openshift-cluster-node-tuning-operator/tuned-hrw82","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal","openshift-multus/multus-additional-cni-plugins-kzqq8","openshift-multus/multus-rwkfx","openshift-multus/network-metrics-daemon-lj2rz","openshift-network-operator/iptables-alerter-lw6v5","kube-system/global-pull-secret-syncer-tmsc5","kube-system/kube-apiserver-proxy-ip-10-0-137-198.ec2.internal"]
Jul 30 00:02:06.999026 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.999010    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.000005 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:06.999990    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:07.000104 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:07.000088    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmsc5" podUID="fefc207e-2848-4204-b460-39c933e7b127"
Jul 30 00:02:07.000935 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.000921    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hmr2v\""
Jul 30 00:02:07.001222 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.001206    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 30 00:02:07.001306 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.001220    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:02:07.001306 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.001258    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 30 00:02:07.001306 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:07.001283    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42d5" podUID="a702b669-744a-4c89-bf15-164d52f5f1d5"
Jul 30 00:02:07.001431 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.001346    2527 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 30 00:02:07.002262 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.002244    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.003417 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.003402    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pnbrq"
Jul 30 00:02:07.004570 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.004418    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 30 00:02:07.004570 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.004424    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 30 00:02:07.004570 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.004444    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 30 00:02:07.004570 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.004468    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 30 00:02:07.004570 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.004508    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 30 00:02:07.004570 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.004517    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xmr29\""
Jul 30 00:02:07.004879 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.004642    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 30 00:02:07.004879 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.004708    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99qf7"
Jul 30 00:02:07.005272 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.005256    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 30 00:02:07.005325 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.005258    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fs72l\""
Jul 30 00:02:07.005357 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.005319    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 30 00:02:07.005769 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.005754    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kzqq8"
Jul 30 00:02:07.006726 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.006711    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 30 00:02:07.006843 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.006828    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 30 00:02:07.006913 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.006901    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 30 00:02:07.007148 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007133    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tq4hc"
Jul 30 00:02:07.007247 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007229    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9xd28\""
Jul 30 00:02:07.007305 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007255    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-var-lib-kubelet\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.007305 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007280    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1e354369-ec72-41b7-ac1d-679685596d1a-etc-tuned\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.007395 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007303    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-host-cni-netd\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.007395 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007326    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-ovnkube-script-lib\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.007395 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007361    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrw92\" (UniqueName: \"kubernetes.io/projected/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-kube-api-access-nrw92\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.007496 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007398    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-etc-sysctl-d\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.007496 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007423    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-etc-sysctl-conf\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.007496 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007442    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-etc-systemd\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.007496 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007457    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-host\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.007496 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007476    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fefc207e-2848-4204-b460-39c933e7b127-kubelet-config\") pod \"global-pull-secret-syncer-tmsc5\" (UID: \"fefc207e-2848-4204-b460-39c933e7b127\") " pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:07.007688 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007540    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fefc207e-2848-4204-b460-39c933e7b127-dbus\") pod \"global-pull-secret-syncer-tmsc5\" (UID: \"fefc207e-2848-4204-b460-39c933e7b127\") " pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:07.007688 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007607    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 30 00:02:07.007688 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007610    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb5rx\" (UniqueName: \"kubernetes.io/projected/a702b669-744a-4c89-bf15-164d52f5f1d5-kube-api-access-bb5rx\") pod \"network-check-target-h42d5\" (UID: \"a702b669-744a-4c89-bf15-164d52f5f1d5\") " pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:02:07.007688 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007649    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-etc-sysconfig\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.007688 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007675    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-etc-kubernetes\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.007904 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007698    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-systemd-units\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.007904 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007713    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-run-systemd\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.007904 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007725    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 30 00:02:07.007904 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007736    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-run-ovn\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.007904 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007750    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-host-cni-bin\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.007904 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007775    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-sys\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.007904 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007816    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fefc207e-2848-4204-b460-39c933e7b127-original-pull-secret\") pod \"global-pull-secret-syncer-tmsc5\" (UID: \"fefc207e-2848-4204-b460-39c933e7b127\") " pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:07.007904 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007860    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-etc-openvswitch\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.007904 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007874    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 30 00:02:07.007904 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007881    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 30 00:02:07.007904 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007899    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-ovn-node-metrics-cert\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.008320 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007922    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-log-socket\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.008320 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007936    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 30 00:02:07.008320 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007947    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-host-kubelet\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.008320 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.007986    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-host-slash\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.008320 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.008011    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-var-lib-openvswitch\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.008320 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.008047    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.008320 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.008061    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-ovnkube-config\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.008320 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.008106    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-etc-modprobe-d\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.008320 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.008123    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e354369-ec72-41b7-ac1d-679685596d1a-tmp\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.008320 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.008152    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-host-run-netns\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.008320 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.008208    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-host-run-ovn-kubernetes\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.008320 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.008225    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-run\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.008320 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.008237    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l9gm\" (UniqueName: \"kubernetes.io/projected/1e354369-ec72-41b7-ac1d-679685596d1a-kube-api-access-5l9gm\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.008320 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.008263    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-run-openvswitch\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.008320 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.008277    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-node-log\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.008320 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.008301    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-env-overrides\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.008320 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.008315    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-lib-modules\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.008906 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.008368    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7mmvs\""
Jul 30 00:02:07.008906 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.008647    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2g9tl"
Jul 30 00:02:07.009251 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.009232    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4hr66\""
Jul 30 00:02:07.009329 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.009298    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 30 00:02:07.009440 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.009425    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 30 00:02:07.010290 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.010273    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.010607 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.010593    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 30 00:02:07.011036 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.010977    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 30 00:02:07.011036 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.011028    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 30 00:02:07.011187 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.011079    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lhc52\""
Jul 30 00:02:07.011409 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.011374    2527 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 23:57:06 +0000 UTC" deadline="2028-02-09 05:09:43.137467169 +0000 UTC"
Jul 30 00:02:07.011409 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.011406    2527 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13421h7m36.126063524s"
Jul 30 00:02:07.011846 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.011828    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:02:07.011900 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:07.011878    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lj2rz" podUID="47b042b2-e9c2-45fd-ae41-9608eaf6aa4d"
Jul 30 00:02:07.012263 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.012245    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 30 00:02:07.012351 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.012334    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8s4xs\""
Jul 30 00:02:07.012838 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.012819    2527 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 00:02:07.013215 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.013197    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lw6v5"
Jul 30 00:02:07.015281 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.015261    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 30 00:02:07.015439 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.015425    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 30 00:02:07.015638 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.015619    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vglbv\""
Jul 30 00:02:07.015638 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.015632    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 30 00:02:07.033807 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.033793    2527 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gfsgk"
Jul 30 00:02:07.040777 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.040761    2527 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gfsgk"
Jul 30 00:02:07.103363 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.103345    2527 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 30 00:02:07.108575 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.108557    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-etc-openvswitch\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.108671 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.108585    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-log-socket\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.108671 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.108608    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b0821896-954e-4d42-a259-11685665d109-serviceca\") pod \"node-ca-2g9tl\" (UID: \"b0821896-954e-4d42-a259-11685665d109\") " pod="openshift-image-registry/node-ca-2g9tl"
Jul 30 00:02:07.108671 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.108634    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vmfp\" (UniqueName: \"kubernetes.io/projected/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-kube-api-access-8vmfp\") pod \"network-metrics-daemon-lj2rz\" (UID: \"47b042b2-e9c2-45fd-ae41-9608eaf6aa4d\") " pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:02:07.108671 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.108652    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-etc-openvswitch\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.108671 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.108667    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-log-socket\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.108907 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.108667    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee4035d2-1fba-4a57-ae6f-39b1010f098b-cni-binary-copy\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.108907 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.108701    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-multus-conf-dir\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.108907 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.108726    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-host-run-multus-certs\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.108907 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.108775    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f0e8d05-2ec5-4cb3-b404-932d0fb6874c-host-slash\") pod \"iptables-alerter-lw6v5\" (UID: \"3f0e8d05-2ec5-4cb3-b404-932d0fb6874c\") " pod="openshift-network-operator/iptables-alerter-lw6v5"
Jul 30 00:02:07.108907 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.108803    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-host-kubelet\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.108907 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.108827    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-host-slash\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.108907 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.108834    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-host-kubelet\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.108907 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.108866    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.108907 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.108893    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-host-slash\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.108907 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.108896    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-ovnkube-config\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.109260 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.108915    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.109260 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.108945    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9e32819a-ea15-489b-b449-2a90e82f4516-kubelet-dir\") pod \"aws-ebs-csi-driver-node-99qf7\" (UID: \"9e32819a-ea15-489b-b449-2a90e82f4516\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99qf7"
Jul 30 00:02:07.109260 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.108959    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9e32819a-ea15-489b-b449-2a90e82f4516-socket-dir\") pod \"aws-ebs-csi-driver-node-99qf7\" (UID: \"9e32819a-ea15-489b-b449-2a90e82f4516\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99qf7"
Jul 30 00:02:07.109260 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.108988    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-host-var-lib-cni-multus\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.109260 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109014    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c69fc\" (UniqueName: \"kubernetes.io/projected/6e3c15d8-57fd-413b-bc96-74ee9feb2f8b-kube-api-access-c69fc\") pod \"multus-additional-cni-plugins-kzqq8\" (UID: \"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b\") " pod="openshift-multus/multus-additional-cni-plugins-kzqq8"
Jul 30 00:02:07.109260 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109038    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-system-cni-dir\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.109260 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109104    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-os-release\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.109260 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109118    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq78f\" (UniqueName: \"kubernetes.io/projected/abd0f838-14de-4c5c-899a-8364a6084905-kube-api-access-fq78f\") pod \"node-resolver-tq4hc\" (UID: \"abd0f838-14de-4c5c-899a-8364a6084905\") " pod="openshift-dns/node-resolver-tq4hc"
Jul 30 00:02:07.109260 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109152    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-run\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.109260 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109184    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l9gm\" (UniqueName: \"kubernetes.io/projected/1e354369-ec72-41b7-ac1d-679685596d1a-kube-api-access-5l9gm\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.109260 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109197    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-env-overrides\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.109260 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109206    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-run\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.109260 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109218    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-host-var-lib-cni-bin\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.109260 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109242    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e3c15d8-57fd-413b-bc96-74ee9feb2f8b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kzqq8\" (UID: \"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b\") " pod="openshift-multus/multus-additional-cni-plugins-kzqq8"
Jul 30 00:02:07.109757 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109267    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-lib-modules\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.109757 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109296    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-var-lib-kubelet\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.109757 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109345    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-host-cni-netd\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.109757 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109378    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbxlk\" (UniqueName: \"kubernetes.io/projected/9e32819a-ea15-489b-b449-2a90e82f4516-kube-api-access-rbxlk\") pod \"aws-ebs-csi-driver-node-99qf7\" (UID: \"9e32819a-ea15-489b-b449-2a90e82f4516\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99qf7"
Jul 30 00:02:07.109757 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109408    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-multus-socket-dir-parent\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.109757 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109351    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-var-lib-kubelet\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.109757 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109432    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-host-cni-netd\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.109757 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109438    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e3c15d8-57fd-413b-bc96-74ee9feb2f8b-cni-binary-copy\") pod \"multus-additional-cni-plugins-kzqq8\" (UID: \"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b\") " pod="openshift-multus/multus-additional-cni-plugins-kzqq8"
Jul 30 00:02:07.109757 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109434    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-lib-modules\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.109757 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109456    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-ovnkube-config\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.109757 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109490    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-etc-systemd\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.109757 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109507    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-host\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.109757 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109554    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-env-overrides\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.109757 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109557    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fefc207e-2848-4204-b460-39c933e7b127-dbus\") pod \"global-pull-secret-syncer-tmsc5\" (UID: \"fefc207e-2848-4204-b460-39c933e7b127\") " pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:07.109757 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109555    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-etc-systemd\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.109757 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109570    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-host\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.109757 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109598    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb5rx\" (UniqueName: \"kubernetes.io/projected/a702b669-744a-4c89-bf15-164d52f5f1d5-kube-api-access-bb5rx\") pod \"network-check-target-h42d5\" (UID: \"a702b669-744a-4c89-bf15-164d52f5f1d5\") " pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:02:07.110472 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109614    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-run-systemd\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.110472 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109649    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-run-ovn\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.110472 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109651    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-run-systemd\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.110472 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109659    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fefc207e-2848-4204-b460-39c933e7b127-dbus\") pod \"global-pull-secret-syncer-tmsc5\" (UID: \"fefc207e-2848-4204-b460-39c933e7b127\") " pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:07.110472 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109704    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-cnibin\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.110472 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109756    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwlw8\" (UniqueName: \"kubernetes.io/projected/3f0e8d05-2ec5-4cb3-b404-932d0fb6874c-kube-api-access-nwlw8\") pod \"iptables-alerter-lw6v5\" (UID: \"3f0e8d05-2ec5-4cb3-b404-932d0fb6874c\") " pod="openshift-network-operator/iptables-alerter-lw6v5"
Jul 30 00:02:07.110472 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109773    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-run-ovn\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.110472 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109801    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-etc-sysconfig\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.110472 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109832    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-etc-kubernetes\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.110472 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109837    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-etc-sysconfig\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.110472 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109859    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-etc-kubernetes\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.110472 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109892    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-systemd-units\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.110472 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109916    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-host-cni-bin\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.110472 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109943    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-systemd-units\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.110472 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109946    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-host-cni-bin\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.110472 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109967    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs\") pod \"network-metrics-daemon-lj2rz\" (UID: \"47b042b2-e9c2-45fd-ae41-9608eaf6aa4d\") " pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:02:07.110472 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.109988    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e3c15d8-57fd-413b-bc96-74ee9feb2f8b-os-release\") pod \"multus-additional-cni-plugins-kzqq8\" (UID: \"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b\") " pod="openshift-multus/multus-additional-cni-plugins-kzqq8"
Jul 30 00:02:07.111149 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110004    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-sys\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.111149 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110018    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fefc207e-2848-4204-b460-39c933e7b127-original-pull-secret\") pod \"global-pull-secret-syncer-tmsc5\" (UID: \"fefc207e-2848-4204-b460-39c933e7b127\") " pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:07.111149 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110041    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-ovn-node-metrics-cert\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.111149 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110050    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-sys\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.111149 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110056    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q642l\" (UniqueName: \"kubernetes.io/projected/b0821896-954e-4d42-a259-11685665d109-kube-api-access-q642l\") pod \"node-ca-2g9tl\" (UID: \"b0821896-954e-4d42-a259-11685665d109\") " pod="openshift-image-registry/node-ca-2g9tl"
Jul 30 00:02:07.111149 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110071    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/877bba44-0778-4142-b6f7-aa03eb30a724-konnectivity-ca\") pod \"konnectivity-agent-pnbrq\" (UID: \"877bba44-0778-4142-b6f7-aa03eb30a724\") " pod="kube-system/konnectivity-agent-pnbrq"
Jul 30 00:02:07.111149 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110086    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e3c15d8-57fd-413b-bc96-74ee9feb2f8b-cnibin\") pod \"multus-additional-cni-plugins-kzqq8\" (UID: \"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b\") " pod="openshift-multus/multus-additional-cni-plugins-kzqq8"
Jul 30 00:02:07.111149 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110102    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-var-lib-openvswitch\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.111149 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110136    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-var-lib-openvswitch\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.111149 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110136    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0821896-954e-4d42-a259-11685665d109-host\") pod \"node-ca-2g9tl\" (UID: \"b0821896-954e-4d42-a259-11685665d109\") " pod="openshift-image-registry/node-ca-2g9tl"
Jul 30 00:02:07.111149 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:07.110143    2527 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 00:02:07.111149 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110189    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/877bba44-0778-4142-b6f7-aa03eb30a724-agent-certs\") pod \"konnectivity-agent-pnbrq\" (UID: \"877bba44-0778-4142-b6f7-aa03eb30a724\") " pod="kube-system/konnectivity-agent-pnbrq"
Jul 30 00:02:07.111149 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110214    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9e32819a-ea15-489b-b449-2a90e82f4516-sys-fs\") pod \"aws-ebs-csi-driver-node-99qf7\" (UID: \"9e32819a-ea15-489b-b449-2a90e82f4516\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99qf7"
Jul 30 00:02:07.111149 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:07.110246    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fefc207e-2848-4204-b460-39c933e7b127-original-pull-secret podName:fefc207e-2848-4204-b460-39c933e7b127 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:07.610214434 +0000 UTC m=+1.912662774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fefc207e-2848-4204-b460-39c933e7b127-original-pull-secret") pod "global-pull-secret-syncer-tmsc5" (UID: "fefc207e-2848-4204-b460-39c933e7b127") : object "kube-system"/"original-pull-secret" not registered
Jul 30 00:02:07.111149 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110279    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-host-run-netns\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.111149 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110303    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-host-var-lib-kubelet\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.111149 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110325    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-hostroot\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.111722 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110387    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-etc-modprobe-d\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.111722 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110393    2527 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 30 00:02:07.111722 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110413    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e354369-ec72-41b7-ac1d-679685596d1a-tmp\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.111722 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110455    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-host-run-netns\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.111722 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110480    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-host-run-ovn-kubernetes\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.111722 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110496    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9e32819a-ea15-489b-b449-2a90e82f4516-registration-dir\") pod \"aws-ebs-csi-driver-node-99qf7\" (UID: \"9e32819a-ea15-489b-b449-2a90e82f4516\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99qf7"
Jul 30 00:02:07.111722 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110501    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-etc-modprobe-d\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.111722 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110514    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9e32819a-ea15-489b-b449-2a90e82f4516-device-dir\") pod \"aws-ebs-csi-driver-node-99qf7\" (UID: \"9e32819a-ea15-489b-b449-2a90e82f4516\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99qf7"
Jul 30 00:02:07.111722 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110524    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-host-run-netns\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.111722 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110542    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ee4035d2-1fba-4a57-ae6f-39b1010f098b-multus-daemon-config\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.111722 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110560    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-host-run-ovn-kubernetes\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.111722 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110568    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsmf7\" (UniqueName: \"kubernetes.io/projected/ee4035d2-1fba-4a57-ae6f-39b1010f098b-kube-api-access-hsmf7\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.111722 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110614    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-run-openvswitch\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.111722 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110627    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-node-log\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.111722 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110644    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-host-run-k8s-cni-cncf-io\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.111722 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110670    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-run-openvswitch\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.111722 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110690    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e3c15d8-57fd-413b-bc96-74ee9feb2f8b-system-cni-dir\") pod \"multus-additional-cni-plugins-kzqq8\" (UID: \"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b\") " pod="openshift-multus/multus-additional-cni-plugins-kzqq8"
Jul 30 00:02:07.112186 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110710    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-node-log\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.112186 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110720    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1e354369-ec72-41b7-ac1d-679685596d1a-etc-tuned\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.112186 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110751    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-ovnkube-script-lib\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.112186 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110774    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrw92\" (UniqueName: \"kubernetes.io/projected/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-kube-api-access-nrw92\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.112186 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110821    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9e32819a-ea15-489b-b449-2a90e82f4516-etc-selinux\") pod \"aws-ebs-csi-driver-node-99qf7\" (UID: \"9e32819a-ea15-489b-b449-2a90e82f4516\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99qf7"
Jul 30 00:02:07.112186 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110835    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6e3c15d8-57fd-413b-bc96-74ee9feb2f8b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kzqq8\" (UID: \"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b\") " pod="openshift-multus/multus-additional-cni-plugins-kzqq8"
Jul 30 00:02:07.112186 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110872    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abd0f838-14de-4c5c-899a-8364a6084905-tmp-dir\") pod \"node-resolver-tq4hc\" (UID: \"abd0f838-14de-4c5c-899a-8364a6084905\") " pod="openshift-dns/node-resolver-tq4hc"
Jul 30 00:02:07.112186 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110938    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-etc-sysctl-d\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.112186 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.110967    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-etc-sysctl-conf\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.112186 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.111003    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fefc207e-2848-4204-b460-39c933e7b127-kubelet-config\") pod \"global-pull-secret-syncer-tmsc5\" (UID: \"fefc207e-2848-4204-b460-39c933e7b127\") " pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:07.112186 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.111038    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-multus-cni-dir\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.112186 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.111062    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-etc-kubernetes\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.112186 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.111102    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3f0e8d05-2ec5-4cb3-b404-932d0fb6874c-iptables-alerter-script\") pod \"iptables-alerter-lw6v5\" (UID: \"3f0e8d05-2ec5-4cb3-b404-932d0fb6874c\") " pod="openshift-network-operator/iptables-alerter-lw6v5"
Jul 30 00:02:07.112186 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.111126    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6e3c15d8-57fd-413b-bc96-74ee9feb2f8b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kzqq8\" (UID: \"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b\") " pod="openshift-multus/multus-additional-cni-plugins-kzqq8"
Jul 30 00:02:07.112186 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.111148    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/abd0f838-14de-4c5c-899a-8364a6084905-hosts-file\") pod \"node-resolver-tq4hc\" (UID: \"abd0f838-14de-4c5c-899a-8364a6084905\") " pod="openshift-dns/node-resolver-tq4hc"
Jul 30 00:02:07.112186 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.111226    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-etc-sysctl-conf\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.112186 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.111265    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fefc207e-2848-4204-b460-39c933e7b127-kubelet-config\") pod \"global-pull-secret-syncer-tmsc5\" (UID: \"fefc207e-2848-4204-b460-39c933e7b127\") " pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:07.112637 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.111335    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1e354369-ec72-41b7-ac1d-679685596d1a-etc-sysctl-d\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.112637 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.111459    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-ovnkube-script-lib\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.113342 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.113321    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-ovn-node-metrics-cert\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.113342 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.113332    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e354369-ec72-41b7-ac1d-679685596d1a-tmp\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.113449 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.113372    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1e354369-ec72-41b7-ac1d-679685596d1a-etc-tuned\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.115602 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:07.115586    2527 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 00:02:07.115687 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:07.115607    2527 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 00:02:07.115687 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:07.115619    2527 projected.go:196] Error preparing data for projected volume kube-api-access-bb5rx for pod openshift-network-diagnostics/network-check-target-h42d5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 00:02:07.115687 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:07.115671    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a702b669-744a-4c89-bf15-164d52f5f1d5-kube-api-access-bb5rx podName:a702b669-744a-4c89-bf15-164d52f5f1d5 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:07.615657267 +0000 UTC m=+1.918105601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bb5rx" (UniqueName: "kubernetes.io/projected/a702b669-744a-4c89-bf15-164d52f5f1d5-kube-api-access-bb5rx") pod "network-check-target-h42d5" (UID: "a702b669-744a-4c89-bf15-164d52f5f1d5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 00:02:07.116287 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.116270    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l9gm\" (UniqueName: \"kubernetes.io/projected/1e354369-ec72-41b7-ac1d-679685596d1a-kube-api-access-5l9gm\") pod \"tuned-hrw82\" (UID: \"1e354369-ec72-41b7-ac1d-679685596d1a\") " pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.118092 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.118070    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrw92\" (UniqueName: \"kubernetes.io/projected/c6b01a1f-c41e-4781-8c25-66b152e0d0e8-kube-api-access-nrw92\") pod \"ovnkube-node-9cggv\" (UID: \"c6b01a1f-c41e-4781-8c25-66b152e0d0e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.212047 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212016    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs\") pod \"network-metrics-daemon-lj2rz\" (UID: \"47b042b2-e9c2-45fd-ae41-9608eaf6aa4d\") " pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:02:07.212047 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212044    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e3c15d8-57fd-413b-bc96-74ee9feb2f8b-os-release\") pod \"multus-additional-cni-plugins-kzqq8\" (UID: \"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b\") " pod="openshift-multus/multus-additional-cni-plugins-kzqq8"
Jul 30 00:02:07.212340 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212068    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q642l\" (UniqueName: \"kubernetes.io/projected/b0821896-954e-4d42-a259-11685665d109-kube-api-access-q642l\") pod \"node-ca-2g9tl\" (UID: \"b0821896-954e-4d42-a259-11685665d109\") " pod="openshift-image-registry/node-ca-2g9tl"
Jul 30 00:02:07.212340 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212084    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/877bba44-0778-4142-b6f7-aa03eb30a724-konnectivity-ca\") pod \"konnectivity-agent-pnbrq\" (UID: \"877bba44-0778-4142-b6f7-aa03eb30a724\") " pod="kube-system/konnectivity-agent-pnbrq"
Jul 30 00:02:07.212340 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212107    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e3c15d8-57fd-413b-bc96-74ee9feb2f8b-cnibin\") pod \"multus-additional-cni-plugins-kzqq8\" (UID: \"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b\") " pod="openshift-multus/multus-additional-cni-plugins-kzqq8"
Jul 30 00:02:07.212340 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212156    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e3c15d8-57fd-413b-bc96-74ee9feb2f8b-cnibin\") pod \"multus-additional-cni-plugins-kzqq8\" (UID: \"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b\") " pod="openshift-multus/multus-additional-cni-plugins-kzqq8"
Jul 30 00:02:07.212340 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212156    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e3c15d8-57fd-413b-bc96-74ee9feb2f8b-os-release\") pod \"multus-additional-cni-plugins-kzqq8\" (UID: \"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b\") " pod="openshift-multus/multus-additional-cni-plugins-kzqq8"
Jul 30 00:02:07.212340 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:07.212189    2527 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 00:02:07.212340 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212229    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0821896-954e-4d42-a259-11685665d109-host\") pod \"node-ca-2g9tl\" (UID: \"b0821896-954e-4d42-a259-11685665d109\") " pod="openshift-image-registry/node-ca-2g9tl"
Jul 30 00:02:07.212340 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:07.212248    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs podName:47b042b2-e9c2-45fd-ae41-9608eaf6aa4d nodeName:}" failed. No retries permitted until 2026-07-30 00:02:07.712228986 +0000 UTC m=+2.014677325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs") pod "network-metrics-daemon-lj2rz" (UID: "47b042b2-e9c2-45fd-ae41-9608eaf6aa4d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 00:02:07.212340 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212281    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/877bba44-0778-4142-b6f7-aa03eb30a724-agent-certs\") pod \"konnectivity-agent-pnbrq\" (UID: \"877bba44-0778-4142-b6f7-aa03eb30a724\") " pod="kube-system/konnectivity-agent-pnbrq"
Jul 30 00:02:07.212340 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212308    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9e32819a-ea15-489b-b449-2a90e82f4516-sys-fs\") pod \"aws-ebs-csi-driver-node-99qf7\" (UID: \"9e32819a-ea15-489b-b449-2a90e82f4516\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99qf7"
Jul 30 00:02:07.212340 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212331    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-host-run-netns\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.212340 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212285    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0821896-954e-4d42-a259-11685665d109-host\") pod \"node-ca-2g9tl\" (UID: \"b0821896-954e-4d42-a259-11685665d109\") " pod="openshift-image-registry/node-ca-2g9tl"
Jul 30 00:02:07.212922 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212375    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-host-var-lib-kubelet\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.212922 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212400    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9e32819a-ea15-489b-b449-2a90e82f4516-sys-fs\") pod \"aws-ebs-csi-driver-node-99qf7\" (UID: \"9e32819a-ea15-489b-b449-2a90e82f4516\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99qf7"
Jul 30 00:02:07.212922 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212419    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-host-var-lib-kubelet\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.212922 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212441    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-host-run-netns\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.212922 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212464    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-hostroot\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.212922 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212486    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9e32819a-ea15-489b-b449-2a90e82f4516-registration-dir\") pod \"aws-ebs-csi-driver-node-99qf7\" (UID: \"9e32819a-ea15-489b-b449-2a90e82f4516\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99qf7"
Jul 30 00:02:07.212922 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212508    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9e32819a-ea15-489b-b449-2a90e82f4516-device-dir\") pod \"aws-ebs-csi-driver-node-99qf7\" (UID: \"9e32819a-ea15-489b-b449-2a90e82f4516\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99qf7"
Jul 30 00:02:07.212922 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212532    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ee4035d2-1fba-4a57-ae6f-39b1010f098b-multus-daemon-config\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.212922 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212533    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-hostroot\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.212922 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212541    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9e32819a-ea15-489b-b449-2a90e82f4516-registration-dir\") pod \"aws-ebs-csi-driver-node-99qf7\" (UID: \"9e32819a-ea15-489b-b449-2a90e82f4516\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99qf7"
Jul 30 00:02:07.212922 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212555    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsmf7\" (UniqueName: \"kubernetes.io/projected/ee4035d2-1fba-4a57-ae6f-39b1010f098b-kube-api-access-hsmf7\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.212922 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212575    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9e32819a-ea15-489b-b449-2a90e82f4516-device-dir\") pod \"aws-ebs-csi-driver-node-99qf7\" (UID: \"9e32819a-ea15-489b-b449-2a90e82f4516\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99qf7"
Jul 30 00:02:07.212922 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212612    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-host-run-k8s-cni-cncf-io\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.212922 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212579    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-host-run-k8s-cni-cncf-io\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.212922 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212652    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e3c15d8-57fd-413b-bc96-74ee9feb2f8b-system-cni-dir\") pod \"multus-additional-cni-plugins-kzqq8\" (UID: \"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b\") " pod="openshift-multus/multus-additional-cni-plugins-kzqq8"
Jul 30 00:02:07.212922 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212670    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9e32819a-ea15-489b-b449-2a90e82f4516-etc-selinux\") pod \"aws-ebs-csi-driver-node-99qf7\" (UID: \"9e32819a-ea15-489b-b449-2a90e82f4516\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99qf7"
Jul 30 00:02:07.212922 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212685    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6e3c15d8-57fd-413b-bc96-74ee9feb2f8b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kzqq8\" (UID: \"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b\") " pod="openshift-multus/multus-additional-cni-plugins-kzqq8"
Jul 30 00:02:07.213727 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212714    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abd0f838-14de-4c5c-899a-8364a6084905-tmp-dir\") pod \"node-resolver-tq4hc\" (UID: \"abd0f838-14de-4c5c-899a-8364a6084905\") " pod="openshift-dns/node-resolver-tq4hc"
Jul 30 00:02:07.213727 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212746    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-multus-cni-dir\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.213727 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212766    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e3c15d8-57fd-413b-bc96-74ee9feb2f8b-system-cni-dir\") pod \"multus-additional-cni-plugins-kzqq8\" (UID: \"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b\") " pod="openshift-multus/multus-additional-cni-plugins-kzqq8"
Jul 30 00:02:07.213727 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212716    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/877bba44-0778-4142-b6f7-aa03eb30a724-konnectivity-ca\") pod \"konnectivity-agent-pnbrq\" (UID: \"877bba44-0778-4142-b6f7-aa03eb30a724\") " pod="kube-system/konnectivity-agent-pnbrq"
Jul 30 00:02:07.213727 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212798    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-multus-cni-dir\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.213727 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212803    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9e32819a-ea15-489b-b449-2a90e82f4516-etc-selinux\") pod \"aws-ebs-csi-driver-node-99qf7\" (UID: \"9e32819a-ea15-489b-b449-2a90e82f4516\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99qf7"
Jul 30 00:02:07.213727 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212824    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-etc-kubernetes\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.213727 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212847    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3f0e8d05-2ec5-4cb3-b404-932d0fb6874c-iptables-alerter-script\") pod \"iptables-alerter-lw6v5\" (UID: \"3f0e8d05-2ec5-4cb3-b404-932d0fb6874c\") " pod="openshift-network-operator/iptables-alerter-lw6v5"
Jul 30 00:02:07.213727 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212871    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6e3c15d8-57fd-413b-bc96-74ee9feb2f8b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kzqq8\" (UID: \"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b\") " pod="openshift-multus/multus-additional-cni-plugins-kzqq8"
Jul 30 00:02:07.213727 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212894    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/abd0f838-14de-4c5c-899a-8364a6084905-hosts-file\") pod \"node-resolver-tq4hc\" (UID: \"abd0f838-14de-4c5c-899a-8364a6084905\") " pod="openshift-dns/node-resolver-tq4hc"
Jul 30 00:02:07.213727 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212906    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-etc-kubernetes\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.213727 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.212920    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b0821896-954e-4d42-a259-11685665d109-serviceca\") pod \"node-ca-2g9tl\" (UID: \"b0821896-954e-4d42-a259-11685665d109\") " pod="openshift-image-registry/node-ca-2g9tl"
Jul 30 00:02:07.213727 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213011    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abd0f838-14de-4c5c-899a-8364a6084905-tmp-dir\") pod \"node-resolver-tq4hc\" (UID: \"abd0f838-14de-4c5c-899a-8364a6084905\") " pod="openshift-dns/node-resolver-tq4hc"
Jul 30 00:02:07.213727 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213007    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vmfp\" (UniqueName: \"kubernetes.io/projected/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-kube-api-access-8vmfp\") pod \"network-metrics-daemon-lj2rz\" (UID: \"47b042b2-e9c2-45fd-ae41-9608eaf6aa4d\") " pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:02:07.213727 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213125    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee4035d2-1fba-4a57-ae6f-39b1010f098b-cni-binary-copy\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.213727 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213146    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-multus-conf-dir\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.213727 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213184    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-host-run-multus-certs\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.213727 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213207    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f0e8d05-2ec5-4cb3-b404-932d0fb6874c-host-slash\") pod \"iptables-alerter-lw6v5\" (UID: \"3f0e8d05-2ec5-4cb3-b404-932d0fb6874c\") " pod="openshift-network-operator/iptables-alerter-lw6v5"
Jul 30 00:02:07.214374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213234    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9e32819a-ea15-489b-b449-2a90e82f4516-kubelet-dir\") pod \"aws-ebs-csi-driver-node-99qf7\" (UID: \"9e32819a-ea15-489b-b449-2a90e82f4516\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99qf7"
Jul 30 00:02:07.214374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213257    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9e32819a-ea15-489b-b449-2a90e82f4516-socket-dir\") pod \"aws-ebs-csi-driver-node-99qf7\" (UID: \"9e32819a-ea15-489b-b449-2a90e82f4516\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99qf7"
Jul 30 00:02:07.214374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213281    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-host-var-lib-cni-multus\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.214374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213290    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-multus-conf-dir\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.214374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213289    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6e3c15d8-57fd-413b-bc96-74ee9feb2f8b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kzqq8\" (UID: \"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b\") " pod="openshift-multus/multus-additional-cni-plugins-kzqq8"
Jul 30 00:02:07.214374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213069    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/abd0f838-14de-4c5c-899a-8364a6084905-hosts-file\") pod \"node-resolver-tq4hc\" (UID: \"abd0f838-14de-4c5c-899a-8364a6084905\") " pod="openshift-dns/node-resolver-tq4hc"
Jul 30 00:02:07.214374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213305    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c69fc\" (UniqueName: \"kubernetes.io/projected/6e3c15d8-57fd-413b-bc96-74ee9feb2f8b-kube-api-access-c69fc\") pod \"multus-additional-cni-plugins-kzqq8\" (UID: \"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b\") " pod="openshift-multus/multus-additional-cni-plugins-kzqq8"
Jul 30 00:02:07.214374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213057    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ee4035d2-1fba-4a57-ae6f-39b1010f098b-multus-daemon-config\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.214374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213350    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-system-cni-dir\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.214374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213356    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9e32819a-ea15-489b-b449-2a90e82f4516-kubelet-dir\") pod \"aws-ebs-csi-driver-node-99qf7\" (UID: \"9e32819a-ea15-489b-b449-2a90e82f4516\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99qf7"
Jul 30 00:02:07.214374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213375    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-os-release\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.214374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213378    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-host-var-lib-cni-multus\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.214374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213381    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6e3c15d8-57fd-413b-bc96-74ee9feb2f8b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kzqq8\" (UID: \"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b\") " pod="openshift-multus/multus-additional-cni-plugins-kzqq8"
Jul 30 00:02:07.214374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213403    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-host-run-multus-certs\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.214374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213404    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq78f\" (UniqueName: \"kubernetes.io/projected/abd0f838-14de-4c5c-899a-8364a6084905-kube-api-access-fq78f\") pod \"node-resolver-tq4hc\" (UID: \"abd0f838-14de-4c5c-899a-8364a6084905\") " pod="openshift-dns/node-resolver-tq4hc"
Jul 30 00:02:07.214374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213443    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-host-var-lib-cni-bin\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.214374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213467    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e3c15d8-57fd-413b-bc96-74ee9feb2f8b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kzqq8\" (UID: \"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b\") " pod="openshift-multus/multus-additional-cni-plugins-kzqq8"
Jul 30 00:02:07.214995 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213474    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3f0e8d05-2ec5-4cb3-b404-932d0fb6874c-iptables-alerter-script\") pod \"iptables-alerter-lw6v5\" (UID: \"3f0e8d05-2ec5-4cb3-b404-932d0fb6874c\") " pod="openshift-network-operator/iptables-alerter-lw6v5"
Jul 30 00:02:07.214995 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213494    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbxlk\" (UniqueName: \"kubernetes.io/projected/9e32819a-ea15-489b-b449-2a90e82f4516-kube-api-access-rbxlk\") pod \"aws-ebs-csi-driver-node-99qf7\" (UID: \"9e32819a-ea15-489b-b449-2a90e82f4516\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99qf7"
Jul 30 00:02:07.214995 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213477    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9e32819a-ea15-489b-b449-2a90e82f4516-socket-dir\") pod \"aws-ebs-csi-driver-node-99qf7\" (UID: \"9e32819a-ea15-489b-b449-2a90e82f4516\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99qf7"
Jul 30 00:02:07.214995 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213490    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b0821896-954e-4d42-a259-11685665d109-serviceca\") pod \"node-ca-2g9tl\" (UID: \"b0821896-954e-4d42-a259-11685665d109\") " pod="openshift-image-registry/node-ca-2g9tl"
Jul 30 00:02:07.214995 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213520    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-multus-socket-dir-parent\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.214995 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213528    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-os-release\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.214995 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213543    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e3c15d8-57fd-413b-bc96-74ee9feb2f8b-cni-binary-copy\") pod \"multus-additional-cni-plugins-kzqq8\" (UID: \"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b\") " pod="openshift-multus/multus-additional-cni-plugins-kzqq8"
Jul 30 00:02:07.214995 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213573    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-host-var-lib-cni-bin\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.214995 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213574    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-system-cni-dir\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.214995 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213583    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-cnibin\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.214995 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213605    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwlw8\" (UniqueName: \"kubernetes.io/projected/3f0e8d05-2ec5-4cb3-b404-932d0fb6874c-kube-api-access-nwlw8\") pod \"iptables-alerter-lw6v5\" (UID: \"3f0e8d05-2ec5-4cb3-b404-932d0fb6874c\") " pod="openshift-network-operator/iptables-alerter-lw6v5"
Jul 30 00:02:07.214995 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213615    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-multus-socket-dir-parent\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.214995 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213688    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee4035d2-1fba-4a57-ae6f-39b1010f098b-cnibin\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.214995 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213737    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f0e8d05-2ec5-4cb3-b404-932d0fb6874c-host-slash\") pod \"iptables-alerter-lw6v5\" (UID: \"3f0e8d05-2ec5-4cb3-b404-932d0fb6874c\") " pod="openshift-network-operator/iptables-alerter-lw6v5"
Jul 30 00:02:07.214995 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213766    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e3c15d8-57fd-413b-bc96-74ee9feb2f8b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kzqq8\" (UID: \"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b\") " pod="openshift-multus/multus-additional-cni-plugins-kzqq8"
Jul 30 00:02:07.214995 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213937    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee4035d2-1fba-4a57-ae6f-39b1010f098b-cni-binary-copy\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.214995 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.213958    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e3c15d8-57fd-413b-bc96-74ee9feb2f8b-cni-binary-copy\") pod \"multus-additional-cni-plugins-kzqq8\" (UID: \"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b\") " pod="openshift-multus/multus-additional-cni-plugins-kzqq8"
Jul 30 00:02:07.214995 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.214878    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/877bba44-0778-4142-b6f7-aa03eb30a724-agent-certs\") pod \"konnectivity-agent-pnbrq\" (UID: \"877bba44-0778-4142-b6f7-aa03eb30a724\") " pod="kube-system/konnectivity-agent-pnbrq"
Jul 30 00:02:07.220821 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.220793    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsmf7\" (UniqueName: \"kubernetes.io/projected/ee4035d2-1fba-4a57-ae6f-39b1010f098b-kube-api-access-hsmf7\") pod \"multus-rwkfx\" (UID: \"ee4035d2-1fba-4a57-ae6f-39b1010f098b\") " pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.221001 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.220979    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q642l\" (UniqueName: \"kubernetes.io/projected/b0821896-954e-4d42-a259-11685665d109-kube-api-access-q642l\") pod \"node-ca-2g9tl\" (UID: \"b0821896-954e-4d42-a259-11685665d109\") " pod="openshift-image-registry/node-ca-2g9tl"
Jul 30 00:02:07.221420 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.221401    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwlw8\" (UniqueName: \"kubernetes.io/projected/3f0e8d05-2ec5-4cb3-b404-932d0fb6874c-kube-api-access-nwlw8\") pod \"iptables-alerter-lw6v5\" (UID: \"3f0e8d05-2ec5-4cb3-b404-932d0fb6874c\") " pod="openshift-network-operator/iptables-alerter-lw6v5"
Jul 30 00:02:07.221555 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.221538    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbxlk\" (UniqueName: \"kubernetes.io/projected/9e32819a-ea15-489b-b449-2a90e82f4516-kube-api-access-rbxlk\") pod \"aws-ebs-csi-driver-node-99qf7\" (UID: \"9e32819a-ea15-489b-b449-2a90e82f4516\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99qf7"
Jul 30 00:02:07.221963 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.221938    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq78f\" (UniqueName: \"kubernetes.io/projected/abd0f838-14de-4c5c-899a-8364a6084905-kube-api-access-fq78f\") pod \"node-resolver-tq4hc\" (UID: \"abd0f838-14de-4c5c-899a-8364a6084905\") " pod="openshift-dns/node-resolver-tq4hc"
Jul 30 00:02:07.222257 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.222242    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c69fc\" (UniqueName: \"kubernetes.io/projected/6e3c15d8-57fd-413b-bc96-74ee9feb2f8b-kube-api-access-c69fc\") pod \"multus-additional-cni-plugins-kzqq8\" (UID: \"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b\") " pod="openshift-multus/multus-additional-cni-plugins-kzqq8"
Jul 30 00:02:07.222452 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.222426    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vmfp\" (UniqueName: \"kubernetes.io/projected/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-kube-api-access-8vmfp\") pod \"network-metrics-daemon-lj2rz\" (UID: \"47b042b2-e9c2-45fd-ae41-9608eaf6aa4d\") " pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:02:07.244886 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:07.244859    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07e6b3dc508eb1747236dbb1b614bc57.slice/crio-9ac3e087e30f249b203295fe26e82426e850676c4889d86a313f5a4c471f9af1 WatchSource:0}: Error finding container 9ac3e087e30f249b203295fe26e82426e850676c4889d86a313f5a4c471f9af1: Status 404 returned error can't find the container with id 9ac3e087e30f249b203295fe26e82426e850676c4889d86a313f5a4c471f9af1
Jul 30 00:02:07.245130 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:07.245115    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67d41482f2fb87a5260d58a8ce3d03fa.slice/crio-624c12a09622f43152ef6a36b5cc96b065e0167ab2ca1ed427dfc979e58527b6 WatchSource:0}: Error finding container 624c12a09622f43152ef6a36b5cc96b065e0167ab2ca1ed427dfc979e58527b6: Status 404 returned error can't find the container with id 624c12a09622f43152ef6a36b5cc96b065e0167ab2ca1ed427dfc979e58527b6
Jul 30 00:02:07.250444 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.250429    2527 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 00:02:07.326181 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.326110    2527 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 00:02:07.331823 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.331809    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hrw82"
Jul 30 00:02:07.338734 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:07.338715    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e354369_ec72_41b7_ac1d_679685596d1a.slice/crio-007ebf87d654b3cd3630e572ba80fa08a747fabbd38a52e473a4075b73f0bc4e WatchSource:0}: Error finding container 007ebf87d654b3cd3630e572ba80fa08a747fabbd38a52e473a4075b73f0bc4e: Status 404 returned error can't find the container with id 007ebf87d654b3cd3630e572ba80fa08a747fabbd38a52e473a4075b73f0bc4e
Jul 30 00:02:07.347594 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.347579    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:07.354482 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:07.354466    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6b01a1f_c41e_4781_8c25_66b152e0d0e8.slice/crio-c681ae4dfec0ac2e47e7533465a34aec1789afe3976c95da8c923b66d5ff1293 WatchSource:0}: Error finding container c681ae4dfec0ac2e47e7533465a34aec1789afe3976c95da8c923b66d5ff1293: Status 404 returned error can't find the container with id c681ae4dfec0ac2e47e7533465a34aec1789afe3976c95da8c923b66d5ff1293
Jul 30 00:02:07.361227 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.361210    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pnbrq"
Jul 30 00:02:07.367564 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:07.367537    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod877bba44_0778_4142_b6f7_aa03eb30a724.slice/crio-796e11b73f8dc0200eb2ed5eed35569fc9f3edc22e7a66811eaa456568b2cc40 WatchSource:0}: Error finding container 796e11b73f8dc0200eb2ed5eed35569fc9f3edc22e7a66811eaa456568b2cc40: Status 404 returned error can't find the container with id 796e11b73f8dc0200eb2ed5eed35569fc9f3edc22e7a66811eaa456568b2cc40
Jul 30 00:02:07.372493 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.372476    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99qf7"
Jul 30 00:02:07.378965 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:07.378943    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e32819a_ea15_489b_b449_2a90e82f4516.slice/crio-d3c0bb3c0d81e415fa5b068e3be893bcb802be8a3b1fbd453e142c048b54fc02 WatchSource:0}: Error finding container d3c0bb3c0d81e415fa5b068e3be893bcb802be8a3b1fbd453e142c048b54fc02: Status 404 returned error can't find the container with id d3c0bb3c0d81e415fa5b068e3be893bcb802be8a3b1fbd453e142c048b54fc02
Jul 30 00:02:07.388081 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.388066    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kzqq8"
Jul 30 00:02:07.393662 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.393642    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tq4hc"
Jul 30 00:02:07.394473 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:07.394454    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e3c15d8_57fd_413b_bc96_74ee9feb2f8b.slice/crio-1186147686ecb028ac3caeda7bda476ef2f047e43122e3e90ed52ca5a648bbb5 WatchSource:0}: Error finding container 1186147686ecb028ac3caeda7bda476ef2f047e43122e3e90ed52ca5a648bbb5: Status 404 returned error can't find the container with id 1186147686ecb028ac3caeda7bda476ef2f047e43122e3e90ed52ca5a648bbb5
Jul 30 00:02:07.401430 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:07.401410    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabd0f838_14de_4c5c_899a_8364a6084905.slice/crio-8d21114272236bc361ca6e46a1f18862de648aa3df04ac1e2ce1d48f14081f92 WatchSource:0}: Error finding container 8d21114272236bc361ca6e46a1f18862de648aa3df04ac1e2ce1d48f14081f92: Status 404 returned error can't find the container with id 8d21114272236bc361ca6e46a1f18862de648aa3df04ac1e2ce1d48f14081f92
Jul 30 00:02:07.402722 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.402708    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2g9tl"
Jul 30 00:02:07.409121 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:07.409104    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0821896_954e_4d42_a259_11685665d109.slice/crio-ed82e47cad15c3834d93db143b579097802510869853ea2fc82ee79a567c065a WatchSource:0}: Error finding container ed82e47cad15c3834d93db143b579097802510869853ea2fc82ee79a567c065a: Status 404 returned error can't find the container with id ed82e47cad15c3834d93db143b579097802510869853ea2fc82ee79a567c065a
Jul 30 00:02:07.426791 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.426776    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rwkfx"
Jul 30 00:02:07.431409 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.431392    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lw6v5"
Jul 30 00:02:07.434107 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:07.434081    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee4035d2_1fba_4a57_ae6f_39b1010f098b.slice/crio-22d2c6daa15fae5eb8693b10426070e82c610a534794b8ae35dbdb6b36ab4bd8 WatchSource:0}: Error finding container 22d2c6daa15fae5eb8693b10426070e82c610a534794b8ae35dbdb6b36ab4bd8: Status 404 returned error can't find the container with id 22d2c6daa15fae5eb8693b10426070e82c610a534794b8ae35dbdb6b36ab4bd8
Jul 30 00:02:07.438539 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:07.438522    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f0e8d05_2ec5_4cb3_b404_932d0fb6874c.slice/crio-e4f1dba8463cdd113e0a3cc3365e860afda3c4c30a6f0b7e1d6be5ae81f617b9 WatchSource:0}: Error finding container e4f1dba8463cdd113e0a3cc3365e860afda3c4c30a6f0b7e1d6be5ae81f617b9: Status 404 returned error can't find the container with id e4f1dba8463cdd113e0a3cc3365e860afda3c4c30a6f0b7e1d6be5ae81f617b9
Jul 30 00:02:07.440345 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:07.440313    2527 kuberuntime_manager.go:1459] "Unhandled Error" err="container iptables-alerter start failed in pod iptables-alerter-lw6v5_openshift-network-operator(3f0e8d05-2ec5-4cb3-b404-932d0fb6874c): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Jul 30 00:02:07.440424 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:07.440348    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"iptables-alerter\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-network-operator/iptables-alerter-lw6v5" podUID="3f0e8d05-2ec5-4cb3-b404-932d0fb6874c"
Jul 30 00:02:07.500433 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.500417    2527 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 00:02:07.616081 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.616061    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb5rx\" (UniqueName: \"kubernetes.io/projected/a702b669-744a-4c89-bf15-164d52f5f1d5-kube-api-access-bb5rx\") pod \"network-check-target-h42d5\" (UID: \"a702b669-744a-4c89-bf15-164d52f5f1d5\") " pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:02:07.616208 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.616105    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fefc207e-2848-4204-b460-39c933e7b127-original-pull-secret\") pod \"global-pull-secret-syncer-tmsc5\" (UID: \"fefc207e-2848-4204-b460-39c933e7b127\") " pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:07.616261 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:07.616245    2527 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 00:02:07.616312 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:07.616264    2527 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 00:02:07.616312 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:07.616275    2527 projected.go:196] Error preparing data for projected volume kube-api-access-bb5rx for pod openshift-network-diagnostics/network-check-target-h42d5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 00:02:07.616312 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:07.616302    2527 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 00:02:07.616421 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:07.616321    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a702b669-744a-4c89-bf15-164d52f5f1d5-kube-api-access-bb5rx podName:a702b669-744a-4c89-bf15-164d52f5f1d5 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:08.616307551 +0000 UTC m=+2.918755875 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bb5rx" (UniqueName: "kubernetes.io/projected/a702b669-744a-4c89-bf15-164d52f5f1d5-kube-api-access-bb5rx") pod "network-check-target-h42d5" (UID: "a702b669-744a-4c89-bf15-164d52f5f1d5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 00:02:07.616421 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:07.616340    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fefc207e-2848-4204-b460-39c933e7b127-original-pull-secret podName:fefc207e-2848-4204-b460-39c933e7b127 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:08.61632934 +0000 UTC m=+2.918777665 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fefc207e-2848-4204-b460-39c933e7b127-original-pull-secret") pod "global-pull-secret-syncer-tmsc5" (UID: "fefc207e-2848-4204-b460-39c933e7b127") : object "kube-system"/"original-pull-secret" not registered
Jul 30 00:02:07.717409 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:07.717390    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs\") pod \"network-metrics-daemon-lj2rz\" (UID: \"47b042b2-e9c2-45fd-ae41-9608eaf6aa4d\") " pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:02:07.717517 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:07.717506    2527 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 00:02:07.717558 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:07.717551    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs podName:47b042b2-e9c2-45fd-ae41-9608eaf6aa4d nodeName:}" failed. No retries permitted until 2026-07-30 00:02:08.71753924 +0000 UTC m=+3.019987580 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs") pod "network-metrics-daemon-lj2rz" (UID: "47b042b2-e9c2-45fd-ae41-9608eaf6aa4d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 00:02:08.042695 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:08.042562    2527 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 23:57:07 +0000 UTC" deadline="2027-12-29 20:57:51.082687143 +0000 UTC"
Jul 30 00:02:08.042695 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:08.042624    2527 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12428h55m43.040067503s"
Jul 30 00:02:08.212504 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:08.212463    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:02:08.212673 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:08.212606    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42d5" podUID="a702b669-744a-4c89-bf15-164d52f5f1d5"
Jul 30 00:02:08.226844 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:08.226791    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal" event={"ID":"67d41482f2fb87a5260d58a8ce3d03fa","Type":"ContainerStarted","Data":"624c12a09622f43152ef6a36b5cc96b065e0167ab2ca1ed427dfc979e58527b6"}
Jul 30 00:02:08.234355 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:08.234152    2527 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 00:02:08.237392 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:08.237363    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-198.ec2.internal" event={"ID":"07e6b3dc508eb1747236dbb1b614bc57","Type":"ContainerStarted","Data":"9ac3e087e30f249b203295fe26e82426e850676c4889d86a313f5a4c471f9af1"}
Jul 30 00:02:08.241948 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:08.241922    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rwkfx" event={"ID":"ee4035d2-1fba-4a57-ae6f-39b1010f098b","Type":"ContainerStarted","Data":"22d2c6daa15fae5eb8693b10426070e82c610a534794b8ae35dbdb6b36ab4bd8"}
Jul 30 00:02:08.245569 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:08.245542    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99qf7" event={"ID":"9e32819a-ea15-489b-b449-2a90e82f4516","Type":"ContainerStarted","Data":"d3c0bb3c0d81e415fa5b068e3be893bcb802be8a3b1fbd453e142c048b54fc02"}
Jul 30 00:02:08.250280 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:08.250240    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pnbrq" event={"ID":"877bba44-0778-4142-b6f7-aa03eb30a724","Type":"ContainerStarted","Data":"796e11b73f8dc0200eb2ed5eed35569fc9f3edc22e7a66811eaa456568b2cc40"}
Jul 30 00:02:08.253466 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:08.253369    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9cggv" event={"ID":"c6b01a1f-c41e-4781-8c25-66b152e0d0e8","Type":"ContainerStarted","Data":"c681ae4dfec0ac2e47e7533465a34aec1789afe3976c95da8c923b66d5ff1293"}
Jul 30 00:02:08.255457 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:08.255432    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hrw82" event={"ID":"1e354369-ec72-41b7-ac1d-679685596d1a","Type":"ContainerStarted","Data":"007ebf87d654b3cd3630e572ba80fa08a747fabbd38a52e473a4075b73f0bc4e"}
Jul 30 00:02:08.262343 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:08.261638    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lw6v5" event={"ID":"3f0e8d05-2ec5-4cb3-b404-932d0fb6874c","Type":"ContainerStarted","Data":"e4f1dba8463cdd113e0a3cc3365e860afda3c4c30a6f0b7e1d6be5ae81f617b9"}
Jul 30 00:02:08.264025 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:08.263834    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"iptables-alerter\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-network-operator/iptables-alerter-lw6v5" podUID="3f0e8d05-2ec5-4cb3-b404-932d0fb6874c"
Jul 30 00:02:08.269131 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:08.269107    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2g9tl" event={"ID":"b0821896-954e-4d42-a259-11685665d109","Type":"ContainerStarted","Data":"ed82e47cad15c3834d93db143b579097802510869853ea2fc82ee79a567c065a"}
Jul 30 00:02:08.284237 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:08.284188    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tq4hc" event={"ID":"abd0f838-14de-4c5c-899a-8364a6084905","Type":"ContainerStarted","Data":"8d21114272236bc361ca6e46a1f18862de648aa3df04ac1e2ce1d48f14081f92"}
Jul 30 00:02:08.288543 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:08.287527    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzqq8" event={"ID":"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b","Type":"ContainerStarted","Data":"1186147686ecb028ac3caeda7bda476ef2f047e43122e3e90ed52ca5a648bbb5"}
Jul 30 00:02:08.625945 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:08.625795    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fefc207e-2848-4204-b460-39c933e7b127-original-pull-secret\") pod \"global-pull-secret-syncer-tmsc5\" (UID: \"fefc207e-2848-4204-b460-39c933e7b127\") " pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:08.625945 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:08.625905    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb5rx\" (UniqueName: \"kubernetes.io/projected/a702b669-744a-4c89-bf15-164d52f5f1d5-kube-api-access-bb5rx\") pod \"network-check-target-h42d5\" (UID: \"a702b669-744a-4c89-bf15-164d52f5f1d5\") " pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:02:08.626262 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:08.626081    2527 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 00:02:08.626262 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:08.626102    2527 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 00:02:08.626262 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:08.626116    2527 projected.go:196] Error preparing data for projected volume kube-api-access-bb5rx for pod openshift-network-diagnostics/network-check-target-h42d5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 00:02:08.626262 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:08.626175    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a702b669-744a-4c89-bf15-164d52f5f1d5-kube-api-access-bb5rx podName:a702b669-744a-4c89-bf15-164d52f5f1d5 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:10.62615553 +0000 UTC m=+4.928603862 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bb5rx" (UniqueName: "kubernetes.io/projected/a702b669-744a-4c89-bf15-164d52f5f1d5-kube-api-access-bb5rx") pod "network-check-target-h42d5" (UID: "a702b669-744a-4c89-bf15-164d52f5f1d5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 00:02:08.626810 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:08.626610    2527 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 00:02:08.626810 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:08.626666    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fefc207e-2848-4204-b460-39c933e7b127-original-pull-secret podName:fefc207e-2848-4204-b460-39c933e7b127 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:10.626650552 +0000 UTC m=+4.929098880 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fefc207e-2848-4204-b460-39c933e7b127-original-pull-secret") pod "global-pull-secret-syncer-tmsc5" (UID: "fefc207e-2848-4204-b460-39c933e7b127") : object "kube-system"/"original-pull-secret" not registered
Jul 30 00:02:08.726938 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:08.726880    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs\") pod \"network-metrics-daemon-lj2rz\" (UID: \"47b042b2-e9c2-45fd-ae41-9608eaf6aa4d\") " pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:02:08.727087 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:08.727047    2527 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 00:02:08.727142 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:08.727105    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs podName:47b042b2-e9c2-45fd-ae41-9608eaf6aa4d nodeName:}" failed. No retries permitted until 2026-07-30 00:02:10.727088214 +0000 UTC m=+5.029536560 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs") pod "network-metrics-daemon-lj2rz" (UID: "47b042b2-e9c2-45fd-ae41-9608eaf6aa4d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 00:02:08.894885 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:08.894810    2527 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 00:02:09.043324 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:09.043259    2527 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 23:57:07 +0000 UTC" deadline="2028-03-08 22:07:34.318134618 +0000 UTC"
Jul 30 00:02:09.043324 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:09.043296    2527 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14110h5m25.27484339s"
Jul 30 00:02:09.210174 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:09.210103    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:02:09.210485 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:09.210449    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lj2rz" podUID="47b042b2-e9c2-45fd-ae41-9608eaf6aa4d"
Jul 30 00:02:09.210845 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:09.210644    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:09.210845 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:09.210797    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmsc5" podUID="fefc207e-2848-4204-b460-39c933e7b127"
Jul 30 00:02:10.213033 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:10.212783    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:02:10.213515 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:10.213132    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42d5" podUID="a702b669-744a-4c89-bf15-164d52f5f1d5"
Jul 30 00:02:10.648607 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:10.648532    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb5rx\" (UniqueName: \"kubernetes.io/projected/a702b669-744a-4c89-bf15-164d52f5f1d5-kube-api-access-bb5rx\") pod \"network-check-target-h42d5\" (UID: \"a702b669-744a-4c89-bf15-164d52f5f1d5\") " pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:02:10.648607 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:10.648600    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fefc207e-2848-4204-b460-39c933e7b127-original-pull-secret\") pod \"global-pull-secret-syncer-tmsc5\" (UID: \"fefc207e-2848-4204-b460-39c933e7b127\") " pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:10.648793 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:10.648733    2527 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 00:02:10.648793 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:10.648760    2527 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 00:02:10.648793 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:10.648787    2527 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 00:02:10.648887 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:10.648794    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fefc207e-2848-4204-b460-39c933e7b127-original-pull-secret podName:fefc207e-2848-4204-b460-39c933e7b127 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:14.648776361 +0000 UTC m=+8.951224690 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fefc207e-2848-4204-b460-39c933e7b127-original-pull-secret") pod "global-pull-secret-syncer-tmsc5" (UID: "fefc207e-2848-4204-b460-39c933e7b127") : object "kube-system"/"original-pull-secret" not registered
Jul 30 00:02:10.648887 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:10.648800    2527 projected.go:196] Error preparing data for projected volume kube-api-access-bb5rx for pod openshift-network-diagnostics/network-check-target-h42d5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 00:02:10.648887 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:10.648868    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a702b669-744a-4c89-bf15-164d52f5f1d5-kube-api-access-bb5rx podName:a702b669-744a-4c89-bf15-164d52f5f1d5 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:14.64883618 +0000 UTC m=+8.951284508 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bb5rx" (UniqueName: "kubernetes.io/projected/a702b669-744a-4c89-bf15-164d52f5f1d5-kube-api-access-bb5rx") pod "network-check-target-h42d5" (UID: "a702b669-744a-4c89-bf15-164d52f5f1d5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 00:02:10.749852 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:10.749811    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs\") pod \"network-metrics-daemon-lj2rz\" (UID: \"47b042b2-e9c2-45fd-ae41-9608eaf6aa4d\") " pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:02:10.750033 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:10.750021    2527 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 00:02:10.750093 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:10.750088    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs podName:47b042b2-e9c2-45fd-ae41-9608eaf6aa4d nodeName:}" failed. No retries permitted until 2026-07-30 00:02:14.750066319 +0000 UTC m=+9.052514649 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs") pod "network-metrics-daemon-lj2rz" (UID: "47b042b2-e9c2-45fd-ae41-9608eaf6aa4d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 00:02:11.209849 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:11.209813    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:02:11.210031 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:11.209968    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lj2rz" podUID="47b042b2-e9c2-45fd-ae41-9608eaf6aa4d"
Jul 30 00:02:11.210382 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:11.210359    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:11.210493 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:11.210473    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmsc5" podUID="fefc207e-2848-4204-b460-39c933e7b127"
Jul 30 00:02:12.213086 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:12.213054    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:02:12.213583 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:12.213181    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42d5" podUID="a702b669-744a-4c89-bf15-164d52f5f1d5"
Jul 30 00:02:13.209769 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:13.209722    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:02:13.209968 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:13.209773    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:13.209968 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:13.209871    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lj2rz" podUID="47b042b2-e9c2-45fd-ae41-9608eaf6aa4d"
Jul 30 00:02:13.210092 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:13.210013    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmsc5" podUID="fefc207e-2848-4204-b460-39c933e7b127"
Jul 30 00:02:14.209859 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:14.209825    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:02:14.210370 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:14.209966    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42d5" podUID="a702b669-744a-4c89-bf15-164d52f5f1d5"
Jul 30 00:02:14.686765 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:14.686646    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb5rx\" (UniqueName: \"kubernetes.io/projected/a702b669-744a-4c89-bf15-164d52f5f1d5-kube-api-access-bb5rx\") pod \"network-check-target-h42d5\" (UID: \"a702b669-744a-4c89-bf15-164d52f5f1d5\") " pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:02:14.686765 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:14.686704    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fefc207e-2848-4204-b460-39c933e7b127-original-pull-secret\") pod \"global-pull-secret-syncer-tmsc5\" (UID: \"fefc207e-2848-4204-b460-39c933e7b127\") " pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:14.686989 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:14.686827    2527 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 00:02:14.686989 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:14.686889    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fefc207e-2848-4204-b460-39c933e7b127-original-pull-secret podName:fefc207e-2848-4204-b460-39c933e7b127 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:22.686869737 +0000 UTC m=+16.989318075 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fefc207e-2848-4204-b460-39c933e7b127-original-pull-secret") pod "global-pull-secret-syncer-tmsc5" (UID: "fefc207e-2848-4204-b460-39c933e7b127") : object "kube-system"/"original-pull-secret" not registered
Jul 30 00:02:14.687324 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:14.687305    2527 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 00:02:14.687324 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:14.687326    2527 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 00:02:14.687491 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:14.687339    2527 projected.go:196] Error preparing data for projected volume kube-api-access-bb5rx for pod openshift-network-diagnostics/network-check-target-h42d5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 00:02:14.687491 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:14.687387    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a702b669-744a-4c89-bf15-164d52f5f1d5-kube-api-access-bb5rx podName:a702b669-744a-4c89-bf15-164d52f5f1d5 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:22.687371741 +0000 UTC m=+16.989820080 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bb5rx" (UniqueName: "kubernetes.io/projected/a702b669-744a-4c89-bf15-164d52f5f1d5-kube-api-access-bb5rx") pod "network-check-target-h42d5" (UID: "a702b669-744a-4c89-bf15-164d52f5f1d5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 00:02:14.787220 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:14.786978    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs\") pod \"network-metrics-daemon-lj2rz\" (UID: \"47b042b2-e9c2-45fd-ae41-9608eaf6aa4d\") " pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:02:14.787220 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:14.787145    2527 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 00:02:14.787220 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:14.787224    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs podName:47b042b2-e9c2-45fd-ae41-9608eaf6aa4d nodeName:}" failed. No retries permitted until 2026-07-30 00:02:22.787188263 +0000 UTC m=+17.089636592 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs") pod "network-metrics-daemon-lj2rz" (UID: "47b042b2-e9c2-45fd-ae41-9608eaf6aa4d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 00:02:15.209829 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:15.209801    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:15.210472 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:15.209929    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmsc5" podUID="fefc207e-2848-4204-b460-39c933e7b127"
Jul 30 00:02:15.210472 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:15.210288    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:02:15.210472 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:15.210431    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lj2rz" podUID="47b042b2-e9c2-45fd-ae41-9608eaf6aa4d"
Jul 30 00:02:16.210711 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:16.210685    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:02:16.211048 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:16.210758    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42d5" podUID="a702b669-744a-4c89-bf15-164d52f5f1d5"
Jul 30 00:02:17.209497 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:17.209476    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:02:17.209595 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:17.209578    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lj2rz" podUID="47b042b2-e9c2-45fd-ae41-9608eaf6aa4d"
Jul 30 00:02:17.209643 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:17.209608    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:17.209689 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:17.209674    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmsc5" podUID="fefc207e-2848-4204-b460-39c933e7b127"
Jul 30 00:02:18.210127 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:18.210096    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:02:18.210563 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:18.210233    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42d5" podUID="a702b669-744a-4c89-bf15-164d52f5f1d5"
Jul 30 00:02:19.209830 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:19.209801    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:19.209830 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:19.209819    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:02:19.210027 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:19.209901    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmsc5" podUID="fefc207e-2848-4204-b460-39c933e7b127"
Jul 30 00:02:19.210027 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:19.210014    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lj2rz" podUID="47b042b2-e9c2-45fd-ae41-9608eaf6aa4d"
Jul 30 00:02:20.210239 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:20.210207    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:02:20.210690 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:20.210327    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42d5" podUID="a702b669-744a-4c89-bf15-164d52f5f1d5"
Jul 30 00:02:21.210546 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:21.210513    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:02:21.210546 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:21.210552    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:21.210978 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:21.210641    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lj2rz" podUID="47b042b2-e9c2-45fd-ae41-9608eaf6aa4d"
Jul 30 00:02:21.210978 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:21.210793    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmsc5" podUID="fefc207e-2848-4204-b460-39c933e7b127"
Jul 30 00:02:22.210403 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:22.210374    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:02:22.210604 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:22.210501    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42d5" podUID="a702b669-744a-4c89-bf15-164d52f5f1d5"
Jul 30 00:02:22.748800 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:22.748762    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb5rx\" (UniqueName: \"kubernetes.io/projected/a702b669-744a-4c89-bf15-164d52f5f1d5-kube-api-access-bb5rx\") pod \"network-check-target-h42d5\" (UID: \"a702b669-744a-4c89-bf15-164d52f5f1d5\") " pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:02:22.748995 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:22.748808    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fefc207e-2848-4204-b460-39c933e7b127-original-pull-secret\") pod \"global-pull-secret-syncer-tmsc5\" (UID: \"fefc207e-2848-4204-b460-39c933e7b127\") " pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:22.748995 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:22.748905    2527 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 00:02:22.748995 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:22.748946    2527 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 00:02:22.748995 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:22.748962    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fefc207e-2848-4204-b460-39c933e7b127-original-pull-secret podName:fefc207e-2848-4204-b460-39c933e7b127 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:38.748942706 +0000 UTC m=+33.051391031 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fefc207e-2848-4204-b460-39c933e7b127-original-pull-secret") pod "global-pull-secret-syncer-tmsc5" (UID: "fefc207e-2848-4204-b460-39c933e7b127") : object "kube-system"/"original-pull-secret" not registered
Jul 30 00:02:22.748995 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:22.748968    2527 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 00:02:22.748995 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:22.748982    2527 projected.go:196] Error preparing data for projected volume kube-api-access-bb5rx for pod openshift-network-diagnostics/network-check-target-h42d5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 00:02:22.749239 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:22.749030    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a702b669-744a-4c89-bf15-164d52f5f1d5-kube-api-access-bb5rx podName:a702b669-744a-4c89-bf15-164d52f5f1d5 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:38.749015041 +0000 UTC m=+33.051463384 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bb5rx" (UniqueName: "kubernetes.io/projected/a702b669-744a-4c89-bf15-164d52f5f1d5-kube-api-access-bb5rx") pod "network-check-target-h42d5" (UID: "a702b669-744a-4c89-bf15-164d52f5f1d5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 00:02:22.849758 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:22.849726    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs\") pod \"network-metrics-daemon-lj2rz\" (UID: \"47b042b2-e9c2-45fd-ae41-9608eaf6aa4d\") " pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:02:22.849929 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:22.849850    2527 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 00:02:22.849929 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:22.849914    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs podName:47b042b2-e9c2-45fd-ae41-9608eaf6aa4d nodeName:}" failed. No retries permitted until 2026-07-30 00:02:38.849895624 +0000 UTC m=+33.152343963 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs") pod "network-metrics-daemon-lj2rz" (UID: "47b042b2-e9c2-45fd-ae41-9608eaf6aa4d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 00:02:23.210344 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:23.210274    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:02:23.210512 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:23.210395    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lj2rz" podUID="47b042b2-e9c2-45fd-ae41-9608eaf6aa4d"
Jul 30 00:02:23.210512 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:23.210451    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:23.210587 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:23.210538    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmsc5" podUID="fefc207e-2848-4204-b460-39c933e7b127"
Jul 30 00:02:24.210345 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:24.210319    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:02:24.210815 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:24.210433    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42d5" podUID="a702b669-744a-4c89-bf15-164d52f5f1d5"
Jul 30 00:02:25.210466 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:25.210440    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:02:25.210894 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:25.210568    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lj2rz" podUID="47b042b2-e9c2-45fd-ae41-9608eaf6aa4d"
Jul 30 00:02:25.210894 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:25.210613    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:25.210894 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:25.210723    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmsc5" podUID="fefc207e-2848-4204-b460-39c933e7b127"
Jul 30 00:02:26.211435 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:26.210993    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:02:26.211435 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:26.211085    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42d5" podUID="a702b669-744a-4c89-bf15-164d52f5f1d5"
Jul 30 00:02:27.209649 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:27.209630    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:02:27.209759 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:27.209720    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lj2rz" podUID="47b042b2-e9c2-45fd-ae41-9608eaf6aa4d"
Jul 30 00:02:27.209825 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:27.209789    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:27.209947 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:27.209929    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmsc5" podUID="fefc207e-2848-4204-b460-39c933e7b127"
Jul 30 00:02:28.209931 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:28.209621    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:02:28.210502 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:28.210024    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42d5" podUID="a702b669-744a-4c89-bf15-164d52f5f1d5"
Jul 30 00:02:28.331802 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:28.331778    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99qf7" event={"ID":"9e32819a-ea15-489b-b449-2a90e82f4516","Type":"ContainerStarted","Data":"e7c66055b72dfd5487e32530aa6c75e5a6e9cc5c3ce8dc3d5cafddcb045fa7fa"}
Jul 30 00:02:28.333185 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:28.333148    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pnbrq" event={"ID":"877bba44-0778-4142-b6f7-aa03eb30a724","Type":"ContainerStarted","Data":"93cd8dc581b4cb9462044a2994143ef88de2bb0395cee0a0f7bda63cb0f68ddb"}
Jul 30 00:02:28.335691 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:28.335673    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9cggv_c6b01a1f-c41e-4781-8c25-66b152e0d0e8/ovn-acl-logging/0.log"
Jul 30 00:02:28.336025 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:28.336001    2527 generic.go:356] "Generic (PLEG): container finished" podID="c6b01a1f-c41e-4781-8c25-66b152e0d0e8" containerID="bd47fe7b9fab5b59b779e5084257039aef2902f0b6d99f4e3e3a1152003712b2" exitCode=1
Jul 30 00:02:28.336123 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:28.336023    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9cggv" event={"ID":"c6b01a1f-c41e-4781-8c25-66b152e0d0e8","Type":"ContainerStarted","Data":"066db199d2eb8b9a4ac6fb42e1d4729a3d508f46acd23a7159e282aae374f5e7"}
Jul 30 00:02:28.336123 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:28.336083    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9cggv" event={"ID":"c6b01a1f-c41e-4781-8c25-66b152e0d0e8","Type":"ContainerStarted","Data":"f720d6232ba9dc54cff55f71b5707f466f2d369da3752c7f893a92ad50df7a6d"}
Jul 30 00:02:28.336268 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:28.336126    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9cggv" event={"ID":"c6b01a1f-c41e-4781-8c25-66b152e0d0e8","Type":"ContainerStarted","Data":"a1d4549643e40a0cfba743f8ca250ed02e8a8adc5dbf34e319b00efd83e23dd6"}
Jul 30 00:02:28.336268 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:28.336214    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9cggv" event={"ID":"c6b01a1f-c41e-4781-8c25-66b152e0d0e8","Type":"ContainerStarted","Data":"baa830ef59cda017cf6e2d337ae1f657673f56c8897738a816fcc9a62632aacc"}
Jul 30 00:02:28.336268 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:28.336244    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9cggv" event={"ID":"c6b01a1f-c41e-4781-8c25-66b152e0d0e8","Type":"ContainerDied","Data":"bd47fe7b9fab5b59b779e5084257039aef2902f0b6d99f4e3e3a1152003712b2"}
Jul 30 00:02:28.336392 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:28.336298    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9cggv" event={"ID":"c6b01a1f-c41e-4781-8c25-66b152e0d0e8","Type":"ContainerStarted","Data":"1cade1ca9b2f4a7193d71af8552bc2ec85abcc723d8ab42ad48de8eaea0da829"}
Jul 30 00:02:28.337438 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:28.337410    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hrw82" event={"ID":"1e354369-ec72-41b7-ac1d-679685596d1a","Type":"ContainerStarted","Data":"00e3244a4f2f7dc59cc242106bd3aa9395f63a5cc7c6e69fb59e70ce14437a7f"}
Jul 30 00:02:28.338660 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:28.338639    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2g9tl" event={"ID":"b0821896-954e-4d42-a259-11685665d109","Type":"ContainerStarted","Data":"c2c145c666eebbbad272228076be44470c3b99008e708291346e43b3c51d5d71"}
Jul 30 00:02:28.339815 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:28.339790    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tq4hc" event={"ID":"abd0f838-14de-4c5c-899a-8364a6084905","Type":"ContainerStarted","Data":"e2c5ce13917aec0278b2527b1a029659d7c8b87f53175e58dc05bdf9b31c6400"}
Jul 30 00:02:28.341081 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:28.341063    2527 generic.go:356] "Generic (PLEG): container finished" podID="6e3c15d8-57fd-413b-bc96-74ee9feb2f8b" containerID="d5149f181ff0746cb2d148ca93a7aa17d1d7d1254ce382ed3331fea97678c2c2" exitCode=0
Jul 30 00:02:28.341183 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:28.341082    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzqq8" event={"ID":"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b","Type":"ContainerDied","Data":"d5149f181ff0746cb2d148ca93a7aa17d1d7d1254ce382ed3331fea97678c2c2"}
Jul 30 00:02:28.342514 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:28.342492    2527 generic.go:356] "Generic (PLEG): container finished" podID="67d41482f2fb87a5260d58a8ce3d03fa" containerID="55fb2b4e2e68fb0421a49369ea2cf651c9fc18d60bd38ac6331c9d489fce4cac" exitCode=0
Jul 30 00:02:28.342612 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:28.342578    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal" event={"ID":"67d41482f2fb87a5260d58a8ce3d03fa","Type":"ContainerDied","Data":"55fb2b4e2e68fb0421a49369ea2cf651c9fc18d60bd38ac6331c9d489fce4cac"}
Jul 30 00:02:28.344070 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:28.344052    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-198.ec2.internal" event={"ID":"07e6b3dc508eb1747236dbb1b614bc57","Type":"ContainerStarted","Data":"58f3af9cb51ffac96e9954c78c9cee66fcc07af9aa463655a72e6fa37792f2b7"}
Jul 30 00:02:28.345454 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:28.345435    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rwkfx" event={"ID":"ee4035d2-1fba-4a57-ae6f-39b1010f098b","Type":"ContainerStarted","Data":"7d6e3542be979811dfeb0ef1b3c690eab9f83c5d862ea92088c9a30590138057"}
Jul 30 00:02:28.346248 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:28.346214    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pnbrq" podStartSLOduration=2.6069381590000003 podStartE2EDuration="22.346203553s" totalImagesPullingTime="19.739265394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:02:28.345795041 +0000 UTC m=+22.648243384" watchObservedRunningTime="2026-07-30 00:02:28.346203553 +0000 UTC m=+22.648651898"
Jul 30 00:02:28.378948 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:28.378912    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rwkfx" podStartSLOduration=2.274739068 podStartE2EDuration="22.37890195s" totalImagesPullingTime="20.104162882s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 00:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:02:28.378489001 +0000 UTC m=+22.680937346" watchObservedRunningTime="2026-07-30 00:02:28.37890195 +0000 UTC m=+22.681350296"
Jul 30 00:02:28.379116 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:28.379098    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2g9tl" podStartSLOduration=2.63456935 podStartE2EDuration="22.379093203s" totalImagesPullingTime="19.744523853s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 00:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:02:28.358237376 +0000 UTC m=+22.660685787" watchObservedRunningTime="2026-07-30 00:02:28.379093203 +0000 UTC m=+22.681541547"
Jul 30 00:02:28.394583 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:28.394357    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-198.ec2.internal" podStartSLOduration=21.394342984 podStartE2EDuration="21.394342984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 00:02:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:02:28.393871476 +0000 UTC m=+22.696319822" watchObservedRunningTime="2026-07-30 00:02:28.394342984 +0000 UTC m=+22.696791327"
Jul 30 00:02:28.410076 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:28.410045    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hrw82" podStartSLOduration=2.576292352 podStartE2EDuration="22.410034476s" totalImagesPullingTime="19.833742124s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 00:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:02:28.409971846 +0000 UTC m=+22.712420191" watchObservedRunningTime="2026-07-30 00:02:28.410034476 +0000 UTC m=+22.712482821"
Jul 30 00:02:28.423188 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:28.423135    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tq4hc" podStartSLOduration=2.652971098 podStartE2EDuration="22.423126046s" totalImagesPullingTime="19.770154948s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 00:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:02:28.423104221 +0000 UTC m=+22.725552566" watchObservedRunningTime="2026-07-30 00:02:28.423126046 +0000 UTC m=+22.725574391"
Jul 30 00:02:29.210152 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:29.210118    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:29.210152 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:29.210146    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:02:29.210654 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:29.210249    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmsc5" podUID="fefc207e-2848-4204-b460-39c933e7b127"
Jul 30 00:02:29.210654 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:29.210411    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lj2rz" podUID="47b042b2-e9c2-45fd-ae41-9608eaf6aa4d"
Jul 30 00:02:29.349883 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:29.349356    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal" event={"ID":"67d41482f2fb87a5260d58a8ce3d03fa","Type":"ContainerStarted","Data":"59695c6e950020066f776effee8446ea23753c87609efcc03fd25f969895fe90"}
Jul 30 00:02:29.353217 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:29.353129    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lw6v5" event={"ID":"3f0e8d05-2ec5-4cb3-b404-932d0fb6874c","Type":"ContainerStarted","Data":"db72b5b6633686f29c40f293eb4bbd5399c949a30ee015302257ecb59b34c36a"}
Jul 30 00:02:29.376079 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:29.376032    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lw6v5" podStartSLOduration=3.540787222 podStartE2EDuration="23.376014722s" totalImagesPullingTime="19.8352275s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 00:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-30 00:02:29.375957618 +0000 UTC m=+23.678405965" watchObservedRunningTime="2026-07-30 00:02:29.376014722 +0000 UTC m=+23.678463066"
Jul 30 00:02:29.376577 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:29.376546    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal" podStartSLOduration=22.376537938 podStartE2EDuration="22.376537938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 00:02:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:02:29.364095721 +0000 UTC m=+23.666544066" watchObservedRunningTime="2026-07-30 00:02:29.376537938 +0000 UTC m=+23.678986282"
Jul 30 00:02:29.453402 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:29.453369    2527 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 30 00:02:30.078673 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:30.078589    2527 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-30T00:02:29.453387065Z","UUID":"56f7be4e-862e-450a-809e-8609646743f3","Handler":null,"Name":"","Endpoint":""}
Jul 30 00:02:30.080664 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:30.080350    2527 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 30 00:02:30.080664 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:30.080389    2527 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 30 00:02:30.210410 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:30.210377    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:02:30.210849 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:30.210510    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42d5" podUID="a702b669-744a-4c89-bf15-164d52f5f1d5"
Jul 30 00:02:30.236062 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:30.235998    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pnbrq"
Jul 30 00:02:30.236515 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:30.236496    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pnbrq"
Jul 30 00:02:30.356957 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:30.356927    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99qf7" event={"ID":"9e32819a-ea15-489b-b449-2a90e82f4516","Type":"ContainerStarted","Data":"58aa017ce98a1bcd068ee368a3cd10783b404e6fe48a0707bd6c2da79e24eb78"}
Jul 30 00:02:30.360311 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:30.360282    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9cggv_c6b01a1f-c41e-4781-8c25-66b152e0d0e8/ovn-acl-logging/0.log"
Jul 30 00:02:30.360756 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:30.360734    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9cggv" event={"ID":"c6b01a1f-c41e-4781-8c25-66b152e0d0e8","Type":"ContainerStarted","Data":"fe40c11e474b988b7394c9fa13fd5f78b09fb1ec9d53f847ee822c91d8cd2d3f"}
Jul 30 00:02:30.361197 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:30.361139    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pnbrq"
Jul 30 00:02:30.361699 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:30.361684    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pnbrq"
Jul 30 00:02:31.209706 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:31.209681    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:31.209706 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:31.209698    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:02:31.209981 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:31.209795    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmsc5" podUID="fefc207e-2848-4204-b460-39c933e7b127"
Jul 30 00:02:31.209981 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:31.209935    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lj2rz" podUID="47b042b2-e9c2-45fd-ae41-9608eaf6aa4d"
Jul 30 00:02:31.365513 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:31.365472    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99qf7" event={"ID":"9e32819a-ea15-489b-b449-2a90e82f4516","Type":"ContainerStarted","Data":"efbd1eae7b3c63a12f0233a6ead9585b332e2c3da1d06662258afa12d579f966"}
Jul 30 00:02:31.381032 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:31.380994    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99qf7" podStartSLOduration=3.002408355 podStartE2EDuration="25.380975566s" totalImagesPullingTime="22.378567211s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 00:02:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:02:31.380765326 +0000 UTC m=+25.683213694" watchObservedRunningTime="2026-07-30 00:02:31.380975566 +0000 UTC m=+25.683423910"
Jul 30 00:02:32.210001 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:32.209967    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:02:32.210179 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:32.210083    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42d5" podUID="a702b669-744a-4c89-bf15-164d52f5f1d5"
Jul 30 00:02:33.210231 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:33.210049    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:02:33.211042 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:33.210102    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:33.211042 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:33.210687    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lj2rz" podUID="47b042b2-e9c2-45fd-ae41-9608eaf6aa4d"
Jul 30 00:02:33.212915 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:33.211289    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmsc5" podUID="fefc207e-2848-4204-b460-39c933e7b127"
Jul 30 00:02:33.371211 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:33.371191    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9cggv_c6b01a1f-c41e-4781-8c25-66b152e0d0e8/ovn-acl-logging/0.log"
Jul 30 00:02:33.371526 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:33.371506    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9cggv" event={"ID":"c6b01a1f-c41e-4781-8c25-66b152e0d0e8","Type":"ContainerStarted","Data":"4f13d6df49919001fb77defb9cf7d926ac6abeaa14906619353ceac0b983f4a1"}
Jul 30 00:02:33.371734 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:33.371709    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:33.371816 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:33.371759    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:33.371911 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:33.371893    2527 scope.go:117] "RemoveContainer" containerID="bd47fe7b9fab5b59b779e5084257039aef2902f0b6d99f4e3e3a1152003712b2"
Jul 30 00:02:33.373336 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:33.373310    2527 generic.go:356] "Generic (PLEG): container finished" podID="6e3c15d8-57fd-413b-bc96-74ee9feb2f8b" containerID="5a49279db68521dea3c98c77cb53b1f24e962d2f60798529741d8a9e2a441b00" exitCode=0
Jul 30 00:02:33.373448 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:33.373356    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzqq8" event={"ID":"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b","Type":"ContainerDied","Data":"5a49279db68521dea3c98c77cb53b1f24e962d2f60798529741d8a9e2a441b00"}
Jul 30 00:02:33.387307 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:33.387291    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:34.210692 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:34.210547    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:02:34.210998 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:34.210777    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42d5" podUID="a702b669-744a-4c89-bf15-164d52f5f1d5"
Jul 30 00:02:34.377976 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:34.377946    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tmsc5"]
Jul 30 00:02:34.378127 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:34.378036    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:34.378127 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:34.378110    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmsc5" podUID="fefc207e-2848-4204-b460-39c933e7b127"
Jul 30 00:02:34.381013 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:34.380935    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h42d5"]
Jul 30 00:02:34.381734 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:34.381714    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lj2rz"]
Jul 30 00:02:34.381840 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:34.381723    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9cggv_c6b01a1f-c41e-4781-8c25-66b152e0d0e8/ovn-acl-logging/0.log"
Jul 30 00:02:34.381840 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:34.381815    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:02:34.381991 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:34.381953    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lj2rz" podUID="47b042b2-e9c2-45fd-ae41-9608eaf6aa4d"
Jul 30 00:02:34.382713 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:34.382695    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:02:34.382804 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:34.382782    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42d5" podUID="a702b669-744a-4c89-bf15-164d52f5f1d5"
Jul 30 00:02:34.383225 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:34.383203    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9cggv" event={"ID":"c6b01a1f-c41e-4781-8c25-66b152e0d0e8","Type":"ContainerStarted","Data":"da55f5ad04ba112cd0ca9116387c5fbe9bfa11661514c32002eb409c428f86e5"}
Jul 30 00:02:34.383312 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:34.383290    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:34.400898 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:34.400851    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:02:34.407937 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:34.407894    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9cggv" podStartSLOduration=8.570292079 podStartE2EDuration="28.407882687s" totalImagesPullingTime="19.837590608s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 00:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:02:34.406932193 +0000 UTC m=+28.709380538" watchObservedRunningTime="2026-07-30 00:02:34.407882687 +0000 UTC m=+28.710331021"
Jul 30 00:02:36.211260 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:36.210715    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:36.211260 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:36.210718    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:02:36.211260 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:36.210848    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmsc5" podUID="fefc207e-2848-4204-b460-39c933e7b127"
Jul 30 00:02:36.211260 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:36.210857    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:02:36.211260 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:36.210951    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lj2rz" podUID="47b042b2-e9c2-45fd-ae41-9608eaf6aa4d"
Jul 30 00:02:36.211260 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:36.211027    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42d5" podUID="a702b669-744a-4c89-bf15-164d52f5f1d5"
Jul 30 00:02:36.388555 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:36.388525    2527 generic.go:356] "Generic (PLEG): container finished" podID="6e3c15d8-57fd-413b-bc96-74ee9feb2f8b" containerID="ffc6f4126585bb2d840818604331d4f371e4a8a7f3529e43ec087554d1ac0a81" exitCode=0
Jul 30 00:02:36.388686 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:36.388608    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzqq8" event={"ID":"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b","Type":"ContainerDied","Data":"ffc6f4126585bb2d840818604331d4f371e4a8a7f3529e43ec087554d1ac0a81"}
Jul 30 00:02:37.392329 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:37.392119    2527 generic.go:356] "Generic (PLEG): container finished" podID="6e3c15d8-57fd-413b-bc96-74ee9feb2f8b" containerID="03164c270ca59ed8bffee1979720b022a1d372bb644c41846e3dfc6165a04f65" exitCode=0
Jul 30 00:02:37.392329 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:37.392191    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzqq8" event={"ID":"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b","Type":"ContainerDied","Data":"03164c270ca59ed8bffee1979720b022a1d372bb644c41846e3dfc6165a04f65"}
Jul 30 00:02:38.210372 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:38.210350    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:02:38.210521 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:38.210355    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:38.210521 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:38.210478    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lj2rz" podUID="47b042b2-e9c2-45fd-ae41-9608eaf6aa4d"
Jul 30 00:02:38.210630 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:38.210355    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:02:38.210630 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:38.210559    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmsc5" podUID="fefc207e-2848-4204-b460-39c933e7b127"
Jul 30 00:02:38.210715 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:38.210623    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h42d5" podUID="a702b669-744a-4c89-bf15-164d52f5f1d5"
Jul 30 00:02:38.768838 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:38.768805    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb5rx\" (UniqueName: \"kubernetes.io/projected/a702b669-744a-4c89-bf15-164d52f5f1d5-kube-api-access-bb5rx\") pod \"network-check-target-h42d5\" (UID: \"a702b669-744a-4c89-bf15-164d52f5f1d5\") " pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:02:38.769277 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:38.768866    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fefc207e-2848-4204-b460-39c933e7b127-original-pull-secret\") pod \"global-pull-secret-syncer-tmsc5\" (UID: \"fefc207e-2848-4204-b460-39c933e7b127\") " pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:38.769277 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:38.768969    2527 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 00:02:38.769277 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:38.768994    2527 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 00:02:38.769277 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:38.769007    2527 projected.go:196] Error preparing data for projected volume kube-api-access-bb5rx for pod openshift-network-diagnostics/network-check-target-h42d5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 00:02:38.769277 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:38.769012    2527 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 00:02:38.769277 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:38.769068    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a702b669-744a-4c89-bf15-164d52f5f1d5-kube-api-access-bb5rx podName:a702b669-744a-4c89-bf15-164d52f5f1d5 nodeName:}" failed. No retries permitted until 2026-07-30 00:03:10.769050646 +0000 UTC m=+65.071498982 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bb5rx" (UniqueName: "kubernetes.io/projected/a702b669-744a-4c89-bf15-164d52f5f1d5-kube-api-access-bb5rx") pod "network-check-target-h42d5" (UID: "a702b669-744a-4c89-bf15-164d52f5f1d5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 00:02:38.769277 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:38.769087    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fefc207e-2848-4204-b460-39c933e7b127-original-pull-secret podName:fefc207e-2848-4204-b460-39c933e7b127 nodeName:}" failed. No retries permitted until 2026-07-30 00:03:10.769077624 +0000 UTC m=+65.071525951 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fefc207e-2848-4204-b460-39c933e7b127-original-pull-secret") pod "global-pull-secret-syncer-tmsc5" (UID: "fefc207e-2848-4204-b460-39c933e7b127") : object "kube-system"/"original-pull-secret" not registered
Jul 30 00:02:38.870018 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:38.869990    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs\") pod \"network-metrics-daemon-lj2rz\" (UID: \"47b042b2-e9c2-45fd-ae41-9608eaf6aa4d\") " pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:02:38.870207 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:38.870122    2527 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 00:02:38.870207 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:38.870197    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs podName:47b042b2-e9c2-45fd-ae41-9608eaf6aa4d nodeName:}" failed. No retries permitted until 2026-07-30 00:03:10.870178418 +0000 UTC m=+65.172626742 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs") pod "network-metrics-daemon-lj2rz" (UID: "47b042b2-e9c2-45fd-ae41-9608eaf6aa4d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 00:02:40.009660 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.009638    2527 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeReady"
Jul 30 00:02:40.009995 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.009747    2527 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 30 00:02:40.049019 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.048997    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jvbw8"]
Jul 30 00:02:40.051008 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.050981    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jvbw8"
Jul 30 00:02:40.051556 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.051532    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2kfjd"]
Jul 30 00:02:40.053130 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.053110    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 30 00:02:40.053251 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.053148    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nxhcc\""
Jul 30 00:02:40.053251 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.053148    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 30 00:02:40.053368 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.053268    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2kfjd"
Jul 30 00:02:40.055583 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.055551    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 30 00:02:40.055583 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.055577    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 30 00:02:40.055804 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.055788    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 30 00:02:40.055869 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.055791    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-559dl\""
Jul 30 00:02:40.060944 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.060922    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jvbw8"]
Jul 30 00:02:40.063465 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.063444    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2kfjd"]
Jul 30 00:02:40.179214 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.179183    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-tmp-dir\") pod \"dns-default-jvbw8\" (UID: \"ac196c9d-ff1e-4ed5-a85a-80ba51fa9819\") " pod="openshift-dns/dns-default-jvbw8"
Jul 30 00:02:40.179342 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.179238    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-metrics-tls\") pod \"dns-default-jvbw8\" (UID: \"ac196c9d-ff1e-4ed5-a85a-80ba51fa9819\") " pod="openshift-dns/dns-default-jvbw8"
Jul 30 00:02:40.179342 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.179306    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5xsv\" (UniqueName: \"kubernetes.io/projected/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-kube-api-access-z5xsv\") pod \"dns-default-jvbw8\" (UID: \"ac196c9d-ff1e-4ed5-a85a-80ba51fa9819\") " pod="openshift-dns/dns-default-jvbw8"
Jul 30 00:02:40.179342 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.179332    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/581ec3fe-74ca-4046-ba10-3ff893cd16a5-cert\") pod \"ingress-canary-2kfjd\" (UID: \"581ec3fe-74ca-4046-ba10-3ff893cd16a5\") " pod="openshift-ingress-canary/ingress-canary-2kfjd"
Jul 30 00:02:40.179475 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.179357    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9cld\" (UniqueName: \"kubernetes.io/projected/581ec3fe-74ca-4046-ba10-3ff893cd16a5-kube-api-access-w9cld\") pod \"ingress-canary-2kfjd\" (UID: \"581ec3fe-74ca-4046-ba10-3ff893cd16a5\") " pod="openshift-ingress-canary/ingress-canary-2kfjd"
Jul 30 00:02:40.179475 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.179382    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-config-volume\") pod \"dns-default-jvbw8\" (UID: \"ac196c9d-ff1e-4ed5-a85a-80ba51fa9819\") " pod="openshift-dns/dns-default-jvbw8"
Jul 30 00:02:40.210502 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.210401    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:02:40.210502 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.210401    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:02:40.210676 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.210524    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:02:40.212752 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.212721    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 00:02:40.212921 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.212906    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 00:02:40.212999 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.212979    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p64v7\""
Jul 30 00:02:40.213068 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.213053    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 00:02:40.213119 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.213106    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 00:02:40.213193 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.213175    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qpk4b\""
Jul 30 00:02:40.280071 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.280051    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-tmp-dir\") pod \"dns-default-jvbw8\" (UID: \"ac196c9d-ff1e-4ed5-a85a-80ba51fa9819\") " pod="openshift-dns/dns-default-jvbw8"
Jul 30 00:02:40.280208 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.280095    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-metrics-tls\") pod \"dns-default-jvbw8\" (UID: \"ac196c9d-ff1e-4ed5-a85a-80ba51fa9819\") " pod="openshift-dns/dns-default-jvbw8"
Jul 30 00:02:40.280208 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.280121    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5xsv\" (UniqueName: \"kubernetes.io/projected/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-kube-api-access-z5xsv\") pod \"dns-default-jvbw8\" (UID: \"ac196c9d-ff1e-4ed5-a85a-80ba51fa9819\") " pod="openshift-dns/dns-default-jvbw8"
Jul 30 00:02:40.280329 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:40.280245    2527 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 00:02:40.280329 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:40.280313    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-metrics-tls podName:ac196c9d-ff1e-4ed5-a85a-80ba51fa9819 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:40.780292505 +0000 UTC m=+35.082741044 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-metrics-tls") pod "dns-default-jvbw8" (UID: "ac196c9d-ff1e-4ed5-a85a-80ba51fa9819") : secret "dns-default-metrics-tls" not found
Jul 30 00:02:40.280440 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.280366    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/581ec3fe-74ca-4046-ba10-3ff893cd16a5-cert\") pod \"ingress-canary-2kfjd\" (UID: \"581ec3fe-74ca-4046-ba10-3ff893cd16a5\") " pod="openshift-ingress-canary/ingress-canary-2kfjd"
Jul 30 00:02:40.280440 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.280396    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9cld\" (UniqueName: \"kubernetes.io/projected/581ec3fe-74ca-4046-ba10-3ff893cd16a5-kube-api-access-w9cld\") pod \"ingress-canary-2kfjd\" (UID: \"581ec3fe-74ca-4046-ba10-3ff893cd16a5\") " pod="openshift-ingress-canary/ingress-canary-2kfjd"
Jul 30 00:02:40.280540 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.280418    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-config-volume\") pod \"dns-default-jvbw8\" (UID: \"ac196c9d-ff1e-4ed5-a85a-80ba51fa9819\") " pod="openshift-dns/dns-default-jvbw8"
Jul 30 00:02:40.280590 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.280570    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-tmp-dir\") pod \"dns-default-jvbw8\" (UID: \"ac196c9d-ff1e-4ed5-a85a-80ba51fa9819\") " pod="openshift-dns/dns-default-jvbw8"
Jul 30 00:02:40.280974 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.280949    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-config-volume\") pod \"dns-default-jvbw8\" (UID: \"ac196c9d-ff1e-4ed5-a85a-80ba51fa9819\") " pod="openshift-dns/dns-default-jvbw8"
Jul 30 00:02:40.284797 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.284780    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/581ec3fe-74ca-4046-ba10-3ff893cd16a5-cert\") pod \"ingress-canary-2kfjd\" (UID: \"581ec3fe-74ca-4046-ba10-3ff893cd16a5\") " pod="openshift-ingress-canary/ingress-canary-2kfjd"
Jul 30 00:02:40.288186 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.288051    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5xsv\" (UniqueName: \"kubernetes.io/projected/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-kube-api-access-z5xsv\") pod \"dns-default-jvbw8\" (UID: \"ac196c9d-ff1e-4ed5-a85a-80ba51fa9819\") " pod="openshift-dns/dns-default-jvbw8"
Jul 30 00:02:40.288438 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.288420    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9cld\" (UniqueName: \"kubernetes.io/projected/581ec3fe-74ca-4046-ba10-3ff893cd16a5-kube-api-access-w9cld\") pod \"ingress-canary-2kfjd\" (UID: \"581ec3fe-74ca-4046-ba10-3ff893cd16a5\") " pod="openshift-ingress-canary/ingress-canary-2kfjd"
Jul 30 00:02:40.368476 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.368444    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2kfjd"
Jul 30 00:02:40.783946 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:40.783910    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-metrics-tls\") pod \"dns-default-jvbw8\" (UID: \"ac196c9d-ff1e-4ed5-a85a-80ba51fa9819\") " pod="openshift-dns/dns-default-jvbw8"
Jul 30 00:02:40.784112 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:40.784034    2527 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 00:02:40.784112 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:40.784102    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-metrics-tls podName:ac196c9d-ff1e-4ed5-a85a-80ba51fa9819 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:41.78408285 +0000 UTC m=+36.086531197 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-metrics-tls") pod "dns-default-jvbw8" (UID: "ac196c9d-ff1e-4ed5-a85a-80ba51fa9819") : secret "dns-default-metrics-tls" not found
Jul 30 00:02:41.790952 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:41.790907    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-metrics-tls\") pod \"dns-default-jvbw8\" (UID: \"ac196c9d-ff1e-4ed5-a85a-80ba51fa9819\") " pod="openshift-dns/dns-default-jvbw8"
Jul 30 00:02:41.791626 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:41.791083    2527 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 00:02:41.791626 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:41.791142    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-metrics-tls podName:ac196c9d-ff1e-4ed5-a85a-80ba51fa9819 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:43.791127237 +0000 UTC m=+38.093575560 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-metrics-tls") pod "dns-default-jvbw8" (UID: "ac196c9d-ff1e-4ed5-a85a-80ba51fa9819") : secret "dns-default-metrics-tls" not found
Jul 30 00:02:41.942460 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:41.942346    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2kfjd"]
Jul 30 00:02:41.945843 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:02:41.945814    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod581ec3fe_74ca_4046_ba10_3ff893cd16a5.slice/crio-f8ad18eb082b980201cac823c2d1a67df8853815b4dfa5d18089e31615470ede WatchSource:0}: Error finding container f8ad18eb082b980201cac823c2d1a67df8853815b4dfa5d18089e31615470ede: Status 404 returned error can't find the container with id f8ad18eb082b980201cac823c2d1a67df8853815b4dfa5d18089e31615470ede
Jul 30 00:02:42.405479 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:42.405404    2527 generic.go:356] "Generic (PLEG): container finished" podID="6e3c15d8-57fd-413b-bc96-74ee9feb2f8b" containerID="42cfe9dd0456f82f96ca825b6578eabe939112cb85042f9ef68870771203b79d" exitCode=0
Jul 30 00:02:42.405610 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:42.405480    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzqq8" event={"ID":"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b","Type":"ContainerDied","Data":"42cfe9dd0456f82f96ca825b6578eabe939112cb85042f9ef68870771203b79d"}
Jul 30 00:02:42.406514 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:42.406491    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2kfjd" event={"ID":"581ec3fe-74ca-4046-ba10-3ff893cd16a5","Type":"ContainerStarted","Data":"f8ad18eb082b980201cac823c2d1a67df8853815b4dfa5d18089e31615470ede"}
Jul 30 00:02:43.412805 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:43.412772    2527 generic.go:356] "Generic (PLEG): container finished" podID="6e3c15d8-57fd-413b-bc96-74ee9feb2f8b" containerID="db300326ec7a096a597b4008f083108d0a74499afa7b16dabbb2015713e7bcc2" exitCode=0
Jul 30 00:02:43.413388 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:43.412844    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzqq8" event={"ID":"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b","Type":"ContainerDied","Data":"db300326ec7a096a597b4008f083108d0a74499afa7b16dabbb2015713e7bcc2"}
Jul 30 00:02:43.805679 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:43.805649    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-metrics-tls\") pod \"dns-default-jvbw8\" (UID: \"ac196c9d-ff1e-4ed5-a85a-80ba51fa9819\") " pod="openshift-dns/dns-default-jvbw8"
Jul 30 00:02:43.805841 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:43.805770    2527 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 00:02:43.805841 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:43.805823    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-metrics-tls podName:ac196c9d-ff1e-4ed5-a85a-80ba51fa9819 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:47.805810623 +0000 UTC m=+42.108258946 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-metrics-tls") pod "dns-default-jvbw8" (UID: "ac196c9d-ff1e-4ed5-a85a-80ba51fa9819") : secret "dns-default-metrics-tls" not found
Jul 30 00:02:44.420351 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:44.420308    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzqq8" event={"ID":"6e3c15d8-57fd-413b-bc96-74ee9feb2f8b","Type":"ContainerStarted","Data":"3c6d2499c4ede52f99a3769659e5c8bc93255510f12365489b664164a835eb81"}
Jul 30 00:02:44.440689 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:44.440640    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kzqq8" podStartSLOduration=7.537775686 podStartE2EDuration="38.440625004s" totalImagesPullingTime="30.902849318s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 00:02:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:02:44.43908042 +0000 UTC m=+38.741528765" watchObservedRunningTime="2026-07-30 00:02:44.440625004 +0000 UTC m=+38.743073361"
Jul 30 00:02:45.423878 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:45.423845    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2kfjd" event={"ID":"581ec3fe-74ca-4046-ba10-3ff893cd16a5","Type":"ContainerStarted","Data":"69e65c6e202bedee88abaa512759d27e27929b1071ef0a7a01872620527e60ba"}
Jul 30 00:02:45.438264 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:45.438221    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2kfjd" podStartSLOduration=2.66358455 podStartE2EDuration="5.438209867s" totalImagesPullingTime="2.774625317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:02:45.438085536 +0000 UTC m=+39.740533880" watchObservedRunningTime="2026-07-30 00:02:45.438209867 +0000 UTC m=+39.740658205"
Jul 30 00:02:47.832622 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:47.832586    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-metrics-tls\") pod \"dns-default-jvbw8\" (UID: \"ac196c9d-ff1e-4ed5-a85a-80ba51fa9819\") " pod="openshift-dns/dns-default-jvbw8"
Jul 30 00:02:47.832958 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:47.832703    2527 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 00:02:47.832958 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:47.832756    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-metrics-tls podName:ac196c9d-ff1e-4ed5-a85a-80ba51fa9819 nodeName:}" failed. No retries permitted until 2026-07-30 00:02:55.832741182 +0000 UTC m=+50.135189505 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-metrics-tls") pod "dns-default-jvbw8" (UID: "ac196c9d-ff1e-4ed5-a85a-80ba51fa9819") : secret "dns-default-metrics-tls" not found
Jul 30 00:02:55.881402 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:02:55.881368    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-metrics-tls\") pod \"dns-default-jvbw8\" (UID: \"ac196c9d-ff1e-4ed5-a85a-80ba51fa9819\") " pod="openshift-dns/dns-default-jvbw8"
Jul 30 00:02:55.881861 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:55.881468    2527 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 00:02:55.881861 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:02:55.881517    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-metrics-tls podName:ac196c9d-ff1e-4ed5-a85a-80ba51fa9819 nodeName:}" failed. No retries permitted until 2026-07-30 00:03:11.881504964 +0000 UTC m=+66.183953286 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-metrics-tls") pod "dns-default-jvbw8" (UID: "ac196c9d-ff1e-4ed5-a85a-80ba51fa9819") : secret "dns-default-metrics-tls" not found
Jul 30 00:03:06.407260 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:06.407231    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9cggv"
Jul 30 00:03:10.780934 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:10.780891    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb5rx\" (UniqueName: \"kubernetes.io/projected/a702b669-744a-4c89-bf15-164d52f5f1d5-kube-api-access-bb5rx\") pod \"network-check-target-h42d5\" (UID: \"a702b669-744a-4c89-bf15-164d52f5f1d5\") " pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:03:10.780934 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:10.780941    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fefc207e-2848-4204-b460-39c933e7b127-original-pull-secret\") pod \"global-pull-secret-syncer-tmsc5\" (UID: \"fefc207e-2848-4204-b460-39c933e7b127\") " pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:03:10.783333 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:10.783317    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 00:03:10.783391 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:10.783319    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 00:03:10.793088 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:10.793066    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 00:03:10.794625 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:10.794607    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fefc207e-2848-4204-b460-39c933e7b127-original-pull-secret\") pod \"global-pull-secret-syncer-tmsc5\" (UID: \"fefc207e-2848-4204-b460-39c933e7b127\") " pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:03:10.803750 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:10.803730    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb5rx\" (UniqueName: \"kubernetes.io/projected/a702b669-744a-4c89-bf15-164d52f5f1d5-kube-api-access-bb5rx\") pod \"network-check-target-h42d5\" (UID: \"a702b669-744a-4c89-bf15-164d52f5f1d5\") " pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:03:10.822125 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:10.822104    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmsc5"
Jul 30 00:03:10.830946 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:10.830926    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p64v7\""
Jul 30 00:03:10.839016 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:10.838990    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:03:10.881775 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:10.881616    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs\") pod \"network-metrics-daemon-lj2rz\" (UID: \"47b042b2-e9c2-45fd-ae41-9608eaf6aa4d\") " pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:03:10.884104 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:10.883876    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 00:03:10.892012 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:03:10.891987    2527 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 30 00:03:10.892129 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:03:10.892092    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs podName:47b042b2-e9c2-45fd-ae41-9608eaf6aa4d nodeName:}" failed. No retries permitted until 2026-07-30 00:04:14.892069043 +0000 UTC m=+129.194517372 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs") pod "network-metrics-daemon-lj2rz" (UID: "47b042b2-e9c2-45fd-ae41-9608eaf6aa4d") : secret "metrics-daemon-secret" not found
Jul 30 00:03:10.946264 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:10.946021    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tmsc5"]
Jul 30 00:03:10.950909 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:03:10.950884    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfefc207e_2848_4204_b460_39c933e7b127.slice/crio-b6df8fed8a5008971aaf0da0580c8b93b1aa918384b02059d09143ffd0fcffd5 WatchSource:0}: Error finding container b6df8fed8a5008971aaf0da0580c8b93b1aa918384b02059d09143ffd0fcffd5: Status 404 returned error can't find the container with id b6df8fed8a5008971aaf0da0580c8b93b1aa918384b02059d09143ffd0fcffd5
Jul 30 00:03:10.967262 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:10.967218    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h42d5"]
Jul 30 00:03:10.969816 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:03:10.969796    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda702b669_744a_4c89_bf15_164d52f5f1d5.slice/crio-dd4c79b7dfd259f53639b0a8572939645edd8392285a27e195d9f5c8986d12a9 WatchSource:0}: Error finding container dd4c79b7dfd259f53639b0a8572939645edd8392285a27e195d9f5c8986d12a9: Status 404 returned error can't find the container with id dd4c79b7dfd259f53639b0a8572939645edd8392285a27e195d9f5c8986d12a9
Jul 30 00:03:11.479675 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:11.479610    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h42d5" event={"ID":"a702b669-744a-4c89-bf15-164d52f5f1d5","Type":"ContainerStarted","Data":"dd4c79b7dfd259f53639b0a8572939645edd8392285a27e195d9f5c8986d12a9"}
Jul 30 00:03:11.480983 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:11.480953    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tmsc5" event={"ID":"fefc207e-2848-4204-b460-39c933e7b127","Type":"ContainerStarted","Data":"b6df8fed8a5008971aaf0da0580c8b93b1aa918384b02059d09143ffd0fcffd5"}
Jul 30 00:03:11.888243 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:11.888156    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-metrics-tls\") pod \"dns-default-jvbw8\" (UID: \"ac196c9d-ff1e-4ed5-a85a-80ba51fa9819\") " pod="openshift-dns/dns-default-jvbw8"
Jul 30 00:03:11.888609 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:03:11.888320    2527 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 00:03:11.888609 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:03:11.888391    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-metrics-tls podName:ac196c9d-ff1e-4ed5-a85a-80ba51fa9819 nodeName:}" failed. No retries permitted until 2026-07-30 00:03:43.888373185 +0000 UTC m=+98.190821507 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-metrics-tls") pod "dns-default-jvbw8" (UID: "ac196c9d-ff1e-4ed5-a85a-80ba51fa9819") : secret "dns-default-metrics-tls" not found
Jul 30 00:03:16.495314 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:16.495278    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h42d5" event={"ID":"a702b669-744a-4c89-bf15-164d52f5f1d5","Type":"ContainerStarted","Data":"545d1758ab3668ba7ae2698986419a889b80eaa376870ca1e87c40d1c36a3944"}
Jul 30 00:03:16.495702 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:16.495362    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:03:16.496600 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:16.496579    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tmsc5" event={"ID":"fefc207e-2848-4204-b460-39c933e7b127","Type":"ContainerStarted","Data":"7f72fd113b9f0a1edd1bc75861449d4b3dd6f50745a7404241a73b12ec11ca9e"}
Jul 30 00:03:16.509102 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:16.509061    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-h42d5" podStartSLOduration=65.89316471 podStartE2EDuration="1m10.509050574s" totalImagesPullingTime="4.615885864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:03:16.507757837 +0000 UTC m=+70.810206181" watchObservedRunningTime="2026-07-30 00:03:16.509050574 +0000 UTC m=+70.811498927"
Jul 30 00:03:16.520816 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:16.520777    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tmsc5" podStartSLOduration=65.881291194 podStartE2EDuration="1m10.52076563s" totalImagesPullingTime="4.639474436s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 00:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:03:16.520313267 +0000 UTC m=+70.822761613" watchObservedRunningTime="2026-07-30 00:03:16.52076563 +0000 UTC m=+70.823213973"
Jul 30 00:03:31.533488 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:31.533393    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cfbf748b8-sgxqn"]
Jul 30 00:03:31.535559 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:31.535543    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cfbf748b8-sgxqn"
Jul 30 00:03:31.537847 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:31.537828    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 30 00:03:31.537847 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:31.537835    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-t642d\""
Jul 30 00:03:31.538342 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:31.538323    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 30 00:03:31.538681 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:31.538663    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 30 00:03:31.538763 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:31.538701    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 30 00:03:31.544871 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:31.544845    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cfbf748b8-sgxqn"]
Jul 30 00:03:31.706341 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:31.706301    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7nbl\" (UniqueName: \"kubernetes.io/projected/459008b7-33b4-468c-a9fd-f3904ae64bf4-kube-api-access-l7nbl\") pod \"managed-serviceaccount-addon-agent-cfbf748b8-sgxqn\" (UID: \"459008b7-33b4-468c-a9fd-f3904ae64bf4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cfbf748b8-sgxqn"
Jul 30 00:03:31.706491 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:31.706358    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/459008b7-33b4-468c-a9fd-f3904ae64bf4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-cfbf748b8-sgxqn\" (UID: \"459008b7-33b4-468c-a9fd-f3904ae64bf4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cfbf748b8-sgxqn"
Jul 30 00:03:31.807050 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:31.806991    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7nbl\" (UniqueName: \"kubernetes.io/projected/459008b7-33b4-468c-a9fd-f3904ae64bf4-kube-api-access-l7nbl\") pod \"managed-serviceaccount-addon-agent-cfbf748b8-sgxqn\" (UID: \"459008b7-33b4-468c-a9fd-f3904ae64bf4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cfbf748b8-sgxqn"
Jul 30 00:03:31.807050 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:31.807038    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/459008b7-33b4-468c-a9fd-f3904ae64bf4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-cfbf748b8-sgxqn\" (UID: \"459008b7-33b4-468c-a9fd-f3904ae64bf4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cfbf748b8-sgxqn"
Jul 30 00:03:31.809450 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:31.809431    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/459008b7-33b4-468c-a9fd-f3904ae64bf4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-cfbf748b8-sgxqn\" (UID: \"459008b7-33b4-468c-a9fd-f3904ae64bf4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cfbf748b8-sgxqn"
Jul 30 00:03:31.814075 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:31.814054    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7nbl\" (UniqueName: \"kubernetes.io/projected/459008b7-33b4-468c-a9fd-f3904ae64bf4-kube-api-access-l7nbl\") pod \"managed-serviceaccount-addon-agent-cfbf748b8-sgxqn\" (UID: \"459008b7-33b4-468c-a9fd-f3904ae64bf4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cfbf748b8-sgxqn"
Jul 30 00:03:31.853937 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:31.853912    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cfbf748b8-sgxqn"
Jul 30 00:03:31.967638 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:31.967611    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cfbf748b8-sgxqn"]
Jul 30 00:03:31.973464 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:03:31.973434    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod459008b7_33b4_468c_a9fd_f3904ae64bf4.slice/crio-4baf24c3246d35048156203df16ed39e16dffd410fc9d6981495bc9cefe32c19 WatchSource:0}: Error finding container 4baf24c3246d35048156203df16ed39e16dffd410fc9d6981495bc9cefe32c19: Status 404 returned error can't find the container with id 4baf24c3246d35048156203df16ed39e16dffd410fc9d6981495bc9cefe32c19
Jul 30 00:03:32.532633 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:32.532600    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cfbf748b8-sgxqn" event={"ID":"459008b7-33b4-468c-a9fd-f3904ae64bf4","Type":"ContainerStarted","Data":"4baf24c3246d35048156203df16ed39e16dffd410fc9d6981495bc9cefe32c19"}
Jul 30 00:03:35.541638 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:35.541608    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cfbf748b8-sgxqn" event={"ID":"459008b7-33b4-468c-a9fd-f3904ae64bf4","Type":"ContainerStarted","Data":"d91dc653959225a88a2424c270f72ef0d8dfd2726b5c62383eed143eacfd5b61"}
Jul 30 00:03:35.556261 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:35.556221    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cfbf748b8-sgxqn" podStartSLOduration=1.9415501229999999 podStartE2EDuration="4.556205838s" totalImagesPullingTime="2.614655715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:03:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:03:35.554687233 +0000 UTC m=+89.857135577" watchObservedRunningTime="2026-07-30 00:03:35.556205838 +0000 UTC m=+89.858654183"
Jul 30 00:03:43.982759 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:43.982733    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-metrics-tls\") pod \"dns-default-jvbw8\" (UID: \"ac196c9d-ff1e-4ed5-a85a-80ba51fa9819\") " pod="openshift-dns/dns-default-jvbw8"
Jul 30 00:03:43.983002 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:03:43.982838    2527 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 00:03:43.983002 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:03:43.982893    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-metrics-tls podName:ac196c9d-ff1e-4ed5-a85a-80ba51fa9819 nodeName:}" failed. No retries permitted until 2026-07-30 00:04:47.982880614 +0000 UTC m=+162.285328936 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-metrics-tls") pod "dns-default-jvbw8" (UID: "ac196c9d-ff1e-4ed5-a85a-80ba51fa9819") : secret "dns-default-metrics-tls" not found
Jul 30 00:03:47.501372 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:03:47.501346    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-h42d5"
Jul 30 00:04:14.981389 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:04:14.981353    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs\") pod \"network-metrics-daemon-lj2rz\" (UID: \"47b042b2-e9c2-45fd-ae41-9608eaf6aa4d\") " pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:04:14.981832 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:04:14.981470    2527 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 30 00:04:14.981832 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:04:14.981523    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs podName:47b042b2-e9c2-45fd-ae41-9608eaf6aa4d nodeName:}" failed. No retries permitted until 2026-07-30 00:06:16.981509977 +0000 UTC m=+251.283958299 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs") pod "network-metrics-daemon-lj2rz" (UID: "47b042b2-e9c2-45fd-ae41-9608eaf6aa4d") : secret "metrics-daemon-secret" not found
Jul 30 00:04:43.062325 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:04:43.062285    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jvbw8" podUID="ac196c9d-ff1e-4ed5-a85a-80ba51fa9819"
Jul 30 00:04:43.234038 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:04:43.234008    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-lj2rz" podUID="47b042b2-e9c2-45fd-ae41-9608eaf6aa4d"
Jul 30 00:04:43.691597 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:04:43.691573    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jvbw8"
Jul 30 00:04:47.987605 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:04:47.987560    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-metrics-tls\") pod \"dns-default-jvbw8\" (UID: \"ac196c9d-ff1e-4ed5-a85a-80ba51fa9819\") " pod="openshift-dns/dns-default-jvbw8"
Jul 30 00:04:47.987975 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:04:47.987674    2527 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 00:04:47.987975 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:04:47.987724    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-metrics-tls podName:ac196c9d-ff1e-4ed5-a85a-80ba51fa9819 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:49.987709316 +0000 UTC m=+284.290157639 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-metrics-tls") pod "dns-default-jvbw8" (UID: "ac196c9d-ff1e-4ed5-a85a-80ba51fa9819") : secret "dns-default-metrics-tls" not found
Jul 30 00:04:57.210446 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:04:57.210378    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:05:34.799804 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:05:34.799778    2527 generic.go:356] "Generic (PLEG): container finished" podID="459008b7-33b4-468c-a9fd-f3904ae64bf4" containerID="d91dc653959225a88a2424c270f72ef0d8dfd2726b5c62383eed143eacfd5b61" exitCode=255
Jul 30 00:05:34.800095 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:05:34.799810    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cfbf748b8-sgxqn" event={"ID":"459008b7-33b4-468c-a9fd-f3904ae64bf4","Type":"ContainerDied","Data":"d91dc653959225a88a2424c270f72ef0d8dfd2726b5c62383eed143eacfd5b61"}
Jul 30 00:05:34.805066 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:05:34.805050    2527 scope.go:117] "RemoveContainer" containerID="d91dc653959225a88a2424c270f72ef0d8dfd2726b5c62383eed143eacfd5b61"
Jul 30 00:05:35.804698 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:05:35.804666    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cfbf748b8-sgxqn" event={"ID":"459008b7-33b4-468c-a9fd-f3904ae64bf4","Type":"ContainerStarted","Data":"fd04faebd942e455c629bbd210a96921cb73bc149098d86df97a4ff5d7e2b6e0"}
Jul 30 00:06:15.085108 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.085078    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-gbjkc"]
Jul 30 00:06:15.087963 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.087949    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-gbjkc"
Jul 30 00:06:15.090416 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.090393    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 30 00:06:15.090600 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.090443    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 30 00:06:15.090600 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.090446    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-x25p7\""
Jul 30 00:06:15.091362 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.091338    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 30 00:06:15.091607 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.091588    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 30 00:06:15.092688 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.092669    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-fwpz8"]
Jul 30 00:06:15.096442 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.096427    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-44gpk"]
Jul 30 00:06:15.096550 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.096535    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-fwpz8"
Jul 30 00:06:15.098558 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.098537    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 30 00:06:15.099310 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.099294    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5d4699ff7f-xg2hr"]
Jul 30 00:06:15.099419 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.099403    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-44gpk"
Jul 30 00:06:15.099965 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.099921    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 30 00:06:15.099965 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.099938    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 30 00:06:15.099965 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.099948    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rq9t6\""
Jul 30 00:06:15.100134 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.099938    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 30 00:06:15.101742 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.101724    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 30 00:06:15.101917 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.101854    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 30 00:06:15.101987 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.101925    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 30 00:06:15.102132 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.102115    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-7g8w7\""
Jul 30 00:06:15.102257 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.102248    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-gbjkc"]
Jul 30 00:06:15.102375 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.102358    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:15.104085 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.104021    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-fwpz8"]
Jul 30 00:06:15.104714 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.104699    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 30 00:06:15.104714 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.104706    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 30 00:06:15.104927 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.104915    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 30 00:06:15.104998 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.104985    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-5f8jq\""
Jul 30 00:06:15.105053 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.104988    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 30 00:06:15.105285 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.105269    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 30 00:06:15.105367 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.105314    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 30 00:06:15.107543 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.107524    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-44gpk"]
Jul 30 00:06:15.110601 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.110581    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5d4699ff7f-xg2hr"]
Jul 30 00:06:15.185002 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.184964    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kk8nr"]
Jul 30 00:06:15.187866 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.187847    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-844b9fb84f-bdxmv"]
Jul 30 00:06:15.187992 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.187980    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kk8nr"
Jul 30 00:06:15.190135 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.190113    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 30 00:06:15.190135 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.190129    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 30 00:06:15.190463 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.190447    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 30 00:06:15.190547 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.190534    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-9nw4x\""
Jul 30 00:06:15.190625 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.190607    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:15.190997 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.190983    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 30 00:06:15.192656 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.192639    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pt2ls\""
Jul 30 00:06:15.192925 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.192906    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 30 00:06:15.193275 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.193259    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 30 00:06:15.193496 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.193477    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 30 00:06:15.198089 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.198068    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 30 00:06:15.198408 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.198393    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kk8nr"]
Jul 30 00:06:15.202000 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.201864    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-844b9fb84f-bdxmv"]
Jul 30 00:06:15.242553 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.242535    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/61402020-403f-44d7-ab55-7d01ccb8d185-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-gbjkc\" (UID: \"61402020-403f-44d7-ab55-7d01ccb8d185\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-gbjkc"
Jul 30 00:06:15.242644 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.242569    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/872d3ff4-c766-4f3b-8e98-4e622f016146-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-fwpz8\" (UID: \"872d3ff4-c766-4f3b-8e98-4e622f016146\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-fwpz8"
Jul 30 00:06:15.242644 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.242608    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e1d50049-e6de-4aa9-80fc-457a51653449-default-certificate\") pod \"router-default-5d4699ff7f-xg2hr\" (UID: \"e1d50049-e6de-4aa9-80fc-457a51653449\") " pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:15.242644 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.242635    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m99z6\" (UniqueName: \"kubernetes.io/projected/61402020-403f-44d7-ab55-7d01ccb8d185-kube-api-access-m99z6\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-gbjkc\" (UID: \"61402020-403f-44d7-ab55-7d01ccb8d185\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-gbjkc"
Jul 30 00:06:15.242752 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.242652    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c72nw\" (UniqueName: \"kubernetes.io/projected/6393983e-c75a-47a0-9f95-6738a80b257c-kube-api-access-c72nw\") pod \"cluster-samples-operator-6748489656-44gpk\" (UID: \"6393983e-c75a-47a0-9f95-6738a80b257c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-44gpk"
Jul 30 00:06:15.242752 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.242674    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46fsw\" (UniqueName: \"kubernetes.io/projected/872d3ff4-c766-4f3b-8e98-4e622f016146-kube-api-access-46fsw\") pod \"cluster-monitoring-operator-548b489cb8-fwpz8\" (UID: \"872d3ff4-c766-4f3b-8e98-4e622f016146\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-fwpz8"
Jul 30 00:06:15.242752 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.242695    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1d50049-e6de-4aa9-80fc-457a51653449-service-ca-bundle\") pod \"router-default-5d4699ff7f-xg2hr\" (UID: \"e1d50049-e6de-4aa9-80fc-457a51653449\") " pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:15.242752 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.242718    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e1d50049-e6de-4aa9-80fc-457a51653449-stats-auth\") pod \"router-default-5d4699ff7f-xg2hr\" (UID: \"e1d50049-e6de-4aa9-80fc-457a51653449\") " pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:15.242752 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.242736    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26lnq\" (UniqueName: \"kubernetes.io/projected/e1d50049-e6de-4aa9-80fc-457a51653449-kube-api-access-26lnq\") pod \"router-default-5d4699ff7f-xg2hr\" (UID: \"e1d50049-e6de-4aa9-80fc-457a51653449\") " pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:15.242919 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.242755    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/872d3ff4-c766-4f3b-8e98-4e622f016146-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-fwpz8\" (UID: \"872d3ff4-c766-4f3b-8e98-4e622f016146\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-fwpz8"
Jul 30 00:06:15.242919 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.242776    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1d50049-e6de-4aa9-80fc-457a51653449-metrics-certs\") pod \"router-default-5d4699ff7f-xg2hr\" (UID: \"e1d50049-e6de-4aa9-80fc-457a51653449\") " pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:15.242919 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.242830    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6393983e-c75a-47a0-9f95-6738a80b257c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-44gpk\" (UID: \"6393983e-c75a-47a0-9f95-6738a80b257c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-44gpk"
Jul 30 00:06:15.242919 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.242876    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/61402020-403f-44d7-ab55-7d01ccb8d185-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-gbjkc\" (UID: \"61402020-403f-44d7-ab55-7d01ccb8d185\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-gbjkc"
Jul 30 00:06:15.343283 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.343222    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlcxn\" (UniqueName: \"kubernetes.io/projected/2cc438b2-74db-4527-afb3-cfe578af038c-kube-api-access-dlcxn\") pod \"service-ca-operator-5d6c75f84f-kk8nr\" (UID: \"2cc438b2-74db-4527-afb3-cfe578af038c\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kk8nr"
Jul 30 00:06:15.343283 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.343261    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/872d3ff4-c766-4f3b-8e98-4e622f016146-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-fwpz8\" (UID: \"872d3ff4-c766-4f3b-8e98-4e622f016146\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-fwpz8"
Jul 30 00:06:15.343432 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.343289    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-registry-tls\") pod \"image-registry-844b9fb84f-bdxmv\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") " pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:15.343432 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.343315    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2cc438b2-74db-4527-afb3-cfe578af038c-config\") pod \"service-ca-operator-5d6c75f84f-kk8nr\" (UID: \"2cc438b2-74db-4527-afb3-cfe578af038c\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kk8nr"
Jul 30 00:06:15.343432 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.343342    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e1d50049-e6de-4aa9-80fc-457a51653449-default-certificate\") pod \"router-default-5d4699ff7f-xg2hr\" (UID: \"e1d50049-e6de-4aa9-80fc-457a51653449\") " pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:15.343432 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.343372    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddad1f6c-b733-47c2-a2ba-efc27c716416-trusted-ca\") pod \"image-registry-844b9fb84f-bdxmv\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") " pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:15.343432 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.343398    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-bound-sa-token\") pod \"image-registry-844b9fb84f-bdxmv\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") " pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:15.343432 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.343426    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46fsw\" (UniqueName: \"kubernetes.io/projected/872d3ff4-c766-4f3b-8e98-4e622f016146-kube-api-access-46fsw\") pod \"cluster-monitoring-operator-548b489cb8-fwpz8\" (UID: \"872d3ff4-c766-4f3b-8e98-4e622f016146\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-fwpz8"
Jul 30 00:06:15.343700 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.343450    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1d50049-e6de-4aa9-80fc-457a51653449-service-ca-bundle\") pod \"router-default-5d4699ff7f-xg2hr\" (UID: \"e1d50049-e6de-4aa9-80fc-457a51653449\") " pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:15.343700 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.343475    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26lnq\" (UniqueName: \"kubernetes.io/projected/e1d50049-e6de-4aa9-80fc-457a51653449-kube-api-access-26lnq\") pod \"router-default-5d4699ff7f-xg2hr\" (UID: \"e1d50049-e6de-4aa9-80fc-457a51653449\") " pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:15.343700 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.343524    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1d50049-e6de-4aa9-80fc-457a51653449-metrics-certs\") pod \"router-default-5d4699ff7f-xg2hr\" (UID: \"e1d50049-e6de-4aa9-80fc-457a51653449\") " pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:15.343700 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.343564    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwb86\" (UniqueName: \"kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-kube-api-access-xwb86\") pod \"image-registry-844b9fb84f-bdxmv\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") " pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:15.343700 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:15.343593    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e1d50049-e6de-4aa9-80fc-457a51653449-service-ca-bundle podName:e1d50049-e6de-4aa9-80fc-457a51653449 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:15.84357218 +0000 UTC m=+250.146020522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e1d50049-e6de-4aa9-80fc-457a51653449-service-ca-bundle") pod "router-default-5d4699ff7f-xg2hr" (UID: "e1d50049-e6de-4aa9-80fc-457a51653449") : configmap references non-existent config key: service-ca.crt
Jul 30 00:06:15.343700 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:15.343689    2527 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 00:06:15.343917 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:15.343736    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1d50049-e6de-4aa9-80fc-457a51653449-metrics-certs podName:e1d50049-e6de-4aa9-80fc-457a51653449 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:15.843725303 +0000 UTC m=+250.146173626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1d50049-e6de-4aa9-80fc-457a51653449-metrics-certs") pod "router-default-5d4699ff7f-xg2hr" (UID: "e1d50049-e6de-4aa9-80fc-457a51653449") : secret "router-metrics-certs-default" not found
Jul 30 00:06:15.343917 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.343752    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/61402020-403f-44d7-ab55-7d01ccb8d185-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-gbjkc\" (UID: \"61402020-403f-44d7-ab55-7d01ccb8d185\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-gbjkc"
Jul 30 00:06:15.343917 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.343779    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddad1f6c-b733-47c2-a2ba-efc27c716416-ca-trust-extracted\") pod \"image-registry-844b9fb84f-bdxmv\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") " pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:15.343917 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.343801    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/61402020-403f-44d7-ab55-7d01ccb8d185-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-gbjkc\" (UID: \"61402020-403f-44d7-ab55-7d01ccb8d185\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-gbjkc"
Jul 30 00:06:15.343917 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.343833    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddad1f6c-b733-47c2-a2ba-efc27c716416-image-registry-private-configuration\") pod \"image-registry-844b9fb84f-bdxmv\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") " pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:15.343917 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.343859    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddad1f6c-b733-47c2-a2ba-efc27c716416-installation-pull-secrets\") pod \"image-registry-844b9fb84f-bdxmv\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") " pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:15.343917 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.343903    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m99z6\" (UniqueName: \"kubernetes.io/projected/61402020-403f-44d7-ab55-7d01ccb8d185-kube-api-access-m99z6\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-gbjkc\" (UID: \"61402020-403f-44d7-ab55-7d01ccb8d185\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-gbjkc"
Jul 30 00:06:15.344324 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.343947    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2cc438b2-74db-4527-afb3-cfe578af038c-serving-cert\") pod \"service-ca-operator-5d6c75f84f-kk8nr\" (UID: \"2cc438b2-74db-4527-afb3-cfe578af038c\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kk8nr"
Jul 30 00:06:15.344324 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.343986    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c72nw\" (UniqueName: \"kubernetes.io/projected/6393983e-c75a-47a0-9f95-6738a80b257c-kube-api-access-c72nw\") pod \"cluster-samples-operator-6748489656-44gpk\" (UID: \"6393983e-c75a-47a0-9f95-6738a80b257c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-44gpk"
Jul 30 00:06:15.344324 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.344010    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/872d3ff4-c766-4f3b-8e98-4e622f016146-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-fwpz8\" (UID: \"872d3ff4-c766-4f3b-8e98-4e622f016146\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-fwpz8"
Jul 30 00:06:15.344324 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.344024    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e1d50049-e6de-4aa9-80fc-457a51653449-stats-auth\") pod \"router-default-5d4699ff7f-xg2hr\" (UID: \"e1d50049-e6de-4aa9-80fc-457a51653449\") " pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:15.344324 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.344065    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/872d3ff4-c766-4f3b-8e98-4e622f016146-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-fwpz8\" (UID: \"872d3ff4-c766-4f3b-8e98-4e622f016146\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-fwpz8"
Jul 30 00:06:15.344324 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.344098    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddad1f6c-b733-47c2-a2ba-efc27c716416-registry-certificates\") pod \"image-registry-844b9fb84f-bdxmv\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") " pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:15.344324 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.344128    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6393983e-c75a-47a0-9f95-6738a80b257c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-44gpk\" (UID: \"6393983e-c75a-47a0-9f95-6738a80b257c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-44gpk"
Jul 30 00:06:15.344324 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:15.344226    2527 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 00:06:15.344324 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:15.344271    2527 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 00:06:15.344324 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:15.344277    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872d3ff4-c766-4f3b-8e98-4e622f016146-cluster-monitoring-operator-tls podName:872d3ff4-c766-4f3b-8e98-4e622f016146 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:15.844262093 +0000 UTC m=+250.146710416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/872d3ff4-c766-4f3b-8e98-4e622f016146-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-fwpz8" (UID: "872d3ff4-c766-4f3b-8e98-4e622f016146") : secret "cluster-monitoring-operator-tls" not found
Jul 30 00:06:15.344653 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:15.344356    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6393983e-c75a-47a0-9f95-6738a80b257c-samples-operator-tls podName:6393983e-c75a-47a0-9f95-6738a80b257c nodeName:}" failed. No retries permitted until 2026-07-30 00:06:15.844338381 +0000 UTC m=+250.146786708 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6393983e-c75a-47a0-9f95-6738a80b257c-samples-operator-tls") pod "cluster-samples-operator-6748489656-44gpk" (UID: "6393983e-c75a-47a0-9f95-6738a80b257c") : secret "samples-operator-tls" not found
Jul 30 00:06:15.344653 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.344366    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/61402020-403f-44d7-ab55-7d01ccb8d185-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-gbjkc\" (UID: \"61402020-403f-44d7-ab55-7d01ccb8d185\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-gbjkc"
Jul 30 00:06:15.345833 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.345815    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e1d50049-e6de-4aa9-80fc-457a51653449-default-certificate\") pod \"router-default-5d4699ff7f-xg2hr\" (UID: \"e1d50049-e6de-4aa9-80fc-457a51653449\") " pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:15.346683 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.346658    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/61402020-403f-44d7-ab55-7d01ccb8d185-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-gbjkc\" (UID: \"61402020-403f-44d7-ab55-7d01ccb8d185\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-gbjkc"
Jul 30 00:06:15.346800 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.346782    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e1d50049-e6de-4aa9-80fc-457a51653449-stats-auth\") pod \"router-default-5d4699ff7f-xg2hr\" (UID: \"e1d50049-e6de-4aa9-80fc-457a51653449\") " pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:15.354202 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.354185    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26lnq\" (UniqueName: \"kubernetes.io/projected/e1d50049-e6de-4aa9-80fc-457a51653449-kube-api-access-26lnq\") pod \"router-default-5d4699ff7f-xg2hr\" (UID: \"e1d50049-e6de-4aa9-80fc-457a51653449\") " pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:15.354298 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.354186    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c72nw\" (UniqueName: \"kubernetes.io/projected/6393983e-c75a-47a0-9f95-6738a80b257c-kube-api-access-c72nw\") pod \"cluster-samples-operator-6748489656-44gpk\" (UID: \"6393983e-c75a-47a0-9f95-6738a80b257c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-44gpk"
Jul 30 00:06:15.354599 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.354582    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m99z6\" (UniqueName: \"kubernetes.io/projected/61402020-403f-44d7-ab55-7d01ccb8d185-kube-api-access-m99z6\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-gbjkc\" (UID: \"61402020-403f-44d7-ab55-7d01ccb8d185\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-gbjkc"
Jul 30 00:06:15.354694 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.354675    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46fsw\" (UniqueName: \"kubernetes.io/projected/872d3ff4-c766-4f3b-8e98-4e622f016146-kube-api-access-46fsw\") pod \"cluster-monitoring-operator-548b489cb8-fwpz8\" (UID: \"872d3ff4-c766-4f3b-8e98-4e622f016146\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-fwpz8"
Jul 30 00:06:15.397262 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.397243    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-gbjkc"
Jul 30 00:06:15.444815 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.444787    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddad1f6c-b733-47c2-a2ba-efc27c716416-registry-certificates\") pod \"image-registry-844b9fb84f-bdxmv\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") " pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:15.445626 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.444840    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlcxn\" (UniqueName: \"kubernetes.io/projected/2cc438b2-74db-4527-afb3-cfe578af038c-kube-api-access-dlcxn\") pod \"service-ca-operator-5d6c75f84f-kk8nr\" (UID: \"2cc438b2-74db-4527-afb3-cfe578af038c\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kk8nr"
Jul 30 00:06:15.445626 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.444861    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-registry-tls\") pod \"image-registry-844b9fb84f-bdxmv\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") " pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:15.445626 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.444878    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2cc438b2-74db-4527-afb3-cfe578af038c-config\") pod \"service-ca-operator-5d6c75f84f-kk8nr\" (UID: \"2cc438b2-74db-4527-afb3-cfe578af038c\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kk8nr"
Jul 30 00:06:15.445626 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.444898    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddad1f6c-b733-47c2-a2ba-efc27c716416-trusted-ca\") pod \"image-registry-844b9fb84f-bdxmv\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") " pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:15.445626 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.444915    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-bound-sa-token\") pod \"image-registry-844b9fb84f-bdxmv\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") " pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:15.445626 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.445277    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwb86\" (UniqueName: \"kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-kube-api-access-xwb86\") pod \"image-registry-844b9fb84f-bdxmv\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") " pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:15.445626 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.445299    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddad1f6c-b733-47c2-a2ba-efc27c716416-ca-trust-extracted\") pod \"image-registry-844b9fb84f-bdxmv\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") " pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:15.445626 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.445324    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddad1f6c-b733-47c2-a2ba-efc27c716416-image-registry-private-configuration\") pod \"image-registry-844b9fb84f-bdxmv\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") " pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:15.445626 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.445341    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddad1f6c-b733-47c2-a2ba-efc27c716416-installation-pull-secrets\") pod \"image-registry-844b9fb84f-bdxmv\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") " pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:15.445626 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.445368    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2cc438b2-74db-4527-afb3-cfe578af038c-serving-cert\") pod \"service-ca-operator-5d6c75f84f-kk8nr\" (UID: \"2cc438b2-74db-4527-afb3-cfe578af038c\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kk8nr"
Jul 30 00:06:15.445626 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.445452    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddad1f6c-b733-47c2-a2ba-efc27c716416-registry-certificates\") pod \"image-registry-844b9fb84f-bdxmv\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") " pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:15.446153 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.445744    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddad1f6c-b733-47c2-a2ba-efc27c716416-ca-trust-extracted\") pod \"image-registry-844b9fb84f-bdxmv\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") " pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:15.446153 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:15.445769    2527 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 00:06:15.446153 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:15.445786    2527 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-844b9fb84f-bdxmv: secret "image-registry-tls" not found
Jul 30 00:06:15.446153 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:15.445852    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-registry-tls podName:ddad1f6c-b733-47c2-a2ba-efc27c716416 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:15.945832234 +0000 UTC m=+250.248280561 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-registry-tls") pod "image-registry-844b9fb84f-bdxmv" (UID: "ddad1f6c-b733-47c2-a2ba-efc27c716416") : secret "image-registry-tls" not found
Jul 30 00:06:15.446592 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.446567    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2cc438b2-74db-4527-afb3-cfe578af038c-config\") pod \"service-ca-operator-5d6c75f84f-kk8nr\" (UID: \"2cc438b2-74db-4527-afb3-cfe578af038c\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kk8nr"
Jul 30 00:06:15.446854 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.446815    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddad1f6c-b733-47c2-a2ba-efc27c716416-trusted-ca\") pod \"image-registry-844b9fb84f-bdxmv\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") " pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:15.448433 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.448401    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddad1f6c-b733-47c2-a2ba-efc27c716416-image-registry-private-configuration\") pod \"image-registry-844b9fb84f-bdxmv\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") " pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:15.448638 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.448617    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2cc438b2-74db-4527-afb3-cfe578af038c-serving-cert\") pod \"service-ca-operator-5d6c75f84f-kk8nr\" (UID: \"2cc438b2-74db-4527-afb3-cfe578af038c\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kk8nr"
Jul 30 00:06:15.449322 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.449304    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddad1f6c-b733-47c2-a2ba-efc27c716416-installation-pull-secrets\") pod \"image-registry-844b9fb84f-bdxmv\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") " pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:15.456181 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.456131    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-bound-sa-token\") pod \"image-registry-844b9fb84f-bdxmv\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") " pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:15.456969 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.456541    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlcxn\" (UniqueName: \"kubernetes.io/projected/2cc438b2-74db-4527-afb3-cfe578af038c-kube-api-access-dlcxn\") pod \"service-ca-operator-5d6c75f84f-kk8nr\" (UID: \"2cc438b2-74db-4527-afb3-cfe578af038c\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kk8nr"
Jul 30 00:06:15.456969 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.456922    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwb86\" (UniqueName: \"kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-kube-api-access-xwb86\") pod \"image-registry-844b9fb84f-bdxmv\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") " pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:15.498780 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.498745    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kk8nr"
Jul 30 00:06:15.517744 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.517688    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-gbjkc"]
Jul 30 00:06:15.521764 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:06:15.521738    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61402020_403f_44d7_ab55_7d01ccb8d185.slice/crio-2ba2145c8d353461545371516dfd060996ccc794c0d63a4233702724b17e3c34 WatchSource:0}: Error finding container 2ba2145c8d353461545371516dfd060996ccc794c0d63a4233702724b17e3c34: Status 404 returned error can't find the container with id 2ba2145c8d353461545371516dfd060996ccc794c0d63a4233702724b17e3c34
Jul 30 00:06:15.620054 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.619879    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kk8nr"]
Jul 30 00:06:15.622262 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:06:15.622236    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cc438b2_74db_4527_afb3_cfe578af038c.slice/crio-10e7925f29a1b36b307371a1c2709cf419995b2fc20b64085475a6040df38281 WatchSource:0}: Error finding container 10e7925f29a1b36b307371a1c2709cf419995b2fc20b64085475a6040df38281: Status 404 returned error can't find the container with id 10e7925f29a1b36b307371a1c2709cf419995b2fc20b64085475a6040df38281
Jul 30 00:06:15.849551 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.849526    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1d50049-e6de-4aa9-80fc-457a51653449-service-ca-bundle\") pod \"router-default-5d4699ff7f-xg2hr\" (UID: \"e1d50049-e6de-4aa9-80fc-457a51653449\") " pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:15.849551 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.849555    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1d50049-e6de-4aa9-80fc-457a51653449-metrics-certs\") pod \"router-default-5d4699ff7f-xg2hr\" (UID: \"e1d50049-e6de-4aa9-80fc-457a51653449\") " pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:15.849754 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.849592    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/872d3ff4-c766-4f3b-8e98-4e622f016146-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-fwpz8\" (UID: \"872d3ff4-c766-4f3b-8e98-4e622f016146\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-fwpz8"
Jul 30 00:06:15.849754 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:15.849673    2527 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 00:06:15.849754 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:15.849674    2527 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 00:06:15.849754 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:15.849701    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e1d50049-e6de-4aa9-80fc-457a51653449-service-ca-bundle podName:e1d50049-e6de-4aa9-80fc-457a51653449 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:16.849676834 +0000 UTC m=+251.152125159 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e1d50049-e6de-4aa9-80fc-457a51653449-service-ca-bundle") pod "router-default-5d4699ff7f-xg2hr" (UID: "e1d50049-e6de-4aa9-80fc-457a51653449") : configmap references non-existent config key: service-ca.crt
Jul 30 00:06:15.849754 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.849729    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6393983e-c75a-47a0-9f95-6738a80b257c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-44gpk\" (UID: \"6393983e-c75a-47a0-9f95-6738a80b257c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-44gpk"
Jul 30 00:06:15.849947 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:15.849784    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872d3ff4-c766-4f3b-8e98-4e622f016146-cluster-monitoring-operator-tls podName:872d3ff4-c766-4f3b-8e98-4e622f016146 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:16.849772832 +0000 UTC m=+251.152221156 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/872d3ff4-c766-4f3b-8e98-4e622f016146-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-fwpz8" (UID: "872d3ff4-c766-4f3b-8e98-4e622f016146") : secret "cluster-monitoring-operator-tls" not found
Jul 30 00:06:15.849947 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:15.849800    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1d50049-e6de-4aa9-80fc-457a51653449-metrics-certs podName:e1d50049-e6de-4aa9-80fc-457a51653449 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:16.849791244 +0000 UTC m=+251.152239574 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1d50049-e6de-4aa9-80fc-457a51653449-metrics-certs") pod "router-default-5d4699ff7f-xg2hr" (UID: "e1d50049-e6de-4aa9-80fc-457a51653449") : secret "router-metrics-certs-default" not found
Jul 30 00:06:15.849947 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:15.849825    2527 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 00:06:15.849947 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:15.849860    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6393983e-c75a-47a0-9f95-6738a80b257c-samples-operator-tls podName:6393983e-c75a-47a0-9f95-6738a80b257c nodeName:}" failed. No retries permitted until 2026-07-30 00:06:16.849852797 +0000 UTC m=+251.152301120 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6393983e-c75a-47a0-9f95-6738a80b257c-samples-operator-tls") pod "cluster-samples-operator-6748489656-44gpk" (UID: "6393983e-c75a-47a0-9f95-6738a80b257c") : secret "samples-operator-tls" not found
Jul 30 00:06:15.904059 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.903998    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kk8nr" event={"ID":"2cc438b2-74db-4527-afb3-cfe578af038c","Type":"ContainerStarted","Data":"10e7925f29a1b36b307371a1c2709cf419995b2fc20b64085475a6040df38281"}
Jul 30 00:06:15.905037 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.905019    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-gbjkc" event={"ID":"61402020-403f-44d7-ab55-7d01ccb8d185","Type":"ContainerStarted","Data":"2ba2145c8d353461545371516dfd060996ccc794c0d63a4233702724b17e3c34"}
Jul 30 00:06:15.950095 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:15.950070    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-registry-tls\") pod \"image-registry-844b9fb84f-bdxmv\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") " pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:15.950251 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:15.950234    2527 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 00:06:15.950294 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:15.950253    2527 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-844b9fb84f-bdxmv: secret "image-registry-tls" not found
Jul 30 00:06:15.950340 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:15.950309    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-registry-tls podName:ddad1f6c-b733-47c2-a2ba-efc27c716416 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:16.950289617 +0000 UTC m=+251.252737939 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-registry-tls") pod "image-registry-844b9fb84f-bdxmv" (UID: "ddad1f6c-b733-47c2-a2ba-efc27c716416") : secret "image-registry-tls" not found
Jul 30 00:06:16.856744 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:16.856711    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/872d3ff4-c766-4f3b-8e98-4e622f016146-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-fwpz8\" (UID: \"872d3ff4-c766-4f3b-8e98-4e622f016146\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-fwpz8"
Jul 30 00:06:16.857232 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:16.856754    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6393983e-c75a-47a0-9f95-6738a80b257c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-44gpk\" (UID: \"6393983e-c75a-47a0-9f95-6738a80b257c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-44gpk"
Jul 30 00:06:16.857232 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:16.856822    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1d50049-e6de-4aa9-80fc-457a51653449-service-ca-bundle\") pod \"router-default-5d4699ff7f-xg2hr\" (UID: \"e1d50049-e6de-4aa9-80fc-457a51653449\") " pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:16.857232 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:16.856850    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1d50049-e6de-4aa9-80fc-457a51653449-metrics-certs\") pod \"router-default-5d4699ff7f-xg2hr\" (UID: \"e1d50049-e6de-4aa9-80fc-457a51653449\") " pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:16.857232 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:16.856923    2527 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 00:06:16.857232 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:16.856954    2527 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 00:06:16.857232 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:16.856923    2527 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 00:06:16.857232 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:16.856969    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e1d50049-e6de-4aa9-80fc-457a51653449-service-ca-bundle podName:e1d50049-e6de-4aa9-80fc-457a51653449 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:18.85694925 +0000 UTC m=+253.159397580 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e1d50049-e6de-4aa9-80fc-457a51653449-service-ca-bundle") pod "router-default-5d4699ff7f-xg2hr" (UID: "e1d50049-e6de-4aa9-80fc-457a51653449") : configmap references non-existent config key: service-ca.crt
Jul 30 00:06:16.857232 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:16.857001    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6393983e-c75a-47a0-9f95-6738a80b257c-samples-operator-tls podName:6393983e-c75a-47a0-9f95-6738a80b257c nodeName:}" failed. No retries permitted until 2026-07-30 00:06:18.85698343 +0000 UTC m=+253.159431757 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6393983e-c75a-47a0-9f95-6738a80b257c-samples-operator-tls") pod "cluster-samples-operator-6748489656-44gpk" (UID: "6393983e-c75a-47a0-9f95-6738a80b257c") : secret "samples-operator-tls" not found
Jul 30 00:06:16.857232 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:16.857023    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872d3ff4-c766-4f3b-8e98-4e622f016146-cluster-monitoring-operator-tls podName:872d3ff4-c766-4f3b-8e98-4e622f016146 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:18.857016442 +0000 UTC m=+253.159464769 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/872d3ff4-c766-4f3b-8e98-4e622f016146-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-fwpz8" (UID: "872d3ff4-c766-4f3b-8e98-4e622f016146") : secret "cluster-monitoring-operator-tls" not found
Jul 30 00:06:16.857232 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:16.857037    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1d50049-e6de-4aa9-80fc-457a51653449-metrics-certs podName:e1d50049-e6de-4aa9-80fc-457a51653449 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:18.857031824 +0000 UTC m=+253.159480146 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1d50049-e6de-4aa9-80fc-457a51653449-metrics-certs") pod "router-default-5d4699ff7f-xg2hr" (UID: "e1d50049-e6de-4aa9-80fc-457a51653449") : secret "router-metrics-certs-default" not found
Jul 30 00:06:16.957852 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:16.957822    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-registry-tls\") pod \"image-registry-844b9fb84f-bdxmv\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") " pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:16.957961 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:16.957930    2527 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 00:06:16.957961 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:16.957942    2527 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-844b9fb84f-bdxmv: secret "image-registry-tls" not found
Jul 30 00:06:16.958046 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:16.957984    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-registry-tls podName:ddad1f6c-b733-47c2-a2ba-efc27c716416 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:18.957969162 +0000 UTC m=+253.260417490 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-registry-tls") pod "image-registry-844b9fb84f-bdxmv" (UID: "ddad1f6c-b733-47c2-a2ba-efc27c716416") : secret "image-registry-tls" not found
Jul 30 00:06:17.058462 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:17.058425    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs\") pod \"network-metrics-daemon-lj2rz\" (UID: \"47b042b2-e9c2-45fd-ae41-9608eaf6aa4d\") " pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:06:17.058625 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:17.058606    2527 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 30 00:06:17.058681 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:17.058668    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs podName:47b042b2-e9c2-45fd-ae41-9608eaf6aa4d nodeName:}" failed. No retries permitted until 2026-07-30 00:08:19.058654441 +0000 UTC m=+373.361102767 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs") pod "network-metrics-daemon-lj2rz" (UID: "47b042b2-e9c2-45fd-ae41-9608eaf6aa4d") : secret "metrics-daemon-secret" not found
Jul 30 00:06:17.917831 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:17.913568    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kk8nr" event={"ID":"2cc438b2-74db-4527-afb3-cfe578af038c","Type":"ContainerStarted","Data":"8f070adae31d94497358d95e65faa68be7eb76e5d15c680a789c90ba98919d6d"}
Jul 30 00:06:17.929990 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:17.929948    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kk8nr" podStartSLOduration=0.716475472 podStartE2EDuration="2.929932901s" totalImagesPullingTime="2.213457429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:06:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:06:17.929699289 +0000 UTC m=+252.232147636" watchObservedRunningTime="2026-07-30 00:06:17.929932901 +0000 UTC m=+252.232381262"
Jul 30 00:06:18.748420 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:18.748382    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xwfd8"]
Jul 30 00:06:18.751682 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:18.751664    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xwfd8"
Jul 30 00:06:18.754263 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:18.754237    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 30 00:06:18.754263 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:18.754251    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 30 00:06:18.754418 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:18.754274    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 30 00:06:18.754844 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:18.754831    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-47ttk\""
Jul 30 00:06:18.754892 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:18.754841    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 30 00:06:18.760504 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:18.760484    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xwfd8"]
Jul 30 00:06:18.771361 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:18.771337    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xwfd8\" (UID: \"d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8\") " pod="openshift-insights/insights-runtime-extractor-xwfd8"
Jul 30 00:06:18.771434 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:18.771406    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btxgg\" (UniqueName: \"kubernetes.io/projected/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-kube-api-access-btxgg\") pod \"insights-runtime-extractor-xwfd8\" (UID: \"d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8\") " pod="openshift-insights/insights-runtime-extractor-xwfd8"
Jul 30 00:06:18.771478 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:18.771431    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xwfd8\" (UID: \"d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8\") " pod="openshift-insights/insights-runtime-extractor-xwfd8"
Jul 30 00:06:18.771478 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:18.771456    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-data-volume\") pod \"insights-runtime-extractor-xwfd8\" (UID: \"d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8\") " pod="openshift-insights/insights-runtime-extractor-xwfd8"
Jul 30 00:06:18.771557 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:18.771541    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-crio-socket\") pod \"insights-runtime-extractor-xwfd8\" (UID: \"d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8\") " pod="openshift-insights/insights-runtime-extractor-xwfd8"
Jul 30 00:06:18.872363 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:18.872330    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/872d3ff4-c766-4f3b-8e98-4e622f016146-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-fwpz8\" (UID: \"872d3ff4-c766-4f3b-8e98-4e622f016146\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-fwpz8"
Jul 30 00:06:18.872504 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:18.872369    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6393983e-c75a-47a0-9f95-6738a80b257c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-44gpk\" (UID: \"6393983e-c75a-47a0-9f95-6738a80b257c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-44gpk"
Jul 30 00:06:18.872504 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:18.872399    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xwfd8\" (UID: \"d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8\") " pod="openshift-insights/insights-runtime-extractor-xwfd8"
Jul 30 00:06:18.872504 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:18.872449    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btxgg\" (UniqueName: \"kubernetes.io/projected/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-kube-api-access-btxgg\") pod \"insights-runtime-extractor-xwfd8\" (UID: \"d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8\") " pod="openshift-insights/insights-runtime-extractor-xwfd8"
Jul 30 00:06:18.872504 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:18.872466    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xwfd8\" (UID: \"d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8\") " pod="openshift-insights/insights-runtime-extractor-xwfd8"
Jul 30 00:06:18.872504 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:18.872493    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-data-volume\") pod \"insights-runtime-extractor-xwfd8\" (UID: \"d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8\") " pod="openshift-insights/insights-runtime-extractor-xwfd8"
Jul 30 00:06:18.872504 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:18.872494    2527 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 00:06:18.872778 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:18.872542    2527 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 00:06:18.872778 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:18.872568    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872d3ff4-c766-4f3b-8e98-4e622f016146-cluster-monitoring-operator-tls podName:872d3ff4-c766-4f3b-8e98-4e622f016146 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:22.872546468 +0000 UTC m=+257.174994815 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/872d3ff4-c766-4f3b-8e98-4e622f016146-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-fwpz8" (UID: "872d3ff4-c766-4f3b-8e98-4e622f016146") : secret "cluster-monitoring-operator-tls" not found
Jul 30 00:06:18.872778 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:18.872573    2527 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 00:06:18.872778 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:18.872586    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-kube-rbac-proxy-cm podName:d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:19.372574673 +0000 UTC m=+253.675022996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xwfd8" (UID: "d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8") : configmap "kube-rbac-proxy" not found
Jul 30 00:06:18.872778 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:18.872494    2527 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 00:06:18.872778 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:18.872628    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-insights-runtime-extractor-tls podName:d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:19.37261172 +0000 UTC m=+253.675060043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xwfd8" (UID: "d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8") : secret "insights-runtime-extractor-tls" not found
Jul 30 00:06:18.872778 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:18.872629    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1d50049-e6de-4aa9-80fc-457a51653449-service-ca-bundle\") pod \"router-default-5d4699ff7f-xg2hr\" (UID: \"e1d50049-e6de-4aa9-80fc-457a51653449\") " pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:18.872778 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:18.872644    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6393983e-c75a-47a0-9f95-6738a80b257c-samples-operator-tls podName:6393983e-c75a-47a0-9f95-6738a80b257c nodeName:}" failed. No retries permitted until 2026-07-30 00:06:22.872636276 +0000 UTC m=+257.175084599 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6393983e-c75a-47a0-9f95-6738a80b257c-samples-operator-tls") pod "cluster-samples-operator-6748489656-44gpk" (UID: "6393983e-c75a-47a0-9f95-6738a80b257c") : secret "samples-operator-tls" not found
Jul 30 00:06:18.872778 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:18.872690    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1d50049-e6de-4aa9-80fc-457a51653449-metrics-certs\") pod \"router-default-5d4699ff7f-xg2hr\" (UID: \"e1d50049-e6de-4aa9-80fc-457a51653449\") " pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:18.872778 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:18.872726    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e1d50049-e6de-4aa9-80fc-457a51653449-service-ca-bundle podName:e1d50049-e6de-4aa9-80fc-457a51653449 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:22.872714304 +0000 UTC m=+257.175162630 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e1d50049-e6de-4aa9-80fc-457a51653449-service-ca-bundle") pod "router-default-5d4699ff7f-xg2hr" (UID: "e1d50049-e6de-4aa9-80fc-457a51653449") : configmap references non-existent config key: service-ca.crt
Jul 30 00:06:18.872778 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:18.872746    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-crio-socket\") pod \"insights-runtime-extractor-xwfd8\" (UID: \"d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8\") " pod="openshift-insights/insights-runtime-extractor-xwfd8"
Jul 30 00:06:18.872778 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:18.872785    2527 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 00:06:18.873191 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:18.872803    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-data-volume\") pod \"insights-runtime-extractor-xwfd8\" (UID: \"d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8\") " pod="openshift-insights/insights-runtime-extractor-xwfd8"
Jul 30 00:06:18.873191 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:18.872830    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1d50049-e6de-4aa9-80fc-457a51653449-metrics-certs podName:e1d50049-e6de-4aa9-80fc-457a51653449 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:22.872815528 +0000 UTC m=+257.175263853 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1d50049-e6de-4aa9-80fc-457a51653449-metrics-certs") pod "router-default-5d4699ff7f-xg2hr" (UID: "e1d50049-e6de-4aa9-80fc-457a51653449") : secret "router-metrics-certs-default" not found
Jul 30 00:06:18.873191 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:18.872858    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-crio-socket\") pod \"insights-runtime-extractor-xwfd8\" (UID: \"d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8\") " pod="openshift-insights/insights-runtime-extractor-xwfd8"
Jul 30 00:06:18.879681 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:18.879664    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btxgg\" (UniqueName: \"kubernetes.io/projected/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-kube-api-access-btxgg\") pod \"insights-runtime-extractor-xwfd8\" (UID: \"d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8\") " pod="openshift-insights/insights-runtime-extractor-xwfd8"
Jul 30 00:06:18.973810 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:18.973785    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-registry-tls\") pod \"image-registry-844b9fb84f-bdxmv\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") " pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:18.974219 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:18.973930    2527 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 00:06:18.974219 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:18.973949    2527 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-844b9fb84f-bdxmv: secret "image-registry-tls" not found
Jul 30 00:06:18.974219 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:18.973999    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-registry-tls podName:ddad1f6c-b733-47c2-a2ba-efc27c716416 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:22.973984341 +0000 UTC m=+257.276432684 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-registry-tls") pod "image-registry-844b9fb84f-bdxmv" (UID: "ddad1f6c-b733-47c2-a2ba-efc27c716416") : secret "image-registry-tls" not found
Jul 30 00:06:19.378036 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:19.377996    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xwfd8\" (UID: \"d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8\") " pod="openshift-insights/insights-runtime-extractor-xwfd8"
Jul 30 00:06:19.378243 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:19.378070    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xwfd8\" (UID: \"d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8\") " pod="openshift-insights/insights-runtime-extractor-xwfd8"
Jul 30 00:06:19.378243 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:19.378193    2527 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 00:06:19.378243 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:19.378234    2527 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 00:06:19.378410 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:19.378272    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-insights-runtime-extractor-tls podName:d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:20.378252261 +0000 UTC m=+254.680700605 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xwfd8" (UID: "d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8") : secret "insights-runtime-extractor-tls" not found
Jul 30 00:06:19.378410 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:19.378300    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-kube-rbac-proxy-cm podName:d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:20.37828002 +0000 UTC m=+254.680728347 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xwfd8" (UID: "d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8") : configmap "kube-rbac-proxy" not found
Jul 30 00:06:19.921327 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:19.921286    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-gbjkc" event={"ID":"61402020-403f-44d7-ab55-7d01ccb8d185","Type":"ContainerStarted","Data":"05db497fcb65d1677ac91c1cf1d220484acfc777d5560a1dc77c18fe725331c1"}
Jul 30 00:06:19.935516 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:19.935474    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-gbjkc" podStartSLOduration=0.947031555 podStartE2EDuration="4.935460134s" totalImagesPullingTime="3.988428579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:06:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:06:19.934390776 +0000 UTC m=+254.236839134" watchObservedRunningTime="2026-07-30 00:06:19.935460134 +0000 UTC m=+254.237908480"
Jul 30 00:06:20.387095 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:20.387062    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xwfd8\" (UID: \"d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8\") " pod="openshift-insights/insights-runtime-extractor-xwfd8"
Jul 30 00:06:20.387489 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:20.387117    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xwfd8\" (UID: \"d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8\") " pod="openshift-insights/insights-runtime-extractor-xwfd8"
Jul 30 00:06:20.387489 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:20.387240    2527 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 00:06:20.387489 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:20.387258    2527 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 00:06:20.387489 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:20.387294    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-kube-rbac-proxy-cm podName:d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:22.387280751 +0000 UTC m=+256.689729074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xwfd8" (UID: "d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8") : configmap "kube-rbac-proxy" not found
Jul 30 00:06:20.387489 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:20.387322    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-insights-runtime-extractor-tls podName:d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:22.387304517 +0000 UTC m=+256.689752849 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xwfd8" (UID: "d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8") : secret "insights-runtime-extractor-tls" not found
Jul 30 00:06:20.732279 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:20.732251    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tq4hc_abd0f838-14de-4c5c-899a-8364a6084905/dns-node-resolver/0.log"
Jul 30 00:06:21.732716 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:21.732690    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2g9tl_b0821896-954e-4d42-a259-11685665d109/node-ca/0.log"
Jul 30 00:06:22.405573 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:22.405538    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xwfd8\" (UID: \"d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8\") " pod="openshift-insights/insights-runtime-extractor-xwfd8"
Jul 30 00:06:22.405745 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:22.405594    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xwfd8\" (UID: \"d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8\") " pod="openshift-insights/insights-runtime-extractor-xwfd8"
Jul 30 00:06:22.405745 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:22.405671    2527 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 00:06:22.405745 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:22.405692    2527 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 00:06:22.405745 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:22.405728    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-insights-runtime-extractor-tls podName:d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:26.405714254 +0000 UTC m=+260.708162577 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xwfd8" (UID: "d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8") : secret "insights-runtime-extractor-tls" not found
Jul 30 00:06:22.405745 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:22.405742    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-kube-rbac-proxy-cm podName:d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:26.405735909 +0000 UTC m=+260.708184232 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xwfd8" (UID: "d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8") : configmap "kube-rbac-proxy" not found
Jul 30 00:06:22.533115 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:22.533085    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2kfjd_581ec3fe-74ca-4046-ba10-3ff893cd16a5/serve-healthcheck-canary/0.log"
Jul 30 00:06:22.909265 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:22.909236    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1d50049-e6de-4aa9-80fc-457a51653449-service-ca-bundle\") pod \"router-default-5d4699ff7f-xg2hr\" (UID: \"e1d50049-e6de-4aa9-80fc-457a51653449\") " pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:22.909265 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:22.909269    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1d50049-e6de-4aa9-80fc-457a51653449-metrics-certs\") pod \"router-default-5d4699ff7f-xg2hr\" (UID: \"e1d50049-e6de-4aa9-80fc-457a51653449\") " pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:22.909648 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:22.909328    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/872d3ff4-c766-4f3b-8e98-4e622f016146-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-fwpz8\" (UID: \"872d3ff4-c766-4f3b-8e98-4e622f016146\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-fwpz8"
Jul 30 00:06:22.909648 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:22.909346    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6393983e-c75a-47a0-9f95-6738a80b257c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-44gpk\" (UID: \"6393983e-c75a-47a0-9f95-6738a80b257c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-44gpk"
Jul 30 00:06:22.909648 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:22.909412    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e1d50049-e6de-4aa9-80fc-457a51653449-service-ca-bundle podName:e1d50049-e6de-4aa9-80fc-457a51653449 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:30.909390645 +0000 UTC m=+265.211838972 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e1d50049-e6de-4aa9-80fc-457a51653449-service-ca-bundle") pod "router-default-5d4699ff7f-xg2hr" (UID: "e1d50049-e6de-4aa9-80fc-457a51653449") : configmap references non-existent config key: service-ca.crt
Jul 30 00:06:22.909648 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:22.909453    2527 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 00:06:22.909648 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:22.909454    2527 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 00:06:22.909648 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:22.909454    2527 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 30 00:06:22.909648 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:22.909496    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872d3ff4-c766-4f3b-8e98-4e622f016146-cluster-monitoring-operator-tls podName:872d3ff4-c766-4f3b-8e98-4e622f016146 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:30.909483845 +0000 UTC m=+265.211932168 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/872d3ff4-c766-4f3b-8e98-4e622f016146-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-fwpz8" (UID: "872d3ff4-c766-4f3b-8e98-4e622f016146") : secret "cluster-monitoring-operator-tls" not found
Jul 30 00:06:22.909648 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:22.909513    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6393983e-c75a-47a0-9f95-6738a80b257c-samples-operator-tls podName:6393983e-c75a-47a0-9f95-6738a80b257c nodeName:}" failed. No retries permitted until 2026-07-30 00:06:30.909504063 +0000 UTC m=+265.211952386 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6393983e-c75a-47a0-9f95-6738a80b257c-samples-operator-tls") pod "cluster-samples-operator-6748489656-44gpk" (UID: "6393983e-c75a-47a0-9f95-6738a80b257c") : secret "samples-operator-tls" not found
Jul 30 00:06:22.909648 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:22.909527    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1d50049-e6de-4aa9-80fc-457a51653449-metrics-certs podName:e1d50049-e6de-4aa9-80fc-457a51653449 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:30.909518786 +0000 UTC m=+265.211967114 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e1d50049-e6de-4aa9-80fc-457a51653449-metrics-certs") pod "router-default-5d4699ff7f-xg2hr" (UID: "e1d50049-e6de-4aa9-80fc-457a51653449") : secret "router-metrics-certs-default" not found
Jul 30 00:06:23.010413 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:23.010384    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-registry-tls\") pod \"image-registry-844b9fb84f-bdxmv\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") " pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:23.010548 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:23.010527    2527 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 00:06:23.010548 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:23.010544    2527 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-844b9fb84f-bdxmv: secret "image-registry-tls" not found
Jul 30 00:06:23.010615 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:23.010591    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-registry-tls podName:ddad1f6c-b733-47c2-a2ba-efc27c716416 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:31.010576686 +0000 UTC m=+265.313025010 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-registry-tls") pod "image-registry-844b9fb84f-bdxmv" (UID: "ddad1f6c-b733-47c2-a2ba-efc27c716416") : secret "image-registry-tls" not found
Jul 30 00:06:26.436132 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:26.436089    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xwfd8\" (UID: \"d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8\") " pod="openshift-insights/insights-runtime-extractor-xwfd8"
Jul 30 00:06:26.436636 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:26.436194    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xwfd8\" (UID: \"d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8\") " pod="openshift-insights/insights-runtime-extractor-xwfd8"
Jul 30 00:06:26.436636 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:26.436261    2527 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 00:06:26.436636 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:26.436334    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-insights-runtime-extractor-tls podName:d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:34.436317351 +0000 UTC m=+268.738765674 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xwfd8" (UID: "d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8") : secret "insights-runtime-extractor-tls" not found
Jul 30 00:06:26.436896 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:26.436875    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xwfd8\" (UID: \"d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8\") " pod="openshift-insights/insights-runtime-extractor-xwfd8"
Jul 30 00:06:30.972534 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:30.972462    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/872d3ff4-c766-4f3b-8e98-4e622f016146-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-fwpz8\" (UID: \"872d3ff4-c766-4f3b-8e98-4e622f016146\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-fwpz8"
Jul 30 00:06:30.972534 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:30.972498    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6393983e-c75a-47a0-9f95-6738a80b257c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-44gpk\" (UID: \"6393983e-c75a-47a0-9f95-6738a80b257c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-44gpk"
Jul 30 00:06:30.973035 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:30.972563    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1d50049-e6de-4aa9-80fc-457a51653449-service-ca-bundle\") pod \"router-default-5d4699ff7f-xg2hr\" (UID: \"e1d50049-e6de-4aa9-80fc-457a51653449\") " pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:30.973035 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:30.972582    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1d50049-e6de-4aa9-80fc-457a51653449-metrics-certs\") pod \"router-default-5d4699ff7f-xg2hr\" (UID: \"e1d50049-e6de-4aa9-80fc-457a51653449\") " pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:30.973035 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:30.972602    2527 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 00:06:30.973035 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:30.972683    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872d3ff4-c766-4f3b-8e98-4e622f016146-cluster-monitoring-operator-tls podName:872d3ff4-c766-4f3b-8e98-4e622f016146 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:46.972665538 +0000 UTC m=+281.275113873 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/872d3ff4-c766-4f3b-8e98-4e622f016146-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-fwpz8" (UID: "872d3ff4-c766-4f3b-8e98-4e622f016146") : secret "cluster-monitoring-operator-tls" not found
Jul 30 00:06:30.973035 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:30.972717    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e1d50049-e6de-4aa9-80fc-457a51653449-service-ca-bundle podName:e1d50049-e6de-4aa9-80fc-457a51653449 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:46.97270311 +0000 UTC m=+281.275151434 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e1d50049-e6de-4aa9-80fc-457a51653449-service-ca-bundle") pod "router-default-5d4699ff7f-xg2hr" (UID: "e1d50049-e6de-4aa9-80fc-457a51653449") : configmap references non-existent config key: service-ca.crt
Jul 30 00:06:30.975016 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:30.974993    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6393983e-c75a-47a0-9f95-6738a80b257c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-44gpk\" (UID: \"6393983e-c75a-47a0-9f95-6738a80b257c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-44gpk"
Jul 30 00:06:30.975103 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:30.975027    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e1d50049-e6de-4aa9-80fc-457a51653449-metrics-certs\") pod \"router-default-5d4699ff7f-xg2hr\" (UID: \"e1d50049-e6de-4aa9-80fc-457a51653449\") " pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:31.015555 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:31.015535    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-44gpk"
Jul 30 00:06:31.073476 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:31.073443    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-registry-tls\") pod \"image-registry-844b9fb84f-bdxmv\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") " pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:31.076648 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:31.076620    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-registry-tls\") pod \"image-registry-844b9fb84f-bdxmv\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") " pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:31.104500 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:31.104473    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:31.146501 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:31.146469    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-44gpk"]
Jul 30 00:06:31.233689 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:31.233624    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-844b9fb84f-bdxmv"]
Jul 30 00:06:31.236402 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:06:31.236377    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddad1f6c_b733_47c2_a2ba_efc27c716416.slice/crio-ca38aad73613f09fff36cb0bcb099804c69ec27b0dc376f5c1f1213ac0f1bd1d WatchSource:0}: Error finding container ca38aad73613f09fff36cb0bcb099804c69ec27b0dc376f5c1f1213ac0f1bd1d: Status 404 returned error can't find the container with id ca38aad73613f09fff36cb0bcb099804c69ec27b0dc376f5c1f1213ac0f1bd1d
Jul 30 00:06:31.957609 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:31.957569    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv" event={"ID":"ddad1f6c-b733-47c2-a2ba-efc27c716416","Type":"ContainerStarted","Data":"1940692c3233f18fd912ceed08b793e9efb0dd88a7ef9d83c9b66443429ea2f6"}
Jul 30 00:06:31.957814 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:31.957622    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv" event={"ID":"ddad1f6c-b733-47c2-a2ba-efc27c716416","Type":"ContainerStarted","Data":"ca38aad73613f09fff36cb0bcb099804c69ec27b0dc376f5c1f1213ac0f1bd1d"}
Jul 30 00:06:31.957814 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:31.957714    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:06:31.958730 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:31.958710    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-44gpk" event={"ID":"6393983e-c75a-47a0-9f95-6738a80b257c","Type":"ContainerStarted","Data":"fceb58b95640c7d6fd3db0472950d1a52274e421a31965016780969d896e5745"}
Jul 30 00:06:31.973939 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:31.973896    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv" podStartSLOduration=16.973883933 podStartE2EDuration="16.973883933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:06:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:06:31.972934046 +0000 UTC m=+266.275382391" watchObservedRunningTime="2026-07-30 00:06:31.973883933 +0000 UTC m=+266.276332278"
Jul 30 00:06:34.503053 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:34.503016    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xwfd8\" (UID: \"d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8\") " pod="openshift-insights/insights-runtime-extractor-xwfd8"
Jul 30 00:06:34.503558 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:34.503209    2527 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 00:06:34.503558 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:34.503285    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-insights-runtime-extractor-tls podName:d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8 nodeName:}" failed. No retries permitted until 2026-07-30 00:06:50.503268366 +0000 UTC m=+284.805716689 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xwfd8" (UID: "d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8") : secret "insights-runtime-extractor-tls" not found
Jul 30 00:06:35.973376 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:35.973335    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-44gpk" event={"ID":"6393983e-c75a-47a0-9f95-6738a80b257c","Type":"ContainerStarted","Data":"0ac27258e3708941e601f4a6da517d682bb2066a3b732a93c80a97b02fc59f3a"}
Jul 30 00:06:35.973744 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:35.973428    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-44gpk" event={"ID":"6393983e-c75a-47a0-9f95-6738a80b257c","Type":"ContainerStarted","Data":"17df8e659177a14d0ca7dadd21337198779456a6079ede6960b48f6a17c7a42b"}
Jul 30 00:06:35.989556 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:35.989503    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-44gpk" podStartSLOduration=17.270218293 podStartE2EDuration="20.98948914s" totalImagesPullingTime="3.719270847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:06:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:06:35.988268476 +0000 UTC m=+270.290716821" watchObservedRunningTime="2026-07-30 00:06:35.98948914 +0000 UTC m=+270.291937484"
Jul 30 00:06:39.793844 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:39.793812    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-844b9fb84f-bdxmv"]
Jul 30 00:06:40.076221 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:40.076138    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-8wqrt"]
Jul 30 00:06:40.080617 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:40.080601    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-8wqrt"
Jul 30 00:06:40.082945 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:40.082918    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-ctbfl\""
Jul 30 00:06:40.082945 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:40.082936    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 30 00:06:40.083090 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:40.082970    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 30 00:06:40.087400 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:40.087384    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-8wqrt"]
Jul 30 00:06:40.149745 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:40.149716    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2769\" (UniqueName: \"kubernetes.io/projected/4fb5f19c-d21a-4d0a-9682-3cfc7f7c284a-kube-api-access-s2769\") pod \"downloads-7c97dc4555-8wqrt\" (UID: \"4fb5f19c-d21a-4d0a-9682-3cfc7f7c284a\") " pod="openshift-console/downloads-7c97dc4555-8wqrt"
Jul 30 00:06:40.250145 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:40.250108    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2769\" (UniqueName: \"kubernetes.io/projected/4fb5f19c-d21a-4d0a-9682-3cfc7f7c284a-kube-api-access-s2769\") pod \"downloads-7c97dc4555-8wqrt\" (UID: \"4fb5f19c-d21a-4d0a-9682-3cfc7f7c284a\") " pod="openshift-console/downloads-7c97dc4555-8wqrt"
Jul 30 00:06:40.258147 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:40.258118    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2769\" (UniqueName: \"kubernetes.io/projected/4fb5f19c-d21a-4d0a-9682-3cfc7f7c284a-kube-api-access-s2769\") pod \"downloads-7c97dc4555-8wqrt\" (UID: \"4fb5f19c-d21a-4d0a-9682-3cfc7f7c284a\") " pod="openshift-console/downloads-7c97dc4555-8wqrt"
Jul 30 00:06:40.390299 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:40.390232    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-8wqrt"
Jul 30 00:06:40.513622 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:40.513594    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-8wqrt"]
Jul 30 00:06:40.516558 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:06:40.516524    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fb5f19c_d21a_4d0a_9682_3cfc7f7c284a.slice/crio-d433bc9d78546448051d9f04d9c6a034b9cdc8a5fc846da17d0c91765d0491e1 WatchSource:0}: Error finding container d433bc9d78546448051d9f04d9c6a034b9cdc8a5fc846da17d0c91765d0491e1: Status 404 returned error can't find the container with id d433bc9d78546448051d9f04d9c6a034b9cdc8a5fc846da17d0c91765d0491e1
Jul 30 00:06:40.989918 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:40.989882    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-8wqrt" event={"ID":"4fb5f19c-d21a-4d0a-9682-3cfc7f7c284a","Type":"ContainerStarted","Data":"d433bc9d78546448051d9f04d9c6a034b9cdc8a5fc846da17d0c91765d0491e1"}
Jul 30 00:06:46.692830 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:06:46.692784    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jvbw8" podUID="ac196c9d-ff1e-4ed5-a85a-80ba51fa9819"
Jul 30 00:06:47.006466 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:47.006368    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1d50049-e6de-4aa9-80fc-457a51653449-service-ca-bundle\") pod \"router-default-5d4699ff7f-xg2hr\" (UID: \"e1d50049-e6de-4aa9-80fc-457a51653449\") " pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:47.006466 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:47.006462    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/872d3ff4-c766-4f3b-8e98-4e622f016146-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-fwpz8\" (UID: \"872d3ff4-c766-4f3b-8e98-4e622f016146\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-fwpz8"
Jul 30 00:06:47.007101 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:47.007076    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1d50049-e6de-4aa9-80fc-457a51653449-service-ca-bundle\") pod \"router-default-5d4699ff7f-xg2hr\" (UID: \"e1d50049-e6de-4aa9-80fc-457a51653449\") " pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:47.009336 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:47.009313    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jvbw8"
Jul 30 00:06:47.009432 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:47.009393    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/872d3ff4-c766-4f3b-8e98-4e622f016146-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-fwpz8\" (UID: \"872d3ff4-c766-4f3b-8e98-4e622f016146\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-fwpz8"
Jul 30 00:06:47.207600 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:47.207565    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-fwpz8"
Jul 30 00:06:47.220607 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:47.220574    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:47.391129 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:47.391101    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-fwpz8"]
Jul 30 00:06:47.395752 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:06:47.395724    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod872d3ff4_c766_4f3b_8e98_4e622f016146.slice/crio-d965e84eeaf84ed68912ca3bd066a80497bb3c87e27c7e795281056677cb965a WatchSource:0}: Error finding container d965e84eeaf84ed68912ca3bd066a80497bb3c87e27c7e795281056677cb965a: Status 404 returned error can't find the container with id d965e84eeaf84ed68912ca3bd066a80497bb3c87e27c7e795281056677cb965a
Jul 30 00:06:47.417813 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:47.417774    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5d4699ff7f-xg2hr"]
Jul 30 00:06:47.419839 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:06:47.419812    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1d50049_e6de_4aa9_80fc_457a51653449.slice/crio-90b468f1983e699f271089f7be3b36539249abea99b1a08e2c53c1c521607635 WatchSource:0}: Error finding container 90b468f1983e699f271089f7be3b36539249abea99b1a08e2c53c1c521607635: Status 404 returned error can't find the container with id 90b468f1983e699f271089f7be3b36539249abea99b1a08e2c53c1c521607635
Jul 30 00:06:48.015322 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:48.015247    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5d4699ff7f-xg2hr" event={"ID":"e1d50049-e6de-4aa9-80fc-457a51653449","Type":"ContainerStarted","Data":"d89f01d80e4a074929b3f24cf84f534a75226cb4ca98423de90add8e5786454d"}
Jul 30 00:06:48.015763 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:48.015344    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5d4699ff7f-xg2hr" event={"ID":"e1d50049-e6de-4aa9-80fc-457a51653449","Type":"ContainerStarted","Data":"90b468f1983e699f271089f7be3b36539249abea99b1a08e2c53c1c521607635"}
Jul 30 00:06:48.016949 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:48.016900    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-fwpz8" event={"ID":"872d3ff4-c766-4f3b-8e98-4e622f016146","Type":"ContainerStarted","Data":"d965e84eeaf84ed68912ca3bd066a80497bb3c87e27c7e795281056677cb965a"}
Jul 30 00:06:48.034726 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:48.034673    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5d4699ff7f-xg2hr" podStartSLOduration=33.034655318 podStartE2EDuration="33.034655318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:06:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:06:48.032992454 +0000 UTC m=+282.335440801" watchObservedRunningTime="2026-07-30 00:06:48.034655318 +0000 UTC m=+282.337103665"
Jul 30 00:06:48.221701 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:48.221668    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:48.224403 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:48.224378    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:49.021477 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:49.021402    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:49.022862 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:49.022829    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5d4699ff7f-xg2hr"
Jul 30 00:06:49.800366 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:49.800270    2527 patch_prober.go:28] interesting pod/image-registry-844b9fb84f-bdxmv container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 30 00:06:49.800366 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:49.800337    2527 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv" podUID="ddad1f6c-b733-47c2-a2ba-efc27c716416" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 00:06:50.026470 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:50.026425    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-fwpz8" event={"ID":"872d3ff4-c766-4f3b-8e98-4e622f016146","Type":"ContainerStarted","Data":"3f87602df2d905965fbc932ad8a2be024281d6cfc82d62faf54522b4294cdd2c"}
Jul 30 00:06:50.032115 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:50.032075    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-metrics-tls\") pod \"dns-default-jvbw8\" (UID: \"ac196c9d-ff1e-4ed5-a85a-80ba51fa9819\") " pod="openshift-dns/dns-default-jvbw8"
Jul 30 00:06:50.034864 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:50.034842    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac196c9d-ff1e-4ed5-a85a-80ba51fa9819-metrics-tls\") pod \"dns-default-jvbw8\" (UID: \"ac196c9d-ff1e-4ed5-a85a-80ba51fa9819\") " pod="openshift-dns/dns-default-jvbw8"
Jul 30 00:06:50.045749 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:50.045711    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-fwpz8" podStartSLOduration=32.922760959 podStartE2EDuration="35.045695394s" totalImagesPullingTime="2.122934435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:06:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:06:50.04542627 +0000 UTC m=+284.347874617" watchObservedRunningTime="2026-07-30 00:06:50.045695394 +0000 UTC m=+284.348143752"
Jul 30 00:06:50.312997 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:50.312967    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nxhcc\""
Jul 30 00:06:50.320846 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:50.320815    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jvbw8"
Jul 30 00:06:50.461930 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:50.461854    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jvbw8"]
Jul 30 00:06:50.464715 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:06:50.464682    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac196c9d_ff1e_4ed5_a85a_80ba51fa9819.slice/crio-b686683e40a30c4329d3e04a19e00d248000b6fadb2942e2c6df9c9533270cf0 WatchSource:0}: Error finding container b686683e40a30c4329d3e04a19e00d248000b6fadb2942e2c6df9c9533270cf0: Status 404 returned error can't find the container with id b686683e40a30c4329d3e04a19e00d248000b6fadb2942e2c6df9c9533270cf0
Jul 30 00:06:50.536536 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:50.536509    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xwfd8\" (UID: \"d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8\") " pod="openshift-insights/insights-runtime-extractor-xwfd8"
Jul 30 00:06:50.539249 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:50.539219    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xwfd8\" (UID: \"d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8\") " pod="openshift-insights/insights-runtime-extractor-xwfd8"
Jul 30 00:06:50.561156 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:50.561125    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xwfd8"
Jul 30 00:06:50.699986 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:50.699938    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xwfd8"]
Jul 30 00:06:50.703344 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:06:50.703315    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6a4f1d2_7b1e_46f4_8619_6dad53e5fdd8.slice/crio-faf744e191ece29c6f0eab9df5c5d19d8966070f725307957d966a1dcc48bc71 WatchSource:0}: Error finding container faf744e191ece29c6f0eab9df5c5d19d8966070f725307957d966a1dcc48bc71: Status 404 returned error can't find the container with id faf744e191ece29c6f0eab9df5c5d19d8966070f725307957d966a1dcc48bc71
Jul 30 00:06:51.031367 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:51.031324    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xwfd8" event={"ID":"d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8","Type":"ContainerStarted","Data":"faf744e191ece29c6f0eab9df5c5d19d8966070f725307957d966a1dcc48bc71"}
Jul 30 00:06:51.032621 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:51.032593    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jvbw8" event={"ID":"ac196c9d-ff1e-4ed5-a85a-80ba51fa9819","Type":"ContainerStarted","Data":"b686683e40a30c4329d3e04a19e00d248000b6fadb2942e2c6df9c9533270cf0"}
Jul 30 00:06:59.408982 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.408675    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-wd4t4"]
Jul 30 00:06:59.419401 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.419359    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wd4t4"
Jul 30 00:06:59.421689 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.421640    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-wd4t4"]
Jul 30 00:06:59.421898 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.421804    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 30 00:06:59.423053 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.422848    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-8nnxj\""
Jul 30 00:06:59.423053 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.423019    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 30 00:06:59.423255 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.423075    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 30 00:06:59.437451 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.436583    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-xzrt8"]
Jul 30 00:06:59.442007 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.441982    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzrt8"
Jul 30 00:06:59.442909 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.442882    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-spd92"]
Jul 30 00:06:59.444291 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.444266    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 30 00:06:59.444399 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.444370    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 30 00:06:59.444746 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.444728    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-n7mhx\""
Jul 30 00:06:59.444949 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.444933    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 30 00:06:59.447756 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.447734    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-spd92"
Jul 30 00:06:59.450380 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.450112    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 30 00:06:59.450380 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.450190    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zmzzb\""
Jul 30 00:06:59.450552 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.450443    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 30 00:06:59.450552 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.450545    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 30 00:06:59.455880 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.455858    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-xzrt8"]
Jul 30 00:06:59.513870 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.513835    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/228f12e0-8eb0-4202-b030-4ae9e68dfd7c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-wd4t4\" (UID: \"228f12e0-8eb0-4202-b030-4ae9e68dfd7c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wd4t4"
Jul 30 00:06:59.514028 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.513886    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/228f12e0-8eb0-4202-b030-4ae9e68dfd7c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-wd4t4\" (UID: \"228f12e0-8eb0-4202-b030-4ae9e68dfd7c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wd4t4"
Jul 30 00:06:59.514028 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.513925    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/228f12e0-8eb0-4202-b030-4ae9e68dfd7c-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-wd4t4\" (UID: \"228f12e0-8eb0-4202-b030-4ae9e68dfd7c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wd4t4"
Jul 30 00:06:59.514028 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.514003    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtx4t\" (UniqueName: \"kubernetes.io/projected/228f12e0-8eb0-4202-b030-4ae9e68dfd7c-kube-api-access-wtx4t\") pod \"openshift-state-metrics-b8f49f5c6-wd4t4\" (UID: \"228f12e0-8eb0-4202-b030-4ae9e68dfd7c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wd4t4"
Jul 30 00:06:59.615460 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.615417    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vdqp\" (UniqueName: \"kubernetes.io/projected/8ce6bb72-448c-4cde-be75-5e093fa7ed40-kube-api-access-9vdqp\") pod \"kube-state-metrics-56d9f944b4-xzrt8\" (UID: \"8ce6bb72-448c-4cde-be75-5e093fa7ed40\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzrt8"
Jul 30 00:06:59.615622 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.615487    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8ce6bb72-448c-4cde-be75-5e093fa7ed40-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-xzrt8\" (UID: \"8ce6bb72-448c-4cde-be75-5e093fa7ed40\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzrt8"
Jul 30 00:06:59.615622 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.615523    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c16aaf3-1bdc-4793-a8b9-6196a0701910-sys\") pod \"node-exporter-spd92\" (UID: \"2c16aaf3-1bdc-4793-a8b9-6196a0701910\") " pod="openshift-monitoring/node-exporter-spd92"
Jul 30 00:06:59.615622 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.615550    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ce6bb72-448c-4cde-be75-5e093fa7ed40-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-xzrt8\" (UID: \"8ce6bb72-448c-4cde-be75-5e093fa7ed40\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzrt8"
Jul 30 00:06:59.615801 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.615633    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c16aaf3-1bdc-4793-a8b9-6196a0701910-node-exporter-accelerators-collector-config\") pod \"node-exporter-spd92\" (UID: \"2c16aaf3-1bdc-4793-a8b9-6196a0701910\") " pod="openshift-monitoring/node-exporter-spd92"
Jul 30 00:06:59.615801 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.615669    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c16aaf3-1bdc-4793-a8b9-6196a0701910-root\") pod \"node-exporter-spd92\" (UID: \"2c16aaf3-1bdc-4793-a8b9-6196a0701910\") " pod="openshift-monitoring/node-exporter-spd92"
Jul 30 00:06:59.615801 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.615699    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ce6bb72-448c-4cde-be75-5e093fa7ed40-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-xzrt8\" (UID: \"8ce6bb72-448c-4cde-be75-5e093fa7ed40\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzrt8"
Jul 30 00:06:59.615947 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.615804    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/228f12e0-8eb0-4202-b030-4ae9e68dfd7c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-wd4t4\" (UID: \"228f12e0-8eb0-4202-b030-4ae9e68dfd7c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wd4t4"
Jul 30 00:06:59.615947 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.615845    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/228f12e0-8eb0-4202-b030-4ae9e68dfd7c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-wd4t4\" (UID: \"228f12e0-8eb0-4202-b030-4ae9e68dfd7c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wd4t4"
Jul 30 00:06:59.615947 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.615880    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/228f12e0-8eb0-4202-b030-4ae9e68dfd7c-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-wd4t4\" (UID: \"228f12e0-8eb0-4202-b030-4ae9e68dfd7c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wd4t4"
Jul 30 00:06:59.615947 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.615908    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c16aaf3-1bdc-4793-a8b9-6196a0701910-metrics-client-ca\") pod \"node-exporter-spd92\" (UID: \"2c16aaf3-1bdc-4793-a8b9-6196a0701910\") " pod="openshift-monitoring/node-exporter-spd92"
Jul 30 00:06:59.616111 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.615945    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c16aaf3-1bdc-4793-a8b9-6196a0701910-node-exporter-tls\") pod \"node-exporter-spd92\" (UID: \"2c16aaf3-1bdc-4793-a8b9-6196a0701910\") " pod="openshift-monitoring/node-exporter-spd92"
Jul 30 00:06:59.616111 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.615975    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ce6bb72-448c-4cde-be75-5e093fa7ed40-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-xzrt8\" (UID: \"8ce6bb72-448c-4cde-be75-5e093fa7ed40\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzrt8"
Jul 30 00:06:59.616111 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.616008    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8ce6bb72-448c-4cde-be75-5e093fa7ed40-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-xzrt8\" (UID: \"8ce6bb72-448c-4cde-be75-5e093fa7ed40\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzrt8"
Jul 30 00:06:59.616111 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.616037    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c16aaf3-1bdc-4793-a8b9-6196a0701910-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-spd92\" (UID: \"2c16aaf3-1bdc-4793-a8b9-6196a0701910\") " pod="openshift-monitoring/node-exporter-spd92"
Jul 30 00:06:59.616111 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.616090    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c16aaf3-1bdc-4793-a8b9-6196a0701910-node-exporter-wtmp\") pod \"node-exporter-spd92\" (UID: \"2c16aaf3-1bdc-4793-a8b9-6196a0701910\") " pod="openshift-monitoring/node-exporter-spd92"
Jul 30 00:06:59.616307 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.616120    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtx4t\" (UniqueName: \"kubernetes.io/projected/228f12e0-8eb0-4202-b030-4ae9e68dfd7c-kube-api-access-wtx4t\") pod \"openshift-state-metrics-b8f49f5c6-wd4t4\" (UID: \"228f12e0-8eb0-4202-b030-4ae9e68dfd7c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wd4t4"
Jul 30 00:06:59.616307 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.616146    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c16aaf3-1bdc-4793-a8b9-6196a0701910-node-exporter-textfile\") pod \"node-exporter-spd92\" (UID: \"2c16aaf3-1bdc-4793-a8b9-6196a0701910\") " pod="openshift-monitoring/node-exporter-spd92"
Jul 30 00:06:59.616307 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.616191    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sntqs\" (UniqueName: \"kubernetes.io/projected/2c16aaf3-1bdc-4793-a8b9-6196a0701910-kube-api-access-sntqs\") pod \"node-exporter-spd92\" (UID: \"2c16aaf3-1bdc-4793-a8b9-6196a0701910\") " pod="openshift-monitoring/node-exporter-spd92"
Jul 30 00:06:59.616980 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.616948    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/228f12e0-8eb0-4202-b030-4ae9e68dfd7c-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-wd4t4\" (UID: \"228f12e0-8eb0-4202-b030-4ae9e68dfd7c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wd4t4"
Jul 30 00:06:59.619065 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.619039    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/228f12e0-8eb0-4202-b030-4ae9e68dfd7c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-wd4t4\" (UID: \"228f12e0-8eb0-4202-b030-4ae9e68dfd7c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wd4t4"
Jul 30 00:06:59.619693 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.619672    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/228f12e0-8eb0-4202-b030-4ae9e68dfd7c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-wd4t4\" (UID: \"228f12e0-8eb0-4202-b030-4ae9e68dfd7c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wd4t4"
Jul 30 00:06:59.630354 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.630298    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtx4t\" (UniqueName: \"kubernetes.io/projected/228f12e0-8eb0-4202-b030-4ae9e68dfd7c-kube-api-access-wtx4t\") pod \"openshift-state-metrics-b8f49f5c6-wd4t4\" (UID: \"228f12e0-8eb0-4202-b030-4ae9e68dfd7c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wd4t4"
Jul 30 00:06:59.717411 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.717334    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c16aaf3-1bdc-4793-a8b9-6196a0701910-node-exporter-tls\") pod \"node-exporter-spd92\" (UID: \"2c16aaf3-1bdc-4793-a8b9-6196a0701910\") " pod="openshift-monitoring/node-exporter-spd92"
Jul 30 00:06:59.717411 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.717389    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ce6bb72-448c-4cde-be75-5e093fa7ed40-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-xzrt8\" (UID: \"8ce6bb72-448c-4cde-be75-5e093fa7ed40\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzrt8"
Jul 30 00:06:59.717642 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.717426    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8ce6bb72-448c-4cde-be75-5e093fa7ed40-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-xzrt8\" (UID: \"8ce6bb72-448c-4cde-be75-5e093fa7ed40\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzrt8"
Jul 30 00:06:59.717642 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.717447    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c16aaf3-1bdc-4793-a8b9-6196a0701910-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-spd92\" (UID: \"2c16aaf3-1bdc-4793-a8b9-6196a0701910\") " pod="openshift-monitoring/node-exporter-spd92"
Jul 30 00:06:59.717642 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.717489    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c16aaf3-1bdc-4793-a8b9-6196a0701910-node-exporter-wtmp\") pod \"node-exporter-spd92\" (UID: \"2c16aaf3-1bdc-4793-a8b9-6196a0701910\") " pod="openshift-monitoring/node-exporter-spd92"
Jul 30 00:06:59.717642 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.717507    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c16aaf3-1bdc-4793-a8b9-6196a0701910-node-exporter-textfile\") pod \"node-exporter-spd92\" (UID: \"2c16aaf3-1bdc-4793-a8b9-6196a0701910\") " pod="openshift-monitoring/node-exporter-spd92"
Jul 30 00:06:59.717642 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.717530    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sntqs\" (UniqueName: \"kubernetes.io/projected/2c16aaf3-1bdc-4793-a8b9-6196a0701910-kube-api-access-sntqs\") pod \"node-exporter-spd92\" (UID: \"2c16aaf3-1bdc-4793-a8b9-6196a0701910\") " pod="openshift-monitoring/node-exporter-spd92"
Jul 30 00:06:59.717642 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.717555    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vdqp\" (UniqueName: \"kubernetes.io/projected/8ce6bb72-448c-4cde-be75-5e093fa7ed40-kube-api-access-9vdqp\") pod \"kube-state-metrics-56d9f944b4-xzrt8\" (UID: \"8ce6bb72-448c-4cde-be75-5e093fa7ed40\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzrt8"
Jul 30 00:06:59.717642 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.717592    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8ce6bb72-448c-4cde-be75-5e093fa7ed40-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-xzrt8\" (UID: \"8ce6bb72-448c-4cde-be75-5e093fa7ed40\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzrt8"
Jul 30 00:06:59.717642 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.717612    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c16aaf3-1bdc-4793-a8b9-6196a0701910-sys\") pod \"node-exporter-spd92\" (UID: \"2c16aaf3-1bdc-4793-a8b9-6196a0701910\") " pod="openshift-monitoring/node-exporter-spd92"
Jul 30 00:06:59.717642 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.717634    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ce6bb72-448c-4cde-be75-5e093fa7ed40-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-xzrt8\" (UID: \"8ce6bb72-448c-4cde-be75-5e093fa7ed40\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzrt8"
Jul 30 00:06:59.718050 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.717690    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c16aaf3-1bdc-4793-a8b9-6196a0701910-node-exporter-accelerators-collector-config\") pod \"node-exporter-spd92\" (UID: \"2c16aaf3-1bdc-4793-a8b9-6196a0701910\") " pod="openshift-monitoring/node-exporter-spd92"
Jul 30 00:06:59.718050 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.717714    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c16aaf3-1bdc-4793-a8b9-6196a0701910-root\") pod \"node-exporter-spd92\" (UID: \"2c16aaf3-1bdc-4793-a8b9-6196a0701910\") " pod="openshift-monitoring/node-exporter-spd92"
Jul 30 00:06:59.718050 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.717745    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ce6bb72-448c-4cde-be75-5e093fa7ed40-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-xzrt8\" (UID: \"8ce6bb72-448c-4cde-be75-5e093fa7ed40\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzrt8"
Jul 30 00:06:59.718050 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.717794    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c16aaf3-1bdc-4793-a8b9-6196a0701910-metrics-client-ca\") pod \"node-exporter-spd92\" (UID: \"2c16aaf3-1bdc-4793-a8b9-6196a0701910\") " pod="openshift-monitoring/node-exporter-spd92"
Jul 30 00:06:59.718443 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.718406    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c16aaf3-1bdc-4793-a8b9-6196a0701910-metrics-client-ca\") pod \"node-exporter-spd92\" (UID: \"2c16aaf3-1bdc-4793-a8b9-6196a0701910\") " pod="openshift-monitoring/node-exporter-spd92"
Jul 30 00:06:59.719090 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.719057    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c16aaf3-1bdc-4793-a8b9-6196a0701910-node-exporter-wtmp\") pod \"node-exporter-spd92\" (UID: \"2c16aaf3-1bdc-4793-a8b9-6196a0701910\") " pod="openshift-monitoring/node-exporter-spd92"
Jul 30 00:06:59.719312 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.719288    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c16aaf3-1bdc-4793-a8b9-6196a0701910-node-exporter-textfile\") pod \"node-exporter-spd92\" (UID: \"2c16aaf3-1bdc-4793-a8b9-6196a0701910\") " pod="openshift-monitoring/node-exporter-spd92"
Jul 30 00:06:59.719467 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.719353    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c16aaf3-1bdc-4793-a8b9-6196a0701910-root\") pod \"node-exporter-spd92\" (UID: \"2c16aaf3-1bdc-4793-a8b9-6196a0701910\") " pod="openshift-monitoring/node-exporter-spd92"
Jul 30 00:06:59.719573 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.719551    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c16aaf3-1bdc-4793-a8b9-6196a0701910-node-exporter-accelerators-collector-config\") pod \"node-exporter-spd92\" (UID: \"2c16aaf3-1bdc-4793-a8b9-6196a0701910\") " pod="openshift-monitoring/node-exporter-spd92"
Jul 30 00:06:59.719646 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.719585    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8ce6bb72-448c-4cde-be75-5e093fa7ed40-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-xzrt8\" (UID: \"8ce6bb72-448c-4cde-be75-5e093fa7ed40\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzrt8"
Jul 30 00:06:59.719646 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.719614    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c16aaf3-1bdc-4793-a8b9-6196a0701910-sys\") pod \"node-exporter-spd92\" (UID: \"2c16aaf3-1bdc-4793-a8b9-6196a0701910\") " pod="openshift-monitoring/node-exporter-spd92"
Jul 30 00:06:59.719925 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.719903    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8ce6bb72-448c-4cde-be75-5e093fa7ed40-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-xzrt8\" (UID: \"8ce6bb72-448c-4cde-be75-5e093fa7ed40\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzrt8"
Jul 30 00:06:59.720006 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.719975    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ce6bb72-448c-4cde-be75-5e093fa7ed40-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-xzrt8\" (UID: \"8ce6bb72-448c-4cde-be75-5e093fa7ed40\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzrt8"
Jul 30 00:06:59.720983 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.720938    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c16aaf3-1bdc-4793-a8b9-6196a0701910-node-exporter-tls\") pod \"node-exporter-spd92\" (UID: \"2c16aaf3-1bdc-4793-a8b9-6196a0701910\") " pod="openshift-monitoring/node-exporter-spd92"
Jul 30 00:06:59.721655 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.721615    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ce6bb72-448c-4cde-be75-5e093fa7ed40-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-xzrt8\" (UID: \"8ce6bb72-448c-4cde-be75-5e093fa7ed40\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzrt8"
Jul 30 00:06:59.721837 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.721762    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c16aaf3-1bdc-4793-a8b9-6196a0701910-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-spd92\" (UID: \"2c16aaf3-1bdc-4793-a8b9-6196a0701910\") " pod="openshift-monitoring/node-exporter-spd92"
Jul 30 00:06:59.722586 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.722568    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ce6bb72-448c-4cde-be75-5e093fa7ed40-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-xzrt8\" (UID: \"8ce6bb72-448c-4cde-be75-5e093fa7ed40\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzrt8"
Jul 30 00:06:59.726748 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.726729    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vdqp\" (UniqueName: \"kubernetes.io/projected/8ce6bb72-448c-4cde-be75-5e093fa7ed40-kube-api-access-9vdqp\") pod \"kube-state-metrics-56d9f944b4-xzrt8\" (UID: \"8ce6bb72-448c-4cde-be75-5e093fa7ed40\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzrt8"
Jul 30 00:06:59.727820 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.727779    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sntqs\" (UniqueName: \"kubernetes.io/projected/2c16aaf3-1bdc-4793-a8b9-6196a0701910-kube-api-access-sntqs\") pod \"node-exporter-spd92\" (UID: \"2c16aaf3-1bdc-4793-a8b9-6196a0701910\") " pod="openshift-monitoring/node-exporter-spd92"
Jul 30 00:06:59.733668 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.733443    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wd4t4"
Jul 30 00:06:59.756115 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.756082    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzrt8"
Jul 30 00:06:59.764252 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.764225    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-spd92"
Jul 30 00:06:59.799025 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:06:59.798998    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:07:00.211002 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:07:00.210963    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-lj2rz" podUID="47b042b2-e9c2-45fd-ae41-9608eaf6aa4d"
Jul 30 00:07:00.479942 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.479877    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 00:07:00.495077 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.495046    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.496405 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.496305    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 00:07:00.499565 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.497715    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 30 00:07:00.499565 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.497918    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 30 00:07:00.499565 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.498082    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 30 00:07:00.499565 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.498479    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 30 00:07:00.499565 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.498670    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 30 00:07:00.499565 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.498845    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 30 00:07:00.499565 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.499063    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 30 00:07:00.499565 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.499238    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-q4sm6\""
Jul 30 00:07:00.499565 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.499404    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 30 00:07:00.500064 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.499408    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 30 00:07:00.626740 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.626705    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bcd07664-bb84-4f8c-8f59-a970892dbce7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.626937 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.626756    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bcd07664-bb84-4f8c-8f59-a970892dbce7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.626937 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.626784    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bcd07664-bb84-4f8c-8f59-a970892dbce7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.626937 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.626891    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bcd07664-bb84-4f8c-8f59-a970892dbce7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.627092 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.626950    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bcd07664-bb84-4f8c-8f59-a970892dbce7-web-config\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.627092 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.627007    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bcd07664-bb84-4f8c-8f59-a970892dbce7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.627092 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.627033    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bcd07664-bb84-4f8c-8f59-a970892dbce7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.627270 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.627093    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bcd07664-bb84-4f8c-8f59-a970892dbce7-config-volume\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.627270 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.627143    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bcd07664-bb84-4f8c-8f59-a970892dbce7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.627270 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.627201    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trqvb\" (UniqueName: \"kubernetes.io/projected/bcd07664-bb84-4f8c-8f59-a970892dbce7-kube-api-access-trqvb\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.627270 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.627224    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcd07664-bb84-4f8c-8f59-a970892dbce7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.627270 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.627253    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bcd07664-bb84-4f8c-8f59-a970892dbce7-config-out\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.627515 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.627273    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bcd07664-bb84-4f8c-8f59-a970892dbce7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.728070 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.728029    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bcd07664-bb84-4f8c-8f59-a970892dbce7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.728070 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.728079    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bcd07664-bb84-4f8c-8f59-a970892dbce7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.728386 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.728234    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bcd07664-bb84-4f8c-8f59-a970892dbce7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.728386 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.728323    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bcd07664-bb84-4f8c-8f59-a970892dbce7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.728386 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.728366    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bcd07664-bb84-4f8c-8f59-a970892dbce7-web-config\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.728554 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.728413    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bcd07664-bb84-4f8c-8f59-a970892dbce7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.728554 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.728437    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bcd07664-bb84-4f8c-8f59-a970892dbce7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.728554 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.728472    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bcd07664-bb84-4f8c-8f59-a970892dbce7-config-volume\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.728554 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.728510    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bcd07664-bb84-4f8c-8f59-a970892dbce7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.728554 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.728546    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trqvb\" (UniqueName: \"kubernetes.io/projected/bcd07664-bb84-4f8c-8f59-a970892dbce7-kube-api-access-trqvb\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.728805 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.728577    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcd07664-bb84-4f8c-8f59-a970892dbce7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.728805 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.728612    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bcd07664-bb84-4f8c-8f59-a970892dbce7-config-out\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.728805 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.728635    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bcd07664-bb84-4f8c-8f59-a970892dbce7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.728994 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.728971    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bcd07664-bb84-4f8c-8f59-a970892dbce7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.729384 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:07:00.729358    2527 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 30 00:07:00.729481 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:07:00.729452    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcd07664-bb84-4f8c-8f59-a970892dbce7-secret-alertmanager-main-tls podName:bcd07664-bb84-4f8c-8f59-a970892dbce7 nodeName:}" failed. No retries permitted until 2026-07-30 00:07:01.229427602 +0000 UTC m=+295.531875926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/bcd07664-bb84-4f8c-8f59-a970892dbce7-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "bcd07664-bb84-4f8c-8f59-a970892dbce7") : secret "alertmanager-main-tls" not found
Jul 30 00:07:00.729631 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.729605    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bcd07664-bb84-4f8c-8f59-a970892dbce7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.730210 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:07:00.730121    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bcd07664-bb84-4f8c-8f59-a970892dbce7-alertmanager-trusted-ca-bundle podName:bcd07664-bb84-4f8c-8f59-a970892dbce7 nodeName:}" failed. No retries permitted until 2026-07-30 00:07:01.230100893 +0000 UTC m=+295.532549242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/bcd07664-bb84-4f8c-8f59-a970892dbce7-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "bcd07664-bb84-4f8c-8f59-a970892dbce7") : configmap references non-existent config key: ca-bundle.crt
Jul 30 00:07:00.731843 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.731806    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bcd07664-bb84-4f8c-8f59-a970892dbce7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.732904 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.732510    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bcd07664-bb84-4f8c-8f59-a970892dbce7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.732904 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.732613    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bcd07664-bb84-4f8c-8f59-a970892dbce7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.733047 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.732954    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bcd07664-bb84-4f8c-8f59-a970892dbce7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.733539 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.733500    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bcd07664-bb84-4f8c-8f59-a970892dbce7-web-config\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.733627 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.733604    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bcd07664-bb84-4f8c-8f59-a970892dbce7-config-out\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.734041 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.734018    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bcd07664-bb84-4f8c-8f59-a970892dbce7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.734379 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.734336    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bcd07664-bb84-4f8c-8f59-a970892dbce7-config-volume\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:00.737672 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:00.737626    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trqvb\" (UniqueName: \"kubernetes.io/projected/bcd07664-bb84-4f8c-8f59-a970892dbce7-kube-api-access-trqvb\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:01.234107 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:01.234063    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcd07664-bb84-4f8c-8f59-a970892dbce7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:01.234301 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:01.234232    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bcd07664-bb84-4f8c-8f59-a970892dbce7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:01.235044 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:01.234995    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcd07664-bb84-4f8c-8f59-a970892dbce7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:01.237093 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:01.237068    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bcd07664-bb84-4f8c-8f59-a970892dbce7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bcd07664-bb84-4f8c-8f59-a970892dbce7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:01.409023 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:01.408949    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 30 00:07:01.569746 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:01.569700    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-wd4t4"]
Jul 30 00:07:02.285195 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:07:02.285138    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod228f12e0_8eb0_4202_b030_4ae9e68dfd7c.slice/crio-4b5e4c21a9c9e21413c0a11717c0b1fac911da3691aaf2b5b1cf6d7d071ba327 WatchSource:0}: Error finding container 4b5e4c21a9c9e21413c0a11717c0b1fac911da3691aaf2b5b1cf6d7d071ba327: Status 404 returned error can't find the container with id 4b5e4c21a9c9e21413c0a11717c0b1fac911da3691aaf2b5b1cf6d7d071ba327
Jul 30 00:07:02.475481 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:02.475418    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-xzrt8"]
Jul 30 00:07:02.535333 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:02.535191    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 00:07:02.542339 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:07:02.542301    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcd07664_bb84_4f8c_8f59_a970892dbce7.slice/crio-a8ed5033c34c9230ea686ba77c64ef1bb1f2e61ca56a1733f087824bfca1d7dd WatchSource:0}: Error finding container a8ed5033c34c9230ea686ba77c64ef1bb1f2e61ca56a1733f087824bfca1d7dd: Status 404 returned error can't find the container with id a8ed5033c34c9230ea686ba77c64ef1bb1f2e61ca56a1733f087824bfca1d7dd
Jul 30 00:07:03.083859 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:03.083814    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xwfd8" event={"ID":"d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8","Type":"ContainerStarted","Data":"f0f96bd7d88b73e7ef62ee0e09208c001d6a2d9c10433f69262247476d8acdca"}
Jul 30 00:07:03.088269 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:03.088202    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzrt8" event={"ID":"8ce6bb72-448c-4cde-be75-5e093fa7ed40","Type":"ContainerStarted","Data":"7d2dd2ced6235873d1b01777787303f9eb5f7f5bbc9c68a5eef24c54665477de"}
Jul 30 00:07:03.092857 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:03.092227    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jvbw8" event={"ID":"ac196c9d-ff1e-4ed5-a85a-80ba51fa9819","Type":"ContainerStarted","Data":"dc999df455697a0d09c5631e98731ec43da834eed95e3cffa571f4acba9db068"}
Jul 30 00:07:03.093079 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:03.092882    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jvbw8"
Jul 30 00:07:03.093079 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:03.092908    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jvbw8" event={"ID":"ac196c9d-ff1e-4ed5-a85a-80ba51fa9819","Type":"ContainerStarted","Data":"a1f4ab385ac755fcf487540084ef883cb1f9b67aa13fb2a67f0a81c93dfc94b7"}
Jul 30 00:07:03.097600 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:03.097359    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-8wqrt" event={"ID":"4fb5f19c-d21a-4d0a-9682-3cfc7f7c284a","Type":"ContainerStarted","Data":"1005ad8edd9c06edf00e104930373a1d89d5a10b2ebf1267e667b8593aad8667"}
Jul 30 00:07:03.098306 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:03.098232    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-8wqrt"
Jul 30 00:07:03.101460 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:03.101385    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bcd07664-bb84-4f8c-8f59-a970892dbce7","Type":"ContainerStarted","Data":"a8ed5033c34c9230ea686ba77c64ef1bb1f2e61ca56a1733f087824bfca1d7dd"}
Jul 30 00:07:03.102855 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:03.102833    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-spd92" event={"ID":"2c16aaf3-1bdc-4793-a8b9-6196a0701910","Type":"ContainerStarted","Data":"7467a01c312bd848c69d24102a85efad16234a8f8a9bb3118102fa16c3c4575d"}
Jul 30 00:07:03.105944 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:03.105916    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wd4t4" event={"ID":"228f12e0-8eb0-4202-b030-4ae9e68dfd7c","Type":"ContainerStarted","Data":"64b417d00250c8422ecf7f34d488e588bd8fcadd1b33d4c07c410477848a740b"}
Jul 30 00:07:03.106068 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:03.106026    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wd4t4" event={"ID":"228f12e0-8eb0-4202-b030-4ae9e68dfd7c","Type":"ContainerStarted","Data":"845e674d7c360fa6523fda5fefa9f11f2c43966fec935da9bcaf45157a4c874b"}
Jul 30 00:07:03.106141 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:03.106069    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wd4t4" event={"ID":"228f12e0-8eb0-4202-b030-4ae9e68dfd7c","Type":"ContainerStarted","Data":"4b5e4c21a9c9e21413c0a11717c0b1fac911da3691aaf2b5b1cf6d7d071ba327"}
Jul 30 00:07:03.110218 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:03.108304    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jvbw8" podStartSLOduration=251.219878741 podStartE2EDuration="4m23.108285688s" totalImagesPullingTime="11.888406947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:07:03.107235138 +0000 UTC m=+297.409683483" watchObservedRunningTime="2026-07-30 00:07:03.108285688 +0000 UTC m=+297.410734034"
Jul 30 00:07:03.110218 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:03.110186    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-8wqrt"
Jul 30 00:07:03.124825 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:03.123062    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-8wqrt" podStartSLOduration=1.356479464 podStartE2EDuration="23.123045109s" totalImagesPullingTime="21.766565645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:06:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:07:03.122599206 +0000 UTC m=+297.425047566" watchObservedRunningTime="2026-07-30 00:07:03.123045109 +0000 UTC m=+297.425493455"
Jul 30 00:07:03.761695 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:03.761655    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5cdf79f7f9-5vgql"]
Jul 30 00:07:03.794198 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:03.788646    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5cdf79f7f9-5vgql"]
Jul 30 00:07:03.794198 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:03.788762    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5cdf79f7f9-5vgql"
Jul 30 00:07:03.794439 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:03.794277    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 30 00:07:03.794595 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:03.794537    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 30 00:07:03.796282 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:03.795202    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 30 00:07:03.796282 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:03.795418    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-be7qdbmch985a\""
Jul 30 00:07:03.796282 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:03.795747    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-q4q9h\""
Jul 30 00:07:03.796282 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:03.795958    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 30 00:07:03.964243 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:03.963822    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/185238c8-7ceb-4ddc-934b-114adc2a97bb-audit-log\") pod \"metrics-server-5cdf79f7f9-5vgql\" (UID: \"185238c8-7ceb-4ddc-934b-114adc2a97bb\") " pod="openshift-monitoring/metrics-server-5cdf79f7f9-5vgql"
Jul 30 00:07:03.964243 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:03.963877    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/185238c8-7ceb-4ddc-934b-114adc2a97bb-secret-metrics-server-client-certs\") pod \"metrics-server-5cdf79f7f9-5vgql\" (UID: \"185238c8-7ceb-4ddc-934b-114adc2a97bb\") " pod="openshift-monitoring/metrics-server-5cdf79f7f9-5vgql"
Jul 30 00:07:03.964243 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:03.963937    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/185238c8-7ceb-4ddc-934b-114adc2a97bb-client-ca-bundle\") pod \"metrics-server-5cdf79f7f9-5vgql\" (UID: \"185238c8-7ceb-4ddc-934b-114adc2a97bb\") " pod="openshift-monitoring/metrics-server-5cdf79f7f9-5vgql"
Jul 30 00:07:03.964243 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:03.963972    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/185238c8-7ceb-4ddc-934b-114adc2a97bb-secret-metrics-server-tls\") pod \"metrics-server-5cdf79f7f9-5vgql\" (UID: \"185238c8-7ceb-4ddc-934b-114adc2a97bb\") " pod="openshift-monitoring/metrics-server-5cdf79f7f9-5vgql"
Jul 30 00:07:03.964243 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:03.964007    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmxx7\" (UniqueName: \"kubernetes.io/projected/185238c8-7ceb-4ddc-934b-114adc2a97bb-kube-api-access-gmxx7\") pod \"metrics-server-5cdf79f7f9-5vgql\" (UID: \"185238c8-7ceb-4ddc-934b-114adc2a97bb\") " pod="openshift-monitoring/metrics-server-5cdf79f7f9-5vgql"
Jul 30 00:07:03.964243 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:03.964049    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/185238c8-7ceb-4ddc-934b-114adc2a97bb-metrics-server-audit-profiles\") pod \"metrics-server-5cdf79f7f9-5vgql\" (UID: \"185238c8-7ceb-4ddc-934b-114adc2a97bb\") " pod="openshift-monitoring/metrics-server-5cdf79f7f9-5vgql"
Jul 30 00:07:03.964243 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:03.964092    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/185238c8-7ceb-4ddc-934b-114adc2a97bb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5cdf79f7f9-5vgql\" (UID: \"185238c8-7ceb-4ddc-934b-114adc2a97bb\") " pod="openshift-monitoring/metrics-server-5cdf79f7f9-5vgql"
Jul 30 00:07:04.065148 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:04.065066    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/185238c8-7ceb-4ddc-934b-114adc2a97bb-client-ca-bundle\") pod \"metrics-server-5cdf79f7f9-5vgql\" (UID: \"185238c8-7ceb-4ddc-934b-114adc2a97bb\") " pod="openshift-monitoring/metrics-server-5cdf79f7f9-5vgql"
Jul 30 00:07:04.065148 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:04.065123    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/185238c8-7ceb-4ddc-934b-114adc2a97bb-secret-metrics-server-tls\") pod \"metrics-server-5cdf79f7f9-5vgql\" (UID: \"185238c8-7ceb-4ddc-934b-114adc2a97bb\") " pod="openshift-monitoring/metrics-server-5cdf79f7f9-5vgql"
Jul 30 00:07:04.065396 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:04.065181    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmxx7\" (UniqueName: \"kubernetes.io/projected/185238c8-7ceb-4ddc-934b-114adc2a97bb-kube-api-access-gmxx7\") pod \"metrics-server-5cdf79f7f9-5vgql\" (UID: \"185238c8-7ceb-4ddc-934b-114adc2a97bb\") " pod="openshift-monitoring/metrics-server-5cdf79f7f9-5vgql"
Jul 30 00:07:04.065396 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:04.065225    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/185238c8-7ceb-4ddc-934b-114adc2a97bb-metrics-server-audit-profiles\") pod \"metrics-server-5cdf79f7f9-5vgql\" (UID: \"185238c8-7ceb-4ddc-934b-114adc2a97bb\") " pod="openshift-monitoring/metrics-server-5cdf79f7f9-5vgql"
Jul 30 00:07:04.065396 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:04.065262    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/185238c8-7ceb-4ddc-934b-114adc2a97bb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5cdf79f7f9-5vgql\" (UID: \"185238c8-7ceb-4ddc-934b-114adc2a97bb\") " pod="openshift-monitoring/metrics-server-5cdf79f7f9-5vgql"
Jul 30 00:07:04.065396 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:04.065335    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/185238c8-7ceb-4ddc-934b-114adc2a97bb-audit-log\") pod \"metrics-server-5cdf79f7f9-5vgql\" (UID: \"185238c8-7ceb-4ddc-934b-114adc2a97bb\") " pod="openshift-monitoring/metrics-server-5cdf79f7f9-5vgql"
Jul 30 00:07:04.065396 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:04.065368    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/185238c8-7ceb-4ddc-934b-114adc2a97bb-secret-metrics-server-client-certs\") pod \"metrics-server-5cdf79f7f9-5vgql\" (UID: \"185238c8-7ceb-4ddc-934b-114adc2a97bb\") " pod="openshift-monitoring/metrics-server-5cdf79f7f9-5vgql"
Jul 30 00:07:04.067627 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:04.067275    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/185238c8-7ceb-4ddc-934b-114adc2a97bb-metrics-server-audit-profiles\") pod \"metrics-server-5cdf79f7f9-5vgql\" (UID: \"185238c8-7ceb-4ddc-934b-114adc2a97bb\") " pod="openshift-monitoring/metrics-server-5cdf79f7f9-5vgql"
Jul 30 00:07:04.067627 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:04.067335    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/185238c8-7ceb-4ddc-934b-114adc2a97bb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5cdf79f7f9-5vgql\" (UID: \"185238c8-7ceb-4ddc-934b-114adc2a97bb\") " pod="openshift-monitoring/metrics-server-5cdf79f7f9-5vgql"
Jul 30 00:07:04.067627 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:04.067567    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/185238c8-7ceb-4ddc-934b-114adc2a97bb-audit-log\") pod \"metrics-server-5cdf79f7f9-5vgql\" (UID: \"185238c8-7ceb-4ddc-934b-114adc2a97bb\") " pod="openshift-monitoring/metrics-server-5cdf79f7f9-5vgql"
Jul 30 00:07:04.081758 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:04.069195    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/185238c8-7ceb-4ddc-934b-114adc2a97bb-secret-metrics-server-client-certs\") pod \"metrics-server-5cdf79f7f9-5vgql\" (UID: \"185238c8-7ceb-4ddc-934b-114adc2a97bb\") " pod="openshift-monitoring/metrics-server-5cdf79f7f9-5vgql"
Jul 30 00:07:04.081758 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:04.072817    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/185238c8-7ceb-4ddc-934b-114adc2a97bb-secret-metrics-server-tls\") pod \"metrics-server-5cdf79f7f9-5vgql\" (UID: \"185238c8-7ceb-4ddc-934b-114adc2a97bb\") " pod="openshift-monitoring/metrics-server-5cdf79f7f9-5vgql"
Jul 30 00:07:04.081758 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:04.075410    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmxx7\" (UniqueName: \"kubernetes.io/projected/185238c8-7ceb-4ddc-934b-114adc2a97bb-kube-api-access-gmxx7\") pod \"metrics-server-5cdf79f7f9-5vgql\" (UID: \"185238c8-7ceb-4ddc-934b-114adc2a97bb\") " pod="openshift-monitoring/metrics-server-5cdf79f7f9-5vgql"
Jul 30 00:07:04.086990 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:04.086832    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/185238c8-7ceb-4ddc-934b-114adc2a97bb-client-ca-bundle\") pod \"metrics-server-5cdf79f7f9-5vgql\" (UID: \"185238c8-7ceb-4ddc-934b-114adc2a97bb\") " pod="openshift-monitoring/metrics-server-5cdf79f7f9-5vgql"
Jul 30 00:07:04.108686 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:04.108604    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5cdf79f7f9-5vgql"
Jul 30 00:07:04.813349 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:04.813123    2527 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv" podUID="ddad1f6c-b733-47c2-a2ba-efc27c716416" containerName="registry" containerID="cri-o://1940692c3233f18fd912ceed08b793e9efb0dd88a7ef9d83c9b66443429ea2f6" gracePeriod=30
Jul 30 00:07:07.148126 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:07.133043    2527 generic.go:356] "Generic (PLEG): container finished" podID="ddad1f6c-b733-47c2-a2ba-efc27c716416" containerID="1940692c3233f18fd912ceed08b793e9efb0dd88a7ef9d83c9b66443429ea2f6" exitCode=0
Jul 30 00:07:07.148126 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:07.133134    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv" event={"ID":"ddad1f6c-b733-47c2-a2ba-efc27c716416","Type":"ContainerDied","Data":"1940692c3233f18fd912ceed08b793e9efb0dd88a7ef9d83c9b66443429ea2f6"}
Jul 30 00:07:08.419286 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:08.419257    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:07:08.508808 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:08.508535    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddad1f6c-b733-47c2-a2ba-efc27c716416-trusted-ca\") pod \"ddad1f6c-b733-47c2-a2ba-efc27c716416\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") "
Jul 30 00:07:08.508808 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:08.508606    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddad1f6c-b733-47c2-a2ba-efc27c716416-ca-trust-extracted\") pod \"ddad1f6c-b733-47c2-a2ba-efc27c716416\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") "
Jul 30 00:07:08.508808 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:08.508648    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwb86\" (UniqueName: \"kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-kube-api-access-xwb86\") pod \"ddad1f6c-b733-47c2-a2ba-efc27c716416\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") "
Jul 30 00:07:08.508808 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:08.508681    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-bound-sa-token\") pod \"ddad1f6c-b733-47c2-a2ba-efc27c716416\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") "
Jul 30 00:07:08.508808 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:08.508709    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddad1f6c-b733-47c2-a2ba-efc27c716416-image-registry-private-configuration\") pod \"ddad1f6c-b733-47c2-a2ba-efc27c716416\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") "
Jul 30 00:07:08.508808 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:08.508753    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-registry-tls\") pod \"ddad1f6c-b733-47c2-a2ba-efc27c716416\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") "
Jul 30 00:07:08.508808 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:08.508777    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddad1f6c-b733-47c2-a2ba-efc27c716416-installation-pull-secrets\") pod \"ddad1f6c-b733-47c2-a2ba-efc27c716416\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") "
Jul 30 00:07:08.508808 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:08.508815    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddad1f6c-b733-47c2-a2ba-efc27c716416-registry-certificates\") pod \"ddad1f6c-b733-47c2-a2ba-efc27c716416\" (UID: \"ddad1f6c-b733-47c2-a2ba-efc27c716416\") "
Jul 30 00:07:08.509403 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:08.509377    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddad1f6c-b733-47c2-a2ba-efc27c716416-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ddad1f6c-b733-47c2-a2ba-efc27c716416" (UID: "ddad1f6c-b733-47c2-a2ba-efc27c716416"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:07:08.509711 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:08.509688    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddad1f6c-b733-47c2-a2ba-efc27c716416-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ddad1f6c-b733-47c2-a2ba-efc27c716416" (UID: "ddad1f6c-b733-47c2-a2ba-efc27c716416"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:07:08.519606 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:08.519551    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddad1f6c-b733-47c2-a2ba-efc27c716416-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ddad1f6c-b733-47c2-a2ba-efc27c716416" (UID: "ddad1f6c-b733-47c2-a2ba-efc27c716416"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:07:08.522771 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:08.522742    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddad1f6c-b733-47c2-a2ba-efc27c716416-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ddad1f6c-b733-47c2-a2ba-efc27c716416" (UID: "ddad1f6c-b733-47c2-a2ba-efc27c716416"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:07:08.523011 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:08.522991    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-kube-api-access-xwb86" (OuterVolumeSpecName: "kube-api-access-xwb86") pod "ddad1f6c-b733-47c2-a2ba-efc27c716416" (UID: "ddad1f6c-b733-47c2-a2ba-efc27c716416"). InnerVolumeSpecName "kube-api-access-xwb86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:07:08.523205 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:08.523131    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddad1f6c-b733-47c2-a2ba-efc27c716416-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ddad1f6c-b733-47c2-a2ba-efc27c716416" (UID: "ddad1f6c-b733-47c2-a2ba-efc27c716416"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:07:08.524112 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:08.524079    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ddad1f6c-b733-47c2-a2ba-efc27c716416" (UID: "ddad1f6c-b733-47c2-a2ba-efc27c716416"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:07:08.525319 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:08.525267    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ddad1f6c-b733-47c2-a2ba-efc27c716416" (UID: "ddad1f6c-b733-47c2-a2ba-efc27c716416"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:07:08.596138 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:08.596099    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5cdf79f7f9-5vgql"]
Jul 30 00:07:08.609966 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:08.609940    2527 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddad1f6c-b733-47c2-a2ba-efc27c716416-trusted-ca\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:07:08.610088 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:08.609970    2527 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddad1f6c-b733-47c2-a2ba-efc27c716416-ca-trust-extracted\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:07:08.610088 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:08.609981    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwb86\" (UniqueName: \"kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-kube-api-access-xwb86\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:07:08.610088 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:08.609990    2527 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-bound-sa-token\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:07:08.610088 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:08.609999    2527 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddad1f6c-b733-47c2-a2ba-efc27c716416-image-registry-private-configuration\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:07:08.610088 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:08.610007    2527 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddad1f6c-b733-47c2-a2ba-efc27c716416-registry-tls\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:07:08.610088 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:08.610015    2527 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddad1f6c-b733-47c2-a2ba-efc27c716416-installation-pull-secrets\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:07:08.610088 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:08.610023    2527 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddad1f6c-b733-47c2-a2ba-efc27c716416-registry-certificates\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:07:09.149201 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:09.147287    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv"
Jul 30 00:07:09.149201 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:09.147345    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-844b9fb84f-bdxmv" event={"ID":"ddad1f6c-b733-47c2-a2ba-efc27c716416","Type":"ContainerDied","Data":"ca38aad73613f09fff36cb0bcb099804c69ec27b0dc376f5c1f1213ac0f1bd1d"}
Jul 30 00:07:09.149201 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:09.147413    2527 scope.go:117] "RemoveContainer" containerID="1940692c3233f18fd912ceed08b793e9efb0dd88a7ef9d83c9b66443429ea2f6"
Jul 30 00:07:09.170710 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:09.170683    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-844b9fb84f-bdxmv"]
Jul 30 00:07:09.174060 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:09.174033    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-844b9fb84f-bdxmv"]
Jul 30 00:07:09.410634 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:07:09.410559    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod185238c8_7ceb_4ddc_934b_114adc2a97bb.slice/crio-32a6d8db39480f6b9d07bdf37a5a2649006d0c38d629ecdf7f74de58130348bb WatchSource:0}: Error finding container 32a6d8db39480f6b9d07bdf37a5a2649006d0c38d629ecdf7f74de58130348bb: Status 404 returned error can't find the container with id 32a6d8db39480f6b9d07bdf37a5a2649006d0c38d629ecdf7f74de58130348bb
Jul 30 00:07:09.417795 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:09.417769    2527 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 00:07:09.628154 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:09.628129    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9cggv_c6b01a1f-c41e-4781-8c25-66b152e0d0e8/ovn-acl-logging/0.log"
Jul 30 00:07:09.629703 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:09.629680    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9cggv_c6b01a1f-c41e-4781-8c25-66b152e0d0e8/ovn-acl-logging/0.log"
Jul 30 00:07:09.632104 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:09.632085    2527 kubelet.go:1648] "Image garbage collection succeeded"
Jul 30 00:07:10.154487 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:10.154454    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzrt8" event={"ID":"8ce6bb72-448c-4cde-be75-5e093fa7ed40","Type":"ContainerStarted","Data":"2c82e29eb5af8bf8fabd474635a90a28d77a1ccc52b6b29956d6f7ffc24a2c43"}
Jul 30 00:07:10.154604 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:10.154561    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzrt8" event={"ID":"8ce6bb72-448c-4cde-be75-5e093fa7ed40","Type":"ContainerStarted","Data":"2e0259495965a33b1633318a8738958f39fde376a30d63e0f1c6729c7b46261a"}
Jul 30 00:07:10.155990 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:10.155964    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5cdf79f7f9-5vgql" event={"ID":"185238c8-7ceb-4ddc-934b-114adc2a97bb","Type":"ContainerStarted","Data":"32a6d8db39480f6b9d07bdf37a5a2649006d0c38d629ecdf7f74de58130348bb"}
Jul 30 00:07:10.158442 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:10.158417    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wd4t4" event={"ID":"228f12e0-8eb0-4202-b030-4ae9e68dfd7c","Type":"ContainerStarted","Data":"941661cdcfb4e4adface32e780ab0e416939d6f77eaaed49bd9d63265fd46082"}
Jul 30 00:07:10.160654 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:10.160628    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xwfd8" event={"ID":"d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8","Type":"ContainerStarted","Data":"a53eb9f82db5ad703f792f103287ea7393b5df81f9f09932d575dbfc3ca51ead"}
Jul 30 00:07:10.163735 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:10.163712    2527 generic.go:356] "Generic (PLEG): container finished" podID="2c16aaf3-1bdc-4793-a8b9-6196a0701910" containerID="ebe55bd6fda5c769c56ef115f94bcf6499c5bae0c92bc1567aea47fef2a4a5fc" exitCode=0
Jul 30 00:07:10.163886 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:10.163863    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-spd92" event={"ID":"2c16aaf3-1bdc-4793-a8b9-6196a0701910","Type":"ContainerDied","Data":"ebe55bd6fda5c769c56ef115f94bcf6499c5bae0c92bc1567aea47fef2a4a5fc"}
Jul 30 00:07:10.166097 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:10.166038    2527 generic.go:356] "Generic (PLEG): container finished" podID="bcd07664-bb84-4f8c-8f59-a970892dbce7" containerID="05101daf0c3341a685efcc7067cf00ff7b199aa23146fe5e7557d60a94352e8e" exitCode=0
Jul 30 00:07:10.166097 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:10.166071    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bcd07664-bb84-4f8c-8f59-a970892dbce7","Type":"ContainerDied","Data":"05101daf0c3341a685efcc7067cf00ff7b199aa23146fe5e7557d60a94352e8e"}
Jul 30 00:07:10.177505 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:10.177436    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wd4t4" podStartSLOduration=4.30315209 podStartE2EDuration="11.177417966s" totalImagesPullingTime="6.874265876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:07:10.176356511 +0000 UTC m=+304.478804858" watchObservedRunningTime="2026-07-30 00:07:10.177417966 +0000 UTC m=+304.479866312"
Jul 30 00:07:10.219501 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:10.219035    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddad1f6c-b733-47c2-a2ba-efc27c716416" path="/var/lib/kubelet/pods/ddad1f6c-b733-47c2-a2ba-efc27c716416/volumes"
Jul 30 00:07:11.175408 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:11.175370    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzrt8" event={"ID":"8ce6bb72-448c-4cde-be75-5e093fa7ed40","Type":"ContainerStarted","Data":"a5a3c9c0fd69ba43920b6aba4c0d286f45d57fdb40d99f7b2cdcd527f7069f5f"}
Jul 30 00:07:11.178851 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:11.178817    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-spd92" event={"ID":"2c16aaf3-1bdc-4793-a8b9-6196a0701910","Type":"ContainerStarted","Data":"3db736d43e8d229433a52cfc3ed7e2dfa7624528eb66563929965ab7903c8c12"}
Jul 30 00:07:11.178973 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:11.178879    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-spd92" event={"ID":"2c16aaf3-1bdc-4793-a8b9-6196a0701910","Type":"ContainerStarted","Data":"3317e8910de6a0d3b8026209ece80730206c235fad7b2e8b81f197079134f370"}
Jul 30 00:07:11.193998 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:11.193949    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xzrt8" podStartSLOduration=5.269496359 podStartE2EDuration="12.193930769s" totalImagesPullingTime="6.92443441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:07:11.191483513 +0000 UTC m=+305.493931869" watchObservedRunningTime="2026-07-30 00:07:11.193930769 +0000 UTC m=+305.496379116"
Jul 30 00:07:11.209009 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:11.208829    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-spd92" podStartSLOduration=5.963739897 podStartE2EDuration="12.20880942s" totalImagesPullingTime="6.095294674s" totalInitContainerRuntime="149.774849ms" isStatefulPod=true podCreationTimestamp="2026-07-30 00:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:07:11.207525339 +0000 UTC m=+305.509973686" watchObservedRunningTime="2026-07-30 00:07:11.20880942 +0000 UTC m=+305.511257766"
Jul 30 00:07:11.210329 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:11.210012    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:07:13.116531 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:13.116468    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jvbw8"
Jul 30 00:07:13.192565 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:13.192304    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bcd07664-bb84-4f8c-8f59-a970892dbce7","Type":"ContainerStarted","Data":"88afe11cebaa09d86c2ed2dab5c7492c3d55776811a8e26c6825e3031fe4e475"}
Jul 30 00:07:13.192565 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:13.192407    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bcd07664-bb84-4f8c-8f59-a970892dbce7","Type":"ContainerStarted","Data":"135fe2c39c8c1e9db1aa56c327a097ec81db9005ee0e7557d9828e051f8e0da9"}
Jul 30 00:07:13.192565 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:13.192449    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bcd07664-bb84-4f8c-8f59-a970892dbce7","Type":"ContainerStarted","Data":"afeaf472afb5d9bc093fcb4b4e0fdacee8b7b00be909de3a11d86903a60e8637"}
Jul 30 00:07:13.192565 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:13.192487    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bcd07664-bb84-4f8c-8f59-a970892dbce7","Type":"ContainerStarted","Data":"282f49e586087384e727f7d4a22724af577a24bd10290da08fa543d5ac207ada"}
Jul 30 00:07:13.194370 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:13.194345    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5cdf79f7f9-5vgql" event={"ID":"185238c8-7ceb-4ddc-934b-114adc2a97bb","Type":"ContainerStarted","Data":"671b769f30b552f2f714eccdf6212ab60c06edbc27e0337d87b379716acf2681"}
Jul 30 00:07:13.216602 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:13.216550    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5cdf79f7f9-5vgql" podStartSLOduration=7.368975663 podStartE2EDuration="10.216530458s" totalImagesPullingTime="2.847554795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:07:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:07:13.214758774 +0000 UTC m=+307.517207142" watchObservedRunningTime="2026-07-30 00:07:13.216530458 +0000 UTC m=+307.518978803"
Jul 30 00:07:14.203275 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:14.203241    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bcd07664-bb84-4f8c-8f59-a970892dbce7","Type":"ContainerStarted","Data":"28f674417ab7cb5b40a98544a94b8115d0b8422c2ce47f980a64dbbccefc396f"}
Jul 30 00:07:16.213969 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:16.213936    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xwfd8" event={"ID":"d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8","Type":"ContainerStarted","Data":"d1b7e4aef097b10a56ccaeee911d5d2f01f3f66d6b3e1c5213129014cdfa2610"}
Jul 30 00:07:16.230746 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:16.230700    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xwfd8" podStartSLOduration=33.570308146 podStartE2EDuration="58.230686065s" totalImagesPullingTime="24.660377919s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 00:06:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:07:16.229034387 +0000 UTC m=+310.531482733" watchObservedRunningTime="2026-07-30 00:07:16.230686065 +0000 UTC m=+310.533134418"
Jul 30 00:07:17.220226 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:17.220187    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bcd07664-bb84-4f8c-8f59-a970892dbce7","Type":"ContainerStarted","Data":"13164c5f3dafbf3d922c8156c0b55f8a4af2a4975b22b81a0faa109dfa92f478"}
Jul 30 00:07:17.245803 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:17.245758    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.905753276 podStartE2EDuration="17.245742634s" totalImagesPullingTime="12.324673112s" totalInitContainerRuntime="15.316246ms" isStatefulPod=false podCreationTimestamp="2026-07-30 00:07:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:07:17.243742969 +0000 UTC m=+311.546191314" watchObservedRunningTime="2026-07-30 00:07:17.245742634 +0000 UTC m=+311.548190979"
Jul 30 00:07:24.109902 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:24.109865    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5cdf79f7f9-5vgql"
Jul 30 00:07:24.110355 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:24.109951    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5cdf79f7f9-5vgql"
Jul 30 00:07:29.267631 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:29.267600    2527 generic.go:356] "Generic (PLEG): container finished" podID="2cc438b2-74db-4527-afb3-cfe578af038c" containerID="8f070adae31d94497358d95e65faa68be7eb76e5d15c680a789c90ba98919d6d" exitCode=0
Jul 30 00:07:29.267967 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:29.267671    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kk8nr" event={"ID":"2cc438b2-74db-4527-afb3-cfe578af038c","Type":"ContainerDied","Data":"8f070adae31d94497358d95e65faa68be7eb76e5d15c680a789c90ba98919d6d"}
Jul 30 00:07:29.267967 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:29.267958    2527 scope.go:117] "RemoveContainer" containerID="8f070adae31d94497358d95e65faa68be7eb76e5d15c680a789c90ba98919d6d"
Jul 30 00:07:30.273599 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:30.273565    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-kk8nr" event={"ID":"2cc438b2-74db-4527-afb3-cfe578af038c","Type":"ContainerStarted","Data":"d0d879c0537ace04be29f57171f749896c38834369559c5fa47c6ccde03bf4e5"}
Jul 30 00:07:31.278303 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:31.278276    2527 generic.go:356] "Generic (PLEG): container finished" podID="61402020-403f-44d7-ab55-7d01ccb8d185" containerID="05db497fcb65d1677ac91c1cf1d220484acfc777d5560a1dc77c18fe725331c1" exitCode=0
Jul 30 00:07:31.278649 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:31.278349    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-gbjkc" event={"ID":"61402020-403f-44d7-ab55-7d01ccb8d185","Type":"ContainerDied","Data":"05db497fcb65d1677ac91c1cf1d220484acfc777d5560a1dc77c18fe725331c1"}
Jul 30 00:07:31.278649 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:31.278624    2527 scope.go:117] "RemoveContainer" containerID="05db497fcb65d1677ac91c1cf1d220484acfc777d5560a1dc77c18fe725331c1"
Jul 30 00:07:32.283912 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:32.283871    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-gbjkc" event={"ID":"61402020-403f-44d7-ab55-7d01ccb8d185","Type":"ContainerStarted","Data":"431c1589d784ef9f5d623bc17beb915eb1114afa082576bc6904663aaddc9676"}
Jul 30 00:07:44.114523 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:44.114490    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5cdf79f7f9-5vgql"
Jul 30 00:07:44.118373 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:07:44.118351    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5cdf79f7f9-5vgql"
Jul 30 00:08:19.136714 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:19.136678    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs\") pod \"network-metrics-daemon-lj2rz\" (UID: \"47b042b2-e9c2-45fd-ae41-9608eaf6aa4d\") " pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:08:19.139055 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:19.139036    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47b042b2-e9c2-45fd-ae41-9608eaf6aa4d-metrics-certs\") pod \"network-metrics-daemon-lj2rz\" (UID: \"47b042b2-e9c2-45fd-ae41-9608eaf6aa4d\") " pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:08:19.313714 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:19.313674    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qpk4b\""
Jul 30 00:08:19.321725 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:19.321701    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lj2rz"
Jul 30 00:08:19.450787 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:19.450761    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lj2rz"]
Jul 30 00:08:19.453250 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:08:19.453225    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47b042b2_e9c2_45fd_ae41_9608eaf6aa4d.slice/crio-4b4ce6ab5e60d8d0a2ac9dbe69fe888bf03f24850ff19f779a2fc83365bc03f7 WatchSource:0}: Error finding container 4b4ce6ab5e60d8d0a2ac9dbe69fe888bf03f24850ff19f779a2fc83365bc03f7: Status 404 returned error can't find the container with id 4b4ce6ab5e60d8d0a2ac9dbe69fe888bf03f24850ff19f779a2fc83365bc03f7
Jul 30 00:08:20.460247 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:20.460215    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lj2rz" event={"ID":"47b042b2-e9c2-45fd-ae41-9608eaf6aa4d","Type":"ContainerStarted","Data":"2f2559c0f99999887e6972f2788750554d3d16e3f0b9c2c61820ad024868f190"}
Jul 30 00:08:20.460606 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:20.460265    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lj2rz" event={"ID":"47b042b2-e9c2-45fd-ae41-9608eaf6aa4d","Type":"ContainerStarted","Data":"47992d2d466336fc87a89a275b224fbdc1b0ff7b403d517a7c1ce921c8f98533"}
Jul 30 00:08:20.460606 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:20.460285    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lj2rz" event={"ID":"47b042b2-e9c2-45fd-ae41-9608eaf6aa4d","Type":"ContainerStarted","Data":"4b4ce6ab5e60d8d0a2ac9dbe69fe888bf03f24850ff19f779a2fc83365bc03f7"}
Jul 30 00:08:20.475302 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:20.475253    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lj2rz" podStartSLOduration=373.665233878 podStartE2EDuration="6m14.475238811s" totalImagesPullingTime="810.004933ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:08:20.473796801 +0000 UTC m=+374.776245146" watchObservedRunningTime="2026-07-30 00:08:20.475238811 +0000 UTC m=+374.777687157"
Jul 30 00:08:23.718889 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.718853    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-cdbd4f948-wkrgg"]
Jul 30 00:08:23.719280 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.719190    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddad1f6c-b733-47c2-a2ba-efc27c716416" containerName="registry"
Jul 30 00:08:23.719280 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.719204    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddad1f6c-b733-47c2-a2ba-efc27c716416" containerName="registry"
Jul 30 00:08:23.719280 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.719275    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddad1f6c-b733-47c2-a2ba-efc27c716416" containerName="registry"
Jul 30 00:08:23.721417 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.721402    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-cdbd4f948-wkrgg"
Jul 30 00:08:23.726213 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.726189    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 30 00:08:23.726394 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.726367    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 30 00:08:23.726528 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.726225    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 30 00:08:23.726528 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.726233    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 30 00:08:23.726528 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.726371    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 30 00:08:23.726528 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.726195    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-k9flg\""
Jul 30 00:08:23.730859 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.730554    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 30 00:08:23.738666 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.738642    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-cdbd4f948-wkrgg"]
Jul 30 00:08:23.771845 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.771814    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/31475f89-e98a-4065-abe2-1dc78512ba3a-secret-telemeter-client\") pod \"telemeter-client-cdbd4f948-wkrgg\" (UID: \"31475f89-e98a-4065-abe2-1dc78512ba3a\") " pod="openshift-monitoring/telemeter-client-cdbd4f948-wkrgg"
Jul 30 00:08:23.771845 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.771847    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31475f89-e98a-4065-abe2-1dc78512ba3a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-cdbd4f948-wkrgg\" (UID: \"31475f89-e98a-4065-abe2-1dc78512ba3a\") " pod="openshift-monitoring/telemeter-client-cdbd4f948-wkrgg"
Jul 30 00:08:23.772035 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.771872    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31475f89-e98a-4065-abe2-1dc78512ba3a-serving-certs-ca-bundle\") pod \"telemeter-client-cdbd4f948-wkrgg\" (UID: \"31475f89-e98a-4065-abe2-1dc78512ba3a\") " pod="openshift-monitoring/telemeter-client-cdbd4f948-wkrgg"
Jul 30 00:08:23.772035 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.771891    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31475f89-e98a-4065-abe2-1dc78512ba3a-metrics-client-ca\") pod \"telemeter-client-cdbd4f948-wkrgg\" (UID: \"31475f89-e98a-4065-abe2-1dc78512ba3a\") " pod="openshift-monitoring/telemeter-client-cdbd4f948-wkrgg"
Jul 30 00:08:23.772035 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.771935    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/31475f89-e98a-4065-abe2-1dc78512ba3a-federate-client-tls\") pod \"telemeter-client-cdbd4f948-wkrgg\" (UID: \"31475f89-e98a-4065-abe2-1dc78512ba3a\") " pod="openshift-monitoring/telemeter-client-cdbd4f948-wkrgg"
Jul 30 00:08:23.772035 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.771972    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/31475f89-e98a-4065-abe2-1dc78512ba3a-telemeter-client-tls\") pod \"telemeter-client-cdbd4f948-wkrgg\" (UID: \"31475f89-e98a-4065-abe2-1dc78512ba3a\") " pod="openshift-monitoring/telemeter-client-cdbd4f948-wkrgg"
Jul 30 00:08:23.772035 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.771999    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31475f89-e98a-4065-abe2-1dc78512ba3a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-cdbd4f948-wkrgg\" (UID: \"31475f89-e98a-4065-abe2-1dc78512ba3a\") " pod="openshift-monitoring/telemeter-client-cdbd4f948-wkrgg"
Jul 30 00:08:23.772035 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.772028    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m9l7\" (UniqueName: \"kubernetes.io/projected/31475f89-e98a-4065-abe2-1dc78512ba3a-kube-api-access-6m9l7\") pod \"telemeter-client-cdbd4f948-wkrgg\" (UID: \"31475f89-e98a-4065-abe2-1dc78512ba3a\") " pod="openshift-monitoring/telemeter-client-cdbd4f948-wkrgg"
Jul 30 00:08:23.872356 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.872329    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31475f89-e98a-4065-abe2-1dc78512ba3a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-cdbd4f948-wkrgg\" (UID: \"31475f89-e98a-4065-abe2-1dc78512ba3a\") " pod="openshift-monitoring/telemeter-client-cdbd4f948-wkrgg"
Jul 30 00:08:23.872478 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.872365    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m9l7\" (UniqueName: \"kubernetes.io/projected/31475f89-e98a-4065-abe2-1dc78512ba3a-kube-api-access-6m9l7\") pod \"telemeter-client-cdbd4f948-wkrgg\" (UID: \"31475f89-e98a-4065-abe2-1dc78512ba3a\") " pod="openshift-monitoring/telemeter-client-cdbd4f948-wkrgg"
Jul 30 00:08:23.872478 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.872404    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/31475f89-e98a-4065-abe2-1dc78512ba3a-secret-telemeter-client\") pod \"telemeter-client-cdbd4f948-wkrgg\" (UID: \"31475f89-e98a-4065-abe2-1dc78512ba3a\") " pod="openshift-monitoring/telemeter-client-cdbd4f948-wkrgg"
Jul 30 00:08:23.872478 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.872433    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31475f89-e98a-4065-abe2-1dc78512ba3a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-cdbd4f948-wkrgg\" (UID: \"31475f89-e98a-4065-abe2-1dc78512ba3a\") " pod="openshift-monitoring/telemeter-client-cdbd4f948-wkrgg"
Jul 30 00:08:23.872478 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.872461    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31475f89-e98a-4065-abe2-1dc78512ba3a-serving-certs-ca-bundle\") pod \"telemeter-client-cdbd4f948-wkrgg\" (UID: \"31475f89-e98a-4065-abe2-1dc78512ba3a\") " pod="openshift-monitoring/telemeter-client-cdbd4f948-wkrgg"
Jul 30 00:08:23.872673 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.872482    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31475f89-e98a-4065-abe2-1dc78512ba3a-metrics-client-ca\") pod \"telemeter-client-cdbd4f948-wkrgg\" (UID: \"31475f89-e98a-4065-abe2-1dc78512ba3a\") " pod="openshift-monitoring/telemeter-client-cdbd4f948-wkrgg"
Jul 30 00:08:23.872673 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.872508    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/31475f89-e98a-4065-abe2-1dc78512ba3a-federate-client-tls\") pod \"telemeter-client-cdbd4f948-wkrgg\" (UID: \"31475f89-e98a-4065-abe2-1dc78512ba3a\") " pod="openshift-monitoring/telemeter-client-cdbd4f948-wkrgg"
Jul 30 00:08:23.872673 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.872546    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/31475f89-e98a-4065-abe2-1dc78512ba3a-telemeter-client-tls\") pod \"telemeter-client-cdbd4f948-wkrgg\" (UID: \"31475f89-e98a-4065-abe2-1dc78512ba3a\") " pod="openshift-monitoring/telemeter-client-cdbd4f948-wkrgg"
Jul 30 00:08:23.873402 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.873376    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31475f89-e98a-4065-abe2-1dc78512ba3a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-cdbd4f948-wkrgg\" (UID: \"31475f89-e98a-4065-abe2-1dc78512ba3a\") " pod="openshift-monitoring/telemeter-client-cdbd4f948-wkrgg"
Jul 30 00:08:23.873533 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.873375    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31475f89-e98a-4065-abe2-1dc78512ba3a-serving-certs-ca-bundle\") pod \"telemeter-client-cdbd4f948-wkrgg\" (UID: \"31475f89-e98a-4065-abe2-1dc78512ba3a\") " pod="openshift-monitoring/telemeter-client-cdbd4f948-wkrgg"
Jul 30 00:08:23.873533 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.873450    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31475f89-e98a-4065-abe2-1dc78512ba3a-metrics-client-ca\") pod \"telemeter-client-cdbd4f948-wkrgg\" (UID: \"31475f89-e98a-4065-abe2-1dc78512ba3a\") " pod="openshift-monitoring/telemeter-client-cdbd4f948-wkrgg"
Jul 30 00:08:23.875093 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.875062    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/31475f89-e98a-4065-abe2-1dc78512ba3a-federate-client-tls\") pod \"telemeter-client-cdbd4f948-wkrgg\" (UID: \"31475f89-e98a-4065-abe2-1dc78512ba3a\") " pod="openshift-monitoring/telemeter-client-cdbd4f948-wkrgg"
Jul 30 00:08:23.875222 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.875192    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/31475f89-e98a-4065-abe2-1dc78512ba3a-secret-telemeter-client\") pod \"telemeter-client-cdbd4f948-wkrgg\" (UID: \"31475f89-e98a-4065-abe2-1dc78512ba3a\") " pod="openshift-monitoring/telemeter-client-cdbd4f948-wkrgg"
Jul 30 00:08:23.875222 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.875213    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31475f89-e98a-4065-abe2-1dc78512ba3a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-cdbd4f948-wkrgg\" (UID: \"31475f89-e98a-4065-abe2-1dc78512ba3a\") " pod="openshift-monitoring/telemeter-client-cdbd4f948-wkrgg"
Jul 30 00:08:23.875350 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.875331    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/31475f89-e98a-4065-abe2-1dc78512ba3a-telemeter-client-tls\") pod \"telemeter-client-cdbd4f948-wkrgg\" (UID: \"31475f89-e98a-4065-abe2-1dc78512ba3a\") " pod="openshift-monitoring/telemeter-client-cdbd4f948-wkrgg"
Jul 30 00:08:23.880032 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:23.880011    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m9l7\" (UniqueName: \"kubernetes.io/projected/31475f89-e98a-4065-abe2-1dc78512ba3a-kube-api-access-6m9l7\") pod \"telemeter-client-cdbd4f948-wkrgg\" (UID: \"31475f89-e98a-4065-abe2-1dc78512ba3a\") " pod="openshift-monitoring/telemeter-client-cdbd4f948-wkrgg"
Jul 30 00:08:24.033094 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:24.033014    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-cdbd4f948-wkrgg"
Jul 30 00:08:24.172691 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:24.172648    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-cdbd4f948-wkrgg"]
Jul 30 00:08:24.175119 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:08:24.175092    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31475f89_e98a_4065_abe2_1dc78512ba3a.slice/crio-aa6e1b70f167a1d86681bad5531e033d57a8fb95fae2ac241e31631dd9276ce4 WatchSource:0}: Error finding container aa6e1b70f167a1d86681bad5531e033d57a8fb95fae2ac241e31631dd9276ce4: Status 404 returned error can't find the container with id aa6e1b70f167a1d86681bad5531e033d57a8fb95fae2ac241e31631dd9276ce4
Jul 30 00:08:24.478423 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:24.478387    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-cdbd4f948-wkrgg" event={"ID":"31475f89-e98a-4065-abe2-1dc78512ba3a","Type":"ContainerStarted","Data":"aa6e1b70f167a1d86681bad5531e033d57a8fb95fae2ac241e31631dd9276ce4"}
Jul 30 00:08:26.488565 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:26.488470    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-cdbd4f948-wkrgg" event={"ID":"31475f89-e98a-4065-abe2-1dc78512ba3a","Type":"ContainerStarted","Data":"42039bde841baa3a10fe7d1ba6c9dd5268be901a16920e7f5b265cf864a0081e"}
Jul 30 00:08:26.488565 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:26.488555    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-cdbd4f948-wkrgg" event={"ID":"31475f89-e98a-4065-abe2-1dc78512ba3a","Type":"ContainerStarted","Data":"57794248d2912784e544fb809774541260a4e4e0f1a7784e39cf0f0583ae03fb"}
Jul 30 00:08:26.488983 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:26.488575    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-cdbd4f948-wkrgg" event={"ID":"31475f89-e98a-4065-abe2-1dc78512ba3a","Type":"ContainerStarted","Data":"e605898367004761a6f0548d0b32a1008e4e724cb69294a9ea23669f786041e3"}
Jul 30 00:08:26.508951 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:08:26.508894    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-cdbd4f948-wkrgg" podStartSLOduration=1.487949699 podStartE2EDuration="3.508875716s" totalImagesPullingTime="2.020926017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:08:26.506779702 +0000 UTC m=+380.809228049" watchObservedRunningTime="2026-07-30 00:08:26.508875716 +0000 UTC m=+380.811324063"
Jul 30 00:09:16.278258 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:16.278221    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7wtq"]
Jul 30 00:09:16.281687 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:16.281665    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7wtq"
Jul 30 00:09:16.284103 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:16.284082    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 30 00:09:16.284629 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:16.284615    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 30 00:09:16.284859 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:16.284845    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bw7j9\""
Jul 30 00:09:16.290313 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:16.290291    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7wtq"]
Jul 30 00:09:16.357382 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:16.357356    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7wtq\" (UID: \"5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7wtq"
Jul 30 00:09:16.357479 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:16.357403    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79pbj\" (UniqueName: \"kubernetes.io/projected/5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e-kube-api-access-79pbj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7wtq\" (UID: \"5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7wtq"
Jul 30 00:09:16.357479 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:16.357425    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7wtq\" (UID: \"5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7wtq"
Jul 30 00:09:16.457844 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:16.457819    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7wtq\" (UID: \"5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7wtq"
Jul 30 00:09:16.457966 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:16.457867    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79pbj\" (UniqueName: \"kubernetes.io/projected/5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e-kube-api-access-79pbj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7wtq\" (UID: \"5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7wtq"
Jul 30 00:09:16.457966 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:16.457897    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7wtq\" (UID: \"5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7wtq"
Jul 30 00:09:16.458240 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:16.458221    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7wtq\" (UID: \"5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7wtq"
Jul 30 00:09:16.458312 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:16.458244    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7wtq\" (UID: \"5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7wtq"
Jul 30 00:09:16.465783 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:16.465762    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79pbj\" (UniqueName: \"kubernetes.io/projected/5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e-kube-api-access-79pbj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7wtq\" (UID: \"5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7wtq"
Jul 30 00:09:16.591675 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:16.591627    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7wtq"
Jul 30 00:09:16.721198 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:16.721153    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7wtq"]
Jul 30 00:09:16.723524 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:09:16.723493    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ae94d1f_eaf0_4aaa_92d6_abcdcf74f39e.slice/crio-302edb6bae8048317125828ea13711f91043a3ecc34b6cfd6dcb7844d387b2cd WatchSource:0}: Error finding container 302edb6bae8048317125828ea13711f91043a3ecc34b6cfd6dcb7844d387b2cd: Status 404 returned error can't find the container with id 302edb6bae8048317125828ea13711f91043a3ecc34b6cfd6dcb7844d387b2cd
Jul 30 00:09:17.678806 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:17.678762    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7wtq" event={"ID":"5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e","Type":"ContainerStarted","Data":"302edb6bae8048317125828ea13711f91043a3ecc34b6cfd6dcb7844d387b2cd"}
Jul 30 00:09:26.725040 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:26.725010    2527 generic.go:356] "Generic (PLEG): container finished" podID="5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e" containerID="da11310b5d9d050e0bcac920f99f079a1cf8d6b41bc7a4b3550d1cc4f86c510a" exitCode=0
Jul 30 00:09:26.725453 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:26.725082    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7wtq" event={"ID":"5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e","Type":"ContainerDied","Data":"da11310b5d9d050e0bcac920f99f079a1cf8d6b41bc7a4b3550d1cc4f86c510a"}
Jul 30 00:09:29.740088 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:29.740053    2527 generic.go:356] "Generic (PLEG): container finished" podID="5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e" containerID="9d14d96f50a45050d8eebaa2df721ca175c8ef8911e7596e2500e0ee4085edce" exitCode=0
Jul 30 00:09:29.740479 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:29.740140    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7wtq" event={"ID":"5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e","Type":"ContainerDied","Data":"9d14d96f50a45050d8eebaa2df721ca175c8ef8911e7596e2500e0ee4085edce"}
Jul 30 00:09:36.772885 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:36.772822    2527 generic.go:356] "Generic (PLEG): container finished" podID="5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e" containerID="6ac79aee0aa775fe8f6ce8ec5b440fbc082809be254e7a6e67bbd9e8782f9322" exitCode=0
Jul 30 00:09:36.773206 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:36.772882    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7wtq" event={"ID":"5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e","Type":"ContainerDied","Data":"6ac79aee0aa775fe8f6ce8ec5b440fbc082809be254e7a6e67bbd9e8782f9322"}
Jul 30 00:09:37.931987 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:37.931963    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7wtq"
Jul 30 00:09:38.043217 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:38.043145    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79pbj\" (UniqueName: \"kubernetes.io/projected/5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e-kube-api-access-79pbj\") pod \"5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e\" (UID: \"5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e\") "
Jul 30 00:09:38.043217 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:38.043209    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e-bundle\") pod \"5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e\" (UID: \"5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e\") "
Jul 30 00:09:38.043396 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:38.043299    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e-util\") pod \"5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e\" (UID: \"5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e\") "
Jul 30 00:09:38.043818 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:38.043796    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e-bundle" (OuterVolumeSpecName: "bundle") pod "5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e" (UID: "5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:09:38.045496 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:38.045474    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e-kube-api-access-79pbj" (OuterVolumeSpecName: "kube-api-access-79pbj") pod "5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e" (UID: "5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e"). InnerVolumeSpecName "kube-api-access-79pbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:09:38.047112 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:38.047090    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e-util" (OuterVolumeSpecName: "util") pod "5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e" (UID: "5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:09:38.144585 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:38.144560    2527 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e-util\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:09:38.144585 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:38.144582    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79pbj\" (UniqueName: \"kubernetes.io/projected/5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e-kube-api-access-79pbj\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:09:38.144688 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:38.144591    2527 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e-bundle\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:09:38.783098 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:38.783061    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7wtq" event={"ID":"5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e","Type":"ContainerDied","Data":"302edb6bae8048317125828ea13711f91043a3ecc34b6cfd6dcb7844d387b2cd"}
Jul 30 00:09:38.783403 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:38.783384    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="302edb6bae8048317125828ea13711f91043a3ecc34b6cfd6dcb7844d387b2cd"
Jul 30 00:09:38.783608 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:38.783596    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7wtq"
Jul 30 00:09:44.250145 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:44.250116    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rnzx5"]
Jul 30 00:09:44.250588 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:44.250434    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e" containerName="util"
Jul 30 00:09:44.250588 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:44.250444    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e" containerName="util"
Jul 30 00:09:44.250588 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:44.250453    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e" containerName="pull"
Jul 30 00:09:44.250588 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:44.250458    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e" containerName="pull"
Jul 30 00:09:44.250588 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:44.250468    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e" containerName="extract"
Jul 30 00:09:44.250588 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:44.250474    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e" containerName="extract"
Jul 30 00:09:44.250588 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:44.250522    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ae94d1f-eaf0-4aaa-92d6-abcdcf74f39e" containerName="extract"
Jul 30 00:09:44.253749 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:44.253731    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rnzx5"
Jul 30 00:09:44.256244 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:44.256222    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-ltnjx\""
Jul 30 00:09:44.256343 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:44.256263    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 30 00:09:44.256568 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:44.256554    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 30 00:09:44.265498 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:44.265476    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rnzx5"]
Jul 30 00:09:44.292548 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:44.292520    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4k86\" (UniqueName: \"kubernetes.io/projected/9e82f4db-b255-4c66-9fe6-ae0d939bcdc2-kube-api-access-r4k86\") pod \"cert-manager-operator-controller-manager-55c444bf86-rnzx5\" (UID: \"9e82f4db-b255-4c66-9fe6-ae0d939bcdc2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rnzx5"
Jul 30 00:09:44.292896 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:44.292831    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e82f4db-b255-4c66-9fe6-ae0d939bcdc2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rnzx5\" (UID: \"9e82f4db-b255-4c66-9fe6-ae0d939bcdc2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rnzx5"
Jul 30 00:09:44.394050 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:44.394027    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e82f4db-b255-4c66-9fe6-ae0d939bcdc2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rnzx5\" (UID: \"9e82f4db-b255-4c66-9fe6-ae0d939bcdc2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rnzx5"
Jul 30 00:09:44.394194 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:44.394065    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4k86\" (UniqueName: \"kubernetes.io/projected/9e82f4db-b255-4c66-9fe6-ae0d939bcdc2-kube-api-access-r4k86\") pod \"cert-manager-operator-controller-manager-55c444bf86-rnzx5\" (UID: \"9e82f4db-b255-4c66-9fe6-ae0d939bcdc2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rnzx5"
Jul 30 00:09:44.394422 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:44.394400    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e82f4db-b255-4c66-9fe6-ae0d939bcdc2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rnzx5\" (UID: \"9e82f4db-b255-4c66-9fe6-ae0d939bcdc2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rnzx5"
Jul 30 00:09:44.401734 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:44.401711    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4k86\" (UniqueName: \"kubernetes.io/projected/9e82f4db-b255-4c66-9fe6-ae0d939bcdc2-kube-api-access-r4k86\") pod \"cert-manager-operator-controller-manager-55c444bf86-rnzx5\" (UID: \"9e82f4db-b255-4c66-9fe6-ae0d939bcdc2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rnzx5"
Jul 30 00:09:44.562818 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:44.562769    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rnzx5"
Jul 30 00:09:44.708967 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:44.708913    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rnzx5"]
Jul 30 00:09:44.712697 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:09:44.712667    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e82f4db_b255_4c66_9fe6_ae0d939bcdc2.slice/crio-a4194ef81527b31794604b54bd2c31418f769daf4b0ebd96b44a00c5a4164c78 WatchSource:0}: Error finding container a4194ef81527b31794604b54bd2c31418f769daf4b0ebd96b44a00c5a4164c78: Status 404 returned error can't find the container with id a4194ef81527b31794604b54bd2c31418f769daf4b0ebd96b44a00c5a4164c78
Jul 30 00:09:44.806685 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:44.806658    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rnzx5" event={"ID":"9e82f4db-b255-4c66-9fe6-ae0d939bcdc2","Type":"ContainerStarted","Data":"a4194ef81527b31794604b54bd2c31418f769daf4b0ebd96b44a00c5a4164c78"}
Jul 30 00:09:51.837928 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:51.837891    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rnzx5" event={"ID":"9e82f4db-b255-4c66-9fe6-ae0d939bcdc2","Type":"ContainerStarted","Data":"7998bcb9d1956085660e455029a2a69507bc1a4babb0cca34780ff2509fe3400"}
Jul 30 00:09:51.859504 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:51.859457    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rnzx5" podStartSLOduration=1.298316525 podStartE2EDuration="7.859443248s" totalImagesPullingTime="6.561126723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:09:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:09:51.857217997 +0000 UTC m=+466.159666339" watchObservedRunningTime="2026-07-30 00:09:51.859443248 +0000 UTC m=+466.161891594"
Jul 30 00:09:52.053743 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:52.053706    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zpz2x"]
Jul 30 00:09:52.055941 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:52.055921    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-zpz2x"
Jul 30 00:09:52.058468 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:52.058449    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 30 00:09:52.058569 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:52.058487    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 30 00:09:52.064533 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:52.064507    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zpz2x"]
Jul 30 00:09:52.156982 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:52.156920    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x96dw\" (UniqueName: \"kubernetes.io/projected/e36df97f-f815-4b5f-b72f-46ba92741718-kube-api-access-x96dw\") pod \"cert-manager-webhook-6486ffd997-zpz2x\" (UID: \"e36df97f-f815-4b5f-b72f-46ba92741718\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zpz2x"
Jul 30 00:09:52.156982 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:52.156956    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e36df97f-f815-4b5f-b72f-46ba92741718-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zpz2x\" (UID: \"e36df97f-f815-4b5f-b72f-46ba92741718\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zpz2x"
Jul 30 00:09:52.257697 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:52.257668    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x96dw\" (UniqueName: \"kubernetes.io/projected/e36df97f-f815-4b5f-b72f-46ba92741718-kube-api-access-x96dw\") pod \"cert-manager-webhook-6486ffd997-zpz2x\" (UID: \"e36df97f-f815-4b5f-b72f-46ba92741718\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zpz2x"
Jul 30 00:09:52.257805 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:52.257704    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e36df97f-f815-4b5f-b72f-46ba92741718-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zpz2x\" (UID: \"e36df97f-f815-4b5f-b72f-46ba92741718\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zpz2x"
Jul 30 00:09:52.274571 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:52.274552    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x96dw\" (UniqueName: \"kubernetes.io/projected/e36df97f-f815-4b5f-b72f-46ba92741718-kube-api-access-x96dw\") pod \"cert-manager-webhook-6486ffd997-zpz2x\" (UID: \"e36df97f-f815-4b5f-b72f-46ba92741718\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zpz2x"
Jul 30 00:09:52.277435 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:52.277415    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e36df97f-f815-4b5f-b72f-46ba92741718-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zpz2x\" (UID: \"e36df97f-f815-4b5f-b72f-46ba92741718\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zpz2x"
Jul 30 00:09:52.365002 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:52.364977    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-zpz2x"
Jul 30 00:09:52.500548 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:52.500524    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zpz2x"]
Jul 30 00:09:52.843223 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:52.843192    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-zpz2x" event={"ID":"e36df97f-f815-4b5f-b72f-46ba92741718","Type":"ContainerStarted","Data":"34d2448b6f168a1c7a83ff0ec5ac9456fa4aa2fbeb00babefecc6edc8cbdde18"}
Jul 30 00:09:53.722937 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:53.722906    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjmnh9"]
Jul 30 00:09:53.725295 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:53.725274    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjmnh9"
Jul 30 00:09:53.727811 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:53.727788    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 30 00:09:53.727907 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:53.727848    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 30 00:09:53.728488 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:53.728472    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bw7j9\""
Jul 30 00:09:53.734399 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:53.734378    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjmnh9"]
Jul 30 00:09:53.870416 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:53.870384    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/403439d0-da69-44d0-9bac-d20952180fa2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjmnh9\" (UID: \"403439d0-da69-44d0-9bac-d20952180fa2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjmnh9"
Jul 30 00:09:53.870793 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:53.870434    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/403439d0-da69-44d0-9bac-d20952180fa2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjmnh9\" (UID: \"403439d0-da69-44d0-9bac-d20952180fa2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjmnh9"
Jul 30 00:09:53.870793 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:53.870498    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztscw\" (UniqueName: \"kubernetes.io/projected/403439d0-da69-44d0-9bac-d20952180fa2-kube-api-access-ztscw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjmnh9\" (UID: \"403439d0-da69-44d0-9bac-d20952180fa2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjmnh9"
Jul 30 00:09:53.971473 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:53.971446    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/403439d0-da69-44d0-9bac-d20952180fa2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjmnh9\" (UID: \"403439d0-da69-44d0-9bac-d20952180fa2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjmnh9"
Jul 30 00:09:53.971617 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:53.971484    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/403439d0-da69-44d0-9bac-d20952180fa2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjmnh9\" (UID: \"403439d0-da69-44d0-9bac-d20952180fa2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjmnh9"
Jul 30 00:09:53.971617 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:53.971523    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztscw\" (UniqueName: \"kubernetes.io/projected/403439d0-da69-44d0-9bac-d20952180fa2-kube-api-access-ztscw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjmnh9\" (UID: \"403439d0-da69-44d0-9bac-d20952180fa2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjmnh9"
Jul 30 00:09:53.971863 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:53.971841    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/403439d0-da69-44d0-9bac-d20952180fa2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjmnh9\" (UID: \"403439d0-da69-44d0-9bac-d20952180fa2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjmnh9"
Jul 30 00:09:53.971931 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:53.971872    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/403439d0-da69-44d0-9bac-d20952180fa2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjmnh9\" (UID: \"403439d0-da69-44d0-9bac-d20952180fa2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjmnh9"
Jul 30 00:09:53.980720 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:53.980645    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztscw\" (UniqueName: \"kubernetes.io/projected/403439d0-da69-44d0-9bac-d20952180fa2-kube-api-access-ztscw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjmnh9\" (UID: \"403439d0-da69-44d0-9bac-d20952180fa2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjmnh9"
Jul 30 00:09:54.035549 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:54.035522    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjmnh9"
Jul 30 00:09:54.193824 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:54.193786    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjmnh9"]
Jul 30 00:09:54.196148 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:09:54.196124    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod403439d0_da69_44d0_9bac_d20952180fa2.slice/crio-6f5e1bb0a7a49b4a6626518960d22a91d46040f8cb25a37d1c34eead16131744 WatchSource:0}: Error finding container 6f5e1bb0a7a49b4a6626518960d22a91d46040f8cb25a37d1c34eead16131744: Status 404 returned error can't find the container with id 6f5e1bb0a7a49b4a6626518960d22a91d46040f8cb25a37d1c34eead16131744
Jul 30 00:09:54.854363 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:54.854329    2527 generic.go:356] "Generic (PLEG): container finished" podID="403439d0-da69-44d0-9bac-d20952180fa2" containerID="0d98db436b5ebc49765892d9553174fce985da0b98d46cbd65f4818c0e7bb32a" exitCode=0
Jul 30 00:09:54.854545 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:54.854415    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjmnh9" event={"ID":"403439d0-da69-44d0-9bac-d20952180fa2","Type":"ContainerDied","Data":"0d98db436b5ebc49765892d9553174fce985da0b98d46cbd65f4818c0e7bb32a"}
Jul 30 00:09:54.854545 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:54.854483    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjmnh9" event={"ID":"403439d0-da69-44d0-9bac-d20952180fa2","Type":"ContainerStarted","Data":"6f5e1bb0a7a49b4a6626518960d22a91d46040f8cb25a37d1c34eead16131744"}
Jul 30 00:09:54.966657 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:54.966624    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-66pwv"]
Jul 30 00:09:54.969117 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:54.969100    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-66pwv"
Jul 30 00:09:54.971561 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:54.971535    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-hcnj9\""
Jul 30 00:09:54.975841 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:54.975789    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-66pwv"]
Jul 30 00:09:55.083209 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:55.083176    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be446e21-6672-4c24-9bd1-9c5cf2bcb183-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-66pwv\" (UID: \"be446e21-6672-4c24-9bd1-9c5cf2bcb183\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-66pwv"
Jul 30 00:09:55.083362 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:55.083247    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg755\" (UniqueName: \"kubernetes.io/projected/be446e21-6672-4c24-9bd1-9c5cf2bcb183-kube-api-access-xg755\") pod \"cert-manager-cainjector-559cdd8c87-66pwv\" (UID: \"be446e21-6672-4c24-9bd1-9c5cf2bcb183\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-66pwv"
Jul 30 00:09:55.183951 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:55.183872    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be446e21-6672-4c24-9bd1-9c5cf2bcb183-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-66pwv\" (UID: \"be446e21-6672-4c24-9bd1-9c5cf2bcb183\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-66pwv"
Jul 30 00:09:55.184106 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:55.183956    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg755\" (UniqueName: \"kubernetes.io/projected/be446e21-6672-4c24-9bd1-9c5cf2bcb183-kube-api-access-xg755\") pod \"cert-manager-cainjector-559cdd8c87-66pwv\" (UID: \"be446e21-6672-4c24-9bd1-9c5cf2bcb183\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-66pwv"
Jul 30 00:09:55.194277 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:55.194250    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be446e21-6672-4c24-9bd1-9c5cf2bcb183-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-66pwv\" (UID: \"be446e21-6672-4c24-9bd1-9c5cf2bcb183\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-66pwv"
Jul 30 00:09:55.194467 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:55.194442    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg755\" (UniqueName: \"kubernetes.io/projected/be446e21-6672-4c24-9bd1-9c5cf2bcb183-kube-api-access-xg755\") pod \"cert-manager-cainjector-559cdd8c87-66pwv\" (UID: \"be446e21-6672-4c24-9bd1-9c5cf2bcb183\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-66pwv"
Jul 30 00:09:55.280713 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:55.280685    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-66pwv"
Jul 30 00:09:55.751177 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:55.750776    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-66pwv"]
Jul 30 00:09:55.753994 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:09:55.753937    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe446e21_6672_4c24_9bd1_9c5cf2bcb183.slice/crio-5a4cc7ee0b586c9db1a5155777fde9838a085b05c4fa02b6ad6a655975bc1ad9 WatchSource:0}: Error finding container 5a4cc7ee0b586c9db1a5155777fde9838a085b05c4fa02b6ad6a655975bc1ad9: Status 404 returned error can't find the container with id 5a4cc7ee0b586c9db1a5155777fde9838a085b05c4fa02b6ad6a655975bc1ad9
Jul 30 00:09:55.860968 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:55.860938    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-66pwv" event={"ID":"be446e21-6672-4c24-9bd1-9c5cf2bcb183","Type":"ContainerStarted","Data":"c3fab1546c241e57323f26f451135052ab75b2dc6f2988fc6ed69a160bf5fe73"}
Jul 30 00:09:55.861105 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:55.860982    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-66pwv" event={"ID":"be446e21-6672-4c24-9bd1-9c5cf2bcb183","Type":"ContainerStarted","Data":"5a4cc7ee0b586c9db1a5155777fde9838a085b05c4fa02b6ad6a655975bc1ad9"}
Jul 30 00:09:55.863845 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:55.863814    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-zpz2x" event={"ID":"e36df97f-f815-4b5f-b72f-46ba92741718","Type":"ContainerStarted","Data":"a50c58bf2e7f93fa8750aaf2ee4f3da8ed3cf9811023276af093ba7ff76a74e4"}
Jul 30 00:09:55.864232 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:55.864214    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-zpz2x"
Jul 30 00:09:55.877848 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:55.877797    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-66pwv" podStartSLOduration=1.877783366 podStartE2EDuration="1.877783366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:09:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:09:55.875921853 +0000 UTC m=+470.178370200" watchObservedRunningTime="2026-07-30 00:09:55.877783366 +0000 UTC m=+470.180231706"
Jul 30 00:09:55.897249 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:55.896344    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-zpz2x" podStartSLOduration=0.736770649 podStartE2EDuration="3.896317179s" totalImagesPullingTime="3.15954653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:09:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:09:55.895398269 +0000 UTC m=+470.197846616" watchObservedRunningTime="2026-07-30 00:09:55.896317179 +0000 UTC m=+470.198765527"
Jul 30 00:09:57.877276 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:57.877246    2527 generic.go:356] "Generic (PLEG): container finished" podID="403439d0-da69-44d0-9bac-d20952180fa2" containerID="35adf775bac40c7c745f49125ffa7932954ed4e6e1cd148487fc8f39342d5fa1" exitCode=0
Jul 30 00:09:57.877636 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:57.877335    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjmnh9" event={"ID":"403439d0-da69-44d0-9bac-d20952180fa2","Type":"ContainerDied","Data":"35adf775bac40c7c745f49125ffa7932954ed4e6e1cd148487fc8f39342d5fa1"}
Jul 30 00:09:58.883799 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:58.883766    2527 generic.go:356] "Generic (PLEG): container finished" podID="403439d0-da69-44d0-9bac-d20952180fa2" containerID="d7210e0174003faa0ef5c6973dffcd6dcddda7f31d6388f65f822eb55e2d7c5b" exitCode=0
Jul 30 00:09:58.884252 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:09:58.883828    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjmnh9" event={"ID":"403439d0-da69-44d0-9bac-d20952180fa2","Type":"ContainerDied","Data":"d7210e0174003faa0ef5c6973dffcd6dcddda7f31d6388f65f822eb55e2d7c5b"}
Jul 30 00:10:00.011025 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:00.011000    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjmnh9"
Jul 30 00:10:00.121982 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:00.121951    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztscw\" (UniqueName: \"kubernetes.io/projected/403439d0-da69-44d0-9bac-d20952180fa2-kube-api-access-ztscw\") pod \"403439d0-da69-44d0-9bac-d20952180fa2\" (UID: \"403439d0-da69-44d0-9bac-d20952180fa2\") "
Jul 30 00:10:00.122129 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:00.122000    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/403439d0-da69-44d0-9bac-d20952180fa2-util\") pod \"403439d0-da69-44d0-9bac-d20952180fa2\" (UID: \"403439d0-da69-44d0-9bac-d20952180fa2\") "
Jul 30 00:10:00.122129 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:00.122025    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/403439d0-da69-44d0-9bac-d20952180fa2-bundle\") pod \"403439d0-da69-44d0-9bac-d20952180fa2\" (UID: \"403439d0-da69-44d0-9bac-d20952180fa2\") "
Jul 30 00:10:00.122548 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:00.122521    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/403439d0-da69-44d0-9bac-d20952180fa2-bundle" (OuterVolumeSpecName: "bundle") pod "403439d0-da69-44d0-9bac-d20952180fa2" (UID: "403439d0-da69-44d0-9bac-d20952180fa2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:10:00.124102 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:00.124080    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/403439d0-da69-44d0-9bac-d20952180fa2-kube-api-access-ztscw" (OuterVolumeSpecName: "kube-api-access-ztscw") pod "403439d0-da69-44d0-9bac-d20952180fa2" (UID: "403439d0-da69-44d0-9bac-d20952180fa2"). InnerVolumeSpecName "kube-api-access-ztscw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:10:00.126593 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:00.126573    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/403439d0-da69-44d0-9bac-d20952180fa2-util" (OuterVolumeSpecName: "util") pod "403439d0-da69-44d0-9bac-d20952180fa2" (UID: "403439d0-da69-44d0-9bac-d20952180fa2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:10:00.222609 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:00.222587    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztscw\" (UniqueName: \"kubernetes.io/projected/403439d0-da69-44d0-9bac-d20952180fa2-kube-api-access-ztscw\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:10:00.222722 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:00.222615    2527 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/403439d0-da69-44d0-9bac-d20952180fa2-util\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:10:00.222722 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:00.222629    2527 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/403439d0-da69-44d0-9bac-d20952180fa2-bundle\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:10:00.895951 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:00.895927    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjmnh9"
Jul 30 00:10:00.896103 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:00.895920    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjmnh9" event={"ID":"403439d0-da69-44d0-9bac-d20952180fa2","Type":"ContainerDied","Data":"6f5e1bb0a7a49b4a6626518960d22a91d46040f8cb25a37d1c34eead16131744"}
Jul 30 00:10:00.896103 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:00.896040    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f5e1bb0a7a49b4a6626518960d22a91d46040f8cb25a37d1c34eead16131744"
Jul 30 00:10:01.872919 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:01.872888    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-zpz2x"
Jul 30 00:10:14.413522 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:14.413492    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8pzxs"]
Jul 30 00:10:14.413926 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:14.413795    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="403439d0-da69-44d0-9bac-d20952180fa2" containerName="pull"
Jul 30 00:10:14.413926 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:14.413807    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="403439d0-da69-44d0-9bac-d20952180fa2" containerName="pull"
Jul 30 00:10:14.413926 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:14.413821    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="403439d0-da69-44d0-9bac-d20952180fa2" containerName="util"
Jul 30 00:10:14.413926 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:14.413828    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="403439d0-da69-44d0-9bac-d20952180fa2" containerName="util"
Jul 30 00:10:14.413926 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:14.413835    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="403439d0-da69-44d0-9bac-d20952180fa2" containerName="extract"
Jul 30 00:10:14.413926 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:14.413841    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="403439d0-da69-44d0-9bac-d20952180fa2" containerName="extract"
Jul 30 00:10:14.413926 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:14.413901    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="403439d0-da69-44d0-9bac-d20952180fa2" containerName="extract"
Jul 30 00:10:14.417996 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:14.417979    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8pzxs"
Jul 30 00:10:14.420344 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:14.420305    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 30 00:10:14.420344 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:14.420322    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 30 00:10:14.420493 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:14.420305    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bw7j9\""
Jul 30 00:10:14.423983 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:14.423963    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8pzxs"]
Jul 30 00:10:14.528029 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:14.528008    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7416cff-ed7a-4e46-844b-a46943105869-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8pzxs\" (UID: \"e7416cff-ed7a-4e46-844b-a46943105869\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8pzxs"
Jul 30 00:10:14.528158 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:14.528045    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf84z\" (UniqueName: \"kubernetes.io/projected/e7416cff-ed7a-4e46-844b-a46943105869-kube-api-access-bf84z\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8pzxs\" (UID: \"e7416cff-ed7a-4e46-844b-a46943105869\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8pzxs"
Jul 30 00:10:14.528158 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:14.528135    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7416cff-ed7a-4e46-844b-a46943105869-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8pzxs\" (UID: \"e7416cff-ed7a-4e46-844b-a46943105869\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8pzxs"
Jul 30 00:10:14.629064 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:14.629041    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf84z\" (UniqueName: \"kubernetes.io/projected/e7416cff-ed7a-4e46-844b-a46943105869-kube-api-access-bf84z\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8pzxs\" (UID: \"e7416cff-ed7a-4e46-844b-a46943105869\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8pzxs"
Jul 30 00:10:14.629197 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:14.629103    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7416cff-ed7a-4e46-844b-a46943105869-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8pzxs\" (UID: \"e7416cff-ed7a-4e46-844b-a46943105869\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8pzxs"
Jul 30 00:10:14.629197 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:14.629127    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7416cff-ed7a-4e46-844b-a46943105869-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8pzxs\" (UID: \"e7416cff-ed7a-4e46-844b-a46943105869\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8pzxs"
Jul 30 00:10:14.629437 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:14.629417    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7416cff-ed7a-4e46-844b-a46943105869-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8pzxs\" (UID: \"e7416cff-ed7a-4e46-844b-a46943105869\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8pzxs"
Jul 30 00:10:14.629507 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:14.629459    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7416cff-ed7a-4e46-844b-a46943105869-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8pzxs\" (UID: \"e7416cff-ed7a-4e46-844b-a46943105869\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8pzxs"
Jul 30 00:10:14.636738 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:14.636717    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf84z\" (UniqueName: \"kubernetes.io/projected/e7416cff-ed7a-4e46-844b-a46943105869-kube-api-access-bf84z\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8pzxs\" (UID: \"e7416cff-ed7a-4e46-844b-a46943105869\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8pzxs"
Jul 30 00:10:14.728697 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:14.728674    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8pzxs"
Jul 30 00:10:14.852944 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:14.852915    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8pzxs"]
Jul 30 00:10:14.855227 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:10:14.855196    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7416cff_ed7a_4e46_844b_a46943105869.slice/crio-783984f960c1664c294fe4b3c71481c4a95fdb7a1c4e52c03fa2a4fb1bd3861d WatchSource:0}: Error finding container 783984f960c1664c294fe4b3c71481c4a95fdb7a1c4e52c03fa2a4fb1bd3861d: Status 404 returned error can't find the container with id 783984f960c1664c294fe4b3c71481c4a95fdb7a1c4e52c03fa2a4fb1bd3861d
Jul 30 00:10:14.957813 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:14.957786    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8pzxs" event={"ID":"e7416cff-ed7a-4e46-844b-a46943105869","Type":"ContainerStarted","Data":"8ae872c28b158a0a4bc8541584bb3b46432b566f525a09c0a623acdde5a0b711"}
Jul 30 00:10:14.957922 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:14.957835    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8pzxs" event={"ID":"e7416cff-ed7a-4e46-844b-a46943105869","Type":"ContainerStarted","Data":"783984f960c1664c294fe4b3c71481c4a95fdb7a1c4e52c03fa2a4fb1bd3861d"}
Jul 30 00:10:15.963599 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:15.963570    2527 generic.go:356] "Generic (PLEG): container finished" podID="e7416cff-ed7a-4e46-844b-a46943105869" containerID="8ae872c28b158a0a4bc8541584bb3b46432b566f525a09c0a623acdde5a0b711" exitCode=0
Jul 30 00:10:15.963599 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:15.963592    2527 generic.go:356] "Generic (PLEG): container finished" podID="e7416cff-ed7a-4e46-844b-a46943105869" containerID="ef689dfea7c0189c2647418f60b0934796f8bd1d3be8b3bfb321c5fdc42f92b6" exitCode=0
Jul 30 00:10:15.963969 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:15.963609    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8pzxs" event={"ID":"e7416cff-ed7a-4e46-844b-a46943105869","Type":"ContainerDied","Data":"8ae872c28b158a0a4bc8541584bb3b46432b566f525a09c0a623acdde5a0b711"}
Jul 30 00:10:15.963969 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:15.963644    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8pzxs" event={"ID":"e7416cff-ed7a-4e46-844b-a46943105869","Type":"ContainerDied","Data":"ef689dfea7c0189c2647418f60b0934796f8bd1d3be8b3bfb321c5fdc42f92b6"}
Jul 30 00:10:16.971986 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:16.971949    2527 generic.go:356] "Generic (PLEG): container finished" podID="e7416cff-ed7a-4e46-844b-a46943105869" containerID="7fb22962c87ca89f69d8384553731e1d0137335f8e54e76d76028a09eb3455eb" exitCode=0
Jul 30 00:10:16.972387 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:16.972036    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8pzxs" event={"ID":"e7416cff-ed7a-4e46-844b-a46943105869","Type":"ContainerDied","Data":"7fb22962c87ca89f69d8384553731e1d0137335f8e54e76d76028a09eb3455eb"}
Jul 30 00:10:18.108947 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:18.108922    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8pzxs"
Jul 30 00:10:18.258087 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:18.258020    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7416cff-ed7a-4e46-844b-a46943105869-bundle\") pod \"e7416cff-ed7a-4e46-844b-a46943105869\" (UID: \"e7416cff-ed7a-4e46-844b-a46943105869\") "
Jul 30 00:10:18.258087 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:18.258068    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7416cff-ed7a-4e46-844b-a46943105869-util\") pod \"e7416cff-ed7a-4e46-844b-a46943105869\" (UID: \"e7416cff-ed7a-4e46-844b-a46943105869\") "
Jul 30 00:10:18.258087 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:18.258089    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bf84z\" (UniqueName: \"kubernetes.io/projected/e7416cff-ed7a-4e46-844b-a46943105869-kube-api-access-bf84z\") pod \"e7416cff-ed7a-4e46-844b-a46943105869\" (UID: \"e7416cff-ed7a-4e46-844b-a46943105869\") "
Jul 30 00:10:18.258688 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:18.258662    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7416cff-ed7a-4e46-844b-a46943105869-bundle" (OuterVolumeSpecName: "bundle") pod "e7416cff-ed7a-4e46-844b-a46943105869" (UID: "e7416cff-ed7a-4e46-844b-a46943105869"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:10:18.260284 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:18.260261    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7416cff-ed7a-4e46-844b-a46943105869-kube-api-access-bf84z" (OuterVolumeSpecName: "kube-api-access-bf84z") pod "e7416cff-ed7a-4e46-844b-a46943105869" (UID: "e7416cff-ed7a-4e46-844b-a46943105869"). InnerVolumeSpecName "kube-api-access-bf84z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:10:18.264121 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:18.264085    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7416cff-ed7a-4e46-844b-a46943105869-util" (OuterVolumeSpecName: "util") pod "e7416cff-ed7a-4e46-844b-a46943105869" (UID: "e7416cff-ed7a-4e46-844b-a46943105869"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:10:18.358588 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:18.358559    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bf84z\" (UniqueName: \"kubernetes.io/projected/e7416cff-ed7a-4e46-844b-a46943105869-kube-api-access-bf84z\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:10:18.358588 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:18.358583    2527 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7416cff-ed7a-4e46-844b-a46943105869-bundle\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:10:18.358588 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:18.358592    2527 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7416cff-ed7a-4e46-844b-a46943105869-util\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:10:18.983262 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:18.983232    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8pzxs"
Jul 30 00:10:18.983412 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:18.983230    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8pzxs" event={"ID":"e7416cff-ed7a-4e46-844b-a46943105869","Type":"ContainerDied","Data":"783984f960c1664c294fe4b3c71481c4a95fdb7a1c4e52c03fa2a4fb1bd3861d"}
Jul 30 00:10:18.983412 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:18.983363    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="783984f960c1664c294fe4b3c71481c4a95fdb7a1c4e52c03fa2a4fb1bd3861d"
Jul 30 00:10:29.375847 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.375801    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-655d97b687-hw4df"]
Jul 30 00:10:29.376363 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.376290    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7416cff-ed7a-4e46-844b-a46943105869" containerName="extract"
Jul 30 00:10:29.376363 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.376309    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7416cff-ed7a-4e46-844b-a46943105869" containerName="extract"
Jul 30 00:10:29.376363 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.376342    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7416cff-ed7a-4e46-844b-a46943105869" containerName="util"
Jul 30 00:10:29.376363 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.376350    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7416cff-ed7a-4e46-844b-a46943105869" containerName="util"
Jul 30 00:10:29.376646 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.376368    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7416cff-ed7a-4e46-844b-a46943105869" containerName="pull"
Jul 30 00:10:29.376646 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.376376    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7416cff-ed7a-4e46-844b-a46943105869" containerName="pull"
Jul 30 00:10:29.376646 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.376470    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7416cff-ed7a-4e46-844b-a46943105869" containerName="extract"
Jul 30 00:10:29.378755 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.378732    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-hw4df"
Jul 30 00:10:29.381583 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.381560    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 30 00:10:29.381742 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.381616    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-59lxz\""
Jul 30 00:10:29.381904 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.381889    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 30 00:10:29.381979 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.381900    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 30 00:10:29.381979 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.381912    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 30 00:10:29.397438 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.397405    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-655d97b687-hw4df"]
Jul 30 00:10:29.538004 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.537969    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68qtp\" (UniqueName: \"kubernetes.io/projected/a3c837d8-482b-4e77-a307-857876f402a5-kube-api-access-68qtp\") pod \"opendatahub-operator-controller-manager-655d97b687-hw4df\" (UID: \"a3c837d8-482b-4e77-a307-857876f402a5\") " pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-hw4df"
Jul 30 00:10:29.538004 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.538017    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3c837d8-482b-4e77-a307-857876f402a5-tmp\") pod \"opendatahub-operator-controller-manager-655d97b687-hw4df\" (UID: \"a3c837d8-482b-4e77-a307-857876f402a5\") " pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-hw4df"
Jul 30 00:10:29.538315 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.538074    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a3c837d8-482b-4e77-a307-857876f402a5-manifests\") pod \"opendatahub-operator-controller-manager-655d97b687-hw4df\" (UID: \"a3c837d8-482b-4e77-a307-857876f402a5\") " pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-hw4df"
Jul 30 00:10:29.538315 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.538116    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a3c837d8-482b-4e77-a307-857876f402a5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-655d97b687-hw4df\" (UID: \"a3c837d8-482b-4e77-a307-857876f402a5\") " pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-hw4df"
Jul 30 00:10:29.538315 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.538154    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3c837d8-482b-4e77-a307-857876f402a5-webhook-cert\") pod \"opendatahub-operator-controller-manager-655d97b687-hw4df\" (UID: \"a3c837d8-482b-4e77-a307-857876f402a5\") " pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-hw4df"
Jul 30 00:10:29.639507 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.639410    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68qtp\" (UniqueName: \"kubernetes.io/projected/a3c837d8-482b-4e77-a307-857876f402a5-kube-api-access-68qtp\") pod \"opendatahub-operator-controller-manager-655d97b687-hw4df\" (UID: \"a3c837d8-482b-4e77-a307-857876f402a5\") " pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-hw4df"
Jul 30 00:10:29.639507 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.639471    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3c837d8-482b-4e77-a307-857876f402a5-tmp\") pod \"opendatahub-operator-controller-manager-655d97b687-hw4df\" (UID: \"a3c837d8-482b-4e77-a307-857876f402a5\") " pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-hw4df"
Jul 30 00:10:29.639507 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.639498    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a3c837d8-482b-4e77-a307-857876f402a5-manifests\") pod \"opendatahub-operator-controller-manager-655d97b687-hw4df\" (UID: \"a3c837d8-482b-4e77-a307-857876f402a5\") " pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-hw4df"
Jul 30 00:10:29.639733 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.639527    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a3c837d8-482b-4e77-a307-857876f402a5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-655d97b687-hw4df\" (UID: \"a3c837d8-482b-4e77-a307-857876f402a5\") " pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-hw4df"
Jul 30 00:10:29.639733 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.639567    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3c837d8-482b-4e77-a307-857876f402a5-webhook-cert\") pod \"opendatahub-operator-controller-manager-655d97b687-hw4df\" (UID: \"a3c837d8-482b-4e77-a307-857876f402a5\") " pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-hw4df"
Jul 30 00:10:29.639982 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.639959    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a3c837d8-482b-4e77-a307-857876f402a5-manifests\") pod \"opendatahub-operator-controller-manager-655d97b687-hw4df\" (UID: \"a3c837d8-482b-4e77-a307-857876f402a5\") " pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-hw4df"
Jul 30 00:10:29.642206 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.642156    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3c837d8-482b-4e77-a307-857876f402a5-tmp\") pod \"opendatahub-operator-controller-manager-655d97b687-hw4df\" (UID: \"a3c837d8-482b-4e77-a307-857876f402a5\") " pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-hw4df"
Jul 30 00:10:29.642339 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.642304    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3c837d8-482b-4e77-a307-857876f402a5-webhook-cert\") pod \"opendatahub-operator-controller-manager-655d97b687-hw4df\" (UID: \"a3c837d8-482b-4e77-a307-857876f402a5\") " pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-hw4df"
Jul 30 00:10:29.642392 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.642375    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a3c837d8-482b-4e77-a307-857876f402a5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-655d97b687-hw4df\" (UID: \"a3c837d8-482b-4e77-a307-857876f402a5\") " pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-hw4df"
Jul 30 00:10:29.648654 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.648628    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68qtp\" (UniqueName: \"kubernetes.io/projected/a3c837d8-482b-4e77-a307-857876f402a5-kube-api-access-68qtp\") pod \"opendatahub-operator-controller-manager-655d97b687-hw4df\" (UID: \"a3c837d8-482b-4e77-a307-857876f402a5\") " pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-hw4df"
Jul 30 00:10:29.689585 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.689540    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-hw4df"
Jul 30 00:10:29.836935 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:29.836894    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-655d97b687-hw4df"]
Jul 30 00:10:29.843210 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:10:29.843146    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3c837d8_482b_4e77_a307_857876f402a5.slice/crio-1331edc3a024497f276b0847951d3a712eec75d7f52536d10afb1a09fc905a1e WatchSource:0}: Error finding container 1331edc3a024497f276b0847951d3a712eec75d7f52536d10afb1a09fc905a1e: Status 404 returned error can't find the container with id 1331edc3a024497f276b0847951d3a712eec75d7f52536d10afb1a09fc905a1e
Jul 30 00:10:30.033207 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:30.033156    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-hw4df" event={"ID":"a3c837d8-482b-4e77-a307-857876f402a5","Type":"ContainerStarted","Data":"1331edc3a024497f276b0847951d3a712eec75d7f52536d10afb1a09fc905a1e"}
Jul 30 00:10:33.051543 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:33.051511    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-hw4df" event={"ID":"a3c837d8-482b-4e77-a307-857876f402a5","Type":"ContainerStarted","Data":"f406d2ccb91be45b1188527364fe8902f8b4fa3ba60b30b3bc6cbafdd5c2166d"}
Jul 30 00:10:35.062768 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:35.062735    2527 generic.go:356] "Generic (PLEG): container finished" podID="a3c837d8-482b-4e77-a307-857876f402a5" containerID="f406d2ccb91be45b1188527364fe8902f8b4fa3ba60b30b3bc6cbafdd5c2166d" exitCode=0
Jul 30 00:10:35.063196 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:35.062818    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-hw4df" event={"ID":"a3c837d8-482b-4e77-a307-857876f402a5","Type":"ContainerDied","Data":"f406d2ccb91be45b1188527364fe8902f8b4fa3ba60b30b3bc6cbafdd5c2166d"}
Jul 30 00:10:36.068857 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:36.068756    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-hw4df" event={"ID":"a3c837d8-482b-4e77-a307-857876f402a5","Type":"ContainerStarted","Data":"288ad14b30f7d3c7fdc2924b9f06300cc2fce5dd58e20ddf33fa95d16359bd1a"}
Jul 30 00:10:36.069359 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:36.069030    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-hw4df"
Jul 30 00:10:36.088862 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:36.088805    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-hw4df" podStartSLOduration=2.220519563 podStartE2EDuration="7.088786083s" totalImagesPullingTime="3.770349501s" totalInitContainerRuntime="1.097917019s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:10:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:10:36.087041209 +0000 UTC m=+510.389489557" watchObservedRunningTime="2026-07-30 00:10:36.088786083 +0000 UTC m=+510.391234430"
Jul 30 00:10:47.075386 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:47.075346    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-655d97b687-hw4df"
Jul 30 00:10:49.243005 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:49.242965    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-59c4b4bfcf-6rm4r"]
Jul 30 00:10:49.252238 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:49.252212    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59c4b4bfcf-6rm4r"
Jul 30 00:10:49.255616 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:49.255593    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 30 00:10:49.255743 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:49.255683    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 30 00:10:49.269342 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:49.269315    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59c4b4bfcf-6rm4r"]
Jul 30 00:10:49.304390 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:49.304356    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0cb52402-a865-4042-bd66-cd5dbd55cbaf-tmp\") pod \"kube-auth-proxy-59c4b4bfcf-6rm4r\" (UID: \"0cb52402-a865-4042-bd66-cd5dbd55cbaf\") " pod="openshift-ingress/kube-auth-proxy-59c4b4bfcf-6rm4r"
Jul 30 00:10:49.304570 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:49.304414    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cb52402-a865-4042-bd66-cd5dbd55cbaf-tls-certs\") pod \"kube-auth-proxy-59c4b4bfcf-6rm4r\" (UID: \"0cb52402-a865-4042-bd66-cd5dbd55cbaf\") " pod="openshift-ingress/kube-auth-proxy-59c4b4bfcf-6rm4r"
Jul 30 00:10:49.304638 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:49.304612    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz88b\" (UniqueName: \"kubernetes.io/projected/0cb52402-a865-4042-bd66-cd5dbd55cbaf-kube-api-access-pz88b\") pod \"kube-auth-proxy-59c4b4bfcf-6rm4r\" (UID: \"0cb52402-a865-4042-bd66-cd5dbd55cbaf\") " pod="openshift-ingress/kube-auth-proxy-59c4b4bfcf-6rm4r"
Jul 30 00:10:49.406009 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:49.405968    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0cb52402-a865-4042-bd66-cd5dbd55cbaf-tmp\") pod \"kube-auth-proxy-59c4b4bfcf-6rm4r\" (UID: \"0cb52402-a865-4042-bd66-cd5dbd55cbaf\") " pod="openshift-ingress/kube-auth-proxy-59c4b4bfcf-6rm4r"
Jul 30 00:10:49.406245 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:49.406020    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cb52402-a865-4042-bd66-cd5dbd55cbaf-tls-certs\") pod \"kube-auth-proxy-59c4b4bfcf-6rm4r\" (UID: \"0cb52402-a865-4042-bd66-cd5dbd55cbaf\") " pod="openshift-ingress/kube-auth-proxy-59c4b4bfcf-6rm4r"
Jul 30 00:10:49.406245 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:49.406096    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz88b\" (UniqueName: \"kubernetes.io/projected/0cb52402-a865-4042-bd66-cd5dbd55cbaf-kube-api-access-pz88b\") pod \"kube-auth-proxy-59c4b4bfcf-6rm4r\" (UID: \"0cb52402-a865-4042-bd66-cd5dbd55cbaf\") " pod="openshift-ingress/kube-auth-proxy-59c4b4bfcf-6rm4r"
Jul 30 00:10:49.408752 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:49.408727    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0cb52402-a865-4042-bd66-cd5dbd55cbaf-tmp\") pod \"kube-auth-proxy-59c4b4bfcf-6rm4r\" (UID: \"0cb52402-a865-4042-bd66-cd5dbd55cbaf\") " pod="openshift-ingress/kube-auth-proxy-59c4b4bfcf-6rm4r"
Jul 30 00:10:49.408945 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:49.408923    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cb52402-a865-4042-bd66-cd5dbd55cbaf-tls-certs\") pod \"kube-auth-proxy-59c4b4bfcf-6rm4r\" (UID: \"0cb52402-a865-4042-bd66-cd5dbd55cbaf\") " pod="openshift-ingress/kube-auth-proxy-59c4b4bfcf-6rm4r"
Jul 30 00:10:49.426461 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:49.426432    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz88b\" (UniqueName: \"kubernetes.io/projected/0cb52402-a865-4042-bd66-cd5dbd55cbaf-kube-api-access-pz88b\") pod \"kube-auth-proxy-59c4b4bfcf-6rm4r\" (UID: \"0cb52402-a865-4042-bd66-cd5dbd55cbaf\") " pod="openshift-ingress/kube-auth-proxy-59c4b4bfcf-6rm4r"
Jul 30 00:10:49.454674 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:49.454643    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-m99gw"]
Jul 30 00:10:49.457084 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:49.457069    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-m99gw"
Jul 30 00:10:49.459864 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:49.459844    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 30 00:10:49.459946 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:49.459847    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-4hsnt\""
Jul 30 00:10:49.469587 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:49.469564    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-m99gw"]
Jul 30 00:10:49.507198 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:49.507100    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/049847b4-1696-4282-a0b6-9a0390fcf7c8-cert\") pod \"odh-model-controller-7998c67dc4-m99gw\" (UID: \"049847b4-1696-4282-a0b6-9a0390fcf7c8\") " pod="opendatahub/odh-model-controller-7998c67dc4-m99gw"
Jul 30 00:10:49.507198 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:49.507149    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znhrv\" (UniqueName: \"kubernetes.io/projected/049847b4-1696-4282-a0b6-9a0390fcf7c8-kube-api-access-znhrv\") pod \"odh-model-controller-7998c67dc4-m99gw\" (UID: \"049847b4-1696-4282-a0b6-9a0390fcf7c8\") " pod="opendatahub/odh-model-controller-7998c67dc4-m99gw"
Jul 30 00:10:49.562265 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:49.562235    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59c4b4bfcf-6rm4r"
Jul 30 00:10:49.608592 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:49.608559    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/049847b4-1696-4282-a0b6-9a0390fcf7c8-cert\") pod \"odh-model-controller-7998c67dc4-m99gw\" (UID: \"049847b4-1696-4282-a0b6-9a0390fcf7c8\") " pod="opendatahub/odh-model-controller-7998c67dc4-m99gw"
Jul 30 00:10:49.608791 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:49.608618    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znhrv\" (UniqueName: \"kubernetes.io/projected/049847b4-1696-4282-a0b6-9a0390fcf7c8-kube-api-access-znhrv\") pod \"odh-model-controller-7998c67dc4-m99gw\" (UID: \"049847b4-1696-4282-a0b6-9a0390fcf7c8\") " pod="opendatahub/odh-model-controller-7998c67dc4-m99gw"
Jul 30 00:10:49.608791 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:10:49.608723    2527 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 30 00:10:49.608919 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:10:49.608812    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/049847b4-1696-4282-a0b6-9a0390fcf7c8-cert podName:049847b4-1696-4282-a0b6-9a0390fcf7c8 nodeName:}" failed. No retries permitted until 2026-07-30 00:10:50.108788774 +0000 UTC m=+524.411237099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/049847b4-1696-4282-a0b6-9a0390fcf7c8-cert") pod "odh-model-controller-7998c67dc4-m99gw" (UID: "049847b4-1696-4282-a0b6-9a0390fcf7c8") : secret "odh-model-controller-webhook-cert" not found
Jul 30 00:10:49.619234 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:49.619203    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znhrv\" (UniqueName: \"kubernetes.io/projected/049847b4-1696-4282-a0b6-9a0390fcf7c8-kube-api-access-znhrv\") pod \"odh-model-controller-7998c67dc4-m99gw\" (UID: \"049847b4-1696-4282-a0b6-9a0390fcf7c8\") " pod="opendatahub/odh-model-controller-7998c67dc4-m99gw"
Jul 30 00:10:49.703361 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:49.703339    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59c4b4bfcf-6rm4r"]
Jul 30 00:10:49.705906 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:10:49.705877    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cb52402_a865_4042_bd66_cd5dbd55cbaf.slice/crio-d2f7e62603008b53e9a1a6d3b227d8da99e07c41842828409a84bbb6be313b06 WatchSource:0}: Error finding container d2f7e62603008b53e9a1a6d3b227d8da99e07c41842828409a84bbb6be313b06: Status 404 returned error can't find the container with id d2f7e62603008b53e9a1a6d3b227d8da99e07c41842828409a84bbb6be313b06
Jul 30 00:10:50.112805 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.112767    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/049847b4-1696-4282-a0b6-9a0390fcf7c8-cert\") pod \"odh-model-controller-7998c67dc4-m99gw\" (UID: \"049847b4-1696-4282-a0b6-9a0390fcf7c8\") " pod="opendatahub/odh-model-controller-7998c67dc4-m99gw"
Jul 30 00:10:50.115378 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.115359    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/049847b4-1696-4282-a0b6-9a0390fcf7c8-cert\") pod \"odh-model-controller-7998c67dc4-m99gw\" (UID: \"049847b4-1696-4282-a0b6-9a0390fcf7c8\") " pod="opendatahub/odh-model-controller-7998c67dc4-m99gw"
Jul 30 00:10:50.137036 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.137002    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59c4b4bfcf-6rm4r" event={"ID":"0cb52402-a865-4042-bd66-cd5dbd55cbaf","Type":"ContainerStarted","Data":"d2f7e62603008b53e9a1a6d3b227d8da99e07c41842828409a84bbb6be313b06"}
Jul 30 00:10:50.367245 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.367140    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-m99gw"
Jul 30 00:10:50.479458 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.479135    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-dxmkc"]
Jul 30 00:10:50.486346 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.486319    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-dxmkc"
Jul 30 00:10:50.488594 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.488570    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 30 00:10:50.488594 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.488584    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-5gbl9\""
Jul 30 00:10:50.497389 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.497250    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-dxmkc"]
Jul 30 00:10:50.516875 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.516848    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qqw6\" (UniqueName: \"kubernetes.io/projected/ed4ef1a3-710d-4624-ac0d-e9c2936eb4e4-kube-api-access-7qqw6\") pod \"model-serving-api-54d89bd5fc-dxmkc\" (UID: \"ed4ef1a3-710d-4624-ac0d-e9c2936eb4e4\") " pod="opendatahub/model-serving-api-54d89bd5fc-dxmkc"
Jul 30 00:10:50.517017 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.516884    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed4ef1a3-710d-4624-ac0d-e9c2936eb4e4-tls-certs\") pod \"model-serving-api-54d89bd5fc-dxmkc\" (UID: \"ed4ef1a3-710d-4624-ac0d-e9c2936eb4e4\") " pod="opendatahub/model-serving-api-54d89bd5fc-dxmkc"
Jul 30 00:10:50.528563 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.528533    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-m99gw"]
Jul 30 00:10:50.532228 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:10:50.532197    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod049847b4_1696_4282_a0b6_9a0390fcf7c8.slice/crio-d12b8dce21b3e5eed308f850239726b6c9858782a6bf4d099a5f132f49e8da0d WatchSource:0}: Error finding container d12b8dce21b3e5eed308f850239726b6c9858782a6bf4d099a5f132f49e8da0d: Status 404 returned error can't find the container with id d12b8dce21b3e5eed308f850239726b6c9858782a6bf4d099a5f132f49e8da0d
Jul 30 00:10:50.617638 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.617545    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qqw6\" (UniqueName: \"kubernetes.io/projected/ed4ef1a3-710d-4624-ac0d-e9c2936eb4e4-kube-api-access-7qqw6\") pod \"model-serving-api-54d89bd5fc-dxmkc\" (UID: \"ed4ef1a3-710d-4624-ac0d-e9c2936eb4e4\") " pod="opendatahub/model-serving-api-54d89bd5fc-dxmkc"
Jul 30 00:10:50.617638 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.617601    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed4ef1a3-710d-4624-ac0d-e9c2936eb4e4-tls-certs\") pod \"model-serving-api-54d89bd5fc-dxmkc\" (UID: \"ed4ef1a3-710d-4624-ac0d-e9c2936eb4e4\") " pod="opendatahub/model-serving-api-54d89bd5fc-dxmkc"
Jul 30 00:10:50.620807 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.620716    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed4ef1a3-710d-4624-ac0d-e9c2936eb4e4-tls-certs\") pod \"model-serving-api-54d89bd5fc-dxmkc\" (UID: \"ed4ef1a3-710d-4624-ac0d-e9c2936eb4e4\") " pod="opendatahub/model-serving-api-54d89bd5fc-dxmkc"
Jul 30 00:10:50.627051 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.627018    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qqw6\" (UniqueName: \"kubernetes.io/projected/ed4ef1a3-710d-4624-ac0d-e9c2936eb4e4-kube-api-access-7qqw6\") pod \"model-serving-api-54d89bd5fc-dxmkc\" (UID: \"ed4ef1a3-710d-4624-ac0d-e9c2936eb4e4\") " pod="opendatahub/model-serving-api-54d89bd5fc-dxmkc"
Jul 30 00:10:50.667851 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.667813    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"]
Jul 30 00:10:50.670539 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.670517    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"
Jul 30 00:10:50.672874 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.672847    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 30 00:10:50.673025 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.672894    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 30 00:10:50.673025 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.672902    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 30 00:10:50.673194 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.673116    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-ggssx\""
Jul 30 00:10:50.673257 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.673208    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 30 00:10:50.687706 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.687642    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"]
Jul 30 00:10:50.718246 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.718214    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7198b99a-d292-41b6-93ae-1b140fd2db72-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-hbdtq\" (UID: \"7198b99a-d292-41b6-93ae-1b140fd2db72\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"
Jul 30 00:10:50.718408 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.718259    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7198b99a-d292-41b6-93ae-1b140fd2db72-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-hbdtq\" (UID: \"7198b99a-d292-41b6-93ae-1b140fd2db72\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"
Jul 30 00:10:50.718408 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.718308    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7198b99a-d292-41b6-93ae-1b140fd2db72-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-hbdtq\" (UID: \"7198b99a-d292-41b6-93ae-1b140fd2db72\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"
Jul 30 00:10:50.718408 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.718327    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7198b99a-d292-41b6-93ae-1b140fd2db72-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-hbdtq\" (UID: \"7198b99a-d292-41b6-93ae-1b140fd2db72\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"
Jul 30 00:10:50.718408 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.718350    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7198b99a-d292-41b6-93ae-1b140fd2db72-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-hbdtq\" (UID: \"7198b99a-d292-41b6-93ae-1b140fd2db72\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"
Jul 30 00:10:50.718408 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.718393    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7198b99a-d292-41b6-93ae-1b140fd2db72-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-hbdtq\" (UID: \"7198b99a-d292-41b6-93ae-1b140fd2db72\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"
Jul 30 00:10:50.718567 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.718447    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k55p4\" (UniqueName: \"kubernetes.io/projected/7198b99a-d292-41b6-93ae-1b140fd2db72-kube-api-access-k55p4\") pod \"istiod-openshift-gateway-7b7995d5cd-hbdtq\" (UID: \"7198b99a-d292-41b6-93ae-1b140fd2db72\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"
Jul 30 00:10:50.802060 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.802018    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-dxmkc"
Jul 30 00:10:50.818930 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.818894    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7198b99a-d292-41b6-93ae-1b140fd2db72-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-hbdtq\" (UID: \"7198b99a-d292-41b6-93ae-1b140fd2db72\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"
Jul 30 00:10:50.819061 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.818943    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k55p4\" (UniqueName: \"kubernetes.io/projected/7198b99a-d292-41b6-93ae-1b140fd2db72-kube-api-access-k55p4\") pod \"istiod-openshift-gateway-7b7995d5cd-hbdtq\" (UID: \"7198b99a-d292-41b6-93ae-1b140fd2db72\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"
Jul 30 00:10:50.819061 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.818988    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7198b99a-d292-41b6-93ae-1b140fd2db72-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-hbdtq\" (UID: \"7198b99a-d292-41b6-93ae-1b140fd2db72\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"
Jul 30 00:10:50.819061 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.819012    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7198b99a-d292-41b6-93ae-1b140fd2db72-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-hbdtq\" (UID: \"7198b99a-d292-41b6-93ae-1b140fd2db72\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"
Jul 30 00:10:50.819061 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.819055    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7198b99a-d292-41b6-93ae-1b140fd2db72-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-hbdtq\" (UID: \"7198b99a-d292-41b6-93ae-1b140fd2db72\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"
Jul 30 00:10:50.819290 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.819193    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7198b99a-d292-41b6-93ae-1b140fd2db72-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-hbdtq\" (UID: \"7198b99a-d292-41b6-93ae-1b140fd2db72\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"
Jul 30 00:10:50.819290 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.819253    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7198b99a-d292-41b6-93ae-1b140fd2db72-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-hbdtq\" (UID: \"7198b99a-d292-41b6-93ae-1b140fd2db72\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"
Jul 30 00:10:50.819713 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.819687    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7198b99a-d292-41b6-93ae-1b140fd2db72-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-hbdtq\" (UID: \"7198b99a-d292-41b6-93ae-1b140fd2db72\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"
Jul 30 00:10:50.822238 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.822196    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7198b99a-d292-41b6-93ae-1b140fd2db72-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-hbdtq\" (UID: \"7198b99a-d292-41b6-93ae-1b140fd2db72\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"
Jul 30 00:10:50.822396 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.822373    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7198b99a-d292-41b6-93ae-1b140fd2db72-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-hbdtq\" (UID: \"7198b99a-d292-41b6-93ae-1b140fd2db72\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"
Jul 30 00:10:50.822654 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.822631    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7198b99a-d292-41b6-93ae-1b140fd2db72-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-hbdtq\" (UID: \"7198b99a-d292-41b6-93ae-1b140fd2db72\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"
Jul 30 00:10:50.822743 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.822679    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7198b99a-d292-41b6-93ae-1b140fd2db72-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-hbdtq\" (UID: \"7198b99a-d292-41b6-93ae-1b140fd2db72\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"
Jul 30 00:10:50.829802 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.829778    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7198b99a-d292-41b6-93ae-1b140fd2db72-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-hbdtq\" (UID: \"7198b99a-d292-41b6-93ae-1b140fd2db72\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"
Jul 30 00:10:50.834138 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.834113    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k55p4\" (UniqueName: \"kubernetes.io/projected/7198b99a-d292-41b6-93ae-1b140fd2db72-kube-api-access-k55p4\") pod \"istiod-openshift-gateway-7b7995d5cd-hbdtq\" (UID: \"7198b99a-d292-41b6-93ae-1b140fd2db72\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"
Jul 30 00:10:50.961594 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.961569    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-dxmkc"]
Jul 30 00:10:50.962914 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:10:50.962882    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded4ef1a3_710d_4624_ac0d_e9c2936eb4e4.slice/crio-c1cf27733ffa8c268d6fc1c84dfc29d3cd857d4b8afcb6ae50191efc21671421 WatchSource:0}: Error finding container c1cf27733ffa8c268d6fc1c84dfc29d3cd857d4b8afcb6ae50191efc21671421: Status 404 returned error can't find the container with id c1cf27733ffa8c268d6fc1c84dfc29d3cd857d4b8afcb6ae50191efc21671421
Jul 30 00:10:50.982040 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:50.982016    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"
Jul 30 00:10:51.124405 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:51.124377    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"]
Jul 30 00:10:51.126252 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:10:51.126220    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7198b99a_d292_41b6_93ae_1b140fd2db72.slice/crio-079bdf94027be0727001e2870e88d6adffec065edc54c0d8ced6b78ea761d3ae WatchSource:0}: Error finding container 079bdf94027be0727001e2870e88d6adffec065edc54c0d8ced6b78ea761d3ae: Status 404 returned error can't find the container with id 079bdf94027be0727001e2870e88d6adffec065edc54c0d8ced6b78ea761d3ae
Jul 30 00:10:51.142541 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:51.142511    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-dxmkc" event={"ID":"ed4ef1a3-710d-4624-ac0d-e9c2936eb4e4","Type":"ContainerStarted","Data":"c1cf27733ffa8c268d6fc1c84dfc29d3cd857d4b8afcb6ae50191efc21671421"}
Jul 30 00:10:51.143709 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:51.143685    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-m99gw" event={"ID":"049847b4-1696-4282-a0b6-9a0390fcf7c8","Type":"ContainerStarted","Data":"d12b8dce21b3e5eed308f850239726b6c9858782a6bf4d099a5f132f49e8da0d"}
Jul 30 00:10:51.144896 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:51.144869    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq" event={"ID":"7198b99a-d292-41b6-93ae-1b140fd2db72","Type":"ContainerStarted","Data":"079bdf94027be0727001e2870e88d6adffec065edc54c0d8ced6b78ea761d3ae"}
Jul 30 00:10:55.711867 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:55.711829    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:10:55.712213 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:55.711898    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:10:56.178936 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:56.178882    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-dxmkc" event={"ID":"ed4ef1a3-710d-4624-ac0d-e9c2936eb4e4","Type":"ContainerStarted","Data":"a6b48048500943b86fbd2bd01f4b4e674d2f0a7ab082d428ff41fb695436d4d8"}
Jul 30 00:10:56.179149 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:56.179053    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-dxmkc"
Jul 30 00:10:56.180518 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:56.180489    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-m99gw" event={"ID":"049847b4-1696-4282-a0b6-9a0390fcf7c8","Type":"ContainerStarted","Data":"72338a224085adb8da806839d53ac4309d1724bde32a37529474dff1d3993d90"}
Jul 30 00:10:56.180654 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:56.180596    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-m99gw"
Jul 30 00:10:56.182013 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:56.181978    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59c4b4bfcf-6rm4r" event={"ID":"0cb52402-a865-4042-bd66-cd5dbd55cbaf","Type":"ContainerStarted","Data":"cefe0591f89fe412fc4eae2f8e3da801f56437cf526f8c2010d02daf038d2f1d"}
Jul 30 00:10:56.183739 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:56.183714    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq" event={"ID":"7198b99a-d292-41b6-93ae-1b140fd2db72","Type":"ContainerStarted","Data":"08d1805ae8f6b4665646d4e9028f297eb1d7d9f0ca8b063b488f7e40090c1e4f"}
Jul 30 00:10:56.183868 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:56.183831    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"
Jul 30 00:10:56.186093 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:56.186073    2527 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-hbdtq container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 00:10:56.186211 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:56.186121    2527 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq" podUID="7198b99a-d292-41b6-93ae-1b140fd2db72" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 00:10:56.205097 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:56.205057    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-dxmkc" podStartSLOduration=1.460550408 podStartE2EDuration="6.205042384s" totalImagesPullingTime="4.744491976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:10:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:10:56.203503631 +0000 UTC m=+530.505951979" watchObservedRunningTime="2026-07-30 00:10:56.205042384 +0000 UTC m=+530.507490739"
Jul 30 00:10:56.238908 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:56.238855    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-m99gw" podStartSLOduration=2.052080706 podStartE2EDuration="7.238839881s" totalImagesPullingTime="5.186759175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:10:56.23753241 +0000 UTC m=+530.539980755" watchObservedRunningTime="2026-07-30 00:10:56.238839881 +0000 UTC m=+530.541288279"
Jul 30 00:10:56.275603 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:56.275546    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq" podStartSLOduration=1.69234167 podStartE2EDuration="6.275528656s" totalImagesPullingTime="4.583186986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:10:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:10:56.275456153 +0000 UTC m=+530.577904498" watchObservedRunningTime="2026-07-30 00:10:56.275528656 +0000 UTC m=+530.577977002"
Jul 30 00:10:56.303761 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:56.303704    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-59c4b4bfcf-6rm4r" podStartSLOduration=1.306561297 podStartE2EDuration="7.303681735s" totalImagesPullingTime="5.997120438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:10:56.301953739 +0000 UTC m=+530.604402085" watchObservedRunningTime="2026-07-30 00:10:56.303681735 +0000 UTC m=+530.606130081"
Jul 30 00:10:57.189335 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:57.189242    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"
Jul 30 00:10:59.894006 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:59.893958    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-lsms4"]
Jul 30 00:10:59.897381 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:59.897356    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pgjck"]
Jul 30 00:10:59.897532 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:59.897467    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lsms4"
Jul 30 00:10:59.900489 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:59.900466    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pgjck"
Jul 30 00:10:59.904504 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:59.904474    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 30 00:10:59.904847 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:59.904830    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-nrzsq\""
Jul 30 00:10:59.904988 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:59.904968    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-zgjw4\""
Jul 30 00:10:59.905497 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:59.905480    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 30 00:10:59.917927 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:59.917904    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-lsms4"]
Jul 30 00:10:59.924345 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:10:59.924322    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pgjck"]
Jul 30 00:11:00.009853 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:00.009820    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq56s\" (UniqueName: \"kubernetes.io/projected/53c02a2c-1f8d-40ba-9588-86b6095c66d5-kube-api-access-zq56s\") pod \"kserve-controller-manager-d6f4b65b8-pgjck\" (UID: \"53c02a2c-1f8d-40ba-9588-86b6095c66d5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pgjck"
Jul 30 00:11:00.010049 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:00.009882    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b365a8d9-4d98-4393-9397-f9cf62216844-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-lsms4\" (UID: \"b365a8d9-4d98-4393-9397-f9cf62216844\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lsms4"
Jul 30 00:11:00.010049 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:00.009966    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53c02a2c-1f8d-40ba-9588-86b6095c66d5-cert\") pod \"kserve-controller-manager-d6f4b65b8-pgjck\" (UID: \"53c02a2c-1f8d-40ba-9588-86b6095c66d5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pgjck"
Jul 30 00:11:00.010049 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:00.010017    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t5m2\" (UniqueName: \"kubernetes.io/projected/b365a8d9-4d98-4393-9397-f9cf62216844-kube-api-access-6t5m2\") pod \"llmisvc-controller-manager-777c6bd7d5-lsms4\" (UID: \"b365a8d9-4d98-4393-9397-f9cf62216844\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lsms4"
Jul 30 00:11:00.110717 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:00.110667    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq56s\" (UniqueName: \"kubernetes.io/projected/53c02a2c-1f8d-40ba-9588-86b6095c66d5-kube-api-access-zq56s\") pod \"kserve-controller-manager-d6f4b65b8-pgjck\" (UID: \"53c02a2c-1f8d-40ba-9588-86b6095c66d5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pgjck"
Jul 30 00:11:00.111110 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:00.110759    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b365a8d9-4d98-4393-9397-f9cf62216844-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-lsms4\" (UID: \"b365a8d9-4d98-4393-9397-f9cf62216844\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lsms4"
Jul 30 00:11:00.111110 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:00.110831    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53c02a2c-1f8d-40ba-9588-86b6095c66d5-cert\") pod \"kserve-controller-manager-d6f4b65b8-pgjck\" (UID: \"53c02a2c-1f8d-40ba-9588-86b6095c66d5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pgjck"
Jul 30 00:11:00.111110 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:00.110865    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t5m2\" (UniqueName: \"kubernetes.io/projected/b365a8d9-4d98-4393-9397-f9cf62216844-kube-api-access-6t5m2\") pod \"llmisvc-controller-manager-777c6bd7d5-lsms4\" (UID: \"b365a8d9-4d98-4393-9397-f9cf62216844\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lsms4"
Jul 30 00:11:00.111110 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:11:00.110910    2527 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 30 00:11:00.111110 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:11:00.110970    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b365a8d9-4d98-4393-9397-f9cf62216844-cert podName:b365a8d9-4d98-4393-9397-f9cf62216844 nodeName:}" failed. No retries permitted until 2026-07-30 00:11:00.610948599 +0000 UTC m=+534.913396936 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b365a8d9-4d98-4393-9397-f9cf62216844-cert") pod "llmisvc-controller-manager-777c6bd7d5-lsms4" (UID: "b365a8d9-4d98-4393-9397-f9cf62216844") : secret "llmisvc-webhook-server-cert" not found
Jul 30 00:11:00.114081 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:00.114052    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53c02a2c-1f8d-40ba-9588-86b6095c66d5-cert\") pod \"kserve-controller-manager-d6f4b65b8-pgjck\" (UID: \"53c02a2c-1f8d-40ba-9588-86b6095c66d5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pgjck"
Jul 30 00:11:00.122795 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:00.122765    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t5m2\" (UniqueName: \"kubernetes.io/projected/b365a8d9-4d98-4393-9397-f9cf62216844-kube-api-access-6t5m2\") pod \"llmisvc-controller-manager-777c6bd7d5-lsms4\" (UID: \"b365a8d9-4d98-4393-9397-f9cf62216844\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lsms4"
Jul 30 00:11:00.123145 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:00.123121    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq56s\" (UniqueName: \"kubernetes.io/projected/53c02a2c-1f8d-40ba-9588-86b6095c66d5-kube-api-access-zq56s\") pod \"kserve-controller-manager-d6f4b65b8-pgjck\" (UID: \"53c02a2c-1f8d-40ba-9588-86b6095c66d5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pgjck"
Jul 30 00:11:00.215620 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:00.215592    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pgjck"
Jul 30 00:11:00.358959 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:00.358934    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pgjck"]
Jul 30 00:11:00.361631 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:11:00.361601    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53c02a2c_1f8d_40ba_9588_86b6095c66d5.slice/crio-a05f62c01c3eb36c7e9d5cd9ccd1d07ffb67f49660ff4e566e38a3a5b6eec04a WatchSource:0}: Error finding container a05f62c01c3eb36c7e9d5cd9ccd1d07ffb67f49660ff4e566e38a3a5b6eec04a: Status 404 returned error can't find the container with id a05f62c01c3eb36c7e9d5cd9ccd1d07ffb67f49660ff4e566e38a3a5b6eec04a
Jul 30 00:11:00.621532 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:00.621421    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b365a8d9-4d98-4393-9397-f9cf62216844-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-lsms4\" (UID: \"b365a8d9-4d98-4393-9397-f9cf62216844\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lsms4"
Jul 30 00:11:00.623867 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:00.623841    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b365a8d9-4d98-4393-9397-f9cf62216844-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-lsms4\" (UID: \"b365a8d9-4d98-4393-9397-f9cf62216844\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lsms4"
Jul 30 00:11:00.809010 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:00.808980    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lsms4"
Jul 30 00:11:00.976070 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:00.976043    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-lsms4"]
Jul 30 00:11:00.978096 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:11:00.978066    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb365a8d9_4d98_4393_9397_f9cf62216844.slice/crio-40c6c32c0b77c6c1de5c76a7b4f2ca77f19e3f90cf3fbb07013d0dc429d522d3 WatchSource:0}: Error finding container 40c6c32c0b77c6c1de5c76a7b4f2ca77f19e3f90cf3fbb07013d0dc429d522d3: Status 404 returned error can't find the container with id 40c6c32c0b77c6c1de5c76a7b4f2ca77f19e3f90cf3fbb07013d0dc429d522d3
Jul 30 00:11:01.211482 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:01.211443    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lsms4" event={"ID":"b365a8d9-4d98-4393-9397-f9cf62216844","Type":"ContainerStarted","Data":"40c6c32c0b77c6c1de5c76a7b4f2ca77f19e3f90cf3fbb07013d0dc429d522d3"}
Jul 30 00:11:01.212804 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:01.212766    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pgjck" event={"ID":"53c02a2c-1f8d-40ba-9588-86b6095c66d5","Type":"ContainerStarted","Data":"a05f62c01c3eb36c7e9d5cd9ccd1d07ffb67f49660ff4e566e38a3a5b6eec04a"}
Jul 30 00:11:02.873750 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:02.873714    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"]
Jul 30 00:11:02.874233 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:02.873948    2527 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq" podUID="7198b99a-d292-41b6-93ae-1b140fd2db72" containerName="discovery" containerID="cri-o://08d1805ae8f6b4665646d4e9028f297eb1d7d9f0ca8b063b488f7e40090c1e4f" gracePeriod=30
Jul 30 00:11:03.176591 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.176565    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"
Jul 30 00:11:03.225475 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.225434    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pgjck" event={"ID":"53c02a2c-1f8d-40ba-9588-86b6095c66d5","Type":"ContainerStarted","Data":"5aa2a547de81a89c131363230ef7802b46e5ee5f802705afdb74086eca30e1fb"}
Jul 30 00:11:03.225639 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.225547    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pgjck"
Jul 30 00:11:03.227102 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.227074    2527 generic.go:356] "Generic (PLEG): container finished" podID="7198b99a-d292-41b6-93ae-1b140fd2db72" containerID="08d1805ae8f6b4665646d4e9028f297eb1d7d9f0ca8b063b488f7e40090c1e4f" exitCode=0
Jul 30 00:11:03.227294 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.227117    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq" event={"ID":"7198b99a-d292-41b6-93ae-1b140fd2db72","Type":"ContainerDied","Data":"08d1805ae8f6b4665646d4e9028f297eb1d7d9f0ca8b063b488f7e40090c1e4f"}
Jul 30 00:11:03.227294 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.227125    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"
Jul 30 00:11:03.227294 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.227150    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq" event={"ID":"7198b99a-d292-41b6-93ae-1b140fd2db72","Type":"ContainerDied","Data":"079bdf94027be0727001e2870e88d6adffec065edc54c0d8ced6b78ea761d3ae"}
Jul 30 00:11:03.227294 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.227208    2527 scope.go:117] "RemoveContainer" containerID="08d1805ae8f6b4665646d4e9028f297eb1d7d9f0ca8b063b488f7e40090c1e4f"
Jul 30 00:11:03.238156 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.238135    2527 scope.go:117] "RemoveContainer" containerID="08d1805ae8f6b4665646d4e9028f297eb1d7d9f0ca8b063b488f7e40090c1e4f"
Jul 30 00:11:03.238512 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:11:03.238479    2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08d1805ae8f6b4665646d4e9028f297eb1d7d9f0ca8b063b488f7e40090c1e4f\": container with ID starting with 08d1805ae8f6b4665646d4e9028f297eb1d7d9f0ca8b063b488f7e40090c1e4f not found: ID does not exist" containerID="08d1805ae8f6b4665646d4e9028f297eb1d7d9f0ca8b063b488f7e40090c1e4f"
Jul 30 00:11:03.238636 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.238521    2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08d1805ae8f6b4665646d4e9028f297eb1d7d9f0ca8b063b488f7e40090c1e4f"} err="failed to get container status \"08d1805ae8f6b4665646d4e9028f297eb1d7d9f0ca8b063b488f7e40090c1e4f\": rpc error: code = NotFound desc = could not find container \"08d1805ae8f6b4665646d4e9028f297eb1d7d9f0ca8b063b488f7e40090c1e4f\": container with ID starting with 08d1805ae8f6b4665646d4e9028f297eb1d7d9f0ca8b063b488f7e40090c1e4f not found: ID does not exist"
Jul 30 00:11:03.246963 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.246937    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7198b99a-d292-41b6-93ae-1b140fd2db72-istio-token\") pod \"7198b99a-d292-41b6-93ae-1b140fd2db72\" (UID: \"7198b99a-d292-41b6-93ae-1b140fd2db72\") "
Jul 30 00:11:03.247114 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.246988    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7198b99a-d292-41b6-93ae-1b140fd2db72-local-certs\") pod \"7198b99a-d292-41b6-93ae-1b140fd2db72\" (UID: \"7198b99a-d292-41b6-93ae-1b140fd2db72\") "
Jul 30 00:11:03.247114 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.247033    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k55p4\" (UniqueName: \"kubernetes.io/projected/7198b99a-d292-41b6-93ae-1b140fd2db72-kube-api-access-k55p4\") pod \"7198b99a-d292-41b6-93ae-1b140fd2db72\" (UID: \"7198b99a-d292-41b6-93ae-1b140fd2db72\") "
Jul 30 00:11:03.247114 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.247081    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7198b99a-d292-41b6-93ae-1b140fd2db72-istio-kubeconfig\") pod \"7198b99a-d292-41b6-93ae-1b140fd2db72\" (UID: \"7198b99a-d292-41b6-93ae-1b140fd2db72\") "
Jul 30 00:11:03.247313 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.247125    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7198b99a-d292-41b6-93ae-1b140fd2db72-cacerts\") pod \"7198b99a-d292-41b6-93ae-1b140fd2db72\" (UID: \"7198b99a-d292-41b6-93ae-1b140fd2db72\") "
Jul 30 00:11:03.247313 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.247194    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7198b99a-d292-41b6-93ae-1b140fd2db72-istio-csr-ca-configmap\") pod \"7198b99a-d292-41b6-93ae-1b140fd2db72\" (UID: \"7198b99a-d292-41b6-93ae-1b140fd2db72\") "
Jul 30 00:11:03.247313 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.247244    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7198b99a-d292-41b6-93ae-1b140fd2db72-istio-csr-dns-cert\") pod \"7198b99a-d292-41b6-93ae-1b140fd2db72\" (UID: \"7198b99a-d292-41b6-93ae-1b140fd2db72\") "
Jul 30 00:11:03.248238 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.248209    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7198b99a-d292-41b6-93ae-1b140fd2db72-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "7198b99a-d292-41b6-93ae-1b140fd2db72" (UID: "7198b99a-d292-41b6-93ae-1b140fd2db72"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:11:03.250622 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.250594    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7198b99a-d292-41b6-93ae-1b140fd2db72-local-certs" (OuterVolumeSpecName: "local-certs") pod "7198b99a-d292-41b6-93ae-1b140fd2db72" (UID: "7198b99a-d292-41b6-93ae-1b140fd2db72"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:11:03.252004 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.251977    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7198b99a-d292-41b6-93ae-1b140fd2db72-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "7198b99a-d292-41b6-93ae-1b140fd2db72" (UID: "7198b99a-d292-41b6-93ae-1b140fd2db72"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:11:03.252593 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.252440    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7198b99a-d292-41b6-93ae-1b140fd2db72-kube-api-access-k55p4" (OuterVolumeSpecName: "kube-api-access-k55p4") pod "7198b99a-d292-41b6-93ae-1b140fd2db72" (UID: "7198b99a-d292-41b6-93ae-1b140fd2db72"). InnerVolumeSpecName "kube-api-access-k55p4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:11:03.253298 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.253270    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7198b99a-d292-41b6-93ae-1b140fd2db72-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "7198b99a-d292-41b6-93ae-1b140fd2db72" (UID: "7198b99a-d292-41b6-93ae-1b140fd2db72"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:11:03.253298 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.253276    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7198b99a-d292-41b6-93ae-1b140fd2db72-istio-token" (OuterVolumeSpecName: "istio-token") pod "7198b99a-d292-41b6-93ae-1b140fd2db72" (UID: "7198b99a-d292-41b6-93ae-1b140fd2db72"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:11:03.253475 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.253346    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7198b99a-d292-41b6-93ae-1b140fd2db72-cacerts" (OuterVolumeSpecName: "cacerts") pod "7198b99a-d292-41b6-93ae-1b140fd2db72" (UID: "7198b99a-d292-41b6-93ae-1b140fd2db72"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:11:03.307987 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.307935    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pgjck" podStartSLOduration=1.638291538 podStartE2EDuration="4.307917835s" totalImagesPullingTime="2.669626297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:10:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:11:03.304976547 +0000 UTC m=+537.607424894" watchObservedRunningTime="2026-07-30 00:11:03.307917835 +0000 UTC m=+537.610366182"
Jul 30 00:11:03.348637 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.348593    2527 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7198b99a-d292-41b6-93ae-1b140fd2db72-istio-csr-dns-cert\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:11:03.348637 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.348631    2527 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7198b99a-d292-41b6-93ae-1b140fd2db72-istio-token\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:11:03.348637 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.348645    2527 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7198b99a-d292-41b6-93ae-1b140fd2db72-local-certs\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:11:03.348892 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.348658    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k55p4\" (UniqueName: \"kubernetes.io/projected/7198b99a-d292-41b6-93ae-1b140fd2db72-kube-api-access-k55p4\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:11:03.348892 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.348672    2527 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7198b99a-d292-41b6-93ae-1b140fd2db72-istio-kubeconfig\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:11:03.348892 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.348684    2527 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7198b99a-d292-41b6-93ae-1b140fd2db72-cacerts\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:11:03.348892 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.348697    2527 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7198b99a-d292-41b6-93ae-1b140fd2db72-istio-csr-ca-configmap\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:11:03.555529 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.555493    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"]
Jul 30 00:11:03.566203 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:03.566151    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hbdtq"]
Jul 30 00:11:04.216053 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:04.216016    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7198b99a-d292-41b6-93ae-1b140fd2db72" path="/var/lib/kubelet/pods/7198b99a-d292-41b6-93ae-1b140fd2db72/volumes"
Jul 30 00:11:04.234734 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:04.234701    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lsms4" event={"ID":"b365a8d9-4d98-4393-9397-f9cf62216844","Type":"ContainerStarted","Data":"d6094cc1abc446a4acb310d58b73eba8a7c7c543510b1cdb38e8c43cbfbdaff4"}
Jul 30 00:11:04.234890 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:04.234763    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lsms4"
Jul 30 00:11:04.251907 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:04.251859    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lsms4" podStartSLOduration=2.155451705 podStartE2EDuration="5.251844931s" totalImagesPullingTime="3.096393226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:10:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:11:04.249489282 +0000 UTC m=+538.551937639" watchObservedRunningTime="2026-07-30 00:11:04.251844931 +0000 UTC m=+538.554293323"
Jul 30 00:11:07.191144 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:07.191109    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-m99gw"
Jul 30 00:11:07.193207 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:07.193184    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-dxmkc"
Jul 30 00:11:34.240620 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:34.240588    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pgjck"
Jul 30 00:11:35.242239 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:35.242202    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lsms4"
Jul 30 00:11:50.161339 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:50.161296    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sfh2r"]
Jul 30 00:11:50.162726 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:50.162695    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7198b99a-d292-41b6-93ae-1b140fd2db72" containerName="discovery"
Jul 30 00:11:50.162894 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:50.162876    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="7198b99a-d292-41b6-93ae-1b140fd2db72" containerName="discovery"
Jul 30 00:11:50.163207 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:50.163190    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="7198b99a-d292-41b6-93ae-1b140fd2db72" containerName="discovery"
Jul 30 00:11:50.166720 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:50.166693    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sfh2r"
Jul 30 00:11:50.169302 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:50.169278    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 30 00:11:50.169436 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:50.169278    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 30 00:11:50.170119 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:50.170093    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-5sggm\""
Jul 30 00:11:50.174058 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:50.173740    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sfh2r"]
Jul 30 00:11:50.267705 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:50.267667    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grsk2\" (UniqueName: \"kubernetes.io/projected/b712c08a-dddd-4e68-b61e-a86cc8f6a66f-kube-api-access-grsk2\") pod \"kuadrant-operator-catalog-sfh2r\" (UID: \"b712c08a-dddd-4e68-b61e-a86cc8f6a66f\") " pod="kuadrant-system/kuadrant-operator-catalog-sfh2r"
Jul 30 00:11:50.368190 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:50.368124    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grsk2\" (UniqueName: \"kubernetes.io/projected/b712c08a-dddd-4e68-b61e-a86cc8f6a66f-kube-api-access-grsk2\") pod \"kuadrant-operator-catalog-sfh2r\" (UID: \"b712c08a-dddd-4e68-b61e-a86cc8f6a66f\") " pod="kuadrant-system/kuadrant-operator-catalog-sfh2r"
Jul 30 00:11:50.376636 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:50.376599    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grsk2\" (UniqueName: \"kubernetes.io/projected/b712c08a-dddd-4e68-b61e-a86cc8f6a66f-kube-api-access-grsk2\") pod \"kuadrant-operator-catalog-sfh2r\" (UID: \"b712c08a-dddd-4e68-b61e-a86cc8f6a66f\") " pod="kuadrant-system/kuadrant-operator-catalog-sfh2r"
Jul 30 00:11:50.479123 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:50.479085    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sfh2r"
Jul 30 00:11:50.526095 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:50.526053    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sfh2r"]
Jul 30 00:11:50.621004 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:50.620978    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sfh2r"]
Jul 30 00:11:50.623193 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:11:50.623148    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb712c08a_dddd_4e68_b61e_a86cc8f6a66f.slice/crio-a46eed73b5f44fb1159841def9809e5496fe51c95c8cb0627b440c569ac8682a WatchSource:0}: Error finding container a46eed73b5f44fb1159841def9809e5496fe51c95c8cb0627b440c569ac8682a: Status 404 returned error can't find the container with id a46eed73b5f44fb1159841def9809e5496fe51c95c8cb0627b440c569ac8682a
Jul 30 00:11:50.736116 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:50.736027    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gqwnf"]
Jul 30 00:11:50.739139 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:50.739115    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gqwnf"
Jul 30 00:11:50.746375 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:50.746347    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gqwnf"]
Jul 30 00:11:50.771933 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:50.771884    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggc78\" (UniqueName: \"kubernetes.io/projected/a2d3cdd5-4aff-4532-b1db-327b20f9eb76-kube-api-access-ggc78\") pod \"kuadrant-operator-catalog-gqwnf\" (UID: \"a2d3cdd5-4aff-4532-b1db-327b20f9eb76\") " pod="kuadrant-system/kuadrant-operator-catalog-gqwnf"
Jul 30 00:11:50.872361 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:50.872323    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggc78\" (UniqueName: \"kubernetes.io/projected/a2d3cdd5-4aff-4532-b1db-327b20f9eb76-kube-api-access-ggc78\") pod \"kuadrant-operator-catalog-gqwnf\" (UID: \"a2d3cdd5-4aff-4532-b1db-327b20f9eb76\") " pod="kuadrant-system/kuadrant-operator-catalog-gqwnf"
Jul 30 00:11:50.880299 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:50.880275    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggc78\" (UniqueName: \"kubernetes.io/projected/a2d3cdd5-4aff-4532-b1db-327b20f9eb76-kube-api-access-ggc78\") pod \"kuadrant-operator-catalog-gqwnf\" (UID: \"a2d3cdd5-4aff-4532-b1db-327b20f9eb76\") " pod="kuadrant-system/kuadrant-operator-catalog-gqwnf"
Jul 30 00:11:51.049825 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:51.049722    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gqwnf"
Jul 30 00:11:51.189092 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:51.188956    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gqwnf"]
Jul 30 00:11:51.191224 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:11:51.191195    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2d3cdd5_4aff_4532_b1db_327b20f9eb76.slice/crio-e62f845eff0cdec7e755c9b8a73b61c8c3e6941d90f28fc46b5758c162f4f555 WatchSource:0}: Error finding container e62f845eff0cdec7e755c9b8a73b61c8c3e6941d90f28fc46b5758c162f4f555: Status 404 returned error can't find the container with id e62f845eff0cdec7e755c9b8a73b61c8c3e6941d90f28fc46b5758c162f4f555
Jul 30 00:11:51.472785 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:51.472743    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sfh2r" event={"ID":"b712c08a-dddd-4e68-b61e-a86cc8f6a66f","Type":"ContainerStarted","Data":"a46eed73b5f44fb1159841def9809e5496fe51c95c8cb0627b440c569ac8682a"}
Jul 30 00:11:51.474109 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:51.474075    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gqwnf" event={"ID":"a2d3cdd5-4aff-4532-b1db-327b20f9eb76","Type":"ContainerStarted","Data":"e62f845eff0cdec7e755c9b8a73b61c8c3e6941d90f28fc46b5758c162f4f555"}
Jul 30 00:11:53.486024 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:53.485980    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sfh2r" event={"ID":"b712c08a-dddd-4e68-b61e-a86cc8f6a66f","Type":"ContainerStarted","Data":"16f739a906790f01cd2ef9588b9af3b00983e6661317deee6bdfd057613801ca"}
Jul 30 00:11:53.486511 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:53.486038    2527 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-sfh2r" podUID="b712c08a-dddd-4e68-b61e-a86cc8f6a66f" containerName="registry-server" containerID="cri-o://16f739a906790f01cd2ef9588b9af3b00983e6661317deee6bdfd057613801ca" gracePeriod=2
Jul 30 00:11:53.487582 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:53.487559    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gqwnf" event={"ID":"a2d3cdd5-4aff-4532-b1db-327b20f9eb76","Type":"ContainerStarted","Data":"10ab2c433f8590157d90fcea76bf14ab3cb42c49d8877e321b9713a2d1562775"}
Jul 30 00:11:53.507740 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:53.507691    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-sfh2r" podStartSLOduration=1.275937451 podStartE2EDuration="3.507677413s" totalImagesPullingTime="2.231739962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:11:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:11:53.505005923 +0000 UTC m=+587.807454270" watchObservedRunningTime="2026-07-30 00:11:53.507677413 +0000 UTC m=+587.810125757"
Jul 30 00:11:53.521341 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:53.521288    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-gqwnf" podStartSLOduration=1.720151402 podStartE2EDuration="3.521274505s" totalImagesPullingTime="1.801123103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:11:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:11:53.519533504 +0000 UTC m=+587.821981850" watchObservedRunningTime="2026-07-30 00:11:53.521274505 +0000 UTC m=+587.823722850"
Jul 30 00:11:53.734908 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:53.734882    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sfh2r"
Jul 30 00:11:53.800884 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:53.800803    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grsk2\" (UniqueName: \"kubernetes.io/projected/b712c08a-dddd-4e68-b61e-a86cc8f6a66f-kube-api-access-grsk2\") pod \"b712c08a-dddd-4e68-b61e-a86cc8f6a66f\" (UID: \"b712c08a-dddd-4e68-b61e-a86cc8f6a66f\") "
Jul 30 00:11:53.803071 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:53.803049    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b712c08a-dddd-4e68-b61e-a86cc8f6a66f-kube-api-access-grsk2" (OuterVolumeSpecName: "kube-api-access-grsk2") pod "b712c08a-dddd-4e68-b61e-a86cc8f6a66f" (UID: "b712c08a-dddd-4e68-b61e-a86cc8f6a66f"). InnerVolumeSpecName "kube-api-access-grsk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:11:53.901776 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:53.901746    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grsk2\" (UniqueName: \"kubernetes.io/projected/b712c08a-dddd-4e68-b61e-a86cc8f6a66f-kube-api-access-grsk2\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:11:54.494509 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:54.494409    2527 generic.go:356] "Generic (PLEG): container finished" podID="b712c08a-dddd-4e68-b61e-a86cc8f6a66f" containerID="16f739a906790f01cd2ef9588b9af3b00983e6661317deee6bdfd057613801ca" exitCode=0
Jul 30 00:11:54.494509 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:54.494446    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sfh2r" event={"ID":"b712c08a-dddd-4e68-b61e-a86cc8f6a66f","Type":"ContainerDied","Data":"16f739a906790f01cd2ef9588b9af3b00983e6661317deee6bdfd057613801ca"}
Jul 30 00:11:54.494509 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:54.494497    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sfh2r" event={"ID":"b712c08a-dddd-4e68-b61e-a86cc8f6a66f","Type":"ContainerDied","Data":"a46eed73b5f44fb1159841def9809e5496fe51c95c8cb0627b440c569ac8682a"}
Jul 30 00:11:54.495053 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:54.494519    2527 scope.go:117] "RemoveContainer" containerID="16f739a906790f01cd2ef9588b9af3b00983e6661317deee6bdfd057613801ca"
Jul 30 00:11:54.495053 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:54.494457    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sfh2r"
Jul 30 00:11:54.504024 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:54.504004    2527 scope.go:117] "RemoveContainer" containerID="16f739a906790f01cd2ef9588b9af3b00983e6661317deee6bdfd057613801ca"
Jul 30 00:11:54.504337 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:11:54.504316    2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16f739a906790f01cd2ef9588b9af3b00983e6661317deee6bdfd057613801ca\": container with ID starting with 16f739a906790f01cd2ef9588b9af3b00983e6661317deee6bdfd057613801ca not found: ID does not exist" containerID="16f739a906790f01cd2ef9588b9af3b00983e6661317deee6bdfd057613801ca"
Jul 30 00:11:54.504403 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:54.504346    2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16f739a906790f01cd2ef9588b9af3b00983e6661317deee6bdfd057613801ca"} err="failed to get container status \"16f739a906790f01cd2ef9588b9af3b00983e6661317deee6bdfd057613801ca\": rpc error: code = NotFound desc = could not find container \"16f739a906790f01cd2ef9588b9af3b00983e6661317deee6bdfd057613801ca\": container with ID starting with 16f739a906790f01cd2ef9588b9af3b00983e6661317deee6bdfd057613801ca not found: ID does not exist"
Jul 30 00:11:54.514721 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:54.514692    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sfh2r"]
Jul 30 00:11:54.516834 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:54.516812    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sfh2r"]
Jul 30 00:11:56.215335 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:11:56.215301    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b712c08a-dddd-4e68-b61e-a86cc8f6a66f" path="/var/lib/kubelet/pods/b712c08a-dddd-4e68-b61e-a86cc8f6a66f/volumes"
Jul 30 00:12:01.050147 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:01.050110    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-gqwnf"
Jul 30 00:12:01.050596 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:01.050200    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-gqwnf"
Jul 30 00:12:01.072091 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:01.072064    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-gqwnf"
Jul 30 00:12:01.550243 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:01.550214    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-gqwnf"
Jul 30 00:12:07.750747 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:07.750708    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc"]
Jul 30 00:12:07.753104 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:07.751114    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b712c08a-dddd-4e68-b61e-a86cc8f6a66f" containerName="registry-server"
Jul 30 00:12:07.753104 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:07.751126    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="b712c08a-dddd-4e68-b61e-a86cc8f6a66f" containerName="registry-server"
Jul 30 00:12:07.753104 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:07.751218    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="b712c08a-dddd-4e68-b61e-a86cc8f6a66f" containerName="registry-server"
Jul 30 00:12:07.754318 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:07.754300    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc"
Jul 30 00:12:07.756567 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:07.756550    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-t67ws\""
Jul 30 00:12:07.762629 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:07.762605    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc"]
Jul 30 00:12:07.823567 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:07.823533    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n684p\" (UniqueName: \"kubernetes.io/projected/0c9d642f-2895-4771-84bf-2e93ed55f350-kube-api-access-n684p\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc\" (UID: \"0c9d642f-2895-4771-84bf-2e93ed55f350\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc"
Jul 30 00:12:07.823742 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:07.823578    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c9d642f-2895-4771-84bf-2e93ed55f350-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc\" (UID: \"0c9d642f-2895-4771-84bf-2e93ed55f350\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc"
Jul 30 00:12:07.823742 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:07.823601    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c9d642f-2895-4771-84bf-2e93ed55f350-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc\" (UID: \"0c9d642f-2895-4771-84bf-2e93ed55f350\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc"
Jul 30 00:12:07.863103 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:07.863070    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv"]
Jul 30 00:12:07.866838 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:07.866821    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv"
Jul 30 00:12:07.875138 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:07.875112    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv"]
Jul 30 00:12:07.924124 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:07.924085    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a07a831c-5ef0-4cfc-8518-01fec916575e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv\" (UID: \"a07a831c-5ef0-4cfc-8518-01fec916575e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv"
Jul 30 00:12:07.924366 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:07.924134    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n684p\" (UniqueName: \"kubernetes.io/projected/0c9d642f-2895-4771-84bf-2e93ed55f350-kube-api-access-n684p\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc\" (UID: \"0c9d642f-2895-4771-84bf-2e93ed55f350\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc"
Jul 30 00:12:07.924366 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:07.924231    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c9d642f-2895-4771-84bf-2e93ed55f350-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc\" (UID: \"0c9d642f-2895-4771-84bf-2e93ed55f350\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc"
Jul 30 00:12:07.924366 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:07.924273    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c9d642f-2895-4771-84bf-2e93ed55f350-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc\" (UID: \"0c9d642f-2895-4771-84bf-2e93ed55f350\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc"
Jul 30 00:12:07.924366 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:07.924305    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a07a831c-5ef0-4cfc-8518-01fec916575e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv\" (UID: \"a07a831c-5ef0-4cfc-8518-01fec916575e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv"
Jul 30 00:12:07.924557 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:07.924386    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28w2p\" (UniqueName: \"kubernetes.io/projected/a07a831c-5ef0-4cfc-8518-01fec916575e-kube-api-access-28w2p\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv\" (UID: \"a07a831c-5ef0-4cfc-8518-01fec916575e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv"
Jul 30 00:12:07.924785 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:07.924766    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c9d642f-2895-4771-84bf-2e93ed55f350-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc\" (UID: \"0c9d642f-2895-4771-84bf-2e93ed55f350\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc"
Jul 30 00:12:07.924820 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:07.924777    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c9d642f-2895-4771-84bf-2e93ed55f350-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc\" (UID: \"0c9d642f-2895-4771-84bf-2e93ed55f350\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc"
Jul 30 00:12:07.932628 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:07.932597    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n684p\" (UniqueName: \"kubernetes.io/projected/0c9d642f-2895-4771-84bf-2e93ed55f350-kube-api-access-n684p\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc\" (UID: \"0c9d642f-2895-4771-84bf-2e93ed55f350\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc"
Jul 30 00:12:07.955107 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:07.955070    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv"]
Jul 30 00:12:07.958862 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:07.958845    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv"
Jul 30 00:12:07.969950 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:07.969926    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv"]
Jul 30 00:12:08.025543 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.025453    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28w2p\" (UniqueName: \"kubernetes.io/projected/a07a831c-5ef0-4cfc-8518-01fec916575e-kube-api-access-28w2p\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv\" (UID: \"a07a831c-5ef0-4cfc-8518-01fec916575e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv"
Jul 30 00:12:08.025543 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.025499    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8gms\" (UniqueName: \"kubernetes.io/projected/432642b0-8a24-46e8-8171-54cb5a47333d-kube-api-access-b8gms\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv\" (UID: \"432642b0-8a24-46e8-8171-54cb5a47333d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv"
Jul 30 00:12:08.025737 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.025552    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/432642b0-8a24-46e8-8171-54cb5a47333d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv\" (UID: \"432642b0-8a24-46e8-8171-54cb5a47333d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv"
Jul 30 00:12:08.025737 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.025598    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a07a831c-5ef0-4cfc-8518-01fec916575e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv\" (UID: \"a07a831c-5ef0-4cfc-8518-01fec916575e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv"
Jul 30 00:12:08.025737 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.025683    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a07a831c-5ef0-4cfc-8518-01fec916575e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv\" (UID: \"a07a831c-5ef0-4cfc-8518-01fec916575e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv"
Jul 30 00:12:08.025737 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.025719    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/432642b0-8a24-46e8-8171-54cb5a47333d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv\" (UID: \"432642b0-8a24-46e8-8171-54cb5a47333d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv"
Jul 30 00:12:08.025960 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.025944    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a07a831c-5ef0-4cfc-8518-01fec916575e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv\" (UID: \"a07a831c-5ef0-4cfc-8518-01fec916575e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv"
Jul 30 00:12:08.025996 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.025971    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a07a831c-5ef0-4cfc-8518-01fec916575e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv\" (UID: \"a07a831c-5ef0-4cfc-8518-01fec916575e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv"
Jul 30 00:12:08.033663 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.033634    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28w2p\" (UniqueName: \"kubernetes.io/projected/a07a831c-5ef0-4cfc-8518-01fec916575e-kube-api-access-28w2p\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv\" (UID: \"a07a831c-5ef0-4cfc-8518-01fec916575e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv"
Jul 30 00:12:08.054649 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.054616    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc"]
Jul 30 00:12:08.058395 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.058378    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc"
Jul 30 00:12:08.063619 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.063592    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc"
Jul 30 00:12:08.066201 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.066151    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc"]
Jul 30 00:12:08.126817 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.126778    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/432642b0-8a24-46e8-8171-54cb5a47333d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv\" (UID: \"432642b0-8a24-46e8-8171-54cb5a47333d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv"
Jul 30 00:12:08.126971 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.126885    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8gms\" (UniqueName: \"kubernetes.io/projected/432642b0-8a24-46e8-8171-54cb5a47333d-kube-api-access-b8gms\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv\" (UID: \"432642b0-8a24-46e8-8171-54cb5a47333d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv"
Jul 30 00:12:08.126971 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.126922    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1adef8ac-c1e9-48d6-b890-d7dd478706f9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc\" (UID: \"1adef8ac-c1e9-48d6-b890-d7dd478706f9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc"
Jul 30 00:12:08.127246 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.126973    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/432642b0-8a24-46e8-8171-54cb5a47333d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv\" (UID: \"432642b0-8a24-46e8-8171-54cb5a47333d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv"
Jul 30 00:12:08.127246 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.127045    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1adef8ac-c1e9-48d6-b890-d7dd478706f9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc\" (UID: \"1adef8ac-c1e9-48d6-b890-d7dd478706f9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc"
Jul 30 00:12:08.127246 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.127082    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65jc9\" (UniqueName: \"kubernetes.io/projected/1adef8ac-c1e9-48d6-b890-d7dd478706f9-kube-api-access-65jc9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc\" (UID: \"1adef8ac-c1e9-48d6-b890-d7dd478706f9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc"
Jul 30 00:12:08.127484 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.127410    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/432642b0-8a24-46e8-8171-54cb5a47333d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv\" (UID: \"432642b0-8a24-46e8-8171-54cb5a47333d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv"
Jul 30 00:12:08.127541 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.127496    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/432642b0-8a24-46e8-8171-54cb5a47333d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv\" (UID: \"432642b0-8a24-46e8-8171-54cb5a47333d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv"
Jul 30 00:12:08.136185 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.136117    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8gms\" (UniqueName: \"kubernetes.io/projected/432642b0-8a24-46e8-8171-54cb5a47333d-kube-api-access-b8gms\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv\" (UID: \"432642b0-8a24-46e8-8171-54cb5a47333d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv"
Jul 30 00:12:08.176712 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.176674    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv"
Jul 30 00:12:08.207334 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.207306    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc"]
Jul 30 00:12:08.207647 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:12:08.207620    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c9d642f_2895_4771_84bf_2e93ed55f350.slice/crio-9723d205747616942f260edc4dc2698796eaa8ee19d8b18fdf0fa0898724d886 WatchSource:0}: Error finding container 9723d205747616942f260edc4dc2698796eaa8ee19d8b18fdf0fa0898724d886: Status 404 returned error can't find the container with id 9723d205747616942f260edc4dc2698796eaa8ee19d8b18fdf0fa0898724d886
Jul 30 00:12:08.228499 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.228475    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1adef8ac-c1e9-48d6-b890-d7dd478706f9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc\" (UID: \"1adef8ac-c1e9-48d6-b890-d7dd478706f9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc"
Jul 30 00:12:08.228575 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.228528    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1adef8ac-c1e9-48d6-b890-d7dd478706f9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc\" (UID: \"1adef8ac-c1e9-48d6-b890-d7dd478706f9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc"
Jul 30 00:12:08.228662 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.228622    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65jc9\" (UniqueName: \"kubernetes.io/projected/1adef8ac-c1e9-48d6-b890-d7dd478706f9-kube-api-access-65jc9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc\" (UID: \"1adef8ac-c1e9-48d6-b890-d7dd478706f9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc"
Jul 30 00:12:08.228835 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.228816    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1adef8ac-c1e9-48d6-b890-d7dd478706f9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc\" (UID: \"1adef8ac-c1e9-48d6-b890-d7dd478706f9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc"
Jul 30 00:12:08.228888 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.228864    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1adef8ac-c1e9-48d6-b890-d7dd478706f9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc\" (UID: \"1adef8ac-c1e9-48d6-b890-d7dd478706f9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc"
Jul 30 00:12:08.237279 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.237253    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65jc9\" (UniqueName: \"kubernetes.io/projected/1adef8ac-c1e9-48d6-b890-d7dd478706f9-kube-api-access-65jc9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc\" (UID: \"1adef8ac-c1e9-48d6-b890-d7dd478706f9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc"
Jul 30 00:12:08.269351 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.269299    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv"
Jul 30 00:12:08.336848 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.336813    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv"]
Jul 30 00:12:08.369472 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.369430    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc"
Jul 30 00:12:08.423514 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.423476    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv"]
Jul 30 00:12:08.425413 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:12:08.425381    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod432642b0_8a24_46e8_8171_54cb5a47333d.slice/crio-ff756300feda53fa2c8060dc4befd54570f781c37fc7657c471a51822de5d91a WatchSource:0}: Error finding container ff756300feda53fa2c8060dc4befd54570f781c37fc7657c471a51822de5d91a: Status 404 returned error can't find the container with id ff756300feda53fa2c8060dc4befd54570f781c37fc7657c471a51822de5d91a
Jul 30 00:12:08.522150 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.522121    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc"]
Jul 30 00:12:08.533209 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:12:08.533135    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1adef8ac_c1e9_48d6_b890_d7dd478706f9.slice/crio-400447b2a1b3d3ad348f1c73d2a2ef41f8232776c4cfbb814f0a2823f19aa030 WatchSource:0}: Error finding container 400447b2a1b3d3ad348f1c73d2a2ef41f8232776c4cfbb814f0a2823f19aa030: Status 404 returned error can't find the container with id 400447b2a1b3d3ad348f1c73d2a2ef41f8232776c4cfbb814f0a2823f19aa030
Jul 30 00:12:08.562626 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.562593    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc" event={"ID":"1adef8ac-c1e9-48d6-b890-d7dd478706f9","Type":"ContainerStarted","Data":"400447b2a1b3d3ad348f1c73d2a2ef41f8232776c4cfbb814f0a2823f19aa030"}
Jul 30 00:12:08.564298 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.564268    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv" event={"ID":"432642b0-8a24-46e8-8171-54cb5a47333d","Type":"ContainerStarted","Data":"4481cc9a442d4adfe9bafdcdfbe906fe6dd968907ac5b121a8c5901f030334c4"}
Jul 30 00:12:08.564437 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.564322    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv" event={"ID":"432642b0-8a24-46e8-8171-54cb5a47333d","Type":"ContainerStarted","Data":"ff756300feda53fa2c8060dc4befd54570f781c37fc7657c471a51822de5d91a"}
Jul 30 00:12:08.566123 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.565971    2527 generic.go:356] "Generic (PLEG): container finished" podID="a07a831c-5ef0-4cfc-8518-01fec916575e" containerID="2903e4c1740268e4e1b9cbc18d7bc644638dd98f24a2b16f39ba33e816a7c163" exitCode=0
Jul 30 00:12:08.566123 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.566109    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv" event={"ID":"a07a831c-5ef0-4cfc-8518-01fec916575e","Type":"ContainerDied","Data":"2903e4c1740268e4e1b9cbc18d7bc644638dd98f24a2b16f39ba33e816a7c163"}
Jul 30 00:12:08.566462 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.566188    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv" event={"ID":"a07a831c-5ef0-4cfc-8518-01fec916575e","Type":"ContainerStarted","Data":"d0b71de62faf0f8a04b7f927bbac9f862a41f775baa5a390c4fdfc71cff64ef0"}
Jul 30 00:12:08.568592 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.568570    2527 generic.go:356] "Generic (PLEG): container finished" podID="0c9d642f-2895-4771-84bf-2e93ed55f350" containerID="03941c09fc528eae5728c0854ae34328c51b948b7eda1a25c996a5e9e9d2ba4d" exitCode=0
Jul 30 00:12:08.568697 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.568629    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc" event={"ID":"0c9d642f-2895-4771-84bf-2e93ed55f350","Type":"ContainerDied","Data":"03941c09fc528eae5728c0854ae34328c51b948b7eda1a25c996a5e9e9d2ba4d"}
Jul 30 00:12:08.568697 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:08.568663    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc" event={"ID":"0c9d642f-2895-4771-84bf-2e93ed55f350","Type":"ContainerStarted","Data":"9723d205747616942f260edc4dc2698796eaa8ee19d8b18fdf0fa0898724d886"}
Jul 30 00:12:09.575402 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:09.575367    2527 generic.go:356] "Generic (PLEG): container finished" podID="1adef8ac-c1e9-48d6-b890-d7dd478706f9" containerID="cd3c40cd957cb90e319f8aede23a44a2fd0c59a05344a1e04dbd432c112c0af3" exitCode=0
Jul 30 00:12:09.575787 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:09.575459    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc" event={"ID":"1adef8ac-c1e9-48d6-b890-d7dd478706f9","Type":"ContainerDied","Data":"cd3c40cd957cb90e319f8aede23a44a2fd0c59a05344a1e04dbd432c112c0af3"}
Jul 30 00:12:09.575994 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:09.575976    2527 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 00:12:09.576988 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:09.576967    2527 generic.go:356] "Generic (PLEG): container finished" podID="432642b0-8a24-46e8-8171-54cb5a47333d" containerID="4481cc9a442d4adfe9bafdcdfbe906fe6dd968907ac5b121a8c5901f030334c4" exitCode=0
Jul 30 00:12:09.577071 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:09.577053    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv" event={"ID":"432642b0-8a24-46e8-8171-54cb5a47333d","Type":"ContainerDied","Data":"4481cc9a442d4adfe9bafdcdfbe906fe6dd968907ac5b121a8c5901f030334c4"}
Jul 30 00:12:09.674330 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:09.674297    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9cggv_c6b01a1f-c41e-4781-8c25-66b152e0d0e8/ovn-acl-logging/0.log"
Jul 30 00:12:09.674815 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:09.674789    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9cggv_c6b01a1f-c41e-4781-8c25-66b152e0d0e8/ovn-acl-logging/0.log"
Jul 30 00:12:10.585266 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:10.585238    2527 generic.go:356] "Generic (PLEG): container finished" podID="1adef8ac-c1e9-48d6-b890-d7dd478706f9" containerID="5351155cf76e3bdb895e9d491017edf9cbd96bdc7e760461b8d49279f06d390e" exitCode=0
Jul 30 00:12:10.585650 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:10.585324    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc" event={"ID":"1adef8ac-c1e9-48d6-b890-d7dd478706f9","Type":"ContainerDied","Data":"5351155cf76e3bdb895e9d491017edf9cbd96bdc7e760461b8d49279f06d390e"}
Jul 30 00:12:10.587565 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:10.587546    2527 generic.go:356] "Generic (PLEG): container finished" podID="a07a831c-5ef0-4cfc-8518-01fec916575e" containerID="f56d58cdee04753265fe004277179dbba8b059e76ff5c4fc1999dc0bc018569e" exitCode=0
Jul 30 00:12:10.587654 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:10.587634    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv" event={"ID":"a07a831c-5ef0-4cfc-8518-01fec916575e","Type":"ContainerDied","Data":"f56d58cdee04753265fe004277179dbba8b059e76ff5c4fc1999dc0bc018569e"}
Jul 30 00:12:10.590272 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:10.590227    2527 generic.go:356] "Generic (PLEG): container finished" podID="0c9d642f-2895-4771-84bf-2e93ed55f350" containerID="a6de7ba4078b5f68dc7cbd8b51786f04b45cfd23c003e40d53aab1e50da8d8e4" exitCode=0
Jul 30 00:12:10.590380 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:10.590317    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc" event={"ID":"0c9d642f-2895-4771-84bf-2e93ed55f350","Type":"ContainerDied","Data":"a6de7ba4078b5f68dc7cbd8b51786f04b45cfd23c003e40d53aab1e50da8d8e4"}
Jul 30 00:12:11.597302 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:11.597269    2527 generic.go:356] "Generic (PLEG): container finished" podID="0c9d642f-2895-4771-84bf-2e93ed55f350" containerID="82cffee5bceb87b77186e156cb186bbc7b4de02182ae063ef9a57c1535f35c66" exitCode=0
Jul 30 00:12:11.597779 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:11.597353    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc" event={"ID":"0c9d642f-2895-4771-84bf-2e93ed55f350","Type":"ContainerDied","Data":"82cffee5bceb87b77186e156cb186bbc7b4de02182ae063ef9a57c1535f35c66"}
Jul 30 00:12:11.599562 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:11.599536    2527 generic.go:356] "Generic (PLEG): container finished" podID="1adef8ac-c1e9-48d6-b890-d7dd478706f9" containerID="565d9af37c999287a6523f869cd0fbe99a1864e7578d8ba01f189c005ef18a2d" exitCode=0
Jul 30 00:12:11.599702 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:11.599608    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc" event={"ID":"1adef8ac-c1e9-48d6-b890-d7dd478706f9","Type":"ContainerDied","Data":"565d9af37c999287a6523f869cd0fbe99a1864e7578d8ba01f189c005ef18a2d"}
Jul 30 00:12:11.601449 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:11.601425    2527 generic.go:356] "Generic (PLEG): container finished" podID="432642b0-8a24-46e8-8171-54cb5a47333d" containerID="cd72679e0bf950a1d689e762e58b1b67d7e6781c7877aa6b74e6f19af6832fec" exitCode=0
Jul 30 00:12:11.601572 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:11.601501    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv" event={"ID":"432642b0-8a24-46e8-8171-54cb5a47333d","Type":"ContainerDied","Data":"cd72679e0bf950a1d689e762e58b1b67d7e6781c7877aa6b74e6f19af6832fec"}
Jul 30 00:12:11.603657 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:11.603638    2527 generic.go:356] "Generic (PLEG): container finished" podID="a07a831c-5ef0-4cfc-8518-01fec916575e" containerID="fd4ec7101954e1a506636caf4746978135552dadb0a0b229d3a9eeb127c7220b" exitCode=0
Jul 30 00:12:11.603747 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:11.603690    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv" event={"ID":"a07a831c-5ef0-4cfc-8518-01fec916575e","Type":"ContainerDied","Data":"fd4ec7101954e1a506636caf4746978135552dadb0a0b229d3a9eeb127c7220b"}
Jul 30 00:12:12.611451 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:12.611413    2527 generic.go:356] "Generic (PLEG): container finished" podID="432642b0-8a24-46e8-8171-54cb5a47333d" containerID="f89110203d3f06828aa0a95a507a80dce9427e30b5731c18699c09d962f06fdd" exitCode=0
Jul 30 00:12:12.611891 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:12.611514    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv" event={"ID":"432642b0-8a24-46e8-8171-54cb5a47333d","Type":"ContainerDied","Data":"f89110203d3f06828aa0a95a507a80dce9427e30b5731c18699c09d962f06fdd"}
Jul 30 00:12:12.744301 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:12.744267    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc"
Jul 30 00:12:12.791460 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:12.791434    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv"
Jul 30 00:12:12.823074 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:12.823050    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc"
Jul 30 00:12:12.871690 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:12.871614    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a07a831c-5ef0-4cfc-8518-01fec916575e-util\") pod \"a07a831c-5ef0-4cfc-8518-01fec916575e\" (UID: \"a07a831c-5ef0-4cfc-8518-01fec916575e\") "
Jul 30 00:12:12.871690 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:12.871650    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a07a831c-5ef0-4cfc-8518-01fec916575e-bundle\") pod \"a07a831c-5ef0-4cfc-8518-01fec916575e\" (UID: \"a07a831c-5ef0-4cfc-8518-01fec916575e\") "
Jul 30 00:12:12.871921 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:12.871723    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65jc9\" (UniqueName: \"kubernetes.io/projected/1adef8ac-c1e9-48d6-b890-d7dd478706f9-kube-api-access-65jc9\") pod \"1adef8ac-c1e9-48d6-b890-d7dd478706f9\" (UID: \"1adef8ac-c1e9-48d6-b890-d7dd478706f9\") "
Jul 30 00:12:12.871921 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:12.871752    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28w2p\" (UniqueName: \"kubernetes.io/projected/a07a831c-5ef0-4cfc-8518-01fec916575e-kube-api-access-28w2p\") pod \"a07a831c-5ef0-4cfc-8518-01fec916575e\" (UID: \"a07a831c-5ef0-4cfc-8518-01fec916575e\") "
Jul 30 00:12:12.871921 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:12.871776    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1adef8ac-c1e9-48d6-b890-d7dd478706f9-util\") pod \"1adef8ac-c1e9-48d6-b890-d7dd478706f9\" (UID: \"1adef8ac-c1e9-48d6-b890-d7dd478706f9\") "
Jul 30 00:12:12.871921 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:12.871848    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1adef8ac-c1e9-48d6-b890-d7dd478706f9-bundle\") pod \"1adef8ac-c1e9-48d6-b890-d7dd478706f9\" (UID: \"1adef8ac-c1e9-48d6-b890-d7dd478706f9\") "
Jul 30 00:12:12.872453 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:12.872380    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a07a831c-5ef0-4cfc-8518-01fec916575e-bundle" (OuterVolumeSpecName: "bundle") pod "a07a831c-5ef0-4cfc-8518-01fec916575e" (UID: "a07a831c-5ef0-4cfc-8518-01fec916575e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:12:12.872744 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:12.872698    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1adef8ac-c1e9-48d6-b890-d7dd478706f9-bundle" (OuterVolumeSpecName: "bundle") pod "1adef8ac-c1e9-48d6-b890-d7dd478706f9" (UID: "1adef8ac-c1e9-48d6-b890-d7dd478706f9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:12:12.874410 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:12.874386    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1adef8ac-c1e9-48d6-b890-d7dd478706f9-kube-api-access-65jc9" (OuterVolumeSpecName: "kube-api-access-65jc9") pod "1adef8ac-c1e9-48d6-b890-d7dd478706f9" (UID: "1adef8ac-c1e9-48d6-b890-d7dd478706f9"). InnerVolumeSpecName "kube-api-access-65jc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:12:12.874410 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:12.874397    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a07a831c-5ef0-4cfc-8518-01fec916575e-kube-api-access-28w2p" (OuterVolumeSpecName: "kube-api-access-28w2p") pod "a07a831c-5ef0-4cfc-8518-01fec916575e" (UID: "a07a831c-5ef0-4cfc-8518-01fec916575e"). InnerVolumeSpecName "kube-api-access-28w2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:12:12.877973 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:12.877935    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1adef8ac-c1e9-48d6-b890-d7dd478706f9-util" (OuterVolumeSpecName: "util") pod "1adef8ac-c1e9-48d6-b890-d7dd478706f9" (UID: "1adef8ac-c1e9-48d6-b890-d7dd478706f9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:12:12.878029 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:12.877955    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a07a831c-5ef0-4cfc-8518-01fec916575e-util" (OuterVolumeSpecName: "util") pod "a07a831c-5ef0-4cfc-8518-01fec916575e" (UID: "a07a831c-5ef0-4cfc-8518-01fec916575e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:12:12.973178 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:12.973133    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c9d642f-2895-4771-84bf-2e93ed55f350-util\") pod \"0c9d642f-2895-4771-84bf-2e93ed55f350\" (UID: \"0c9d642f-2895-4771-84bf-2e93ed55f350\") "
Jul 30 00:12:12.973380 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:12.973209    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n684p\" (UniqueName: \"kubernetes.io/projected/0c9d642f-2895-4771-84bf-2e93ed55f350-kube-api-access-n684p\") pod \"0c9d642f-2895-4771-84bf-2e93ed55f350\" (UID: \"0c9d642f-2895-4771-84bf-2e93ed55f350\") "
Jul 30 00:12:12.973380 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:12.973337    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c9d642f-2895-4771-84bf-2e93ed55f350-bundle\") pod \"0c9d642f-2895-4771-84bf-2e93ed55f350\" (UID: \"0c9d642f-2895-4771-84bf-2e93ed55f350\") "
Jul 30 00:12:12.973561 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:12.973548    2527 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a07a831c-5ef0-4cfc-8518-01fec916575e-bundle\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:12:12.973613 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:12.973562    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65jc9\" (UniqueName: \"kubernetes.io/projected/1adef8ac-c1e9-48d6-b890-d7dd478706f9-kube-api-access-65jc9\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:12:12.973613 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:12.973573    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28w2p\" (UniqueName: \"kubernetes.io/projected/a07a831c-5ef0-4cfc-8518-01fec916575e-kube-api-access-28w2p\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:12:12.973613 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:12.973581    2527 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1adef8ac-c1e9-48d6-b890-d7dd478706f9-util\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:12:12.973613 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:12.973589    2527 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1adef8ac-c1e9-48d6-b890-d7dd478706f9-bundle\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:12:12.973613 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:12.973597    2527 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a07a831c-5ef0-4cfc-8518-01fec916575e-util\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:12:12.973905 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:12.973879    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c9d642f-2895-4771-84bf-2e93ed55f350-bundle" (OuterVolumeSpecName: "bundle") pod "0c9d642f-2895-4771-84bf-2e93ed55f350" (UID: "0c9d642f-2895-4771-84bf-2e93ed55f350"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:12:12.975398 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:12.975375    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c9d642f-2895-4771-84bf-2e93ed55f350-kube-api-access-n684p" (OuterVolumeSpecName: "kube-api-access-n684p") pod "0c9d642f-2895-4771-84bf-2e93ed55f350" (UID: "0c9d642f-2895-4771-84bf-2e93ed55f350"). InnerVolumeSpecName "kube-api-access-n684p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:12:12.978761 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:12.978740    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c9d642f-2895-4771-84bf-2e93ed55f350-util" (OuterVolumeSpecName: "util") pod "0c9d642f-2895-4771-84bf-2e93ed55f350" (UID: "0c9d642f-2895-4771-84bf-2e93ed55f350"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:12:13.074259 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:13.074221    2527 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c9d642f-2895-4771-84bf-2e93ed55f350-util\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:12:13.074259 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:13.074253    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n684p\" (UniqueName: \"kubernetes.io/projected/0c9d642f-2895-4771-84bf-2e93ed55f350-kube-api-access-n684p\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:12:13.074259 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:13.074266    2527 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c9d642f-2895-4771-84bf-2e93ed55f350-bundle\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:12:13.618658 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:13.618628    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc"
Jul 30 00:12:13.618658 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:13.618648    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc" event={"ID":"0c9d642f-2895-4771-84bf-2e93ed55f350","Type":"ContainerDied","Data":"9723d205747616942f260edc4dc2698796eaa8ee19d8b18fdf0fa0898724d886"}
Jul 30 00:12:13.619130 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:13.618697    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9723d205747616942f260edc4dc2698796eaa8ee19d8b18fdf0fa0898724d886"
Jul 30 00:12:13.620607 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:13.620585    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc"
Jul 30 00:12:13.620749 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:13.620609    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc" event={"ID":"1adef8ac-c1e9-48d6-b890-d7dd478706f9","Type":"ContainerDied","Data":"400447b2a1b3d3ad348f1c73d2a2ef41f8232776c4cfbb814f0a2823f19aa030"}
Jul 30 00:12:13.620749 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:13.620644    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="400447b2a1b3d3ad348f1c73d2a2ef41f8232776c4cfbb814f0a2823f19aa030"
Jul 30 00:12:13.622658 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:13.622638    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv"
Jul 30 00:12:13.622775 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:13.622661    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv" event={"ID":"a07a831c-5ef0-4cfc-8518-01fec916575e","Type":"ContainerDied","Data":"d0b71de62faf0f8a04b7f927bbac9f862a41f775baa5a390c4fdfc71cff64ef0"}
Jul 30 00:12:13.622775 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:13.622705    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0b71de62faf0f8a04b7f927bbac9f862a41f775baa5a390c4fdfc71cff64ef0"
Jul 30 00:12:13.756897 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:13.756874    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv"
Jul 30 00:12:13.879878 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:13.879786    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8gms\" (UniqueName: \"kubernetes.io/projected/432642b0-8a24-46e8-8171-54cb5a47333d-kube-api-access-b8gms\") pod \"432642b0-8a24-46e8-8171-54cb5a47333d\" (UID: \"432642b0-8a24-46e8-8171-54cb5a47333d\") "
Jul 30 00:12:13.879878 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:13.879832    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/432642b0-8a24-46e8-8171-54cb5a47333d-util\") pod \"432642b0-8a24-46e8-8171-54cb5a47333d\" (UID: \"432642b0-8a24-46e8-8171-54cb5a47333d\") "
Jul 30 00:12:13.880107 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:13.879901    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/432642b0-8a24-46e8-8171-54cb5a47333d-bundle\") pod \"432642b0-8a24-46e8-8171-54cb5a47333d\" (UID: \"432642b0-8a24-46e8-8171-54cb5a47333d\") "
Jul 30 00:12:13.880387 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:13.880365    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/432642b0-8a24-46e8-8171-54cb5a47333d-bundle" (OuterVolumeSpecName: "bundle") pod "432642b0-8a24-46e8-8171-54cb5a47333d" (UID: "432642b0-8a24-46e8-8171-54cb5a47333d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:12:13.882042 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:13.882018    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/432642b0-8a24-46e8-8171-54cb5a47333d-kube-api-access-b8gms" (OuterVolumeSpecName: "kube-api-access-b8gms") pod "432642b0-8a24-46e8-8171-54cb5a47333d" (UID: "432642b0-8a24-46e8-8171-54cb5a47333d"). InnerVolumeSpecName "kube-api-access-b8gms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:12:13.885794 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:13.885768    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/432642b0-8a24-46e8-8171-54cb5a47333d-util" (OuterVolumeSpecName: "util") pod "432642b0-8a24-46e8-8171-54cb5a47333d" (UID: "432642b0-8a24-46e8-8171-54cb5a47333d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:12:13.980592 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:13.980556    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8gms\" (UniqueName: \"kubernetes.io/projected/432642b0-8a24-46e8-8171-54cb5a47333d-kube-api-access-b8gms\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:12:13.980592 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:13.980585    2527 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/432642b0-8a24-46e8-8171-54cb5a47333d-util\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:12:13.980592 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:13.980595    2527 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/432642b0-8a24-46e8-8171-54cb5a47333d-bundle\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:12:14.629538 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:14.629445    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv" event={"ID":"432642b0-8a24-46e8-8171-54cb5a47333d","Type":"ContainerDied","Data":"ff756300feda53fa2c8060dc4befd54570f781c37fc7657c471a51822de5d91a"}
Jul 30 00:12:14.629538 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:14.629493    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff756300feda53fa2c8060dc4befd54570f781c37fc7657c471a51822de5d91a"
Jul 30 00:12:14.629538 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:14.629495    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv"
Jul 30 00:12:24.330517 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.330477    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-tgdh9"]
Jul 30 00:12:24.330912 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.330848    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c9d642f-2895-4771-84bf-2e93ed55f350" containerName="util"
Jul 30 00:12:24.330912 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.330860    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c9d642f-2895-4771-84bf-2e93ed55f350" containerName="util"
Jul 30 00:12:24.330912 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.330869    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a07a831c-5ef0-4cfc-8518-01fec916575e" containerName="pull"
Jul 30 00:12:24.330912 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.330874    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="a07a831c-5ef0-4cfc-8518-01fec916575e" containerName="pull"
Jul 30 00:12:24.330912 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.330880    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="432642b0-8a24-46e8-8171-54cb5a47333d" containerName="extract"
Jul 30 00:12:24.330912 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.330885    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="432642b0-8a24-46e8-8171-54cb5a47333d" containerName="extract"
Jul 30 00:12:24.330912 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.330893    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="432642b0-8a24-46e8-8171-54cb5a47333d" containerName="pull"
Jul 30 00:12:24.330912 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.330897    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="432642b0-8a24-46e8-8171-54cb5a47333d" containerName="pull"
Jul 30 00:12:24.330912 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.330903    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a07a831c-5ef0-4cfc-8518-01fec916575e" containerName="extract"
Jul 30 00:12:24.330912 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.330908    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="a07a831c-5ef0-4cfc-8518-01fec916575e" containerName="extract"
Jul 30 00:12:24.330912 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.330915    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1adef8ac-c1e9-48d6-b890-d7dd478706f9" containerName="pull"
Jul 30 00:12:24.331280 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.330920    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="1adef8ac-c1e9-48d6-b890-d7dd478706f9" containerName="pull"
Jul 30 00:12:24.331280 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.330927    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c9d642f-2895-4771-84bf-2e93ed55f350" containerName="extract"
Jul 30 00:12:24.331280 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.330932    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c9d642f-2895-4771-84bf-2e93ed55f350" containerName="extract"
Jul 30 00:12:24.331280 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.330951    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a07a831c-5ef0-4cfc-8518-01fec916575e" containerName="util"
Jul 30 00:12:24.331280 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.330955    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="a07a831c-5ef0-4cfc-8518-01fec916575e" containerName="util"
Jul 30 00:12:24.331280 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.330961    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1adef8ac-c1e9-48d6-b890-d7dd478706f9" containerName="extract"
Jul 30 00:12:24.331280 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.330965    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="1adef8ac-c1e9-48d6-b890-d7dd478706f9" containerName="extract"
Jul 30 00:12:24.331280 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.330972    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="432642b0-8a24-46e8-8171-54cb5a47333d" containerName="util"
Jul 30 00:12:24.331280 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.330977    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="432642b0-8a24-46e8-8171-54cb5a47333d" containerName="util"
Jul 30 00:12:24.331280 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.330984    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c9d642f-2895-4771-84bf-2e93ed55f350" containerName="pull"
Jul 30 00:12:24.331280 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.330990    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c9d642f-2895-4771-84bf-2e93ed55f350" containerName="pull"
Jul 30 00:12:24.331280 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.330999    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1adef8ac-c1e9-48d6-b890-d7dd478706f9" containerName="util"
Jul 30 00:12:24.331280 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.331006    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="1adef8ac-c1e9-48d6-b890-d7dd478706f9" containerName="util"
Jul 30 00:12:24.331280 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.331079    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="1adef8ac-c1e9-48d6-b890-d7dd478706f9" containerName="extract"
Jul 30 00:12:24.331280 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.331092    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="a07a831c-5ef0-4cfc-8518-01fec916575e" containerName="extract"
Jul 30 00:12:24.331280 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.331102    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c9d642f-2895-4771-84bf-2e93ed55f350" containerName="extract"
Jul 30 00:12:24.331280 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.331111    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="432642b0-8a24-46e8-8171-54cb5a47333d" containerName="extract"
Jul 30 00:12:24.334499 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.334479    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tgdh9"
Jul 30 00:12:24.336928 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.336910    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-znzwm\""
Jul 30 00:12:24.345542 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.345517    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-tgdh9"]
Jul 30 00:12:24.469509 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.469449    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlnt8\" (UniqueName: \"kubernetes.io/projected/667956b5-c05b-4b82-94ae-3bba71fd9dfb-kube-api-access-zlnt8\") pod \"authorino-operator-75cc8d5cb7-tgdh9\" (UID: \"667956b5-c05b-4b82-94ae-3bba71fd9dfb\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-tgdh9"
Jul 30 00:12:24.570799 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.570760    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlnt8\" (UniqueName: \"kubernetes.io/projected/667956b5-c05b-4b82-94ae-3bba71fd9dfb-kube-api-access-zlnt8\") pod \"authorino-operator-75cc8d5cb7-tgdh9\" (UID: \"667956b5-c05b-4b82-94ae-3bba71fd9dfb\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-tgdh9"
Jul 30 00:12:24.579106 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.579081    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlnt8\" (UniqueName: \"kubernetes.io/projected/667956b5-c05b-4b82-94ae-3bba71fd9dfb-kube-api-access-zlnt8\") pod \"authorino-operator-75cc8d5cb7-tgdh9\" (UID: \"667956b5-c05b-4b82-94ae-3bba71fd9dfb\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-tgdh9"
Jul 30 00:12:24.646289 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.646205    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tgdh9"
Jul 30 00:12:24.786315 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:24.786290    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-tgdh9"]
Jul 30 00:12:24.788124 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:12:24.788103    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod667956b5_c05b_4b82_94ae_3bba71fd9dfb.slice/crio-218c56ed6a55921f379705659e656f83c0e73285c44091f2c08eeb3442c80917 WatchSource:0}: Error finding container 218c56ed6a55921f379705659e656f83c0e73285c44091f2c08eeb3442c80917: Status 404 returned error can't find the container with id 218c56ed6a55921f379705659e656f83c0e73285c44091f2c08eeb3442c80917
Jul 30 00:12:25.697643 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:25.697601    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tgdh9" event={"ID":"667956b5-c05b-4b82-94ae-3bba71fd9dfb","Type":"ContainerStarted","Data":"218c56ed6a55921f379705659e656f83c0e73285c44091f2c08eeb3442c80917"}
Jul 30 00:12:27.555482 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:27.555449    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-s5n4l"]
Jul 30 00:12:27.559256 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:27.559233    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s5n4l"
Jul 30 00:12:27.561661 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:27.561638    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 30 00:12:27.561812 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:27.561787    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-4d9l5\""
Jul 30 00:12:27.569417 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:27.569388    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-s5n4l"]
Jul 30 00:12:27.598009 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:27.597969    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79brp\" (UniqueName: \"kubernetes.io/projected/98c93779-1196-4e2a-84c6-1de5f700e0c3-kube-api-access-79brp\") pod \"dns-operator-controller-manager-864dd78c4c-s5n4l\" (UID: \"98c93779-1196-4e2a-84c6-1de5f700e0c3\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s5n4l"
Jul 30 00:12:27.698538 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:27.698496    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79brp\" (UniqueName: \"kubernetes.io/projected/98c93779-1196-4e2a-84c6-1de5f700e0c3-kube-api-access-79brp\") pod \"dns-operator-controller-manager-864dd78c4c-s5n4l\" (UID: \"98c93779-1196-4e2a-84c6-1de5f700e0c3\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s5n4l"
Jul 30 00:12:27.712644 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:27.712607    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tgdh9" event={"ID":"667956b5-c05b-4b82-94ae-3bba71fd9dfb","Type":"ContainerStarted","Data":"9eb699c92d5edb5ed5701667c92e08cffd1a3486d58bab6826bc16df7c01c8bb"}
Jul 30 00:12:27.712847 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:27.712765    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tgdh9"
Jul 30 00:12:27.716692 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:27.716670    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79brp\" (UniqueName: \"kubernetes.io/projected/98c93779-1196-4e2a-84c6-1de5f700e0c3-kube-api-access-79brp\") pod \"dns-operator-controller-manager-864dd78c4c-s5n4l\" (UID: \"98c93779-1196-4e2a-84c6-1de5f700e0c3\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s5n4l"
Jul 30 00:12:27.741521 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:27.741468    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tgdh9" podStartSLOduration=1.351115507 podStartE2EDuration="3.741452726s" totalImagesPullingTime="2.390337219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:12:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:12:27.739559227 +0000 UTC m=+622.042007572" watchObservedRunningTime="2026-07-30 00:12:27.741452726 +0000 UTC m=+622.043901070"
Jul 30 00:12:27.871307 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:27.871214    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s5n4l"
Jul 30 00:12:28.078370 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:28.078268    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-s5n4l"]
Jul 30 00:12:28.091132 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:12:28.091097    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98c93779_1196_4e2a_84c6_1de5f700e0c3.slice/crio-800cf645ba2aa428dddd8e7693c36f98696321a2a52e38d5e7cba9766284d0d8 WatchSource:0}: Error finding container 800cf645ba2aa428dddd8e7693c36f98696321a2a52e38d5e7cba9766284d0d8: Status 404 returned error can't find the container with id 800cf645ba2aa428dddd8e7693c36f98696321a2a52e38d5e7cba9766284d0d8
Jul 30 00:12:28.719377 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:28.719336    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s5n4l" event={"ID":"98c93779-1196-4e2a-84c6-1de5f700e0c3","Type":"ContainerStarted","Data":"800cf645ba2aa428dddd8e7693c36f98696321a2a52e38d5e7cba9766284d0d8"}
Jul 30 00:12:30.734133 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:30.734097    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s5n4l" event={"ID":"98c93779-1196-4e2a-84c6-1de5f700e0c3","Type":"ContainerStarted","Data":"34366e201de1103a10c57ed766e2f8b8281d606126244c13065e5f490f514578"}
Jul 30 00:12:30.734575 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:30.734292    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s5n4l"
Jul 30 00:12:30.751469 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:30.751420    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s5n4l" podStartSLOduration=1.580533111 podStartE2EDuration="3.751405688s" totalImagesPullingTime="2.170872577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:12:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:12:30.750314817 +0000 UTC m=+625.052763174" watchObservedRunningTime="2026-07-30 00:12:30.751405688 +0000 UTC m=+625.053854045"
Jul 30 00:12:32.296825 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:32.296788    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dswr4"]
Jul 30 00:12:32.300664 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:32.300642    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dswr4"
Jul 30 00:12:32.303588 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:32.303566    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-g8nlw\""
Jul 30 00:12:32.311627 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:32.311604    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dswr4"]
Jul 30 00:12:32.342685 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:32.342648    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29f387cd-f41b-49e6-b848-3cf6784b7e6a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dswr4\" (UID: \"29f387cd-f41b-49e6-b848-3cf6784b7e6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dswr4"
Jul 30 00:12:32.342864 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:32.342706    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nddkb\" (UniqueName: \"kubernetes.io/projected/29f387cd-f41b-49e6-b848-3cf6784b7e6a-kube-api-access-nddkb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dswr4\" (UID: \"29f387cd-f41b-49e6-b848-3cf6784b7e6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dswr4"
Jul 30 00:12:32.444063 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:32.444024    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nddkb\" (UniqueName: \"kubernetes.io/projected/29f387cd-f41b-49e6-b848-3cf6784b7e6a-kube-api-access-nddkb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dswr4\" (UID: \"29f387cd-f41b-49e6-b848-3cf6784b7e6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dswr4"
Jul 30 00:12:32.444270 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:32.444120    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29f387cd-f41b-49e6-b848-3cf6784b7e6a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dswr4\" (UID: \"29f387cd-f41b-49e6-b848-3cf6784b7e6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dswr4"
Jul 30 00:12:32.444535 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:32.444514    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29f387cd-f41b-49e6-b848-3cf6784b7e6a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dswr4\" (UID: \"29f387cd-f41b-49e6-b848-3cf6784b7e6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dswr4"
Jul 30 00:12:32.452284 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:32.452263    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nddkb\" (UniqueName: \"kubernetes.io/projected/29f387cd-f41b-49e6-b848-3cf6784b7e6a-kube-api-access-nddkb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dswr4\" (UID: \"29f387cd-f41b-49e6-b848-3cf6784b7e6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dswr4"
Jul 30 00:12:32.611073 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:32.610980    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dswr4"
Jul 30 00:12:32.756262 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:32.756235    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dswr4"]
Jul 30 00:12:32.758213 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:12:32.758183    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29f387cd_f41b_49e6_b848_3cf6784b7e6a.slice/crio-256ec69150512b5264723559d5343dbe1bf67c2139fee8201c219a507ae3121f WatchSource:0}: Error finding container 256ec69150512b5264723559d5343dbe1bf67c2139fee8201c219a507ae3121f: Status 404 returned error can't find the container with id 256ec69150512b5264723559d5343dbe1bf67c2139fee8201c219a507ae3121f
Jul 30 00:12:33.753293 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:33.753253    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dswr4" event={"ID":"29f387cd-f41b-49e6-b848-3cf6784b7e6a","Type":"ContainerStarted","Data":"256ec69150512b5264723559d5343dbe1bf67c2139fee8201c219a507ae3121f"}
Jul 30 00:12:34.348992 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:34.348957    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7pcd"]
Jul 30 00:12:34.352603 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:34.352581    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7pcd"
Jul 30 00:12:34.355390 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:34.355368    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-z28g8\""
Jul 30 00:12:34.363148 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:34.363120    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7pcd"]
Jul 30 00:12:34.464649 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:34.464607    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x69lr\" (UniqueName: \"kubernetes.io/projected/d9e4431e-9f1a-42c8-8240-28b26c061049-kube-api-access-x69lr\") pod \"limitador-operator-controller-manager-859d7b78bd-p7pcd\" (UID: \"d9e4431e-9f1a-42c8-8240-28b26c061049\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7pcd"
Jul 30 00:12:34.565638 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:34.565603    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x69lr\" (UniqueName: \"kubernetes.io/projected/d9e4431e-9f1a-42c8-8240-28b26c061049-kube-api-access-x69lr\") pod \"limitador-operator-controller-manager-859d7b78bd-p7pcd\" (UID: \"d9e4431e-9f1a-42c8-8240-28b26c061049\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7pcd"
Jul 30 00:12:34.579218 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:34.579189    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x69lr\" (UniqueName: \"kubernetes.io/projected/d9e4431e-9f1a-42c8-8240-28b26c061049-kube-api-access-x69lr\") pod \"limitador-operator-controller-manager-859d7b78bd-p7pcd\" (UID: \"d9e4431e-9f1a-42c8-8240-28b26c061049\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7pcd"
Jul 30 00:12:34.663585 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:34.663488    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7pcd"
Jul 30 00:12:34.807515 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:34.807485    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7pcd"]
Jul 30 00:12:34.809993 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:12:34.809962    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9e4431e_9f1a_42c8_8240_28b26c061049.slice/crio-677c250db3fa81797ee8b8fd44a37147b1d830a766d971659e3a3cfbc0e371a4 WatchSource:0}: Error finding container 677c250db3fa81797ee8b8fd44a37147b1d830a766d971659e3a3cfbc0e371a4: Status 404 returned error can't find the container with id 677c250db3fa81797ee8b8fd44a37147b1d830a766d971659e3a3cfbc0e371a4
Jul 30 00:12:35.769744 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:35.769693    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7pcd" event={"ID":"d9e4431e-9f1a-42c8-8240-28b26c061049","Type":"ContainerStarted","Data":"677c250db3fa81797ee8b8fd44a37147b1d830a766d971659e3a3cfbc0e371a4"}
Jul 30 00:12:36.777608 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:36.777574    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7pcd" event={"ID":"d9e4431e-9f1a-42c8-8240-28b26c061049","Type":"ContainerStarted","Data":"2161f845c0166d5481a881fa08b206b83f7314c8c3ac71597e2c4b01523b592d"}
Jul 30 00:12:36.777982 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:36.777741    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7pcd"
Jul 30 00:12:36.793492 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:36.793431    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7pcd" podStartSLOduration=1.057673657 podStartE2EDuration="2.793410123s" totalImagesPullingTime="1.735736466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:12:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:12:36.791356461 +0000 UTC m=+631.093804807" watchObservedRunningTime="2026-07-30 00:12:36.793410123 +0000 UTC m=+631.095858470"
Jul 30 00:12:38.721664 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:38.721628    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tgdh9"
Jul 30 00:12:38.793003 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:38.792964    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dswr4" event={"ID":"29f387cd-f41b-49e6-b848-3cf6784b7e6a","Type":"ContainerStarted","Data":"667b7b783d917d5c6153213f321e57126414d97c0a1f9100f73b449c165cf405"}
Jul 30 00:12:38.793193 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:38.793116    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dswr4"
Jul 30 00:12:38.809681 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:38.809614    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dswr4" podStartSLOduration=0.99138721 podStartE2EDuration="6.809598684s" totalImagesPullingTime="5.818211474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:12:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:12:38.808679243 +0000 UTC m=+633.111127591" watchObservedRunningTime="2026-07-30 00:12:38.809598684 +0000 UTC m=+633.112047029"
Jul 30 00:12:41.343424 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:41.343388    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-2fn4p"]
Jul 30 00:12:41.347301 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:41.347283    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2fn4p"
Jul 30 00:12:41.349446 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:41.349418    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 30 00:12:41.349586 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:41.349482    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-t67ws\""
Jul 30 00:12:41.349658 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:41.349595    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 30 00:12:41.353803 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:41.353778    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-2fn4p"]
Jul 30 00:12:41.432526 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:41.432491    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd4e0fff-93e7-4843-831d-811d747c02fd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2fn4p\" (UID: \"bd4e0fff-93e7-4843-831d-811d747c02fd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2fn4p"
Jul 30 00:12:41.432715 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:41.432549    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bd4e0fff-93e7-4843-831d-811d747c02fd-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-2fn4p\" (UID: \"bd4e0fff-93e7-4843-831d-811d747c02fd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2fn4p"
Jul 30 00:12:41.432715 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:41.432590    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8dq2\" (UniqueName: \"kubernetes.io/projected/bd4e0fff-93e7-4843-831d-811d747c02fd-kube-api-access-n8dq2\") pod \"kuadrant-console-plugin-66b5774985-2fn4p\" (UID: \"bd4e0fff-93e7-4843-831d-811d747c02fd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2fn4p"
Jul 30 00:12:41.533265 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:41.533231    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd4e0fff-93e7-4843-831d-811d747c02fd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2fn4p\" (UID: \"bd4e0fff-93e7-4843-831d-811d747c02fd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2fn4p"
Jul 30 00:12:41.533419 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:41.533274    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bd4e0fff-93e7-4843-831d-811d747c02fd-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-2fn4p\" (UID: \"bd4e0fff-93e7-4843-831d-811d747c02fd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2fn4p"
Jul 30 00:12:41.533419 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:41.533305    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8dq2\" (UniqueName: \"kubernetes.io/projected/bd4e0fff-93e7-4843-831d-811d747c02fd-kube-api-access-n8dq2\") pod \"kuadrant-console-plugin-66b5774985-2fn4p\" (UID: \"bd4e0fff-93e7-4843-831d-811d747c02fd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2fn4p"
Jul 30 00:12:41.533419 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:12:41.533397    2527 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 30 00:12:41.533517 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:12:41.533473    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd4e0fff-93e7-4843-831d-811d747c02fd-plugin-serving-cert podName:bd4e0fff-93e7-4843-831d-811d747c02fd nodeName:}" failed. No retries permitted until 2026-07-30 00:12:42.033455004 +0000 UTC m=+636.335903331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/bd4e0fff-93e7-4843-831d-811d747c02fd-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-2fn4p" (UID: "bd4e0fff-93e7-4843-831d-811d747c02fd") : secret "plugin-serving-cert" not found
Jul 30 00:12:41.533930 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:41.533910    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bd4e0fff-93e7-4843-831d-811d747c02fd-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-2fn4p\" (UID: \"bd4e0fff-93e7-4843-831d-811d747c02fd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2fn4p"
Jul 30 00:12:41.541584 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:41.541554    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8dq2\" (UniqueName: \"kubernetes.io/projected/bd4e0fff-93e7-4843-831d-811d747c02fd-kube-api-access-n8dq2\") pod \"kuadrant-console-plugin-66b5774985-2fn4p\" (UID: \"bd4e0fff-93e7-4843-831d-811d747c02fd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2fn4p"
Jul 30 00:12:41.742834 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:41.742804    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s5n4l"
Jul 30 00:12:42.038813 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:42.038694    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd4e0fff-93e7-4843-831d-811d747c02fd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2fn4p\" (UID: \"bd4e0fff-93e7-4843-831d-811d747c02fd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2fn4p"
Jul 30 00:12:42.041409 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:42.041387    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd4e0fff-93e7-4843-831d-811d747c02fd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2fn4p\" (UID: \"bd4e0fff-93e7-4843-831d-811d747c02fd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2fn4p"
Jul 30 00:12:42.258215 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:42.258182    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2fn4p"
Jul 30 00:12:42.400391 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:42.400365    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-2fn4p"]
Jul 30 00:12:42.402684 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:12:42.402650    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd4e0fff_93e7_4843_831d_811d747c02fd.slice/crio-4fcca40489ca33d446507e59303f4688345a9ecf48ef8b7c44cc4375d865b4df WatchSource:0}: Error finding container 4fcca40489ca33d446507e59303f4688345a9ecf48ef8b7c44cc4375d865b4df: Status 404 returned error can't find the container with id 4fcca40489ca33d446507e59303f4688345a9ecf48ef8b7c44cc4375d865b4df
Jul 30 00:12:42.817277 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:42.817231    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2fn4p" event={"ID":"bd4e0fff-93e7-4843-831d-811d747c02fd","Type":"ContainerStarted","Data":"4fcca40489ca33d446507e59303f4688345a9ecf48ef8b7c44cc4375d865b4df"}
Jul 30 00:12:47.787493 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:47.787463    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7pcd"
Jul 30 00:12:49.801273 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:49.801237    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dswr4"
Jul 30 00:12:50.913428 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:50.913392    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrk92"]
Jul 30 00:12:50.924013 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:50.923975    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrk92"
Jul 30 00:12:50.930796 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:50.930761    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrk92"]
Jul 30 00:12:51.010843 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.010798    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrk92"]
Jul 30 00:12:51.011188 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:12:51.011132    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-svccs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrk92" podUID="014cab84-1d0c-4eed-9686-ec5f384eea85"
Jul 30 00:12:51.027971 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.027934    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svccs\" (UniqueName: \"kubernetes.io/projected/014cab84-1d0c-4eed-9686-ec5f384eea85-kube-api-access-svccs\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zrk92\" (UID: \"014cab84-1d0c-4eed-9686-ec5f384eea85\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrk92"
Jul 30 00:12:51.028137 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.028007    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/014cab84-1d0c-4eed-9686-ec5f384eea85-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zrk92\" (UID: \"014cab84-1d0c-4eed-9686-ec5f384eea85\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrk92"
Jul 30 00:12:51.045717 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.045682    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gwknn"]
Jul 30 00:12:51.049865 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.049845    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gwknn"
Jul 30 00:12:51.060296 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.060266    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gwknn"]
Jul 30 00:12:51.128628 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.128591    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/085eaf0c-396a-4710-a2db-0cdff5249aae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-gwknn\" (UID: \"085eaf0c-396a-4710-a2db-0cdff5249aae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gwknn"
Jul 30 00:12:51.128789 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.128640    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrq8m\" (UniqueName: \"kubernetes.io/projected/085eaf0c-396a-4710-a2db-0cdff5249aae-kube-api-access-wrq8m\") pod \"kuadrant-operator-controller-manager-55467d9f7-gwknn\" (UID: \"085eaf0c-396a-4710-a2db-0cdff5249aae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gwknn"
Jul 30 00:12:51.128789 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.128686    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svccs\" (UniqueName: \"kubernetes.io/projected/014cab84-1d0c-4eed-9686-ec5f384eea85-kube-api-access-svccs\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zrk92\" (UID: \"014cab84-1d0c-4eed-9686-ec5f384eea85\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrk92"
Jul 30 00:12:51.128789 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.128755    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/014cab84-1d0c-4eed-9686-ec5f384eea85-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zrk92\" (UID: \"014cab84-1d0c-4eed-9686-ec5f384eea85\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrk92"
Jul 30 00:12:51.129261 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.129222    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/014cab84-1d0c-4eed-9686-ec5f384eea85-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zrk92\" (UID: \"014cab84-1d0c-4eed-9686-ec5f384eea85\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrk92"
Jul 30 00:12:51.140214 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.140185    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svccs\" (UniqueName: \"kubernetes.io/projected/014cab84-1d0c-4eed-9686-ec5f384eea85-kube-api-access-svccs\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-zrk92\" (UID: \"014cab84-1d0c-4eed-9686-ec5f384eea85\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrk92"
Jul 30 00:12:51.230209 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.230148    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/085eaf0c-396a-4710-a2db-0cdff5249aae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-gwknn\" (UID: \"085eaf0c-396a-4710-a2db-0cdff5249aae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gwknn"
Jul 30 00:12:51.230407 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.230227    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrq8m\" (UniqueName: \"kubernetes.io/projected/085eaf0c-396a-4710-a2db-0cdff5249aae-kube-api-access-wrq8m\") pod \"kuadrant-operator-controller-manager-55467d9f7-gwknn\" (UID: \"085eaf0c-396a-4710-a2db-0cdff5249aae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gwknn"
Jul 30 00:12:51.230561 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.230536    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/085eaf0c-396a-4710-a2db-0cdff5249aae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-gwknn\" (UID: \"085eaf0c-396a-4710-a2db-0cdff5249aae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gwknn"
Jul 30 00:12:51.239685 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.239653    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrq8m\" (UniqueName: \"kubernetes.io/projected/085eaf0c-396a-4710-a2db-0cdff5249aae-kube-api-access-wrq8m\") pod \"kuadrant-operator-controller-manager-55467d9f7-gwknn\" (UID: \"085eaf0c-396a-4710-a2db-0cdff5249aae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gwknn"
Jul 30 00:12:51.364205 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.364151    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gwknn"
Jul 30 00:12:51.447678 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.447643    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gwknn"]
Jul 30 00:12:51.453828 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.453801    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gwknn"]
Jul 30 00:12:51.466287 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.466150    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrk92"]
Jul 30 00:12:51.469256 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.469209    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-glbnh"]
Jul 30 00:12:51.479266 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.479233    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrk92"]
Jul 30 00:12:51.479443 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.479379    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-glbnh"
Jul 30 00:12:51.484360 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.484297    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-glbnh"]
Jul 30 00:12:51.488621 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.488562    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dswr4"]
Jul 30 00:12:51.490525 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.490477    2527 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dswr4" podUID="29f387cd-f41b-49e6-b848-3cf6784b7e6a" containerName="manager" containerID="cri-o://667b7b783d917d5c6153213f321e57126414d97c0a1f9100f73b449c165cf405" gracePeriod=2
Jul 30 00:12:51.494105 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.492116    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dswr4"]
Jul 30 00:12:51.505104 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:12:51.505071    2527 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dswr4\" is forbidden: User \"system:node:ip-10-0-137-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-198.ec2.internal' and this object" podUID="29f387cd-f41b-49e6-b848-3cf6784b7e6a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dswr4"
Jul 30 00:12:51.509068 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.509036    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7pcd"]
Jul 30 00:12:51.511233 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.509357    2527 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7pcd" podUID="d9e4431e-9f1a-42c8-8240-28b26c061049" containerName="manager" containerID="cri-o://2161f845c0166d5481a881fa08b206b83f7314c8c3ac71597e2c4b01523b592d" gracePeriod=2
Jul 30 00:12:51.514023 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:12:51.513558    2527 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dswr4\" is forbidden: User \"system:node:ip-10-0-137-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-198.ec2.internal' and this object" podUID="29f387cd-f41b-49e6-b848-3cf6784b7e6a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dswr4"
Jul 30 00:12:51.515522 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:12:51.515477    2527 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-p7pcd\" is forbidden: User \"system:node:ip-10-0-137-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-198.ec2.internal' and this object" podUID="d9e4431e-9f1a-42c8-8240-28b26c061049" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7pcd"
Jul 30 00:12:51.519103 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.519044    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7pcd"]
Jul 30 00:12:51.522789 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.522768    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npg86"]
Jul 30 00:12:51.523432 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.523414    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9e4431e-9f1a-42c8-8240-28b26c061049" containerName="manager"
Jul 30 00:12:51.523597 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.523579    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9e4431e-9f1a-42c8-8240-28b26c061049" containerName="manager"
Jul 30 00:12:51.523667 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.523619    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29f387cd-f41b-49e6-b848-3cf6784b7e6a" containerName="manager"
Jul 30 00:12:51.523667 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.523630    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="29f387cd-f41b-49e6-b848-3cf6784b7e6a" containerName="manager"
Jul 30 00:12:51.523759 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.523744    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="29f387cd-f41b-49e6-b848-3cf6784b7e6a" containerName="manager"
Jul 30 00:12:51.523812 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.523762    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9e4431e-9f1a-42c8-8240-28b26c061049" containerName="manager"
Jul 30 00:12:51.528595 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.528573    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npg86"
Jul 30 00:12:51.530951 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:12:51.530922    2527 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dswr4\" is forbidden: User \"system:node:ip-10-0-137-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-198.ec2.internal' and this object" podUID="29f387cd-f41b-49e6-b848-3cf6784b7e6a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dswr4"
Jul 30 00:12:51.533000 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:12:51.532971    2527 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-p7pcd\" is forbidden: User \"system:node:ip-10-0-137-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-198.ec2.internal' and this object" podUID="d9e4431e-9f1a-42c8-8240-28b26c061049" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7pcd"
Jul 30 00:12:51.539441 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.539351    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npg86"]
Jul 30 00:12:51.636318 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.636273    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/50f8ca61-a5d3-4388-a07c-a9d104b68246-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-glbnh\" (UID: \"50f8ca61-a5d3-4388-a07c-a9d104b68246\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-glbnh"
Jul 30 00:12:51.636497 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.636352    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8xzp\" (UniqueName: \"kubernetes.io/projected/50f8ca61-a5d3-4388-a07c-a9d104b68246-kube-api-access-n8xzp\") pod \"kuadrant-operator-controller-manager-55467d9f7-glbnh\" (UID: \"50f8ca61-a5d3-4388-a07c-a9d104b68246\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-glbnh"
Jul 30 00:12:51.636497 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.636387    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v8ql\" (UniqueName: \"kubernetes.io/projected/d73f1983-3e53-44a6-974b-dd1d25b8b63e-kube-api-access-9v8ql\") pod \"kuadrant-operator-controller-manager-8684c9ff49-npg86\" (UID: \"d73f1983-3e53-44a6-974b-dd1d25b8b63e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npg86"
Jul 30 00:12:51.636497 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.636424    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d73f1983-3e53-44a6-974b-dd1d25b8b63e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-npg86\" (UID: \"d73f1983-3e53-44a6-974b-dd1d25b8b63e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npg86"
Jul 30 00:12:51.737759 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.737199    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/50f8ca61-a5d3-4388-a07c-a9d104b68246-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-glbnh\" (UID: \"50f8ca61-a5d3-4388-a07c-a9d104b68246\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-glbnh"
Jul 30 00:12:51.737759 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.737287    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8xzp\" (UniqueName: \"kubernetes.io/projected/50f8ca61-a5d3-4388-a07c-a9d104b68246-kube-api-access-n8xzp\") pod \"kuadrant-operator-controller-manager-55467d9f7-glbnh\" (UID: \"50f8ca61-a5d3-4388-a07c-a9d104b68246\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-glbnh"
Jul 30 00:12:51.737759 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.737327    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v8ql\" (UniqueName: \"kubernetes.io/projected/d73f1983-3e53-44a6-974b-dd1d25b8b63e-kube-api-access-9v8ql\") pod \"kuadrant-operator-controller-manager-8684c9ff49-npg86\" (UID: \"d73f1983-3e53-44a6-974b-dd1d25b8b63e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npg86"
Jul 30 00:12:51.737759 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.737357    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d73f1983-3e53-44a6-974b-dd1d25b8b63e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-npg86\" (UID: \"d73f1983-3e53-44a6-974b-dd1d25b8b63e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npg86"
Jul 30 00:12:51.737759 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.737644    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/50f8ca61-a5d3-4388-a07c-a9d104b68246-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-glbnh\" (UID: \"50f8ca61-a5d3-4388-a07c-a9d104b68246\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-glbnh"
Jul 30 00:12:51.737759 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.737745    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d73f1983-3e53-44a6-974b-dd1d25b8b63e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-npg86\" (UID: \"d73f1983-3e53-44a6-974b-dd1d25b8b63e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npg86"
Jul 30 00:12:51.755333 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.755299    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v8ql\" (UniqueName: \"kubernetes.io/projected/d73f1983-3e53-44a6-974b-dd1d25b8b63e-kube-api-access-9v8ql\") pod \"kuadrant-operator-controller-manager-8684c9ff49-npg86\" (UID: \"d73f1983-3e53-44a6-974b-dd1d25b8b63e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npg86"
Jul 30 00:12:51.755498 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.755341    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8xzp\" (UniqueName: \"kubernetes.io/projected/50f8ca61-a5d3-4388-a07c-a9d104b68246-kube-api-access-n8xzp\") pod \"kuadrant-operator-controller-manager-55467d9f7-glbnh\" (UID: \"50f8ca61-a5d3-4388-a07c-a9d104b68246\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-glbnh"
Jul 30 00:12:51.804182 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.804115    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-glbnh"
Jul 30 00:12:51.882816 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.882757    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrk92"
Jul 30 00:12:51.887563 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:12:51.887516    2527 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-zrk92\" is forbidden: User \"system:node:ip-10-0-137-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-198.ec2.internal' and this object" podUID="014cab84-1d0c-4eed-9686-ec5f384eea85" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrk92"
Jul 30 00:12:51.889635 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:12:51.889602    2527 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dswr4\" is forbidden: User \"system:node:ip-10-0-137-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-198.ec2.internal' and this object" podUID="29f387cd-f41b-49e6-b848-3cf6784b7e6a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dswr4"
Jul 30 00:12:51.891698 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.891675    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrk92"
Jul 30 00:12:51.891839 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:12:51.891696    2527 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-p7pcd\" is forbidden: User \"system:node:ip-10-0-137-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-198.ec2.internal' and this object" podUID="d9e4431e-9f1a-42c8-8240-28b26c061049" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7pcd"
Jul 30 00:12:51.893721 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:12:51.893697    2527 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-zrk92\" is forbidden: User \"system:node:ip-10-0-137-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-198.ec2.internal' and this object" podUID="014cab84-1d0c-4eed-9686-ec5f384eea85" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrk92"
Jul 30 00:12:51.895827 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:12:51.895777    2527 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dswr4\" is forbidden: User \"system:node:ip-10-0-137-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-198.ec2.internal' and this object" podUID="29f387cd-f41b-49e6-b848-3cf6784b7e6a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dswr4"
Jul 30 00:12:51.895827 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:51.895817    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npg86"
Jul 30 00:12:51.897725 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:12:51.897702    2527 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-p7pcd\" is forbidden: User \"system:node:ip-10-0-137-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-198.ec2.internal' and this object" podUID="d9e4431e-9f1a-42c8-8240-28b26c061049" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7pcd"
Jul 30 00:12:52.040285 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:52.040191    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svccs\" (UniqueName: \"kubernetes.io/projected/014cab84-1d0c-4eed-9686-ec5f384eea85-kube-api-access-svccs\") pod \"014cab84-1d0c-4eed-9686-ec5f384eea85\" (UID: \"014cab84-1d0c-4eed-9686-ec5f384eea85\") "
Jul 30 00:12:52.040693 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:52.040300    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/014cab84-1d0c-4eed-9686-ec5f384eea85-extensions-socket-volume\") pod \"014cab84-1d0c-4eed-9686-ec5f384eea85\" (UID: \"014cab84-1d0c-4eed-9686-ec5f384eea85\") "
Jul 30 00:12:52.040693 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:52.040588    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/014cab84-1d0c-4eed-9686-ec5f384eea85-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "014cab84-1d0c-4eed-9686-ec5f384eea85" (UID: "014cab84-1d0c-4eed-9686-ec5f384eea85"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:12:52.042825 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:52.042793    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/014cab84-1d0c-4eed-9686-ec5f384eea85-kube-api-access-svccs" (OuterVolumeSpecName: "kube-api-access-svccs") pod "014cab84-1d0c-4eed-9686-ec5f384eea85" (UID: "014cab84-1d0c-4eed-9686-ec5f384eea85"). InnerVolumeSpecName "kube-api-access-svccs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:12:52.141423 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:52.141387    2527 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/014cab84-1d0c-4eed-9686-ec5f384eea85-extensions-socket-volume\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:12:52.141423 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:52.141424    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svccs\" (UniqueName: \"kubernetes.io/projected/014cab84-1d0c-4eed-9686-ec5f384eea85-kube-api-access-svccs\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:12:52.218386 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:52.218352    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="014cab84-1d0c-4eed-9686-ec5f384eea85" path="/var/lib/kubelet/pods/014cab84-1d0c-4eed-9686-ec5f384eea85/volumes"
Jul 30 00:12:52.888780 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:12:52.888744    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrk92"
Jul 30 00:12:52.893289 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:12:52.893253    2527 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-zrk92\" is forbidden: User \"system:node:ip-10-0-137-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-198.ec2.internal' and this object" podUID="014cab84-1d0c-4eed-9686-ec5f384eea85" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-zrk92"
Jul 30 00:13:04.292943 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:04.292715    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dswr4"
Jul 30 00:13:04.294926 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:13:04.294889    2527 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dswr4\" is forbidden: User \"system:node:ip-10-0-137-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-198.ec2.internal' and this object" podUID="29f387cd-f41b-49e6-b848-3cf6784b7e6a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dswr4"
Jul 30 00:13:04.309352 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:04.309268    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7pcd"
Jul 30 00:13:04.311831 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:13:04.311794    2527 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dswr4\" is forbidden: User \"system:node:ip-10-0-137-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-198.ec2.internal' and this object" podUID="29f387cd-f41b-49e6-b848-3cf6784b7e6a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dswr4"
Jul 30 00:13:04.313730 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:13:04.313701    2527 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-p7pcd\" is forbidden: User \"system:node:ip-10-0-137-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-198.ec2.internal' and this object" podUID="d9e4431e-9f1a-42c8-8240-28b26c061049" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7pcd"
Jul 30 00:13:04.353404 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:04.353377    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npg86"]
Jul 30 00:13:04.354739 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:13:04.354707    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd73f1983_3e53_44a6_974b_dd1d25b8b63e.slice/crio-8c6ee2ce16e8234c8c598cac7f60221e062af74b67b3d1df4f0446f52dedc737 WatchSource:0}: Error finding container 8c6ee2ce16e8234c8c598cac7f60221e062af74b67b3d1df4f0446f52dedc737: Status 404 returned error can't find the container with id 8c6ee2ce16e8234c8c598cac7f60221e062af74b67b3d1df4f0446f52dedc737
Jul 30 00:13:04.364985 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:04.364961    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-glbnh"]
Jul 30 00:13:04.368576 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:13:04.368554    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50f8ca61_a5d3_4388_a07c_a9d104b68246.slice/crio-f2a80283fbc05b533a735f85e34fe2fc855b94cf8dda54cf46b3d0d4df066106 WatchSource:0}: Error finding container f2a80283fbc05b533a735f85e34fe2fc855b94cf8dda54cf46b3d0d4df066106: Status 404 returned error can't find the container with id f2a80283fbc05b533a735f85e34fe2fc855b94cf8dda54cf46b3d0d4df066106
Jul 30 00:13:04.466070 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:04.466041    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x69lr\" (UniqueName: \"kubernetes.io/projected/d9e4431e-9f1a-42c8-8240-28b26c061049-kube-api-access-x69lr\") pod \"d9e4431e-9f1a-42c8-8240-28b26c061049\" (UID: \"d9e4431e-9f1a-42c8-8240-28b26c061049\") "
Jul 30 00:13:04.466356 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:04.466105    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nddkb\" (UniqueName: \"kubernetes.io/projected/29f387cd-f41b-49e6-b848-3cf6784b7e6a-kube-api-access-nddkb\") pod \"29f387cd-f41b-49e6-b848-3cf6784b7e6a\" (UID: \"29f387cd-f41b-49e6-b848-3cf6784b7e6a\") "
Jul 30 00:13:04.466356 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:04.466133    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29f387cd-f41b-49e6-b848-3cf6784b7e6a-extensions-socket-volume\") pod \"29f387cd-f41b-49e6-b848-3cf6784b7e6a\" (UID: \"29f387cd-f41b-49e6-b848-3cf6784b7e6a\") "
Jul 30 00:13:04.466745 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:04.466719    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29f387cd-f41b-49e6-b848-3cf6784b7e6a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "29f387cd-f41b-49e6-b848-3cf6784b7e6a" (UID: "29f387cd-f41b-49e6-b848-3cf6784b7e6a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:13:04.468411 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:04.468380    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29f387cd-f41b-49e6-b848-3cf6784b7e6a-kube-api-access-nddkb" (OuterVolumeSpecName: "kube-api-access-nddkb") pod "29f387cd-f41b-49e6-b848-3cf6784b7e6a" (UID: "29f387cd-f41b-49e6-b848-3cf6784b7e6a"). InnerVolumeSpecName "kube-api-access-nddkb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:13:04.468478 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:04.468431    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9e4431e-9f1a-42c8-8240-28b26c061049-kube-api-access-x69lr" (OuterVolumeSpecName: "kube-api-access-x69lr") pod "d9e4431e-9f1a-42c8-8240-28b26c061049" (UID: "d9e4431e-9f1a-42c8-8240-28b26c061049"). InnerVolumeSpecName "kube-api-access-x69lr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:13:04.567153 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:04.567115    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x69lr\" (UniqueName: \"kubernetes.io/projected/d9e4431e-9f1a-42c8-8240-28b26c061049-kube-api-access-x69lr\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:13:04.567153 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:04.567145    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nddkb\" (UniqueName: \"kubernetes.io/projected/29f387cd-f41b-49e6-b848-3cf6784b7e6a-kube-api-access-nddkb\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:13:04.567153 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:04.567156    2527 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29f387cd-f41b-49e6-b848-3cf6784b7e6a-extensions-socket-volume\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:13:04.968469 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:04.968430    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2fn4p" event={"ID":"bd4e0fff-93e7-4843-831d-811d747c02fd","Type":"ContainerStarted","Data":"3a2200b9f05c75de188b9ea70511997fa3f253b54c5d521d231e84797c19177a"}
Jul 30 00:13:04.970226 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:04.970198    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-glbnh" event={"ID":"50f8ca61-a5d3-4388-a07c-a9d104b68246","Type":"ContainerStarted","Data":"ef50a272c798d3bffb0af413acd135fa5eb473db9d35f75cc81696a52ec2af02"}
Jul 30 00:13:04.970376 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:04.970246    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-glbnh" event={"ID":"50f8ca61-a5d3-4388-a07c-a9d104b68246","Type":"ContainerStarted","Data":"f2a80283fbc05b533a735f85e34fe2fc855b94cf8dda54cf46b3d0d4df066106"}
Jul 30 00:13:04.970376 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:04.970332    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-glbnh"
Jul 30 00:13:04.970517 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:13:04.970496    2527 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dswr4\" is forbidden: User \"system:node:ip-10-0-137-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-198.ec2.internal' and this object" podUID="29f387cd-f41b-49e6-b848-3cf6784b7e6a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dswr4"
Jul 30 00:13:04.971557 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:04.971532    2527 generic.go:356] "Generic (PLEG): container finished" podID="29f387cd-f41b-49e6-b848-3cf6784b7e6a" containerID="667b7b783d917d5c6153213f321e57126414d97c0a1f9100f73b449c165cf405" exitCode=0
Jul 30 00:13:04.971674 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:04.971563    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dswr4"
Jul 30 00:13:04.971674 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:04.971619    2527 scope.go:117] "RemoveContainer" containerID="667b7b783d917d5c6153213f321e57126414d97c0a1f9100f73b449c165cf405"
Jul 30 00:13:04.972273 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:13:04.972243    2527 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-p7pcd\" is forbidden: User \"system:node:ip-10-0-137-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-198.ec2.internal' and this object" podUID="d9e4431e-9f1a-42c8-8240-28b26c061049" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7pcd"
Jul 30 00:13:04.973032 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:04.972923    2527 generic.go:356] "Generic (PLEG): container finished" podID="d9e4431e-9f1a-42c8-8240-28b26c061049" containerID="2161f845c0166d5481a881fa08b206b83f7314c8c3ac71597e2c4b01523b592d" exitCode=0
Jul 30 00:13:04.973032 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:04.972971    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7pcd"
Jul 30 00:13:04.974883 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:04.974847    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npg86" event={"ID":"d73f1983-3e53-44a6-974b-dd1d25b8b63e","Type":"ContainerStarted","Data":"ce5947d6908bffd616161233d3d216f1b66392c81ad9a7a020e1e400d905e313"}
Jul 30 00:13:04.974982 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:04.974906    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npg86" event={"ID":"d73f1983-3e53-44a6-974b-dd1d25b8b63e","Type":"ContainerStarted","Data":"8c6ee2ce16e8234c8c598cac7f60221e062af74b67b3d1df4f0446f52dedc737"}
Jul 30 00:13:04.974982 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:04.974935    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npg86"
Jul 30 00:13:04.982310 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:04.982292    2527 scope.go:117] "RemoveContainer" containerID="667b7b783d917d5c6153213f321e57126414d97c0a1f9100f73b449c165cf405"
Jul 30 00:13:04.982575 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:13:04.982558    2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"667b7b783d917d5c6153213f321e57126414d97c0a1f9100f73b449c165cf405\": container with ID starting with 667b7b783d917d5c6153213f321e57126414d97c0a1f9100f73b449c165cf405 not found: ID does not exist" containerID="667b7b783d917d5c6153213f321e57126414d97c0a1f9100f73b449c165cf405"
Jul 30 00:13:04.982638 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:04.982583    2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"667b7b783d917d5c6153213f321e57126414d97c0a1f9100f73b449c165cf405"} err="failed to get container status \"667b7b783d917d5c6153213f321e57126414d97c0a1f9100f73b449c165cf405\": rpc error: code = NotFound desc = could not find container \"667b7b783d917d5c6153213f321e57126414d97c0a1f9100f73b449c165cf405\": container with ID starting with 667b7b783d917d5c6153213f321e57126414d97c0a1f9100f73b449c165cf405 not found: ID does not exist"
Jul 30 00:13:04.982638 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:04.982601    2527 scope.go:117] "RemoveContainer" containerID="2161f845c0166d5481a881fa08b206b83f7314c8c3ac71597e2c4b01523b592d"
Jul 30 00:13:04.991845 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:04.991827    2527 scope.go:117] "RemoveContainer" containerID="2161f845c0166d5481a881fa08b206b83f7314c8c3ac71597e2c4b01523b592d"
Jul 30 00:13:04.992087 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:13:04.992069    2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2161f845c0166d5481a881fa08b206b83f7314c8c3ac71597e2c4b01523b592d\": container with ID starting with 2161f845c0166d5481a881fa08b206b83f7314c8c3ac71597e2c4b01523b592d not found: ID does not exist" containerID="2161f845c0166d5481a881fa08b206b83f7314c8c3ac71597e2c4b01523b592d"
Jul 30 00:13:04.992148 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:04.992100    2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2161f845c0166d5481a881fa08b206b83f7314c8c3ac71597e2c4b01523b592d"} err="failed to get container status \"2161f845c0166d5481a881fa08b206b83f7314c8c3ac71597e2c4b01523b592d\": rpc error: code = NotFound desc = could not find container \"2161f845c0166d5481a881fa08b206b83f7314c8c3ac71597e2c4b01523b592d\": container with ID starting with 2161f845c0166d5481a881fa08b206b83f7314c8c3ac71597e2c4b01523b592d not found: ID does not exist"
Jul 30 00:13:05.002639 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:05.002597    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2fn4p" podStartSLOduration=2.193188901 podStartE2EDuration="24.002583603s" totalImagesPullingTime="21.809394702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:13:05.000121075 +0000 UTC m=+659.302569433" watchObservedRunningTime="2026-07-30 00:13:05.002583603 +0000 UTC m=+659.305031948"
Jul 30 00:13:05.023810 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:13:05.023754    2527 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dswr4\" is forbidden: User \"system:node:ip-10-0-137-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-198.ec2.internal' and this object" podUID="29f387cd-f41b-49e6-b848-3cf6784b7e6a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dswr4"
Jul 30 00:13:05.023974 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:05.023862    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-glbnh" podStartSLOduration=14.023844817 podStartE2EDuration="14.023844817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:12:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:13:05.022002156 +0000 UTC m=+659.324450518" watchObservedRunningTime="2026-07-30 00:13:05.023844817 +0000 UTC m=+659.326293163"
Jul 30 00:13:05.025617 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:13:05.025583    2527 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-p7pcd\" is forbidden: User \"system:node:ip-10-0-137-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-198.ec2.internal' and this object" podUID="d9e4431e-9f1a-42c8-8240-28b26c061049" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7pcd"
Jul 30 00:13:05.048341 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:05.048288    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npg86" podStartSLOduration=14.048268473 podStartE2EDuration="14.048268473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:12:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:13:05.042924304 +0000 UTC m=+659.345372651" watchObservedRunningTime="2026-07-30 00:13:05.048268473 +0000 UTC m=+659.350716819"
Jul 30 00:13:06.215019 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:13:06.214971    2527 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dswr4\" is forbidden: User \"system:node:ip-10-0-137-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-198.ec2.internal' and this object" podUID="29f387cd-f41b-49e6-b848-3cf6784b7e6a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dswr4"
Jul 30 00:13:06.216681 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:13:06.216656    2527 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-p7pcd\" is forbidden: User \"system:node:ip-10-0-137-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-198.ec2.internal' and this object" podUID="d9e4431e-9f1a-42c8-8240-28b26c061049" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7pcd"
Jul 30 00:13:06.216915 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:06.216895    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29f387cd-f41b-49e6-b848-3cf6784b7e6a" path="/var/lib/kubelet/pods/29f387cd-f41b-49e6-b848-3cf6784b7e6a/volumes"
Jul 30 00:13:06.217232 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:06.217218    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9e4431e-9f1a-42c8-8240-28b26c061049" path="/var/lib/kubelet/pods/d9e4431e-9f1a-42c8-8240-28b26c061049/volumes"
Jul 30 00:13:06.706805 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:13:06.706767    2527 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-gwknn_kuadrant-system_085eaf0c-396a-4710-a2db-0cdff5249aae_0(29b6b55db528c37782ee66f66d908b0abdb785cf49e886280a4d1cf0e9d97b70): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-gwknn to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 30 00:13:06.706887 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:13:06.706834    2527 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-gwknn_kuadrant-system_085eaf0c-396a-4710-a2db-0cdff5249aae_0(29b6b55db528c37782ee66f66d908b0abdb785cf49e886280a4d1cf0e9d97b70): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-gwknn to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gwknn"
Jul 30 00:13:06.987867 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:06.987834    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gwknn"
Jul 30 00:13:06.990015 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:13:06.989989    2527 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-gwknn\" is forbidden: User \"system:node:ip-10-0-137-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-198.ec2.internal' and this object" podUID="085eaf0c-396a-4710-a2db-0cdff5249aae" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gwknn"
Jul 30 00:13:06.996690 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:06.996663    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gwknn"
Jul 30 00:13:06.998724 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:13:06.998693    2527 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-gwknn\" is forbidden: User \"system:node:ip-10-0-137-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-198.ec2.internal' and this object" podUID="085eaf0c-396a-4710-a2db-0cdff5249aae" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gwknn"
Jul 30 00:13:07.085594 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:07.085558    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/085eaf0c-396a-4710-a2db-0cdff5249aae-extensions-socket-volume\") pod \"085eaf0c-396a-4710-a2db-0cdff5249aae\" (UID: \"085eaf0c-396a-4710-a2db-0cdff5249aae\") "
Jul 30 00:13:07.085755 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:07.085665    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrq8m\" (UniqueName: \"kubernetes.io/projected/085eaf0c-396a-4710-a2db-0cdff5249aae-kube-api-access-wrq8m\") pod \"085eaf0c-396a-4710-a2db-0cdff5249aae\" (UID: \"085eaf0c-396a-4710-a2db-0cdff5249aae\") "
Jul 30 00:13:07.085866 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:07.085835    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/085eaf0c-396a-4710-a2db-0cdff5249aae-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "085eaf0c-396a-4710-a2db-0cdff5249aae" (UID: "085eaf0c-396a-4710-a2db-0cdff5249aae"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:13:07.087887 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:07.087866    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/085eaf0c-396a-4710-a2db-0cdff5249aae-kube-api-access-wrq8m" (OuterVolumeSpecName: "kube-api-access-wrq8m") pod "085eaf0c-396a-4710-a2db-0cdff5249aae" (UID: "085eaf0c-396a-4710-a2db-0cdff5249aae"). InnerVolumeSpecName "kube-api-access-wrq8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:13:07.186320 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:07.186283    2527 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/085eaf0c-396a-4710-a2db-0cdff5249aae-extensions-socket-volume\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:13:07.186320 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:07.186313    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrq8m\" (UniqueName: \"kubernetes.io/projected/085eaf0c-396a-4710-a2db-0cdff5249aae-kube-api-access-wrq8m\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:13:07.993480 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:07.993439    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gwknn"
Jul 30 00:13:07.995693 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:13:07.995660    2527 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-gwknn\" is forbidden: User \"system:node:ip-10-0-137-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-198.ec2.internal' and this object" podUID="085eaf0c-396a-4710-a2db-0cdff5249aae" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gwknn"
Jul 30 00:13:08.001070 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:13:08.001038    2527 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-gwknn\" is forbidden: User \"system:node:ip-10-0-137-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-198.ec2.internal' and this object" podUID="085eaf0c-396a-4710-a2db-0cdff5249aae" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gwknn"
Jul 30 00:13:08.216129 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:08.216093    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="085eaf0c-396a-4710-a2db-0cdff5249aae" path="/var/lib/kubelet/pods/085eaf0c-396a-4710-a2db-0cdff5249aae/volumes"
Jul 30 00:13:15.985202 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:15.985151    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npg86"
Jul 30 00:13:15.985695 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:15.985253    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-glbnh"
Jul 30 00:13:16.055264 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:16.055232    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npg86"]
Jul 30 00:13:16.055531 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:16.055439    2527 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npg86" podUID="d73f1983-3e53-44a6-974b-dd1d25b8b63e" containerName="manager" containerID="cri-o://ce5947d6908bffd616161233d3d216f1b66392c81ad9a7a020e1e400d905e313" gracePeriod=10
Jul 30 00:13:16.257647 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:16.257610    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h74x9"]
Jul 30 00:13:16.262332 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:16.262299    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h74x9"
Jul 30 00:13:16.276297 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:16.276268    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h74x9"]
Jul 30 00:13:16.329395 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:16.329366    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npg86"
Jul 30 00:13:16.364268 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:16.364237    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d73f1983-3e53-44a6-974b-dd1d25b8b63e-extensions-socket-volume\") pod \"d73f1983-3e53-44a6-974b-dd1d25b8b63e\" (UID: \"d73f1983-3e53-44a6-974b-dd1d25b8b63e\") "
Jul 30 00:13:16.364454 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:16.364288    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9v8ql\" (UniqueName: \"kubernetes.io/projected/d73f1983-3e53-44a6-974b-dd1d25b8b63e-kube-api-access-9v8ql\") pod \"d73f1983-3e53-44a6-974b-dd1d25b8b63e\" (UID: \"d73f1983-3e53-44a6-974b-dd1d25b8b63e\") "
Jul 30 00:13:16.364572 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:16.364533    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65zl9\" (UniqueName: \"kubernetes.io/projected/b50f22a8-ab93-4535-b6a5-7123eab6e7cd-kube-api-access-65zl9\") pod \"kuadrant-operator-controller-manager-86878c769f-h74x9\" (UID: \"b50f22a8-ab93-4535-b6a5-7123eab6e7cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h74x9"
Jul 30 00:13:16.364702 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:16.364638    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b50f22a8-ab93-4535-b6a5-7123eab6e7cd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h74x9\" (UID: \"b50f22a8-ab93-4535-b6a5-7123eab6e7cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h74x9"
Jul 30 00:13:16.364702 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:16.364635    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d73f1983-3e53-44a6-974b-dd1d25b8b63e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d73f1983-3e53-44a6-974b-dd1d25b8b63e" (UID: "d73f1983-3e53-44a6-974b-dd1d25b8b63e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:13:16.364800 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:16.364753    2527 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d73f1983-3e53-44a6-974b-dd1d25b8b63e-extensions-socket-volume\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:13:16.366569 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:16.366548    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d73f1983-3e53-44a6-974b-dd1d25b8b63e-kube-api-access-9v8ql" (OuterVolumeSpecName: "kube-api-access-9v8ql") pod "d73f1983-3e53-44a6-974b-dd1d25b8b63e" (UID: "d73f1983-3e53-44a6-974b-dd1d25b8b63e"). InnerVolumeSpecName "kube-api-access-9v8ql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:13:16.466129 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:16.466075    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b50f22a8-ab93-4535-b6a5-7123eab6e7cd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h74x9\" (UID: \"b50f22a8-ab93-4535-b6a5-7123eab6e7cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h74x9"
Jul 30 00:13:16.466354 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:16.466242    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65zl9\" (UniqueName: \"kubernetes.io/projected/b50f22a8-ab93-4535-b6a5-7123eab6e7cd-kube-api-access-65zl9\") pod \"kuadrant-operator-controller-manager-86878c769f-h74x9\" (UID: \"b50f22a8-ab93-4535-b6a5-7123eab6e7cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h74x9"
Jul 30 00:13:16.466354 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:16.466301    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9v8ql\" (UniqueName: \"kubernetes.io/projected/d73f1983-3e53-44a6-974b-dd1d25b8b63e-kube-api-access-9v8ql\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:13:16.466523 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:16.466505    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b50f22a8-ab93-4535-b6a5-7123eab6e7cd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h74x9\" (UID: \"b50f22a8-ab93-4535-b6a5-7123eab6e7cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h74x9"
Jul 30 00:13:16.474196 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:16.474154    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65zl9\" (UniqueName: \"kubernetes.io/projected/b50f22a8-ab93-4535-b6a5-7123eab6e7cd-kube-api-access-65zl9\") pod \"kuadrant-operator-controller-manager-86878c769f-h74x9\" (UID: \"b50f22a8-ab93-4535-b6a5-7123eab6e7cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h74x9"
Jul 30 00:13:16.574947 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:16.574848    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h74x9"
Jul 30 00:13:16.716364 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:16.716339    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h74x9"]
Jul 30 00:13:16.719574 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:13:16.719539    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb50f22a8_ab93_4535_b6a5_7123eab6e7cd.slice/crio-3c9e3e9e86d8382f81c0a4f47abadf22371417bce669ca2c1c05a7b756bfee7e WatchSource:0}: Error finding container 3c9e3e9e86d8382f81c0a4f47abadf22371417bce669ca2c1c05a7b756bfee7e: Status 404 returned error can't find the container with id 3c9e3e9e86d8382f81c0a4f47abadf22371417bce669ca2c1c05a7b756bfee7e
Jul 30 00:13:17.045741 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:17.045706    2527 generic.go:356] "Generic (PLEG): container finished" podID="d73f1983-3e53-44a6-974b-dd1d25b8b63e" containerID="ce5947d6908bffd616161233d3d216f1b66392c81ad9a7a020e1e400d905e313" exitCode=0
Jul 30 00:13:17.046263 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:17.045762    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npg86"
Jul 30 00:13:17.046263 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:17.045796    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npg86" event={"ID":"d73f1983-3e53-44a6-974b-dd1d25b8b63e","Type":"ContainerDied","Data":"ce5947d6908bffd616161233d3d216f1b66392c81ad9a7a020e1e400d905e313"}
Jul 30 00:13:17.046263 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:17.045866    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npg86" event={"ID":"d73f1983-3e53-44a6-974b-dd1d25b8b63e","Type":"ContainerDied","Data":"8c6ee2ce16e8234c8c598cac7f60221e062af74b67b3d1df4f0446f52dedc737"}
Jul 30 00:13:17.046263 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:17.045896    2527 scope.go:117] "RemoveContainer" containerID="ce5947d6908bffd616161233d3d216f1b66392c81ad9a7a020e1e400d905e313"
Jul 30 00:13:17.048013 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:17.047990    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h74x9" event={"ID":"b50f22a8-ab93-4535-b6a5-7123eab6e7cd","Type":"ContainerStarted","Data":"42c971578fad6d39148bea8106a87afa35fe4a8ad55b4b07eb7a1cac5c86444e"}
Jul 30 00:13:17.048137 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:17.048041    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h74x9"
Jul 30 00:13:17.048137 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:17.048066    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h74x9" event={"ID":"b50f22a8-ab93-4535-b6a5-7123eab6e7cd","Type":"ContainerStarted","Data":"3c9e3e9e86d8382f81c0a4f47abadf22371417bce669ca2c1c05a7b756bfee7e"}
Jul 30 00:13:17.056773 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:17.056595    2527 scope.go:117] "RemoveContainer" containerID="ce5947d6908bffd616161233d3d216f1b66392c81ad9a7a020e1e400d905e313"
Jul 30 00:13:17.056919 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:13:17.056899    2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce5947d6908bffd616161233d3d216f1b66392c81ad9a7a020e1e400d905e313\": container with ID starting with ce5947d6908bffd616161233d3d216f1b66392c81ad9a7a020e1e400d905e313 not found: ID does not exist" containerID="ce5947d6908bffd616161233d3d216f1b66392c81ad9a7a020e1e400d905e313"
Jul 30 00:13:17.056960 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:17.056930    2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce5947d6908bffd616161233d3d216f1b66392c81ad9a7a020e1e400d905e313"} err="failed to get container status \"ce5947d6908bffd616161233d3d216f1b66392c81ad9a7a020e1e400d905e313\": rpc error: code = NotFound desc = could not find container \"ce5947d6908bffd616161233d3d216f1b66392c81ad9a7a020e1e400d905e313\": container with ID starting with ce5947d6908bffd616161233d3d216f1b66392c81ad9a7a020e1e400d905e313 not found: ID does not exist"
Jul 30 00:13:17.070881 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:17.070825    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h74x9" podStartSLOduration=1.070806042 podStartE2EDuration="1.070806042s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:13:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:13:17.068096444 +0000 UTC m=+671.370544790" watchObservedRunningTime="2026-07-30 00:13:17.070806042 +0000 UTC m=+671.373254399"
Jul 30 00:13:17.084020 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:17.083986    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npg86"]
Jul 30 00:13:17.089986 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:17.089957    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-npg86"]
Jul 30 00:13:18.216506 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:18.216475    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d73f1983-3e53-44a6-974b-dd1d25b8b63e" path="/var/lib/kubelet/pods/d73f1983-3e53-44a6-974b-dd1d25b8b63e/volumes"
Jul 30 00:13:28.057062 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:28.057028    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h74x9"
Jul 30 00:13:28.106195 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:28.106046    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-glbnh"]
Jul 30 00:13:28.106383 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:28.106307    2527 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-glbnh" podUID="50f8ca61-a5d3-4388-a07c-a9d104b68246" containerName="manager" containerID="cri-o://ef50a272c798d3bffb0af413acd135fa5eb473db9d35f75cc81696a52ec2af02" gracePeriod=10
Jul 30 00:13:28.389121 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:28.389089    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-glbnh"
Jul 30 00:13:28.476404 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:28.476359    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/50f8ca61-a5d3-4388-a07c-a9d104b68246-extensions-socket-volume\") pod \"50f8ca61-a5d3-4388-a07c-a9d104b68246\" (UID: \"50f8ca61-a5d3-4388-a07c-a9d104b68246\") "
Jul 30 00:13:28.476575 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:28.476435    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8xzp\" (UniqueName: \"kubernetes.io/projected/50f8ca61-a5d3-4388-a07c-a9d104b68246-kube-api-access-n8xzp\") pod \"50f8ca61-a5d3-4388-a07c-a9d104b68246\" (UID: \"50f8ca61-a5d3-4388-a07c-a9d104b68246\") "
Jul 30 00:13:28.476840 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:28.476800    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50f8ca61-a5d3-4388-a07c-a9d104b68246-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "50f8ca61-a5d3-4388-a07c-a9d104b68246" (UID: "50f8ca61-a5d3-4388-a07c-a9d104b68246"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:13:28.478934 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:28.478887    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50f8ca61-a5d3-4388-a07c-a9d104b68246-kube-api-access-n8xzp" (OuterVolumeSpecName: "kube-api-access-n8xzp") pod "50f8ca61-a5d3-4388-a07c-a9d104b68246" (UID: "50f8ca61-a5d3-4388-a07c-a9d104b68246"). InnerVolumeSpecName "kube-api-access-n8xzp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:13:28.577482 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:28.577434    2527 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/50f8ca61-a5d3-4388-a07c-a9d104b68246-extensions-socket-volume\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:13:28.577482 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:28.577481    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8xzp\" (UniqueName: \"kubernetes.io/projected/50f8ca61-a5d3-4388-a07c-a9d104b68246-kube-api-access-n8xzp\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:13:29.120873 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:29.120840    2527 generic.go:356] "Generic (PLEG): container finished" podID="50f8ca61-a5d3-4388-a07c-a9d104b68246" containerID="ef50a272c798d3bffb0af413acd135fa5eb473db9d35f75cc81696a52ec2af02" exitCode=0
Jul 30 00:13:29.121294 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:29.120887    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-glbnh"
Jul 30 00:13:29.121294 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:29.120926    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-glbnh" event={"ID":"50f8ca61-a5d3-4388-a07c-a9d104b68246","Type":"ContainerDied","Data":"ef50a272c798d3bffb0af413acd135fa5eb473db9d35f75cc81696a52ec2af02"}
Jul 30 00:13:29.121294 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:29.120983    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-glbnh" event={"ID":"50f8ca61-a5d3-4388-a07c-a9d104b68246","Type":"ContainerDied","Data":"f2a80283fbc05b533a735f85e34fe2fc855b94cf8dda54cf46b3d0d4df066106"}
Jul 30 00:13:29.121294 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:29.121011    2527 scope.go:117] "RemoveContainer" containerID="ef50a272c798d3bffb0af413acd135fa5eb473db9d35f75cc81696a52ec2af02"
Jul 30 00:13:29.130960 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:29.130940    2527 scope.go:117] "RemoveContainer" containerID="ef50a272c798d3bffb0af413acd135fa5eb473db9d35f75cc81696a52ec2af02"
Jul 30 00:13:29.131249 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:13:29.131229    2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef50a272c798d3bffb0af413acd135fa5eb473db9d35f75cc81696a52ec2af02\": container with ID starting with ef50a272c798d3bffb0af413acd135fa5eb473db9d35f75cc81696a52ec2af02 not found: ID does not exist" containerID="ef50a272c798d3bffb0af413acd135fa5eb473db9d35f75cc81696a52ec2af02"
Jul 30 00:13:29.131320 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:29.131256    2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef50a272c798d3bffb0af413acd135fa5eb473db9d35f75cc81696a52ec2af02"} err="failed to get container status \"ef50a272c798d3bffb0af413acd135fa5eb473db9d35f75cc81696a52ec2af02\": rpc error: code = NotFound desc = could not find container \"ef50a272c798d3bffb0af413acd135fa5eb473db9d35f75cc81696a52ec2af02\": container with ID starting with ef50a272c798d3bffb0af413acd135fa5eb473db9d35f75cc81696a52ec2af02 not found: ID does not exist"
Jul 30 00:13:29.148488 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:29.148464    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-glbnh"]
Jul 30 00:13:29.153795 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:29.153771    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-glbnh"]
Jul 30 00:13:30.217653 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:30.217612    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50f8ca61-a5d3-4388-a07c-a9d104b68246" path="/var/lib/kubelet/pods/50f8ca61-a5d3-4388-a07c-a9d104b68246/volumes"
Jul 30 00:13:32.326577 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.326536    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"]
Jul 30 00:13:32.327188 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.327137    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d73f1983-3e53-44a6-974b-dd1d25b8b63e" containerName="manager"
Jul 30 00:13:32.327188 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.327175    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="d73f1983-3e53-44a6-974b-dd1d25b8b63e" containerName="manager"
Jul 30 00:13:32.327345 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.327195    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50f8ca61-a5d3-4388-a07c-a9d104b68246" containerName="manager"
Jul 30 00:13:32.327345 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.327200    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="50f8ca61-a5d3-4388-a07c-a9d104b68246" containerName="manager"
Jul 30 00:13:32.327345 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.327279    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="50f8ca61-a5d3-4388-a07c-a9d104b68246" containerName="manager"
Jul 30 00:13:32.327345 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.327291    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="d73f1983-3e53-44a6-974b-dd1d25b8b63e" containerName="manager"
Jul 30 00:13:32.507063 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.507027    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"]
Jul 30 00:13:32.507328 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.507130    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:32.509918 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.509896    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 30 00:13:32.510105 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.509975    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-2mfvw\""
Jul 30 00:13:32.617580 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.617501    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c3a4be4-9ee5-4e76-9047-c600284aec82-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sjrkr\" (UID: \"2c3a4be4-9ee5-4e76-9047-c600284aec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:32.617580 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.617552    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c3a4be4-9ee5-4e76-9047-c600284aec82-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sjrkr\" (UID: \"2c3a4be4-9ee5-4e76-9047-c600284aec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:32.617580 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.617572    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c3a4be4-9ee5-4e76-9047-c600284aec82-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sjrkr\" (UID: \"2c3a4be4-9ee5-4e76-9047-c600284aec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:32.617857 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.617604    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c3a4be4-9ee5-4e76-9047-c600284aec82-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sjrkr\" (UID: \"2c3a4be4-9ee5-4e76-9047-c600284aec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:32.617857 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.617627    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c3a4be4-9ee5-4e76-9047-c600284aec82-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sjrkr\" (UID: \"2c3a4be4-9ee5-4e76-9047-c600284aec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:32.617857 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.617711    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c3a4be4-9ee5-4e76-9047-c600284aec82-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sjrkr\" (UID: \"2c3a4be4-9ee5-4e76-9047-c600284aec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:32.617857 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.617758    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjwfb\" (UniqueName: \"kubernetes.io/projected/2c3a4be4-9ee5-4e76-9047-c600284aec82-kube-api-access-vjwfb\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sjrkr\" (UID: \"2c3a4be4-9ee5-4e76-9047-c600284aec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:32.617857 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.617784    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c3a4be4-9ee5-4e76-9047-c600284aec82-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sjrkr\" (UID: \"2c3a4be4-9ee5-4e76-9047-c600284aec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:32.617857 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.617821    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c3a4be4-9ee5-4e76-9047-c600284aec82-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sjrkr\" (UID: \"2c3a4be4-9ee5-4e76-9047-c600284aec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:32.719154 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.719122    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c3a4be4-9ee5-4e76-9047-c600284aec82-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sjrkr\" (UID: \"2c3a4be4-9ee5-4e76-9047-c600284aec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:32.719358 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.719189    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjwfb\" (UniqueName: \"kubernetes.io/projected/2c3a4be4-9ee5-4e76-9047-c600284aec82-kube-api-access-vjwfb\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sjrkr\" (UID: \"2c3a4be4-9ee5-4e76-9047-c600284aec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:32.719358 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.719220    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c3a4be4-9ee5-4e76-9047-c600284aec82-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sjrkr\" (UID: \"2c3a4be4-9ee5-4e76-9047-c600284aec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:32.719358 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.719253    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c3a4be4-9ee5-4e76-9047-c600284aec82-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sjrkr\" (UID: \"2c3a4be4-9ee5-4e76-9047-c600284aec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:32.719358 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.719290    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c3a4be4-9ee5-4e76-9047-c600284aec82-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sjrkr\" (UID: \"2c3a4be4-9ee5-4e76-9047-c600284aec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:32.719358 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.719306    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c3a4be4-9ee5-4e76-9047-c600284aec82-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sjrkr\" (UID: \"2c3a4be4-9ee5-4e76-9047-c600284aec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:32.719358 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.719322    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c3a4be4-9ee5-4e76-9047-c600284aec82-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sjrkr\" (UID: \"2c3a4be4-9ee5-4e76-9047-c600284aec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:32.719358 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.719352    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c3a4be4-9ee5-4e76-9047-c600284aec82-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sjrkr\" (UID: \"2c3a4be4-9ee5-4e76-9047-c600284aec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:32.719715 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.719526    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c3a4be4-9ee5-4e76-9047-c600284aec82-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sjrkr\" (UID: \"2c3a4be4-9ee5-4e76-9047-c600284aec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:32.719715 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.719560    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c3a4be4-9ee5-4e76-9047-c600284aec82-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sjrkr\" (UID: \"2c3a4be4-9ee5-4e76-9047-c600284aec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:32.719715 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.719638    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c3a4be4-9ee5-4e76-9047-c600284aec82-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sjrkr\" (UID: \"2c3a4be4-9ee5-4e76-9047-c600284aec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:32.719876 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.719732    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c3a4be4-9ee5-4e76-9047-c600284aec82-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sjrkr\" (UID: \"2c3a4be4-9ee5-4e76-9047-c600284aec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:32.719938 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.719892    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c3a4be4-9ee5-4e76-9047-c600284aec82-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sjrkr\" (UID: \"2c3a4be4-9ee5-4e76-9047-c600284aec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:32.720259 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.720241    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c3a4be4-9ee5-4e76-9047-c600284aec82-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sjrkr\" (UID: \"2c3a4be4-9ee5-4e76-9047-c600284aec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:32.721852 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.721827    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c3a4be4-9ee5-4e76-9047-c600284aec82-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sjrkr\" (UID: \"2c3a4be4-9ee5-4e76-9047-c600284aec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:32.722057 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.722039    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c3a4be4-9ee5-4e76-9047-c600284aec82-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sjrkr\" (UID: \"2c3a4be4-9ee5-4e76-9047-c600284aec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:32.728536 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.728509    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjwfb\" (UniqueName: \"kubernetes.io/projected/2c3a4be4-9ee5-4e76-9047-c600284aec82-kube-api-access-vjwfb\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sjrkr\" (UID: \"2c3a4be4-9ee5-4e76-9047-c600284aec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:32.728640 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.728606    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c3a4be4-9ee5-4e76-9047-c600284aec82-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-sjrkr\" (UID: \"2c3a4be4-9ee5-4e76-9047-c600284aec82\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:32.818028 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.817995    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:32.995381 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:32.995347    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"]
Jul 30 00:13:32.997764 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:13:32.997735    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c3a4be4_9ee5_4e76_9047_c600284aec82.slice/crio-68589cc349cd502918412711c74795d3dd05141be1aa1a6e29c774340eb6bc46 WatchSource:0}: Error finding container 68589cc349cd502918412711c74795d3dd05141be1aa1a6e29c774340eb6bc46: Status 404 returned error can't find the container with id 68589cc349cd502918412711c74795d3dd05141be1aa1a6e29c774340eb6bc46
Jul 30 00:13:33.147351 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:33.147313    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr" event={"ID":"2c3a4be4-9ee5-4e76-9047-c600284aec82","Type":"ContainerStarted","Data":"68589cc349cd502918412711c74795d3dd05141be1aa1a6e29c774340eb6bc46"}
Jul 30 00:13:35.925050 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:35.925004    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:13:35.925335 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:35.925093    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:13:35.925335 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:35.925124    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:13:36.167815 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:36.167764    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr" event={"ID":"2c3a4be4-9ee5-4e76-9047-c600284aec82","Type":"ContainerStarted","Data":"65f401cacc086a262d9c4f683d2e088e422cf789d00838f02ef6d2e3520009ee"}
Jul 30 00:13:36.186281 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:36.186129    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr" podStartSLOduration=1.261218923 podStartE2EDuration="4.186106274s" totalImagesPullingTime="2.924887351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:13:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:13:36.185196687 +0000 UTC m=+690.487645036" watchObservedRunningTime="2026-07-30 00:13:36.186106274 +0000 UTC m=+690.488554618"
Jul 30 00:13:36.819216 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:36.819154    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:36.824077 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:36.824053    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:37.173645 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:37.173565    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:37.175022 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:37.174998    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:13:44.256840 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:44.256805    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z2hqj"]
Jul 30 00:13:44.261618 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:44.261599    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-z2hqj"
Jul 30 00:13:44.264068 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:44.264041    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 30 00:13:44.267210 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:44.267182    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z2hqj"]
Jul 30 00:13:44.356973 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:44.356938    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z2hqj"]
Jul 30 00:13:44.428928 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:44.428885    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngz4k\" (UniqueName: \"kubernetes.io/projected/3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2-kube-api-access-ngz4k\") pod \"limitador-limitador-64c94fd64f-z2hqj\" (UID: \"3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-z2hqj"
Jul 30 00:13:44.429107 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:44.428948    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2-config-file\") pod \"limitador-limitador-64c94fd64f-z2hqj\" (UID: \"3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-z2hqj"
Jul 30 00:13:44.530020 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:44.529918    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngz4k\" (UniqueName: \"kubernetes.io/projected/3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2-kube-api-access-ngz4k\") pod \"limitador-limitador-64c94fd64f-z2hqj\" (UID: \"3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-z2hqj"
Jul 30 00:13:44.530020 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:44.530011    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2-config-file\") pod \"limitador-limitador-64c94fd64f-z2hqj\" (UID: \"3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-z2hqj"
Jul 30 00:13:44.530670 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:44.530651    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2-config-file\") pod \"limitador-limitador-64c94fd64f-z2hqj\" (UID: \"3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-z2hqj"
Jul 30 00:13:44.540552 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:44.540523    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngz4k\" (UniqueName: \"kubernetes.io/projected/3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2-kube-api-access-ngz4k\") pod \"limitador-limitador-64c94fd64f-z2hqj\" (UID: \"3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-z2hqj"
Jul 30 00:13:44.567097 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:44.567064    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:13:44.570865 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:44.570844    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"
Jul 30 00:13:44.574177 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:44.574141    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-z2hqj"
Jul 30 00:13:44.593109 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:44.593082    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:13:44.599563 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:44.598464    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:13:44.731764 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:44.731725    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftcx2\" (UniqueName: \"kubernetes.io/projected/f438f7c1-89e4-4172-9dae-a6d582cee115-kube-api-access-ftcx2\") pod \"limitador-limitador-54d6d988d5-n9cd2\" (UID: \"f438f7c1-89e4-4172-9dae-a6d582cee115\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"
Jul 30 00:13:44.731936 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:44.731784    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f438f7c1-89e4-4172-9dae-a6d582cee115-config-file\") pod \"limitador-limitador-54d6d988d5-n9cd2\" (UID: \"f438f7c1-89e4-4172-9dae-a6d582cee115\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"
Jul 30 00:13:44.740895 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:44.740871    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z2hqj"]
Jul 30 00:13:44.742470 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:13:44.742440    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c1c0cd5_3c2d_4701_a9f2_abaa7787d7f2.slice/crio-c713af71e644d217e83ffddb779131ed1c8d38072e36d6d0b5a3965ac98db11a WatchSource:0}: Error finding container c713af71e644d217e83ffddb779131ed1c8d38072e36d6d0b5a3965ac98db11a: Status 404 returned error can't find the container with id c713af71e644d217e83ffddb779131ed1c8d38072e36d6d0b5a3965ac98db11a
Jul 30 00:13:44.832962 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:44.832869    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftcx2\" (UniqueName: \"kubernetes.io/projected/f438f7c1-89e4-4172-9dae-a6d582cee115-kube-api-access-ftcx2\") pod \"limitador-limitador-54d6d988d5-n9cd2\" (UID: \"f438f7c1-89e4-4172-9dae-a6d582cee115\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"
Jul 30 00:13:44.832962 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:44.832915    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f438f7c1-89e4-4172-9dae-a6d582cee115-config-file\") pod \"limitador-limitador-54d6d988d5-n9cd2\" (UID: \"f438f7c1-89e4-4172-9dae-a6d582cee115\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"
Jul 30 00:13:44.833587 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:44.833568    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f438f7c1-89e4-4172-9dae-a6d582cee115-config-file\") pod \"limitador-limitador-54d6d988d5-n9cd2\" (UID: \"f438f7c1-89e4-4172-9dae-a6d582cee115\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"
Jul 30 00:13:44.840788 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:44.840770    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftcx2\" (UniqueName: \"kubernetes.io/projected/f438f7c1-89e4-4172-9dae-a6d582cee115-kube-api-access-ftcx2\") pod \"limitador-limitador-54d6d988d5-n9cd2\" (UID: \"f438f7c1-89e4-4172-9dae-a6d582cee115\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"
Jul 30 00:13:44.904815 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:44.904784    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"
Jul 30 00:13:45.048618 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:45.048553    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:13:45.050717 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:13:45.050677    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf438f7c1_89e4_4172_9dae_a6d582cee115.slice/crio-c05df240de01d754265899561f8459c9bec50b2e5740d0378c37a7079b444a74 WatchSource:0}: Error finding container c05df240de01d754265899561f8459c9bec50b2e5740d0378c37a7079b444a74: Status 404 returned error can't find the container with id c05df240de01d754265899561f8459c9bec50b2e5740d0378c37a7079b444a74
Jul 30 00:13:45.223249 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:45.223209    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-n9cd2" event={"ID":"f438f7c1-89e4-4172-9dae-a6d582cee115","Type":"ContainerStarted","Data":"c05df240de01d754265899561f8459c9bec50b2e5740d0378c37a7079b444a74"}
Jul 30 00:13:45.224770 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:45.224739    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-z2hqj" event={"ID":"3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2","Type":"ContainerStarted","Data":"c713af71e644d217e83ffddb779131ed1c8d38072e36d6d0b5a3965ac98db11a"}
Jul 30 00:13:45.225258 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:45.225232    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-wcnsn"]
Jul 30 00:13:45.229229 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:45.229204    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wcnsn"
Jul 30 00:13:45.231437 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:45.231421    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-j2x5b\""
Jul 30 00:13:45.232133 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:45.232109    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wcnsn"]
Jul 30 00:13:45.336650 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:45.336618    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl6pk\" (UniqueName: \"kubernetes.io/projected/7d04953a-25bd-4325-9df4-56820a4d6b43-kube-api-access-xl6pk\") pod \"authorino-75d556bd77-wcnsn\" (UID: \"7d04953a-25bd-4325-9df4-56820a4d6b43\") " pod="kuadrant-system/authorino-75d556bd77-wcnsn"
Jul 30 00:13:45.438288 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:45.438246    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl6pk\" (UniqueName: \"kubernetes.io/projected/7d04953a-25bd-4325-9df4-56820a4d6b43-kube-api-access-xl6pk\") pod \"authorino-75d556bd77-wcnsn\" (UID: \"7d04953a-25bd-4325-9df4-56820a4d6b43\") " pod="kuadrant-system/authorino-75d556bd77-wcnsn"
Jul 30 00:13:45.449754 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:45.449715    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl6pk\" (UniqueName: \"kubernetes.io/projected/7d04953a-25bd-4325-9df4-56820a4d6b43-kube-api-access-xl6pk\") pod \"authorino-75d556bd77-wcnsn\" (UID: \"7d04953a-25bd-4325-9df4-56820a4d6b43\") " pod="kuadrant-system/authorino-75d556bd77-wcnsn"
Jul 30 00:13:45.540453 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:45.540358    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wcnsn"
Jul 30 00:13:45.765263 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:45.765131    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wcnsn"]
Jul 30 00:13:45.770925 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:13:45.769990    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d04953a_25bd_4325_9df4_56820a4d6b43.slice/crio-3ec7cdc5f1052497fdcde2f62ee2a879a381ad70d3fc5f5d104f8b326bb55612 WatchSource:0}: Error finding container 3ec7cdc5f1052497fdcde2f62ee2a879a381ad70d3fc5f5d104f8b326bb55612: Status 404 returned error can't find the container with id 3ec7cdc5f1052497fdcde2f62ee2a879a381ad70d3fc5f5d104f8b326bb55612
Jul 30 00:13:46.238131 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:46.238083    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wcnsn" event={"ID":"7d04953a-25bd-4325-9df4-56820a4d6b43","Type":"ContainerStarted","Data":"3ec7cdc5f1052497fdcde2f62ee2a879a381ad70d3fc5f5d104f8b326bb55612"}
Jul 30 00:13:50.264981 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:50.264943    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-z2hqj" event={"ID":"3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2","Type":"ContainerStarted","Data":"4ecb941f0cf21f8dd056d3332973f383f4b1d761c1885135a4df4cd0390d6b87"}
Jul 30 00:13:50.265441 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:50.265007    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-z2hqj"
Jul 30 00:13:50.266547 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:50.266522    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-n9cd2" event={"ID":"f438f7c1-89e4-4172-9dae-a6d582cee115","Type":"ContainerStarted","Data":"728b64f55440be31f22b3c93f21ec80a5bfd333760f8d0af0a605a27179dfb1d"}
Jul 30 00:13:50.266671 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:50.266584    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"
Jul 30 00:13:50.267927 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:50.267907    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wcnsn" event={"ID":"7d04953a-25bd-4325-9df4-56820a4d6b43","Type":"ContainerStarted","Data":"4ec475ef819671ce0e6b98acbee27a1ef0ae975af4b8a0bd14313d00f004507e"}
Jul 30 00:13:50.282230 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:50.282188    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-z2hqj" podStartSLOduration=1.351448811 podStartE2EDuration="6.282147184s" totalImagesPullingTime="4.930698373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:13:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:13:50.279996593 +0000 UTC m=+704.582444939" watchObservedRunningTime="2026-07-30 00:13:50.282147184 +0000 UTC m=+704.584595530"
Jul 30 00:13:50.293624 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:50.293582    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-wcnsn" podStartSLOduration=1.393020633 podStartE2EDuration="5.293566928s" totalImagesPullingTime="3.900546295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:13:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:13:50.292728632 +0000 UTC m=+704.595176978" watchObservedRunningTime="2026-07-30 00:13:50.293566928 +0000 UTC m=+704.596015283"
Jul 30 00:13:50.310984 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:13:50.310925    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-n9cd2" podStartSLOduration=1.681335544 podStartE2EDuration="6.310902971s" totalImagesPullingTime="4.629567427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:13:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:13:50.307458732 +0000 UTC m=+704.609907078" watchObservedRunningTime="2026-07-30 00:13:50.310902971 +0000 UTC m=+704.613351331"
Jul 30 00:14:01.274603 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:01.274526    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-z2hqj"
Jul 30 00:14:01.275094 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:01.274608    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"
Jul 30 00:14:01.330219 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:01.330188    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z2hqj"]
Jul 30 00:14:01.331209 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:01.331139    2527 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-z2hqj" podUID="3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2" containerName="limitador" containerID="cri-o://4ecb941f0cf21f8dd056d3332973f383f4b1d761c1885135a4df4cd0390d6b87" gracePeriod=30
Jul 30 00:14:01.885886 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:01.885860    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-z2hqj"
Jul 30 00:14:01.990825 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:01.990786    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2-config-file\") pod \"3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2\" (UID: \"3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2\") "
Jul 30 00:14:01.991029 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:01.990862    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngz4k\" (UniqueName: \"kubernetes.io/projected/3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2-kube-api-access-ngz4k\") pod \"3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2\" (UID: \"3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2\") "
Jul 30 00:14:01.991200 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:01.991148    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2-config-file" (OuterVolumeSpecName: "config-file") pod "3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2" (UID: "3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:14:01.993155 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:01.993127    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2-kube-api-access-ngz4k" (OuterVolumeSpecName: "kube-api-access-ngz4k") pod "3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2" (UID: "3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2"). InnerVolumeSpecName "kube-api-access-ngz4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:14:02.091843 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:02.091807    2527 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2-config-file\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:14:02.091843 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:02.091836    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngz4k\" (UniqueName: \"kubernetes.io/projected/3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2-kube-api-access-ngz4k\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:14:02.338672 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:02.338572    2527 generic.go:356] "Generic (PLEG): container finished" podID="3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2" containerID="4ecb941f0cf21f8dd056d3332973f383f4b1d761c1885135a4df4cd0390d6b87" exitCode=0
Jul 30 00:14:02.338672 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:02.338630    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-z2hqj"
Jul 30 00:14:02.338672 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:02.338659    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-z2hqj" event={"ID":"3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2","Type":"ContainerDied","Data":"4ecb941f0cf21f8dd056d3332973f383f4b1d761c1885135a4df4cd0390d6b87"}
Jul 30 00:14:02.339239 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:02.338755    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-z2hqj" event={"ID":"3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2","Type":"ContainerDied","Data":"c713af71e644d217e83ffddb779131ed1c8d38072e36d6d0b5a3965ac98db11a"}
Jul 30 00:14:02.339239 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:02.338779    2527 scope.go:117] "RemoveContainer" containerID="4ecb941f0cf21f8dd056d3332973f383f4b1d761c1885135a4df4cd0390d6b87"
Jul 30 00:14:02.348081 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:02.348063    2527 scope.go:117] "RemoveContainer" containerID="4ecb941f0cf21f8dd056d3332973f383f4b1d761c1885135a4df4cd0390d6b87"
Jul 30 00:14:02.348487 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:14:02.348463    2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ecb941f0cf21f8dd056d3332973f383f4b1d761c1885135a4df4cd0390d6b87\": container with ID starting with 4ecb941f0cf21f8dd056d3332973f383f4b1d761c1885135a4df4cd0390d6b87 not found: ID does not exist" containerID="4ecb941f0cf21f8dd056d3332973f383f4b1d761c1885135a4df4cd0390d6b87"
Jul 30 00:14:02.348568 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:02.348501    2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ecb941f0cf21f8dd056d3332973f383f4b1d761c1885135a4df4cd0390d6b87"} err="failed to get container status \"4ecb941f0cf21f8dd056d3332973f383f4b1d761c1885135a4df4cd0390d6b87\": rpc error: code = NotFound desc = could not find container \"4ecb941f0cf21f8dd056d3332973f383f4b1d761c1885135a4df4cd0390d6b87\": container with ID starting with 4ecb941f0cf21f8dd056d3332973f383f4b1d761c1885135a4df4cd0390d6b87 not found: ID does not exist"
Jul 30 00:14:02.354898 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:02.354867    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z2hqj"]
Jul 30 00:14:02.359340 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:02.359313    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z2hqj"]
Jul 30 00:14:04.216773 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:04.216742    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2" path="/var/lib/kubelet/pods/3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2/volumes"
Jul 30 00:14:18.022360 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.022322    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-cb2hj"]
Jul 30 00:14:18.022801 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.022785    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2" containerName="limitador"
Jul 30 00:14:18.022801 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.022802    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2" containerName="limitador"
Jul 30 00:14:18.022899 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.022889    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c1c0cd5-3c2d-4701-a9f2-abaa7787d7f2" containerName="limitador"
Jul 30 00:14:18.027978 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.027962    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-cb2hj"
Jul 30 00:14:18.030260 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.030224    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 30 00:14:18.031754 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.031729    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-cb2hj"]
Jul 30 00:14:18.144421 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.144382    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w6q8\" (UniqueName: \"kubernetes.io/projected/d90636e4-0640-4b20-92cd-82672a86b4a5-kube-api-access-6w6q8\") pod \"authorino-76877994-cb2hj\" (UID: \"d90636e4-0640-4b20-92cd-82672a86b4a5\") " pod="kuadrant-system/authorino-76877994-cb2hj"
Jul 30 00:14:18.144601 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.144526    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d90636e4-0640-4b20-92cd-82672a86b4a5-tls-cert\") pod \"authorino-76877994-cb2hj\" (UID: \"d90636e4-0640-4b20-92cd-82672a86b4a5\") " pod="kuadrant-system/authorino-76877994-cb2hj"
Jul 30 00:14:18.216864 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.216832    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-cb2hj"]
Jul 30 00:14:18.217189 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:14:18.217142    2527 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-6w6q8 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-76877994-cb2hj" podUID="d90636e4-0640-4b20-92cd-82672a86b4a5"
Jul 30 00:14:18.238766 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.238733    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5cbcf965f-lzq85"]
Jul 30 00:14:18.241460 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.241439    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cbcf965f-lzq85"
Jul 30 00:14:18.245929 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.245904    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d90636e4-0640-4b20-92cd-82672a86b4a5-tls-cert\") pod \"authorino-76877994-cb2hj\" (UID: \"d90636e4-0640-4b20-92cd-82672a86b4a5\") " pod="kuadrant-system/authorino-76877994-cb2hj"
Jul 30 00:14:18.246042 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.245994    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w6q8\" (UniqueName: \"kubernetes.io/projected/d90636e4-0640-4b20-92cd-82672a86b4a5-kube-api-access-6w6q8\") pod \"authorino-76877994-cb2hj\" (UID: \"d90636e4-0640-4b20-92cd-82672a86b4a5\") " pod="kuadrant-system/authorino-76877994-cb2hj"
Jul 30 00:14:18.249020 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.249000    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d90636e4-0640-4b20-92cd-82672a86b4a5-tls-cert\") pod \"authorino-76877994-cb2hj\" (UID: \"d90636e4-0640-4b20-92cd-82672a86b4a5\") " pod="kuadrant-system/authorino-76877994-cb2hj"
Jul 30 00:14:18.253178 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.253133    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cbcf965f-lzq85"]
Jul 30 00:14:18.253962 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.253942    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w6q8\" (UniqueName: \"kubernetes.io/projected/d90636e4-0640-4b20-92cd-82672a86b4a5-kube-api-access-6w6q8\") pod \"authorino-76877994-cb2hj\" (UID: \"d90636e4-0640-4b20-92cd-82672a86b4a5\") " pod="kuadrant-system/authorino-76877994-cb2hj"
Jul 30 00:14:18.347041 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.346956    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/12bd438f-28dd-4052-834a-98459bbb2027-tls-cert\") pod \"authorino-5cbcf965f-lzq85\" (UID: \"12bd438f-28dd-4052-834a-98459bbb2027\") " pod="kuadrant-system/authorino-5cbcf965f-lzq85"
Jul 30 00:14:18.347041 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.347014    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w25z2\" (UniqueName: \"kubernetes.io/projected/12bd438f-28dd-4052-834a-98459bbb2027-kube-api-access-w25z2\") pod \"authorino-5cbcf965f-lzq85\" (UID: \"12bd438f-28dd-4052-834a-98459bbb2027\") " pod="kuadrant-system/authorino-5cbcf965f-lzq85"
Jul 30 00:14:18.432551 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.432517    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-cb2hj"
Jul 30 00:14:18.438637 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.438611    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-cb2hj"
Jul 30 00:14:18.447636 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.447609    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/12bd438f-28dd-4052-834a-98459bbb2027-tls-cert\") pod \"authorino-5cbcf965f-lzq85\" (UID: \"12bd438f-28dd-4052-834a-98459bbb2027\") " pod="kuadrant-system/authorino-5cbcf965f-lzq85"
Jul 30 00:14:18.447791 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.447675    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w25z2\" (UniqueName: \"kubernetes.io/projected/12bd438f-28dd-4052-834a-98459bbb2027-kube-api-access-w25z2\") pod \"authorino-5cbcf965f-lzq85\" (UID: \"12bd438f-28dd-4052-834a-98459bbb2027\") " pod="kuadrant-system/authorino-5cbcf965f-lzq85"
Jul 30 00:14:18.450344 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.450319    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/12bd438f-28dd-4052-834a-98459bbb2027-tls-cert\") pod \"authorino-5cbcf965f-lzq85\" (UID: \"12bd438f-28dd-4052-834a-98459bbb2027\") " pod="kuadrant-system/authorino-5cbcf965f-lzq85"
Jul 30 00:14:18.454958 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.454932    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w25z2\" (UniqueName: \"kubernetes.io/projected/12bd438f-28dd-4052-834a-98459bbb2027-kube-api-access-w25z2\") pod \"authorino-5cbcf965f-lzq85\" (UID: \"12bd438f-28dd-4052-834a-98459bbb2027\") " pod="kuadrant-system/authorino-5cbcf965f-lzq85"
Jul 30 00:14:18.548438 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.548384    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6w6q8\" (UniqueName: \"kubernetes.io/projected/d90636e4-0640-4b20-92cd-82672a86b4a5-kube-api-access-6w6q8\") pod \"d90636e4-0640-4b20-92cd-82672a86b4a5\" (UID: \"d90636e4-0640-4b20-92cd-82672a86b4a5\") "
Jul 30 00:14:18.548438 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.548444    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d90636e4-0640-4b20-92cd-82672a86b4a5-tls-cert\") pod \"d90636e4-0640-4b20-92cd-82672a86b4a5\" (UID: \"d90636e4-0640-4b20-92cd-82672a86b4a5\") "
Jul 30 00:14:18.550688 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.550654    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d90636e4-0640-4b20-92cd-82672a86b4a5-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d90636e4-0640-4b20-92cd-82672a86b4a5" (UID: "d90636e4-0640-4b20-92cd-82672a86b4a5"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:14:18.550809 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.550725    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d90636e4-0640-4b20-92cd-82672a86b4a5-kube-api-access-6w6q8" (OuterVolumeSpecName: "kube-api-access-6w6q8") pod "d90636e4-0640-4b20-92cd-82672a86b4a5" (UID: "d90636e4-0640-4b20-92cd-82672a86b4a5"). InnerVolumeSpecName "kube-api-access-6w6q8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:14:18.571880 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.571855    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cbcf965f-lzq85"
Jul 30 00:14:18.649388 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.649338    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6w6q8\" (UniqueName: \"kubernetes.io/projected/d90636e4-0640-4b20-92cd-82672a86b4a5-kube-api-access-6w6q8\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:14:18.649388 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.649364    2527 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d90636e4-0640-4b20-92cd-82672a86b4a5-tls-cert\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:14:18.714067 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:18.714034    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cbcf965f-lzq85"]
Jul 30 00:14:18.716715 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:14:18.716688    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12bd438f_28dd_4052_834a_98459bbb2027.slice/crio-64b5edd8c8009444e44cb5fbe62bae49229593695eb8a98a940fbdaa4a552152 WatchSource:0}: Error finding container 64b5edd8c8009444e44cb5fbe62bae49229593695eb8a98a940fbdaa4a552152: Status 404 returned error can't find the container with id 64b5edd8c8009444e44cb5fbe62bae49229593695eb8a98a940fbdaa4a552152
Jul 30 00:14:19.439938 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:19.439833    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cbcf965f-lzq85" event={"ID":"12bd438f-28dd-4052-834a-98459bbb2027","Type":"ContainerStarted","Data":"ba859728156e5ba333a191547fb58a7897296b5ddd892ef73846157994969277"}
Jul 30 00:14:19.439938 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:19.439890    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cbcf965f-lzq85" event={"ID":"12bd438f-28dd-4052-834a-98459bbb2027","Type":"ContainerStarted","Data":"64b5edd8c8009444e44cb5fbe62bae49229593695eb8a98a940fbdaa4a552152"}
Jul 30 00:14:19.439938 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:19.439923    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-cb2hj"
Jul 30 00:14:19.457423 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:19.457370    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5cbcf965f-lzq85" podStartSLOduration=1.049787603 podStartE2EDuration="1.457353824s" totalImagesPullingTime="407.566221ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:14:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:14:19.455809171 +0000 UTC m=+733.758257531" watchObservedRunningTime="2026-07-30 00:14:19.457353824 +0000 UTC m=+733.759802168"
Jul 30 00:14:19.483948 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:19.483897    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-cb2hj"]
Jul 30 00:14:19.498527 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:19.498401    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wcnsn"]
Jul 30 00:14:19.498683 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:19.498610    2527 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-wcnsn" podUID="7d04953a-25bd-4325-9df4-56820a4d6b43" containerName="authorino" containerID="cri-o://4ec475ef819671ce0e6b98acbee27a1ef0ae975af4b8a0bd14313d00f004507e" gracePeriod=30
Jul 30 00:14:19.502406 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:19.502380    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-cb2hj"]
Jul 30 00:14:19.757998 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:19.757973    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wcnsn"
Jul 30 00:14:19.861074 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:19.861041    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xl6pk\" (UniqueName: \"kubernetes.io/projected/7d04953a-25bd-4325-9df4-56820a4d6b43-kube-api-access-xl6pk\") pod \"7d04953a-25bd-4325-9df4-56820a4d6b43\" (UID: \"7d04953a-25bd-4325-9df4-56820a4d6b43\") "
Jul 30 00:14:19.863318 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:19.863286    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d04953a-25bd-4325-9df4-56820a4d6b43-kube-api-access-xl6pk" (OuterVolumeSpecName: "kube-api-access-xl6pk") pod "7d04953a-25bd-4325-9df4-56820a4d6b43" (UID: "7d04953a-25bd-4325-9df4-56820a4d6b43"). InnerVolumeSpecName "kube-api-access-xl6pk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:14:19.962445 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:19.962403    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xl6pk\" (UniqueName: \"kubernetes.io/projected/7d04953a-25bd-4325-9df4-56820a4d6b43-kube-api-access-xl6pk\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:14:20.217611 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:20.217573    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d90636e4-0640-4b20-92cd-82672a86b4a5" path="/var/lib/kubelet/pods/d90636e4-0640-4b20-92cd-82672a86b4a5/volumes"
Jul 30 00:14:20.447316 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:20.447282    2527 generic.go:356] "Generic (PLEG): container finished" podID="7d04953a-25bd-4325-9df4-56820a4d6b43" containerID="4ec475ef819671ce0e6b98acbee27a1ef0ae975af4b8a0bd14313d00f004507e" exitCode=0
Jul 30 00:14:20.447763 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:20.447325    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wcnsn"
Jul 30 00:14:20.447763 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:20.447365    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wcnsn" event={"ID":"7d04953a-25bd-4325-9df4-56820a4d6b43","Type":"ContainerDied","Data":"4ec475ef819671ce0e6b98acbee27a1ef0ae975af4b8a0bd14313d00f004507e"}
Jul 30 00:14:20.447763 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:20.447401    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wcnsn" event={"ID":"7d04953a-25bd-4325-9df4-56820a4d6b43","Type":"ContainerDied","Data":"3ec7cdc5f1052497fdcde2f62ee2a879a381ad70d3fc5f5d104f8b326bb55612"}
Jul 30 00:14:20.447763 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:20.447421    2527 scope.go:117] "RemoveContainer" containerID="4ec475ef819671ce0e6b98acbee27a1ef0ae975af4b8a0bd14313d00f004507e"
Jul 30 00:14:20.456645 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:20.456627    2527 scope.go:117] "RemoveContainer" containerID="4ec475ef819671ce0e6b98acbee27a1ef0ae975af4b8a0bd14313d00f004507e"
Jul 30 00:14:20.456914 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:14:20.456896    2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ec475ef819671ce0e6b98acbee27a1ef0ae975af4b8a0bd14313d00f004507e\": container with ID starting with 4ec475ef819671ce0e6b98acbee27a1ef0ae975af4b8a0bd14313d00f004507e not found: ID does not exist" containerID="4ec475ef819671ce0e6b98acbee27a1ef0ae975af4b8a0bd14313d00f004507e"
Jul 30 00:14:20.456969 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:20.456923    2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ec475ef819671ce0e6b98acbee27a1ef0ae975af4b8a0bd14313d00f004507e"} err="failed to get container status \"4ec475ef819671ce0e6b98acbee27a1ef0ae975af4b8a0bd14313d00f004507e\": rpc error: code = NotFound desc = could not find container \"4ec475ef819671ce0e6b98acbee27a1ef0ae975af4b8a0bd14313d00f004507e\": container with ID starting with 4ec475ef819671ce0e6b98acbee27a1ef0ae975af4b8a0bd14313d00f004507e not found: ID does not exist"
Jul 30 00:14:20.473622 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:20.473556    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wcnsn"]
Jul 30 00:14:20.477260 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:20.477231    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wcnsn"]
Jul 30 00:14:22.216318 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:22.216282    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d04953a-25bd-4325-9df4-56820a4d6b43" path="/var/lib/kubelet/pods/7d04953a-25bd-4325-9df4-56820a4d6b43/volumes"
Jul 30 00:14:24.045855 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:24.045810    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-86695858f6-qkcbn"]
Jul 30 00:14:24.046871 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:24.046845    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d04953a-25bd-4325-9df4-56820a4d6b43" containerName="authorino"
Jul 30 00:14:24.046871 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:24.046873    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d04953a-25bd-4325-9df4-56820a4d6b43" containerName="authorino"
Jul 30 00:14:24.047107 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:24.047093    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d04953a-25bd-4325-9df4-56820a4d6b43" containerName="authorino"
Jul 30 00:14:24.055130 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:24.055075    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86695858f6-qkcbn"
Jul 30 00:14:24.058229 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:24.058202    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 30 00:14:24.058867 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:24.058551    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-j78v9\""
Jul 30 00:14:24.058867 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:24.058646    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 30 00:14:24.061545 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:24.061519    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86695858f6-qkcbn"]
Jul 30 00:14:24.203240 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:24.203199    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76889fd47d-vhmng"]
Jul 30 00:14:24.203611 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:24.203547    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b16d0a28-bc59-4101-9007-e05cb02ddd24-webhook-cert\") pod \"maas-controller-86695858f6-qkcbn\" (UID: \"b16d0a28-bc59-4101-9007-e05cb02ddd24\") " pod="opendatahub/maas-controller-86695858f6-qkcbn"
Jul 30 00:14:24.203611 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:24.203599    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw4rg\" (UniqueName: \"kubernetes.io/projected/b16d0a28-bc59-4101-9007-e05cb02ddd24-kube-api-access-kw4rg\") pod \"maas-controller-86695858f6-qkcbn\" (UID: \"b16d0a28-bc59-4101-9007-e05cb02ddd24\") " pod="opendatahub/maas-controller-86695858f6-qkcbn"
Jul 30 00:14:24.205930 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:24.205912    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76889fd47d-vhmng"
Jul 30 00:14:24.221261 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:24.221235    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76889fd47d-vhmng"]
Jul 30 00:14:24.304671 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:24.304556    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6ba4141a-3649-4745-87b4-6a83870e34eb-webhook-cert\") pod \"maas-controller-76889fd47d-vhmng\" (UID: \"6ba4141a-3649-4745-87b4-6a83870e34eb\") " pod="opendatahub/maas-controller-76889fd47d-vhmng"
Jul 30 00:14:24.304671 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:24.304624    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqx6l\" (UniqueName: \"kubernetes.io/projected/6ba4141a-3649-4745-87b4-6a83870e34eb-kube-api-access-dqx6l\") pod \"maas-controller-76889fd47d-vhmng\" (UID: \"6ba4141a-3649-4745-87b4-6a83870e34eb\") " pod="opendatahub/maas-controller-76889fd47d-vhmng"
Jul 30 00:14:24.304891 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:24.304707    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b16d0a28-bc59-4101-9007-e05cb02ddd24-webhook-cert\") pod \"maas-controller-86695858f6-qkcbn\" (UID: \"b16d0a28-bc59-4101-9007-e05cb02ddd24\") " pod="opendatahub/maas-controller-86695858f6-qkcbn"
Jul 30 00:14:24.304891 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:24.304755    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw4rg\" (UniqueName: \"kubernetes.io/projected/b16d0a28-bc59-4101-9007-e05cb02ddd24-kube-api-access-kw4rg\") pod \"maas-controller-86695858f6-qkcbn\" (UID: \"b16d0a28-bc59-4101-9007-e05cb02ddd24\") " pod="opendatahub/maas-controller-86695858f6-qkcbn"
Jul 30 00:14:24.307428 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:24.307403    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b16d0a28-bc59-4101-9007-e05cb02ddd24-webhook-cert\") pod \"maas-controller-86695858f6-qkcbn\" (UID: \"b16d0a28-bc59-4101-9007-e05cb02ddd24\") " pod="opendatahub/maas-controller-86695858f6-qkcbn"
Jul 30 00:14:24.312758 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:24.312730    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw4rg\" (UniqueName: \"kubernetes.io/projected/b16d0a28-bc59-4101-9007-e05cb02ddd24-kube-api-access-kw4rg\") pod \"maas-controller-86695858f6-qkcbn\" (UID: \"b16d0a28-bc59-4101-9007-e05cb02ddd24\") " pod="opendatahub/maas-controller-86695858f6-qkcbn"
Jul 30 00:14:24.367809 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:24.367773    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86695858f6-qkcbn"
Jul 30 00:14:24.406094 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:24.406058    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqx6l\" (UniqueName: \"kubernetes.io/projected/6ba4141a-3649-4745-87b4-6a83870e34eb-kube-api-access-dqx6l\") pod \"maas-controller-76889fd47d-vhmng\" (UID: \"6ba4141a-3649-4745-87b4-6a83870e34eb\") " pod="opendatahub/maas-controller-76889fd47d-vhmng"
Jul 30 00:14:24.406378 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:24.406158    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6ba4141a-3649-4745-87b4-6a83870e34eb-webhook-cert\") pod \"maas-controller-76889fd47d-vhmng\" (UID: \"6ba4141a-3649-4745-87b4-6a83870e34eb\") " pod="opendatahub/maas-controller-76889fd47d-vhmng"
Jul 30 00:14:24.408635 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:24.408605    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6ba4141a-3649-4745-87b4-6a83870e34eb-webhook-cert\") pod \"maas-controller-76889fd47d-vhmng\" (UID: \"6ba4141a-3649-4745-87b4-6a83870e34eb\") " pod="opendatahub/maas-controller-76889fd47d-vhmng"
Jul 30 00:14:24.414271 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:24.414245    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqx6l\" (UniqueName: \"kubernetes.io/projected/6ba4141a-3649-4745-87b4-6a83870e34eb-kube-api-access-dqx6l\") pod \"maas-controller-76889fd47d-vhmng\" (UID: \"6ba4141a-3649-4745-87b4-6a83870e34eb\") " pod="opendatahub/maas-controller-76889fd47d-vhmng"
Jul 30 00:14:24.511444 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:24.511414    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86695858f6-qkcbn"]
Jul 30 00:14:24.512891 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:14:24.512857    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb16d0a28_bc59_4101_9007_e05cb02ddd24.slice/crio-3be14fb28142ad4ef04ef0de62b3b9d19d8c1713cbfb10bdb10a2b05e15d6209 WatchSource:0}: Error finding container 3be14fb28142ad4ef04ef0de62b3b9d19d8c1713cbfb10bdb10a2b05e15d6209: Status 404 returned error can't find the container with id 3be14fb28142ad4ef04ef0de62b3b9d19d8c1713cbfb10bdb10a2b05e15d6209
Jul 30 00:14:24.519864 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:24.519838    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76889fd47d-vhmng"
Jul 30 00:14:24.659789 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:24.659759    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76889fd47d-vhmng"]
Jul 30 00:14:24.661182 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:14:24.661130    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ba4141a_3649_4745_87b4_6a83870e34eb.slice/crio-c57130a1a66ac85c0816670fdf08343eee7e6c77d8d9db0c1fecafdff73ea536 WatchSource:0}: Error finding container c57130a1a66ac85c0816670fdf08343eee7e6c77d8d9db0c1fecafdff73ea536: Status 404 returned error can't find the container with id c57130a1a66ac85c0816670fdf08343eee7e6c77d8d9db0c1fecafdff73ea536
Jul 30 00:14:25.483398 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:25.483361    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76889fd47d-vhmng" event={"ID":"6ba4141a-3649-4745-87b4-6a83870e34eb","Type":"ContainerStarted","Data":"c57130a1a66ac85c0816670fdf08343eee7e6c77d8d9db0c1fecafdff73ea536"}
Jul 30 00:14:25.485321 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:25.485290    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86695858f6-qkcbn" event={"ID":"b16d0a28-bc59-4101-9007-e05cb02ddd24","Type":"ContainerStarted","Data":"3be14fb28142ad4ef04ef0de62b3b9d19d8c1713cbfb10bdb10a2b05e15d6209"}
Jul 30 00:14:27.501692 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:27.501656    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76889fd47d-vhmng" event={"ID":"6ba4141a-3649-4745-87b4-6a83870e34eb","Type":"ContainerStarted","Data":"2931b51f97cfe7e9b26f59f4205cde4cbf25361f2a6da36372b57959b1587c93"}
Jul 30 00:14:27.502191 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:27.501721    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76889fd47d-vhmng"
Jul 30 00:14:27.503183 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:27.503143    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86695858f6-qkcbn" event={"ID":"b16d0a28-bc59-4101-9007-e05cb02ddd24","Type":"ContainerStarted","Data":"c3218e3c6a5862c0bcda821b101dad550c47faa6bb8e5e67145ac8ed12115df4"}
Jul 30 00:14:27.503299 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:27.503243    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-86695858f6-qkcbn"
Jul 30 00:14:27.522451 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:27.522405    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76889fd47d-vhmng" podStartSLOduration=1.024034232 podStartE2EDuration="3.522389942s" totalImagesPullingTime="2.49835571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:14:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:14:27.520200141 +0000 UTC m=+741.822648488" watchObservedRunningTime="2026-07-30 00:14:27.522389942 +0000 UTC m=+741.824838297"
Jul 30 00:14:27.538239 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:27.538192    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-86695858f6-qkcbn" podStartSLOduration=0.884839142 podStartE2EDuration="3.538156876s" totalImagesPullingTime="2.653317734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:14:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:14:27.535423807 +0000 UTC m=+741.837872148" watchObservedRunningTime="2026-07-30 00:14:27.538156876 +0000 UTC m=+741.840605221"
Jul 30 00:14:38.511799 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:38.511766    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-86695858f6-qkcbn"
Jul 30 00:14:38.512564 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:38.511835    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76889fd47d-vhmng"
Jul 30 00:14:38.578491 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:38.578459    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-86695858f6-qkcbn"]
Jul 30 00:14:38.578715 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:38.578674    2527 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-86695858f6-qkcbn" podUID="b16d0a28-bc59-4101-9007-e05cb02ddd24" containerName="manager" containerID="cri-o://c3218e3c6a5862c0bcda821b101dad550c47faa6bb8e5e67145ac8ed12115df4" gracePeriod=30
Jul 30 00:14:38.840019 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:38.839991    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86695858f6-qkcbn"
Jul 30 00:14:38.940975 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:38.940937    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b16d0a28-bc59-4101-9007-e05cb02ddd24-webhook-cert\") pod \"b16d0a28-bc59-4101-9007-e05cb02ddd24\" (UID: \"b16d0a28-bc59-4101-9007-e05cb02ddd24\") "
Jul 30 00:14:38.941155 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:38.941033    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kw4rg\" (UniqueName: \"kubernetes.io/projected/b16d0a28-bc59-4101-9007-e05cb02ddd24-kube-api-access-kw4rg\") pod \"b16d0a28-bc59-4101-9007-e05cb02ddd24\" (UID: \"b16d0a28-bc59-4101-9007-e05cb02ddd24\") "
Jul 30 00:14:38.943461 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:38.943431    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b16d0a28-bc59-4101-9007-e05cb02ddd24-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b16d0a28-bc59-4101-9007-e05cb02ddd24" (UID: "b16d0a28-bc59-4101-9007-e05cb02ddd24"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:14:38.943595 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:38.943478    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b16d0a28-bc59-4101-9007-e05cb02ddd24-kube-api-access-kw4rg" (OuterVolumeSpecName: "kube-api-access-kw4rg") pod "b16d0a28-bc59-4101-9007-e05cb02ddd24" (UID: "b16d0a28-bc59-4101-9007-e05cb02ddd24"). InnerVolumeSpecName "kube-api-access-kw4rg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:14:39.041934 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:39.041885    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kw4rg\" (UniqueName: \"kubernetes.io/projected/b16d0a28-bc59-4101-9007-e05cb02ddd24-kube-api-access-kw4rg\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:14:39.041934 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:39.041929    2527 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b16d0a28-bc59-4101-9007-e05cb02ddd24-webhook-cert\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:14:39.576891 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:39.576854    2527 generic.go:356] "Generic (PLEG): container finished" podID="b16d0a28-bc59-4101-9007-e05cb02ddd24" containerID="c3218e3c6a5862c0bcda821b101dad550c47faa6bb8e5e67145ac8ed12115df4" exitCode=0
Jul 30 00:14:39.577379 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:39.576902    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86695858f6-qkcbn"
Jul 30 00:14:39.577379 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:39.576905    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86695858f6-qkcbn" event={"ID":"b16d0a28-bc59-4101-9007-e05cb02ddd24","Type":"ContainerDied","Data":"c3218e3c6a5862c0bcda821b101dad550c47faa6bb8e5e67145ac8ed12115df4"}
Jul 30 00:14:39.577379 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:39.577008    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86695858f6-qkcbn" event={"ID":"b16d0a28-bc59-4101-9007-e05cb02ddd24","Type":"ContainerDied","Data":"3be14fb28142ad4ef04ef0de62b3b9d19d8c1713cbfb10bdb10a2b05e15d6209"}
Jul 30 00:14:39.577379 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:39.577030    2527 scope.go:117] "RemoveContainer" containerID="c3218e3c6a5862c0bcda821b101dad550c47faa6bb8e5e67145ac8ed12115df4"
Jul 30 00:14:39.587322 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:39.587145    2527 scope.go:117] "RemoveContainer" containerID="c3218e3c6a5862c0bcda821b101dad550c47faa6bb8e5e67145ac8ed12115df4"
Jul 30 00:14:39.587493 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:14:39.587474    2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3218e3c6a5862c0bcda821b101dad550c47faa6bb8e5e67145ac8ed12115df4\": container with ID starting with c3218e3c6a5862c0bcda821b101dad550c47faa6bb8e5e67145ac8ed12115df4 not found: ID does not exist" containerID="c3218e3c6a5862c0bcda821b101dad550c47faa6bb8e5e67145ac8ed12115df4"
Jul 30 00:14:39.587544 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:39.587503    2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3218e3c6a5862c0bcda821b101dad550c47faa6bb8e5e67145ac8ed12115df4"} err="failed to get container status \"c3218e3c6a5862c0bcda821b101dad550c47faa6bb8e5e67145ac8ed12115df4\": rpc error: code = NotFound desc = could not find container \"c3218e3c6a5862c0bcda821b101dad550c47faa6bb8e5e67145ac8ed12115df4\": container with ID starting with c3218e3c6a5862c0bcda821b101dad550c47faa6bb8e5e67145ac8ed12115df4 not found: ID does not exist"
Jul 30 00:14:39.599173 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:39.599138    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-86695858f6-qkcbn"]
Jul 30 00:14:39.604858 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:39.604837    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-86695858f6-qkcbn"]
Jul 30 00:14:40.216728 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:14:40.216684    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b16d0a28-bc59-4101-9007-e05cb02ddd24" path="/var/lib/kubelet/pods/b16d0a28-bc59-4101-9007-e05cb02ddd24/volumes"
Jul 30 00:15:01.146702 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:01.146661    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:15:01.174875 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:01.174839    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-8xmlm"]
Jul 30 00:15:01.175518 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:01.175491    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b16d0a28-bc59-4101-9007-e05cb02ddd24" containerName="manager"
Jul 30 00:15:01.175518 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:01.175514    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="b16d0a28-bc59-4101-9007-e05cb02ddd24" containerName="manager"
Jul 30 00:15:01.175714 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:01.175643    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="b16d0a28-bc59-4101-9007-e05cb02ddd24" containerName="manager"
Jul 30 00:15:01.178892 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:01.178872    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-8xmlm"
Jul 30 00:15:01.181407 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:01.181377    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 30 00:15:01.181533 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:01.181420    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-nhsn2\""
Jul 30 00:15:01.187688 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:01.187109    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-8xmlm"]
Jul 30 00:15:01.255213 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:01.255153    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p94g7\" (UniqueName: \"kubernetes.io/projected/e241e5ee-2fa2-4fb3-a8a2-e028fec62a89-kube-api-access-p94g7\") pod \"payload-pre-processing-687dbb6cf6-8xmlm\" (UID: \"e241e5ee-2fa2-4fb3-a8a2-e028fec62a89\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-8xmlm"
Jul 30 00:15:01.255390 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:01.255361    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e241e5ee-2fa2-4fb3-a8a2-e028fec62a89-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-8xmlm\" (UID: \"e241e5ee-2fa2-4fb3-a8a2-e028fec62a89\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-8xmlm"
Jul 30 00:15:01.356178 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:01.356129    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p94g7\" (UniqueName: \"kubernetes.io/projected/e241e5ee-2fa2-4fb3-a8a2-e028fec62a89-kube-api-access-p94g7\") pod \"payload-pre-processing-687dbb6cf6-8xmlm\" (UID: \"e241e5ee-2fa2-4fb3-a8a2-e028fec62a89\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-8xmlm"
Jul 30 00:15:01.356378 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:01.356234    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e241e5ee-2fa2-4fb3-a8a2-e028fec62a89-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-8xmlm\" (UID: \"e241e5ee-2fa2-4fb3-a8a2-e028fec62a89\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-8xmlm"
Jul 30 00:15:01.356960 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:01.356934    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e241e5ee-2fa2-4fb3-a8a2-e028fec62a89-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-8xmlm\" (UID: \"e241e5ee-2fa2-4fb3-a8a2-e028fec62a89\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-8xmlm"
Jul 30 00:15:01.364110 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:01.364089    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p94g7\" (UniqueName: \"kubernetes.io/projected/e241e5ee-2fa2-4fb3-a8a2-e028fec62a89-kube-api-access-p94g7\") pod \"payload-pre-processing-687dbb6cf6-8xmlm\" (UID: \"e241e5ee-2fa2-4fb3-a8a2-e028fec62a89\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-8xmlm"
Jul 30 00:15:01.492304 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:01.492271    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-8xmlm"
Jul 30 00:15:01.849048 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:01.849011    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-8xmlm"]
Jul 30 00:15:01.850788 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:15:01.850756    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode241e5ee_2fa2_4fb3_a8a2_e028fec62a89.slice/crio-ccae9f53f9aff757ae7168696717a4072537cd01389bc366cb15f6db38e5c5b6 WatchSource:0}: Error finding container ccae9f53f9aff757ae7168696717a4072537cd01389bc366cb15f6db38e5c5b6: Status 404 returned error can't find the container with id ccae9f53f9aff757ae7168696717a4072537cd01389bc366cb15f6db38e5c5b6
Jul 30 00:15:02.727347 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:02.727308    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-8xmlm" event={"ID":"e241e5ee-2fa2-4fb3-a8a2-e028fec62a89","Type":"ContainerStarted","Data":"ccae9f53f9aff757ae7168696717a4072537cd01389bc366cb15f6db38e5c5b6"}
Jul 30 00:15:04.744489 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:04.744416    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-8xmlm" event={"ID":"e241e5ee-2fa2-4fb3-a8a2-e028fec62a89","Type":"ContainerStarted","Data":"5a5b2f37ab82e9ff3719a2c4bfba461e81fa23693de1a063b38b197c28186e09"}
Jul 30 00:15:04.745420 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:04.745390    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-8xmlm"
Jul 30 00:15:04.762616 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:04.762546    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-8xmlm" podStartSLOduration=1.779886475 podStartE2EDuration="3.762521648s" totalImagesPullingTime="1.982635173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:15:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:15:04.75913827 +0000 UTC m=+779.061586618" watchObservedRunningTime="2026-07-30 00:15:04.762521648 +0000 UTC m=+779.064969994"
Jul 30 00:15:08.216355 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:08.216319    2527 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-sjrkr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 30 00:15:08.216811 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:08.216406    2527 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr" podUID="2c3a4be4-9ee5-4e76-9047-c600284aec82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 30 00:15:09.781030 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:09.780998    2527 generic.go:356] "Generic (PLEG): container finished" podID="2c3a4be4-9ee5-4e76-9047-c600284aec82" containerID="65f401cacc086a262d9c4f683d2e088e422cf789d00838f02ef6d2e3520009ee" exitCode=0
Jul 30 00:15:09.781030 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:09.781035    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr" event={"ID":"2c3a4be4-9ee5-4e76-9047-c600284aec82","Type":"ContainerDied","Data":"65f401cacc086a262d9c4f683d2e088e422cf789d00838f02ef6d2e3520009ee"}
Jul 30 00:15:09.781523 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:09.781459    2527 scope.go:117] "RemoveContainer" containerID="65f401cacc086a262d9c4f683d2e088e422cf789d00838f02ef6d2e3520009ee"
Jul 30 00:15:09.782468 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:09.782431    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:15:09.782553 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:09.782511    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:15:09.782553 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:09.782547    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:15:10.789461 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:10.789426    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr" event={"ID":"2c3a4be4-9ee5-4e76-9047-c600284aec82","Type":"ContainerStarted","Data":"702d9a80f9ada0869849e077c9b0d1ed34de5bd95f6fafaad5ad4daaee923050"}
Jul 30 00:15:10.818768 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:10.818741    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:15:10.818938 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:10.818876    2527 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-sjrkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 30 00:15:10.818938 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:10.818919    2527 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr" podUID="2c3a4be4-9ee5-4e76-9047-c600284aec82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 30 00:15:11.819151 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:11.819116    2527 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-sjrkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 30 00:15:11.819603 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:11.819196    2527 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr" podUID="2c3a4be4-9ee5-4e76-9047-c600284aec82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 30 00:15:12.818869 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:12.818804    2527 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-sjrkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 30 00:15:12.819076 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:12.818886    2527 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr" podUID="2c3a4be4-9ee5-4e76-9047-c600284aec82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 30 00:15:13.818980 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:13.818936    2527 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-sjrkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 30 00:15:13.819514 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:13.819016    2527 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr" podUID="2c3a4be4-9ee5-4e76-9047-c600284aec82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 30 00:15:14.822323 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:14.822294    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:15:14.822733 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:14.822550    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:15:14.823155 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:14.823139    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-sjrkr"
Jul 30 00:15:16.763938 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:16.763907    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-8xmlm"
Jul 30 00:15:25.192357 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:25.192324    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:15:40.900906 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:40.900822    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:15:51.096485 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:51.096446    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:15:57.900332 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:57.900300    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6"]
Jul 30 00:15:57.905443 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:57.905423    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6"
Jul 30 00:15:57.908858 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:57.908826    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 30 00:15:57.909001 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:57.908913    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dw4m6\""
Jul 30 00:15:57.909001 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:57.908944    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 30 00:15:57.909001 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:57.908913    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 30 00:15:57.909312 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:57.909287    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7531a470-f060-4c28-ad99-ecb007bc1ce2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6\" (UID: \"7531a470-f060-4c28-ad99-ecb007bc1ce2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6"
Jul 30 00:15:57.909392 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:57.909327    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2gqz\" (UniqueName: \"kubernetes.io/projected/7531a470-f060-4c28-ad99-ecb007bc1ce2-kube-api-access-v2gqz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6\" (UID: \"7531a470-f060-4c28-ad99-ecb007bc1ce2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6"
Jul 30 00:15:57.909448 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:57.909388    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7531a470-f060-4c28-ad99-ecb007bc1ce2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6\" (UID: \"7531a470-f060-4c28-ad99-ecb007bc1ce2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6"
Jul 30 00:15:57.909448 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:57.909414    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7531a470-f060-4c28-ad99-ecb007bc1ce2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6\" (UID: \"7531a470-f060-4c28-ad99-ecb007bc1ce2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6"
Jul 30 00:15:57.909560 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:57.909502    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7531a470-f060-4c28-ad99-ecb007bc1ce2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6\" (UID: \"7531a470-f060-4c28-ad99-ecb007bc1ce2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6"
Jul 30 00:15:57.909620 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:57.909605    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7531a470-f060-4c28-ad99-ecb007bc1ce2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6\" (UID: \"7531a470-f060-4c28-ad99-ecb007bc1ce2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6"
Jul 30 00:15:57.915816 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:57.915793    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6"]
Jul 30 00:15:58.010449 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:58.010409    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7531a470-f060-4c28-ad99-ecb007bc1ce2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6\" (UID: \"7531a470-f060-4c28-ad99-ecb007bc1ce2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6"
Jul 30 00:15:58.010449 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:58.010446    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7531a470-f060-4c28-ad99-ecb007bc1ce2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6\" (UID: \"7531a470-f060-4c28-ad99-ecb007bc1ce2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6"
Jul 30 00:15:58.010718 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:58.010485    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7531a470-f060-4c28-ad99-ecb007bc1ce2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6\" (UID: \"7531a470-f060-4c28-ad99-ecb007bc1ce2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6"
Jul 30 00:15:58.010718 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:58.010534    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7531a470-f060-4c28-ad99-ecb007bc1ce2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6\" (UID: \"7531a470-f060-4c28-ad99-ecb007bc1ce2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6"
Jul 30 00:15:58.010718 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:58.010554    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7531a470-f060-4c28-ad99-ecb007bc1ce2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6\" (UID: \"7531a470-f060-4c28-ad99-ecb007bc1ce2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6"
Jul 30 00:15:58.010718 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:58.010573    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2gqz\" (UniqueName: \"kubernetes.io/projected/7531a470-f060-4c28-ad99-ecb007bc1ce2-kube-api-access-v2gqz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6\" (UID: \"7531a470-f060-4c28-ad99-ecb007bc1ce2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6"
Jul 30 00:15:58.010998 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:58.010975    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7531a470-f060-4c28-ad99-ecb007bc1ce2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6\" (UID: \"7531a470-f060-4c28-ad99-ecb007bc1ce2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6"
Jul 30 00:15:58.011062 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:58.011042    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7531a470-f060-4c28-ad99-ecb007bc1ce2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6\" (UID: \"7531a470-f060-4c28-ad99-ecb007bc1ce2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6"
Jul 30 00:15:58.011102 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:58.011084    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7531a470-f060-4c28-ad99-ecb007bc1ce2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6\" (UID: \"7531a470-f060-4c28-ad99-ecb007bc1ce2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6"
Jul 30 00:15:58.013198 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:58.013135    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7531a470-f060-4c28-ad99-ecb007bc1ce2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6\" (UID: \"7531a470-f060-4c28-ad99-ecb007bc1ce2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6"
Jul 30 00:15:58.013339 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:58.013299    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7531a470-f060-4c28-ad99-ecb007bc1ce2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6\" (UID: \"7531a470-f060-4c28-ad99-ecb007bc1ce2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6"
Jul 30 00:15:58.025932 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:58.025909    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2gqz\" (UniqueName: \"kubernetes.io/projected/7531a470-f060-4c28-ad99-ecb007bc1ce2-kube-api-access-v2gqz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6\" (UID: \"7531a470-f060-4c28-ad99-ecb007bc1ce2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6"
Jul 30 00:15:58.216352 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:58.216326    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6"
Jul 30 00:15:58.371537 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:58.371502    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6"]
Jul 30 00:15:58.372916 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:15:58.372888    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7531a470_f060_4c28_ad99_ecb007bc1ce2.slice/crio-90a26c63013caddf074ae4bcda7974219bf7d9266ee058d5b69f661c32bb959b WatchSource:0}: Error finding container 90a26c63013caddf074ae4bcda7974219bf7d9266ee058d5b69f661c32bb959b: Status 404 returned error can't find the container with id 90a26c63013caddf074ae4bcda7974219bf7d9266ee058d5b69f661c32bb959b
Jul 30 00:15:59.074157 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:59.074117    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6" event={"ID":"7531a470-f060-4c28-ad99-ecb007bc1ce2","Type":"ContainerStarted","Data":"90a26c63013caddf074ae4bcda7974219bf7d9266ee058d5b69f661c32bb959b"}
Jul 30 00:15:59.906852 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:15:59.906804    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:16:00.082176 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:16:00.082119    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6" event={"ID":"7531a470-f060-4c28-ad99-ecb007bc1ce2","Type":"ContainerStarted","Data":"e61bb3820966811b2fb9199559f51a7b9bab999d708176be03120d2769420978"}
Jul 30 00:16:00.101253 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:16:00.101179    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6" podStartSLOduration=2.117362922 podStartE2EDuration="3.101137221s" totalImagesPullingTime="983.774299ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:16:00.097685425 +0000 UTC m=+834.400133774" watchObservedRunningTime="2026-07-30 00:16:00.101137221 +0000 UTC m=+834.403585566"
Jul 30 00:16:08.217067 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:16:08.217035    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6"
Jul 30 00:16:08.217468 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:16:08.217089    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6"
Jul 30 00:16:08.230038 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:16:08.230006    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6"
Jul 30 00:16:08.908976 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:16:08.908940    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:16:09.150039 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:16:09.149997    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6"
Jul 30 00:16:24.298067 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:16:24.298027    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:17:09.725908 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:09.725878    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9cggv_c6b01a1f-c41e-4781-8c25-66b152e0d0e8/ovn-acl-logging/0.log"
Jul 30 00:17:09.729464 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:09.729442    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9cggv_c6b01a1f-c41e-4781-8c25-66b152e0d0e8/ovn-acl-logging/0.log"
Jul 30 00:17:57.213514 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:57.213478    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-594b58bf5d-hmvmk"]
Jul 30 00:17:57.217074 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:57.217052    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-594b58bf5d-hmvmk"
Jul 30 00:17:57.223994 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:57.223966    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-594b58bf5d-hmvmk"]
Jul 30 00:17:57.359286 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:57.359250    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f63cc435-1192-4f73-9a41-83295000cd12-tls-cert\") pod \"authorino-594b58bf5d-hmvmk\" (UID: \"f63cc435-1192-4f73-9a41-83295000cd12\") " pod="kuadrant-system/authorino-594b58bf5d-hmvmk"
Jul 30 00:17:57.359496 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:57.359312    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v65sk\" (UniqueName: \"kubernetes.io/projected/f63cc435-1192-4f73-9a41-83295000cd12-kube-api-access-v65sk\") pod \"authorino-594b58bf5d-hmvmk\" (UID: \"f63cc435-1192-4f73-9a41-83295000cd12\") " pod="kuadrant-system/authorino-594b58bf5d-hmvmk"
Jul 30 00:17:57.460434 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:57.460393    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f63cc435-1192-4f73-9a41-83295000cd12-tls-cert\") pod \"authorino-594b58bf5d-hmvmk\" (UID: \"f63cc435-1192-4f73-9a41-83295000cd12\") " pod="kuadrant-system/authorino-594b58bf5d-hmvmk"
Jul 30 00:17:57.460603 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:57.460462    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v65sk\" (UniqueName: \"kubernetes.io/projected/f63cc435-1192-4f73-9a41-83295000cd12-kube-api-access-v65sk\") pod \"authorino-594b58bf5d-hmvmk\" (UID: \"f63cc435-1192-4f73-9a41-83295000cd12\") " pod="kuadrant-system/authorino-594b58bf5d-hmvmk"
Jul 30 00:17:57.463151 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:57.463128    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f63cc435-1192-4f73-9a41-83295000cd12-tls-cert\") pod \"authorino-594b58bf5d-hmvmk\" (UID: \"f63cc435-1192-4f73-9a41-83295000cd12\") " pod="kuadrant-system/authorino-594b58bf5d-hmvmk"
Jul 30 00:17:57.467989 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:57.467927    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v65sk\" (UniqueName: \"kubernetes.io/projected/f63cc435-1192-4f73-9a41-83295000cd12-kube-api-access-v65sk\") pod \"authorino-594b58bf5d-hmvmk\" (UID: \"f63cc435-1192-4f73-9a41-83295000cd12\") " pod="kuadrant-system/authorino-594b58bf5d-hmvmk"
Jul 30 00:17:57.527667 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:57.527633    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-594b58bf5d-hmvmk"
Jul 30 00:17:57.675670 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:57.675635    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-594b58bf5d-hmvmk"]
Jul 30 00:17:57.677503 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:17:57.677477    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf63cc435_1192_4f73_9a41_83295000cd12.slice/crio-624ee49f616f85da23d0c4730da54e210b0fcc59a10814c3411dff9c498b9fbd WatchSource:0}: Error finding container 624ee49f616f85da23d0c4730da54e210b0fcc59a10814c3411dff9c498b9fbd: Status 404 returned error can't find the container with id 624ee49f616f85da23d0c4730da54e210b0fcc59a10814c3411dff9c498b9fbd
Jul 30 00:17:57.678767 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:57.678747    2527 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 00:17:57.799061 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:57.798967    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-594b58bf5d-hmvmk" event={"ID":"f63cc435-1192-4f73-9a41-83295000cd12","Type":"ContainerStarted","Data":"624ee49f616f85da23d0c4730da54e210b0fcc59a10814c3411dff9c498b9fbd"}
Jul 30 00:17:58.808255 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:58.808209    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-594b58bf5d-hmvmk" event={"ID":"f63cc435-1192-4f73-9a41-83295000cd12","Type":"ContainerStarted","Data":"c4129f9cd3a2b3d655bbfb22ed68bc6752d9d58d669b6bc3b2565fff335a4899"}
Jul 30 00:17:58.856015 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:58.855946    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-594b58bf5d-hmvmk" podStartSLOduration=1.399885816 podStartE2EDuration="1.855921543s" totalImagesPullingTime="456.035727ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:17:58.82438784 +0000 UTC m=+953.126836187" watchObservedRunningTime="2026-07-30 00:17:58.855921543 +0000 UTC m=+953.158369905"
Jul 30 00:17:58.858514 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:58.858445    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5cbcf965f-lzq85"]
Jul 30 00:17:58.858693 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:58.858663    2527 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5cbcf965f-lzq85" podUID="12bd438f-28dd-4052-834a-98459bbb2027" containerName="authorino" containerID="cri-o://ba859728156e5ba333a191547fb58a7897296b5ddd892ef73846157994969277" gracePeriod=30
Jul 30 00:17:59.133187 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:59.133131    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cbcf965f-lzq85"
Jul 30 00:17:59.279148 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:59.279106    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/12bd438f-28dd-4052-834a-98459bbb2027-tls-cert\") pod \"12bd438f-28dd-4052-834a-98459bbb2027\" (UID: \"12bd438f-28dd-4052-834a-98459bbb2027\") "
Jul 30 00:17:59.279393 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:59.279237    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w25z2\" (UniqueName: \"kubernetes.io/projected/12bd438f-28dd-4052-834a-98459bbb2027-kube-api-access-w25z2\") pod \"12bd438f-28dd-4052-834a-98459bbb2027\" (UID: \"12bd438f-28dd-4052-834a-98459bbb2027\") "
Jul 30 00:17:59.281532 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:59.281493    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12bd438f-28dd-4052-834a-98459bbb2027-kube-api-access-w25z2" (OuterVolumeSpecName: "kube-api-access-w25z2") pod "12bd438f-28dd-4052-834a-98459bbb2027" (UID: "12bd438f-28dd-4052-834a-98459bbb2027"). InnerVolumeSpecName "kube-api-access-w25z2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:17:59.292925 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:59.292887    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12bd438f-28dd-4052-834a-98459bbb2027-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "12bd438f-28dd-4052-834a-98459bbb2027" (UID: "12bd438f-28dd-4052-834a-98459bbb2027"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:17:59.380085 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:59.380006    2527 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/12bd438f-28dd-4052-834a-98459bbb2027-tls-cert\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:17:59.380085 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:59.380040    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w25z2\" (UniqueName: \"kubernetes.io/projected/12bd438f-28dd-4052-834a-98459bbb2027-kube-api-access-w25z2\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:17:59.819873 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:59.819838    2527 generic.go:356] "Generic (PLEG): container finished" podID="12bd438f-28dd-4052-834a-98459bbb2027" containerID="ba859728156e5ba333a191547fb58a7897296b5ddd892ef73846157994969277" exitCode=0
Jul 30 00:17:59.820310 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:59.819898    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cbcf965f-lzq85"
Jul 30 00:17:59.820310 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:59.819922    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cbcf965f-lzq85" event={"ID":"12bd438f-28dd-4052-834a-98459bbb2027","Type":"ContainerDied","Data":"ba859728156e5ba333a191547fb58a7897296b5ddd892ef73846157994969277"}
Jul 30 00:17:59.820310 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:59.819971    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cbcf965f-lzq85" event={"ID":"12bd438f-28dd-4052-834a-98459bbb2027","Type":"ContainerDied","Data":"64b5edd8c8009444e44cb5fbe62bae49229593695eb8a98a940fbdaa4a552152"}
Jul 30 00:17:59.820310 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:59.819991    2527 scope.go:117] "RemoveContainer" containerID="ba859728156e5ba333a191547fb58a7897296b5ddd892ef73846157994969277"
Jul 30 00:17:59.830614 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:59.830594    2527 scope.go:117] "RemoveContainer" containerID="ba859728156e5ba333a191547fb58a7897296b5ddd892ef73846157994969277"
Jul 30 00:17:59.830954 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:17:59.830933    2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba859728156e5ba333a191547fb58a7897296b5ddd892ef73846157994969277\": container with ID starting with ba859728156e5ba333a191547fb58a7897296b5ddd892ef73846157994969277 not found: ID does not exist" containerID="ba859728156e5ba333a191547fb58a7897296b5ddd892ef73846157994969277"
Jul 30 00:17:59.831009 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:59.830964    2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba859728156e5ba333a191547fb58a7897296b5ddd892ef73846157994969277"} err="failed to get container status \"ba859728156e5ba333a191547fb58a7897296b5ddd892ef73846157994969277\": rpc error: code = NotFound desc = could not find container \"ba859728156e5ba333a191547fb58a7897296b5ddd892ef73846157994969277\": container with ID starting with ba859728156e5ba333a191547fb58a7897296b5ddd892ef73846157994969277 not found: ID does not exist"
Jul 30 00:17:59.843219 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:59.843181    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5cbcf965f-lzq85"]
Jul 30 00:17:59.850928 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:17:59.850898    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5cbcf965f-lzq85"]
Jul 30 00:18:00.219246 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:18:00.219213    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12bd438f-28dd-4052-834a-98459bbb2027" path="/var/lib/kubelet/pods/12bd438f-28dd-4052-834a-98459bbb2027/volumes"
Jul 30 00:18:30.307309 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:18:30.307225    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:18:39.798034 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:18:39.797995    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:18:46.466581 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:18:46.466544    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76889fd47d-vhmng"]
Jul 30 00:18:46.467049 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:18:46.466788    2527 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-76889fd47d-vhmng" podUID="6ba4141a-3649-4745-87b4-6a83870e34eb" containerName="manager" containerID="cri-o://2931b51f97cfe7e9b26f59f4205cde4cbf25361f2a6da36372b57959b1587c93" gracePeriod=30
Jul 30 00:18:46.732089 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:18:46.732018    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76889fd47d-vhmng"
Jul 30 00:18:46.834805 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:18:46.834766    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6ba4141a-3649-4745-87b4-6a83870e34eb-webhook-cert\") pod \"6ba4141a-3649-4745-87b4-6a83870e34eb\" (UID: \"6ba4141a-3649-4745-87b4-6a83870e34eb\") "
Jul 30 00:18:46.834977 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:18:46.834841    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqx6l\" (UniqueName: \"kubernetes.io/projected/6ba4141a-3649-4745-87b4-6a83870e34eb-kube-api-access-dqx6l\") pod \"6ba4141a-3649-4745-87b4-6a83870e34eb\" (UID: \"6ba4141a-3649-4745-87b4-6a83870e34eb\") "
Jul 30 00:18:46.837138 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:18:46.837100    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ba4141a-3649-4745-87b4-6a83870e34eb-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6ba4141a-3649-4745-87b4-6a83870e34eb" (UID: "6ba4141a-3649-4745-87b4-6a83870e34eb"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:18:46.837303 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:18:46.837179    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ba4141a-3649-4745-87b4-6a83870e34eb-kube-api-access-dqx6l" (OuterVolumeSpecName: "kube-api-access-dqx6l") pod "6ba4141a-3649-4745-87b4-6a83870e34eb" (UID: "6ba4141a-3649-4745-87b4-6a83870e34eb"). InnerVolumeSpecName "kube-api-access-dqx6l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:18:46.936544 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:18:46.936505    2527 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6ba4141a-3649-4745-87b4-6a83870e34eb-webhook-cert\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:18:46.936544 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:18:46.936538    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqx6l\" (UniqueName: \"kubernetes.io/projected/6ba4141a-3649-4745-87b4-6a83870e34eb-kube-api-access-dqx6l\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:18:47.118138 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:18:47.118050    2527 generic.go:356] "Generic (PLEG): container finished" podID="6ba4141a-3649-4745-87b4-6a83870e34eb" containerID="2931b51f97cfe7e9b26f59f4205cde4cbf25361f2a6da36372b57959b1587c93" exitCode=0
Jul 30 00:18:47.118138 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:18:47.118109    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76889fd47d-vhmng"
Jul 30 00:18:47.118344 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:18:47.118141    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76889fd47d-vhmng" event={"ID":"6ba4141a-3649-4745-87b4-6a83870e34eb","Type":"ContainerDied","Data":"2931b51f97cfe7e9b26f59f4205cde4cbf25361f2a6da36372b57959b1587c93"}
Jul 30 00:18:47.118344 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:18:47.118236    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76889fd47d-vhmng" event={"ID":"6ba4141a-3649-4745-87b4-6a83870e34eb","Type":"ContainerDied","Data":"c57130a1a66ac85c0816670fdf08343eee7e6c77d8d9db0c1fecafdff73ea536"}
Jul 30 00:18:47.118344 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:18:47.118259    2527 scope.go:117] "RemoveContainer" containerID="2931b51f97cfe7e9b26f59f4205cde4cbf25361f2a6da36372b57959b1587c93"
Jul 30 00:18:47.127996 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:18:47.127980    2527 scope.go:117] "RemoveContainer" containerID="2931b51f97cfe7e9b26f59f4205cde4cbf25361f2a6da36372b57959b1587c93"
Jul 30 00:18:47.128268 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:18:47.128247    2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2931b51f97cfe7e9b26f59f4205cde4cbf25361f2a6da36372b57959b1587c93\": container with ID starting with 2931b51f97cfe7e9b26f59f4205cde4cbf25361f2a6da36372b57959b1587c93 not found: ID does not exist" containerID="2931b51f97cfe7e9b26f59f4205cde4cbf25361f2a6da36372b57959b1587c93"
Jul 30 00:18:47.128333 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:18:47.128276    2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2931b51f97cfe7e9b26f59f4205cde4cbf25361f2a6da36372b57959b1587c93"} err="failed to get container status \"2931b51f97cfe7e9b26f59f4205cde4cbf25361f2a6da36372b57959b1587c93\": rpc error: code = NotFound desc = could not find container \"2931b51f97cfe7e9b26f59f4205cde4cbf25361f2a6da36372b57959b1587c93\": container with ID starting with 2931b51f97cfe7e9b26f59f4205cde4cbf25361f2a6da36372b57959b1587c93 not found: ID does not exist"
Jul 30 00:18:47.140254 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:18:47.140228    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76889fd47d-vhmng"]
Jul 30 00:18:47.144546 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:18:47.144522    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76889fd47d-vhmng"]
Jul 30 00:18:48.217357 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:18:48.217327    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ba4141a-3649-4745-87b4-6a83870e34eb" path="/var/lib/kubelet/pods/6ba4141a-3649-4745-87b4-6a83870e34eb/volumes"
Jul 30 00:18:48.704194 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:18:48.704144    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:19:47.946352 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:19:47.946306    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76889fd47d-x6gsq"]
Jul 30 00:19:47.946980 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:19:47.946946    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ba4141a-3649-4745-87b4-6a83870e34eb" containerName="manager"
Jul 30 00:19:47.946980 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:19:47.946963    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ba4141a-3649-4745-87b4-6a83870e34eb" containerName="manager"
Jul 30 00:19:47.946980 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:19:47.946979    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12bd438f-28dd-4052-834a-98459bbb2027" containerName="authorino"
Jul 30 00:19:47.947183 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:19:47.946987    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="12bd438f-28dd-4052-834a-98459bbb2027" containerName="authorino"
Jul 30 00:19:47.947183 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:19:47.947096    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="12bd438f-28dd-4052-834a-98459bbb2027" containerName="authorino"
Jul 30 00:19:47.947183 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:19:47.947111    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ba4141a-3649-4745-87b4-6a83870e34eb" containerName="manager"
Jul 30 00:19:47.950832 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:19:47.950807    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76889fd47d-x6gsq"
Jul 30 00:19:47.953640 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:19:47.953621    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 30 00:19:47.954518 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:19:47.954502    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-j78v9\""
Jul 30 00:19:47.954621 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:19:47.954604    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 30 00:19:47.959884 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:19:47.959860    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76889fd47d-x6gsq"]
Jul 30 00:19:47.989710 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:19:47.989667    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtsck\" (UniqueName: \"kubernetes.io/projected/eeb805e0-ed76-4d46-a967-8891183b5d5b-kube-api-access-jtsck\") pod \"maas-controller-76889fd47d-x6gsq\" (UID: \"eeb805e0-ed76-4d46-a967-8891183b5d5b\") " pod="opendatahub/maas-controller-76889fd47d-x6gsq"
Jul 30 00:19:47.989892 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:19:47.989741    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eeb805e0-ed76-4d46-a967-8891183b5d5b-webhook-cert\") pod \"maas-controller-76889fd47d-x6gsq\" (UID: \"eeb805e0-ed76-4d46-a967-8891183b5d5b\") " pod="opendatahub/maas-controller-76889fd47d-x6gsq"
Jul 30 00:19:48.090993 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:19:48.090946    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtsck\" (UniqueName: \"kubernetes.io/projected/eeb805e0-ed76-4d46-a967-8891183b5d5b-kube-api-access-jtsck\") pod \"maas-controller-76889fd47d-x6gsq\" (UID: \"eeb805e0-ed76-4d46-a967-8891183b5d5b\") " pod="opendatahub/maas-controller-76889fd47d-x6gsq"
Jul 30 00:19:48.091272 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:19:48.091003    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eeb805e0-ed76-4d46-a967-8891183b5d5b-webhook-cert\") pod \"maas-controller-76889fd47d-x6gsq\" (UID: \"eeb805e0-ed76-4d46-a967-8891183b5d5b\") " pod="opendatahub/maas-controller-76889fd47d-x6gsq"
Jul 30 00:19:48.093693 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:19:48.093667    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eeb805e0-ed76-4d46-a967-8891183b5d5b-webhook-cert\") pod \"maas-controller-76889fd47d-x6gsq\" (UID: \"eeb805e0-ed76-4d46-a967-8891183b5d5b\") " pod="opendatahub/maas-controller-76889fd47d-x6gsq"
Jul 30 00:19:48.098839 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:19:48.098819    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtsck\" (UniqueName: \"kubernetes.io/projected/eeb805e0-ed76-4d46-a967-8891183b5d5b-kube-api-access-jtsck\") pod \"maas-controller-76889fd47d-x6gsq\" (UID: \"eeb805e0-ed76-4d46-a967-8891183b5d5b\") " pod="opendatahub/maas-controller-76889fd47d-x6gsq"
Jul 30 00:19:48.263674 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:19:48.263578    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76889fd47d-x6gsq"
Jul 30 00:19:48.431894 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:19:48.425004    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76889fd47d-x6gsq"]
Jul 30 00:19:48.434013 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:19:48.433973    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeb805e0_ed76_4d46_a967_8891183b5d5b.slice/crio-0ac79bc6990231d05f40c6668ef8e571f4b5e444f8df14fc8c5323d81d8b9d34 WatchSource:0}: Error finding container 0ac79bc6990231d05f40c6668ef8e571f4b5e444f8df14fc8c5323d81d8b9d34: Status 404 returned error can't find the container with id 0ac79bc6990231d05f40c6668ef8e571f4b5e444f8df14fc8c5323d81d8b9d34
Jul 30 00:19:48.490422 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:19:48.490383    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76889fd47d-x6gsq" event={"ID":"eeb805e0-ed76-4d46-a967-8891183b5d5b","Type":"ContainerStarted","Data":"0ac79bc6990231d05f40c6668ef8e571f4b5e444f8df14fc8c5323d81d8b9d34"}
Jul 30 00:19:49.497412 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:19:49.497378    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76889fd47d-x6gsq" event={"ID":"eeb805e0-ed76-4d46-a967-8891183b5d5b","Type":"ContainerStarted","Data":"c8768a20f310bbd1e043c8672d553e2d8c59ffba0cdd9efeb78fad76e5f81798"}
Jul 30 00:19:49.497842 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:19:49.497490    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76889fd47d-x6gsq"
Jul 30 00:19:49.513822 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:19:49.513773    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76889fd47d-x6gsq" podStartSLOduration=1.911603814 podStartE2EDuration="2.513757156s" totalImagesPullingTime="602.153342ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:19:49.513383666 +0000 UTC m=+1063.815832012" watchObservedRunningTime="2026-07-30 00:19:49.513757156 +0000 UTC m=+1063.816205512"
Jul 30 00:20:00.506369 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:20:00.506288    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76889fd47d-x6gsq"
Jul 30 00:20:05.121131 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:20:05.121089    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76889fd47d-x6gsq"]
Jul 30 00:20:05.121558 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:20:05.121305    2527 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-76889fd47d-x6gsq" podUID="eeb805e0-ed76-4d46-a967-8891183b5d5b" containerName="manager" containerID="cri-o://c8768a20f310bbd1e043c8672d553e2d8c59ffba0cdd9efeb78fad76e5f81798" gracePeriod=30
Jul 30 00:20:05.386877 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:20:05.386812    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76889fd47d-x6gsq"
Jul 30 00:20:05.430549 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:20:05.430506    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eeb805e0-ed76-4d46-a967-8891183b5d5b-webhook-cert\") pod \"eeb805e0-ed76-4d46-a967-8891183b5d5b\" (UID: \"eeb805e0-ed76-4d46-a967-8891183b5d5b\") "
Jul 30 00:20:05.430770 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:20:05.430617    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtsck\" (UniqueName: \"kubernetes.io/projected/eeb805e0-ed76-4d46-a967-8891183b5d5b-kube-api-access-jtsck\") pod \"eeb805e0-ed76-4d46-a967-8891183b5d5b\" (UID: \"eeb805e0-ed76-4d46-a967-8891183b5d5b\") "
Jul 30 00:20:05.432917 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:20:05.432874    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeb805e0-ed76-4d46-a967-8891183b5d5b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "eeb805e0-ed76-4d46-a967-8891183b5d5b" (UID: "eeb805e0-ed76-4d46-a967-8891183b5d5b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:20:05.433047 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:20:05.432991    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeb805e0-ed76-4d46-a967-8891183b5d5b-kube-api-access-jtsck" (OuterVolumeSpecName: "kube-api-access-jtsck") pod "eeb805e0-ed76-4d46-a967-8891183b5d5b" (UID: "eeb805e0-ed76-4d46-a967-8891183b5d5b"). InnerVolumeSpecName "kube-api-access-jtsck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:20:05.532080 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:20:05.532046    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtsck\" (UniqueName: \"kubernetes.io/projected/eeb805e0-ed76-4d46-a967-8891183b5d5b-kube-api-access-jtsck\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:20:05.532080 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:20:05.532078    2527 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eeb805e0-ed76-4d46-a967-8891183b5d5b-webhook-cert\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:20:05.594852 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:20:05.594816    2527 generic.go:356] "Generic (PLEG): container finished" podID="eeb805e0-ed76-4d46-a967-8891183b5d5b" containerID="c8768a20f310bbd1e043c8672d553e2d8c59ffba0cdd9efeb78fad76e5f81798" exitCode=0
Jul 30 00:20:05.595115 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:20:05.594866    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76889fd47d-x6gsq"
Jul 30 00:20:05.595115 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:20:05.594861    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76889fd47d-x6gsq" event={"ID":"eeb805e0-ed76-4d46-a967-8891183b5d5b","Type":"ContainerDied","Data":"c8768a20f310bbd1e043c8672d553e2d8c59ffba0cdd9efeb78fad76e5f81798"}
Jul 30 00:20:05.595115 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:20:05.595002    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76889fd47d-x6gsq" event={"ID":"eeb805e0-ed76-4d46-a967-8891183b5d5b","Type":"ContainerDied","Data":"0ac79bc6990231d05f40c6668ef8e571f4b5e444f8df14fc8c5323d81d8b9d34"}
Jul 30 00:20:05.595115 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:20:05.595040    2527 scope.go:117] "RemoveContainer" containerID="c8768a20f310bbd1e043c8672d553e2d8c59ffba0cdd9efeb78fad76e5f81798"
Jul 30 00:20:05.605229 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:20:05.605206    2527 scope.go:117] "RemoveContainer" containerID="c8768a20f310bbd1e043c8672d553e2d8c59ffba0cdd9efeb78fad76e5f81798"
Jul 30 00:20:05.605499 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:20:05.605481    2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8768a20f310bbd1e043c8672d553e2d8c59ffba0cdd9efeb78fad76e5f81798\": container with ID starting with c8768a20f310bbd1e043c8672d553e2d8c59ffba0cdd9efeb78fad76e5f81798 not found: ID does not exist" containerID="c8768a20f310bbd1e043c8672d553e2d8c59ffba0cdd9efeb78fad76e5f81798"
Jul 30 00:20:05.605555 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:20:05.605510    2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8768a20f310bbd1e043c8672d553e2d8c59ffba0cdd9efeb78fad76e5f81798"} err="failed to get container status \"c8768a20f310bbd1e043c8672d553e2d8c59ffba0cdd9efeb78fad76e5f81798\": rpc error: code = NotFound desc = could not find container \"c8768a20f310bbd1e043c8672d553e2d8c59ffba0cdd9efeb78fad76e5f81798\": container with ID starting with c8768a20f310bbd1e043c8672d553e2d8c59ffba0cdd9efeb78fad76e5f81798 not found: ID does not exist"
Jul 30 00:20:05.616596 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:20:05.616572    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76889fd47d-x6gsq"]
Jul 30 00:20:05.619956 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:20:05.619929    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76889fd47d-x6gsq"]
Jul 30 00:20:06.217052 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:20:06.217016    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eeb805e0-ed76-4d46-a967-8891183b5d5b" path="/var/lib/kubelet/pods/eeb805e0-ed76-4d46-a967-8891183b5d5b/volumes"
Jul 30 00:20:29.799211 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:20:29.799171    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:20:40.200487 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:20:40.200447    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:21:10.199710 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:21:10.199674    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:21:19.599527 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:21:19.599486    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:21:29.002795 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:21:29.002702    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:21:35.097514 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:21:35.097477    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:21:45.808100 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:21:45.808058    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:21:56.403898 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:21:56.403861    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:22:07.498674 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:22:07.498640    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:22:09.767931 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:22:09.767901    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9cggv_c6b01a1f-c41e-4781-8c25-66b152e0d0e8/ovn-acl-logging/0.log"
Jul 30 00:22:09.772348 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:22:09.772322    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9cggv_c6b01a1f-c41e-4781-8c25-66b152e0d0e8/ovn-acl-logging/0.log"
Jul 30 00:22:16.803837 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:22:16.803796    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:22:41.504631 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:22:41.504595    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:22:53.602498 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:22:53.602464    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:23:18.405113 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:23:18.405026    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:23:29.797085 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:23:29.797043    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:23:39.311175 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:23:39.311138    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:23:55.602564 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:23:55.602525    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:24:09.359798 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:24:09.359757    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:24:23.595459 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:24:23.595415    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:24:33.203039 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:24:33.202749    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:24:58.350846 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:24:58.350806    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h74x9"]
Jul 30 00:24:58.351503 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:24:58.351034    2527 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h74x9" podUID="b50f22a8-ab93-4535-b6a5-7123eab6e7cd" containerName="manager" containerID="cri-o://42c971578fad6d39148bea8106a87afa35fe4a8ad55b4b07eb7a1cac5c86444e" gracePeriod=10
Jul 30 00:25:02.393531 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:02.393483    2527 generic.go:356] "Generic (PLEG): container finished" podID="b50f22a8-ab93-4535-b6a5-7123eab6e7cd" containerID="42c971578fad6d39148bea8106a87afa35fe4a8ad55b4b07eb7a1cac5c86444e" exitCode=0
Jul 30 00:25:02.393923 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:02.393561    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h74x9" event={"ID":"b50f22a8-ab93-4535-b6a5-7123eab6e7cd","Type":"ContainerDied","Data":"42c971578fad6d39148bea8106a87afa35fe4a8ad55b4b07eb7a1cac5c86444e"}
Jul 30 00:25:02.519776 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:02.519749    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h74x9"
Jul 30 00:25:02.645950 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:02.645859    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b50f22a8-ab93-4535-b6a5-7123eab6e7cd-extensions-socket-volume\") pod \"b50f22a8-ab93-4535-b6a5-7123eab6e7cd\" (UID: \"b50f22a8-ab93-4535-b6a5-7123eab6e7cd\") "
Jul 30 00:25:02.645950 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:02.645932    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65zl9\" (UniqueName: \"kubernetes.io/projected/b50f22a8-ab93-4535-b6a5-7123eab6e7cd-kube-api-access-65zl9\") pod \"b50f22a8-ab93-4535-b6a5-7123eab6e7cd\" (UID: \"b50f22a8-ab93-4535-b6a5-7123eab6e7cd\") "
Jul 30 00:25:02.646386 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:02.646356    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b50f22a8-ab93-4535-b6a5-7123eab6e7cd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b50f22a8-ab93-4535-b6a5-7123eab6e7cd" (UID: "b50f22a8-ab93-4535-b6a5-7123eab6e7cd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:25:02.648277 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:02.648249    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b50f22a8-ab93-4535-b6a5-7123eab6e7cd-kube-api-access-65zl9" (OuterVolumeSpecName: "kube-api-access-65zl9") pod "b50f22a8-ab93-4535-b6a5-7123eab6e7cd" (UID: "b50f22a8-ab93-4535-b6a5-7123eab6e7cd"). InnerVolumeSpecName "kube-api-access-65zl9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:25:02.747506 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:02.747455    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65zl9\" (UniqueName: \"kubernetes.io/projected/b50f22a8-ab93-4535-b6a5-7123eab6e7cd-kube-api-access-65zl9\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:25:02.747506 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:02.747499    2527 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b50f22a8-ab93-4535-b6a5-7123eab6e7cd-extensions-socket-volume\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:25:03.401471 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:03.401429    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h74x9" event={"ID":"b50f22a8-ab93-4535-b6a5-7123eab6e7cd","Type":"ContainerDied","Data":"3c9e3e9e86d8382f81c0a4f47abadf22371417bce669ca2c1c05a7b756bfee7e"}
Jul 30 00:25:03.401901 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:03.401497    2527 scope.go:117] "RemoveContainer" containerID="42c971578fad6d39148bea8106a87afa35fe4a8ad55b4b07eb7a1cac5c86444e"
Jul 30 00:25:03.401901 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:03.401446    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h74x9"
Jul 30 00:25:03.425844 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:03.425816    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h74x9"]
Jul 30 00:25:03.429940 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:03.429909    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h74x9"]
Jul 30 00:25:04.216574 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:04.216541    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b50f22a8-ab93-4535-b6a5-7123eab6e7cd" path="/var/lib/kubelet/pods/b50f22a8-ab93-4535-b6a5-7123eab6e7cd/volumes"
Jul 30 00:25:59.477464 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:59.477373    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n87j"]
Jul 30 00:25:59.479889 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:59.477866    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b50f22a8-ab93-4535-b6a5-7123eab6e7cd" containerName="manager"
Jul 30 00:25:59.479889 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:59.477878    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="b50f22a8-ab93-4535-b6a5-7123eab6e7cd" containerName="manager"
Jul 30 00:25:59.479889 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:59.477905    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeb805e0-ed76-4d46-a967-8891183b5d5b" containerName="manager"
Jul 30 00:25:59.479889 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:59.477910    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeb805e0-ed76-4d46-a967-8891183b5d5b" containerName="manager"
Jul 30 00:25:59.479889 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:59.477974    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="b50f22a8-ab93-4535-b6a5-7123eab6e7cd" containerName="manager"
Jul 30 00:25:59.479889 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:59.477983    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeb805e0-ed76-4d46-a967-8891183b5d5b" containerName="manager"
Jul 30 00:25:59.481012 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:59.480997    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n87j"
Jul 30 00:25:59.483684 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:59.483658    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-g8nlw\""
Jul 30 00:25:59.495504 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:59.495478    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n87j"]
Jul 30 00:25:59.577960 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:59.577910    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/562b861b-de2e-4e5b-b7f3-71930849a297-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7n87j\" (UID: \"562b861b-de2e-4e5b-b7f3-71930849a297\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n87j"
Jul 30 00:25:59.578221 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:59.577971    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkghd\" (UniqueName: \"kubernetes.io/projected/562b861b-de2e-4e5b-b7f3-71930849a297-kube-api-access-dkghd\") pod \"kuadrant-operator-controller-manager-86878c769f-7n87j\" (UID: \"562b861b-de2e-4e5b-b7f3-71930849a297\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n87j"
Jul 30 00:25:59.678920 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:59.678882    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/562b861b-de2e-4e5b-b7f3-71930849a297-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7n87j\" (UID: \"562b861b-de2e-4e5b-b7f3-71930849a297\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n87j"
Jul 30 00:25:59.679131 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:59.678928    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkghd\" (UniqueName: \"kubernetes.io/projected/562b861b-de2e-4e5b-b7f3-71930849a297-kube-api-access-dkghd\") pod \"kuadrant-operator-controller-manager-86878c769f-7n87j\" (UID: \"562b861b-de2e-4e5b-b7f3-71930849a297\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n87j"
Jul 30 00:25:59.679377 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:59.679351    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/562b861b-de2e-4e5b-b7f3-71930849a297-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7n87j\" (UID: \"562b861b-de2e-4e5b-b7f3-71930849a297\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n87j"
Jul 30 00:25:59.689391 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:59.689367    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkghd\" (UniqueName: \"kubernetes.io/projected/562b861b-de2e-4e5b-b7f3-71930849a297-kube-api-access-dkghd\") pod \"kuadrant-operator-controller-manager-86878c769f-7n87j\" (UID: \"562b861b-de2e-4e5b-b7f3-71930849a297\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n87j"
Jul 30 00:25:59.792137 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:59.792036    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n87j"
Jul 30 00:25:59.946416 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:25:59.946383    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n87j"]
Jul 30 00:25:59.950518 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:25:59.950491    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod562b861b_de2e_4e5b_b7f3_71930849a297.slice/crio-52d8ef2a58cdbaa3c4140929f930ce7faf3352ab844c17988774db5e6938fcda WatchSource:0}: Error finding container 52d8ef2a58cdbaa3c4140929f930ce7faf3352ab844c17988774db5e6938fcda: Status 404 returned error can't find the container with id 52d8ef2a58cdbaa3c4140929f930ce7faf3352ab844c17988774db5e6938fcda
Jul 30 00:26:00.732461 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:26:00.732414    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n87j" event={"ID":"562b861b-de2e-4e5b-b7f3-71930849a297","Type":"ContainerStarted","Data":"2e67654e664f0a8604976a95b849bc413acf764272115e951d9ac5984104ddf8"}
Jul 30 00:26:00.732867 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:26:00.732488    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n87j"
Jul 30 00:26:00.732867 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:26:00.732505    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n87j" event={"ID":"562b861b-de2e-4e5b-b7f3-71930849a297","Type":"ContainerStarted","Data":"52d8ef2a58cdbaa3c4140929f930ce7faf3352ab844c17988774db5e6938fcda"}
Jul 30 00:26:00.755044 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:26:00.754981    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n87j" podStartSLOduration=1.754961328 podStartE2EDuration="1.754961328s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:25:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:26:00.753259978 +0000 UTC m=+1435.055708320" watchObservedRunningTime="2026-07-30 00:26:00.754961328 +0000 UTC m=+1435.057409673"
Jul 30 00:26:11.740629 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:26:11.740591    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7n87j"
Jul 30 00:26:21.405294 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:26:21.405255    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:26:33.200192 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:26:33.200141    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:26:46.699345 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:26:46.699299    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:26:58.613155 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:26:58.613120    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:27:08.497341 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:27:08.497301    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:27:09.806617 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:27:09.806590    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9cggv_c6b01a1f-c41e-4781-8c25-66b152e0d0e8/ovn-acl-logging/0.log"
Jul 30 00:27:09.812747 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:27:09.812726    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9cggv_c6b01a1f-c41e-4781-8c25-66b152e0d0e8/ovn-acl-logging/0.log"
Jul 30 00:27:20.698472 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:27:20.698434    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:27:28.998656 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:27:28.998561    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:27:39.997008 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:27:39.996968    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:27:50.100449 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:27:50.100408    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:28:00.710737 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:28:00.710698    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:28:12.900319 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:28:12.900281    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:28:34.203251 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:28:34.203217    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:28:43.700361 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:28:43.700324    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:28:54.405971 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:28:54.405937    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:29:10.599269 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:29:10.599237    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:29:29.001866 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:29:29.001833    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:29:43.504246 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:29:43.504212    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:29:54.002973 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:29:54.002938    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:30:00.130793 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:30:00.130758    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29756190-2nn72"]
Jul 30 00:30:00.134637 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:30:00.134619    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756190-2nn72"
Jul 30 00:30:00.137110 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:30:00.137088    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t42rq\""
Jul 30 00:30:00.142031 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:30:00.142002    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29756190-2nn72"]
Jul 30 00:30:00.147186 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:30:00.147139    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756190-2nn72"
Jul 30 00:30:00.303520 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:30:00.303495    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29756190-2nn72"]
Jul 30 00:30:00.304716 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:30:00.304688    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb23a8ac9_66c7_4985_b2df_f0afd6bde8f9.slice/crio-8b44155cfe6439adc94dedac7acbb67dbb15ea35511497c758123a6bd92661c3 WatchSource:0}: Error finding container 8b44155cfe6439adc94dedac7acbb67dbb15ea35511497c758123a6bd92661c3: Status 404 returned error can't find the container with id 8b44155cfe6439adc94dedac7acbb67dbb15ea35511497c758123a6bd92661c3
Jul 30 00:30:00.306583 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:30:00.306568    2527 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 00:30:01.188502 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:30:01.188461    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756190-2nn72" event={"ID":"b23a8ac9-66c7-4985-b2df-f0afd6bde8f9","Type":"ContainerStarted","Data":"8b44155cfe6439adc94dedac7acbb67dbb15ea35511497c758123a6bd92661c3"}
Jul 30 00:30:03.203759 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:30:03.203717    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756190-2nn72" event={"ID":"b23a8ac9-66c7-4985-b2df-f0afd6bde8f9","Type":"ContainerStarted","Data":"a966e3121a990b5efb12921d66cf6871b2f1f0d6c7538a5cf2acdf1db06b9f7c"}
Jul 30 00:30:03.220218 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:30:03.220145    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756190-2nn72" podStartSLOduration=0.788584651 podStartE2EDuration="3.220128393s" totalImagesPullingTime="2.431543742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:30:03.217893963 +0000 UTC m=+1677.520342310" watchObservedRunningTime="2026-07-30 00:30:03.220128393 +0000 UTC m=+1677.522576797"
Jul 30 00:30:04.212420 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:30:04.212388    2527 generic.go:356] "Generic (PLEG): container finished" podID="b23a8ac9-66c7-4985-b2df-f0afd6bde8f9" containerID="a966e3121a990b5efb12921d66cf6871b2f1f0d6c7538a5cf2acdf1db06b9f7c" exitCode=0
Jul 30 00:30:04.216877 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:30:04.216847    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756190-2nn72" event={"ID":"b23a8ac9-66c7-4985-b2df-f0afd6bde8f9","Type":"ContainerDied","Data":"a966e3121a990b5efb12921d66cf6871b2f1f0d6c7538a5cf2acdf1db06b9f7c"}
Jul 30 00:30:05.366076 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:30:05.366051    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756190-2nn72"
Jul 30 00:30:06.224766 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:30:06.224735    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756190-2nn72"
Jul 30 00:30:06.224951 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:30:06.224828    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756190-2nn72" event={"ID":"b23a8ac9-66c7-4985-b2df-f0afd6bde8f9","Type":"ContainerDied","Data":"8b44155cfe6439adc94dedac7acbb67dbb15ea35511497c758123a6bd92661c3"}
Jul 30 00:30:06.224951 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:30:06.224875    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b44155cfe6439adc94dedac7acbb67dbb15ea35511497c758123a6bd92661c3"
Jul 30 00:30:06.809350 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:30:06.809312    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:30:16.964888 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:30:16.964849    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:30:26.398694 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:30:26.398651    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:30:37.194577 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:30:37.194492    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:30:46.406133 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:30:46.406095    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:30:57.109343 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:30:57.109305    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:31:09.406887 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:31:09.406849    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:31:22.801416 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:31:22.801381    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:31:32.096720 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:31:32.096675    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:31:42.307587 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:31:42.307547    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:31:54.898893 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:31:54.898841    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:32:09.848937 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:32:09.848904    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9cggv_c6b01a1f-c41e-4781-8c25-66b152e0d0e8/ovn-acl-logging/0.log"
Jul 30 00:32:09.856956 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:32:09.856925    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9cggv_c6b01a1f-c41e-4781-8c25-66b152e0d0e8/ovn-acl-logging/0.log"
Jul 30 00:32:11.102914 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:32:11.102874    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:32:24.100070 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:32:24.100033    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:32:33.696459 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:32:33.696411    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:32:48.201429 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:32:48.201388    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:33:01.313064 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:01.313027    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:33:11.308738 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:11.308698    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9092d698-644549c9df-9cdfq"]
Jul 30 00:33:11.309264 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:11.309246    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b23a8ac9-66c7-4985-b2df-f0afd6bde8f9" containerName="cleanup"
Jul 30 00:33:11.309321 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:11.309267    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="b23a8ac9-66c7-4985-b2df-f0afd6bde8f9" containerName="cleanup"
Jul 30 00:33:11.309357 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:11.309349    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="b23a8ac9-66c7-4985-b2df-f0afd6bde8f9" containerName="cleanup"
Jul 30 00:33:11.312553 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:11.312530    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9092d698-644549c9df-9cdfq"
Jul 30 00:33:11.314730 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:11.314695    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-9092d698-serving-cert\""
Jul 30 00:33:11.314886 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:11.314848    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 00:33:11.314999 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:11.314981    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 30 00:33:11.315727 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:11.315711    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wft5v\""
Jul 30 00:33:11.323431 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:11.323403    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9092d698-644549c9df-9cdfq"]
Jul 30 00:33:11.338709 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:11.338661    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dfdf654-8264-4bdf-bc46-948099d855f2-maas-api-tls\") pod \"maas-api-e2e-ait-9092d698-644549c9df-9cdfq\" (UID: \"9dfdf654-8264-4bdf-bc46-948099d855f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9092d698-644549c9df-9cdfq"
Jul 30 00:33:11.338868 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:11.338726    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dfdf654-8264-4bdf-bc46-948099d855f2-openshift-service-ca\") pod \"maas-api-e2e-ait-9092d698-644549c9df-9cdfq\" (UID: \"9dfdf654-8264-4bdf-bc46-948099d855f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9092d698-644549c9df-9cdfq"
Jul 30 00:33:11.338868 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:11.338774    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kzb2\" (UniqueName: \"kubernetes.io/projected/9dfdf654-8264-4bdf-bc46-948099d855f2-kube-api-access-9kzb2\") pod \"maas-api-e2e-ait-9092d698-644549c9df-9cdfq\" (UID: \"9dfdf654-8264-4bdf-bc46-948099d855f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9092d698-644549c9df-9cdfq"
Jul 30 00:33:11.439765 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:11.439729    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dfdf654-8264-4bdf-bc46-948099d855f2-maas-api-tls\") pod \"maas-api-e2e-ait-9092d698-644549c9df-9cdfq\" (UID: \"9dfdf654-8264-4bdf-bc46-948099d855f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9092d698-644549c9df-9cdfq"
Jul 30 00:33:11.439765 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:11.439769    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dfdf654-8264-4bdf-bc46-948099d855f2-openshift-service-ca\") pod \"maas-api-e2e-ait-9092d698-644549c9df-9cdfq\" (UID: \"9dfdf654-8264-4bdf-bc46-948099d855f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9092d698-644549c9df-9cdfq"
Jul 30 00:33:11.440049 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:11.439803    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kzb2\" (UniqueName: \"kubernetes.io/projected/9dfdf654-8264-4bdf-bc46-948099d855f2-kube-api-access-9kzb2\") pod \"maas-api-e2e-ait-9092d698-644549c9df-9cdfq\" (UID: \"9dfdf654-8264-4bdf-bc46-948099d855f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9092d698-644549c9df-9cdfq"
Jul 30 00:33:11.440494 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:11.440469    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dfdf654-8264-4bdf-bc46-948099d855f2-openshift-service-ca\") pod \"maas-api-e2e-ait-9092d698-644549c9df-9cdfq\" (UID: \"9dfdf654-8264-4bdf-bc46-948099d855f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9092d698-644549c9df-9cdfq"
Jul 30 00:33:11.442652 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:11.442620    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dfdf654-8264-4bdf-bc46-948099d855f2-maas-api-tls\") pod \"maas-api-e2e-ait-9092d698-644549c9df-9cdfq\" (UID: \"9dfdf654-8264-4bdf-bc46-948099d855f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9092d698-644549c9df-9cdfq"
Jul 30 00:33:11.450551 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:11.450521    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kzb2\" (UniqueName: \"kubernetes.io/projected/9dfdf654-8264-4bdf-bc46-948099d855f2-kube-api-access-9kzb2\") pod \"maas-api-e2e-ait-9092d698-644549c9df-9cdfq\" (UID: \"9dfdf654-8264-4bdf-bc46-948099d855f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9092d698-644549c9df-9cdfq"
Jul 30 00:33:11.625215 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:11.625099    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9092d698-644549c9df-9cdfq"
Jul 30 00:33:11.776564 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:11.776521    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9092d698-644549c9df-9cdfq"]
Jul 30 00:33:11.779081 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:33:11.779053    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dfdf654_8264_4bdf_bc46_948099d855f2.slice/crio-faef5ea0ce5b80611c654ca4cf0d1682a7be73064952b29c7c59dff785f18f08 WatchSource:0}: Error finding container faef5ea0ce5b80611c654ca4cf0d1682a7be73064952b29c7c59dff785f18f08: Status 404 returned error can't find the container with id faef5ea0ce5b80611c654ca4cf0d1682a7be73064952b29c7c59dff785f18f08
Jul 30 00:33:12.372571 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:12.372533    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9092d698-644549c9df-9cdfq" event={"ID":"9dfdf654-8264-4bdf-bc46-948099d855f2","Type":"ContainerStarted","Data":"faef5ea0ce5b80611c654ca4cf0d1682a7be73064952b29c7c59dff785f18f08"}
Jul 30 00:33:14.396920 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:14.396879    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9092d698-644549c9df-9cdfq" event={"ID":"9dfdf654-8264-4bdf-bc46-948099d855f2","Type":"ContainerStarted","Data":"fbb34fbb67aa46f8dd4962962cce60f6a6e047a69eb8ca3b9967a4dbc614f91c"}
Jul 30 00:33:14.397317 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:14.396947    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9092d698-644549c9df-9cdfq"
Jul 30 00:33:14.415232 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:14.415131    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9092d698-644549c9df-9cdfq" podStartSLOduration=1.872421118 podStartE2EDuration="3.415116163s" totalImagesPullingTime="1.542695045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:33:14.414258728 +0000 UTC m=+1868.716707076" watchObservedRunningTime="2026-07-30 00:33:14.415116163 +0000 UTC m=+1868.717564519"
Jul 30 00:33:17.401944 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:17.401912    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:33:20.408691 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:20.408662    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9092d698-644549c9df-9cdfq"
Jul 30 00:33:35.770948 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:35.770859    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9092d698-4kv56"]
Jul 30 00:33:35.775006 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:35.774987    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9092d698-4kv56"
Jul 30 00:33:35.777670 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:35.777642    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t42rq\""
Jul 30 00:33:35.781011 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:35.780987    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9092d698-4kv56"]
Jul 30 00:33:35.877531 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:35.877488    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e347093-6a6b-47a4-aaa7-b229871220f9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9092d698-4kv56\" (UID: \"9e347093-6a6b-47a4-aaa7-b229871220f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9092d698-4kv56"
Jul 30 00:33:35.978310 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:35.978273    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e347093-6a6b-47a4-aaa7-b229871220f9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9092d698-4kv56\" (UID: \"9e347093-6a6b-47a4-aaa7-b229871220f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9092d698-4kv56"
Jul 30 00:33:35.978943 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:35.978920    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e347093-6a6b-47a4-aaa7-b229871220f9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9092d698-4kv56\" (UID: \"9e347093-6a6b-47a4-aaa7-b229871220f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9092d698-4kv56"
Jul 30 00:33:36.090255 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:36.090095    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9092d698-4kv56"
Jul 30 00:33:36.229560 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:36.229536    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9092d698-4kv56"]
Jul 30 00:33:36.231857 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:33:36.231829    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e347093_6a6b_47a4_aaa7_b229871220f9.slice/crio-f3e7205a3b678a6a04e92804a53c7f21aa673540e86f4018acd5b6ccf044e7d9 WatchSource:0}: Error finding container f3e7205a3b678a6a04e92804a53c7f21aa673540e86f4018acd5b6ccf044e7d9: Status 404 returned error can't find the container with id f3e7205a3b678a6a04e92804a53c7f21aa673540e86f4018acd5b6ccf044e7d9
Jul 30 00:33:36.542842 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:36.542805    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9092d698-4kv56" event={"ID":"9e347093-6a6b-47a4-aaa7-b229871220f9","Type":"ContainerStarted","Data":"f3e7205a3b678a6a04e92804a53c7f21aa673540e86f4018acd5b6ccf044e7d9"}
Jul 30 00:33:37.551231 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:37.551190    2527 generic.go:356] "Generic (PLEG): container finished" podID="9e347093-6a6b-47a4-aaa7-b229871220f9" containerID="9d9797c4f7ac43d810c302e52a29d563f9a99097e8028102f7fe5050b93f2cb3" exitCode=0
Jul 30 00:33:37.551654 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:37.551263    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9092d698-4kv56" event={"ID":"9e347093-6a6b-47a4-aaa7-b229871220f9","Type":"ContainerDied","Data":"9d9797c4f7ac43d810c302e52a29d563f9a99097e8028102f7fe5050b93f2cb3"}
Jul 30 00:33:38.705632 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:38.705604    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9092d698-4kv56"
Jul 30 00:33:38.805430 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:38.805387    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e347093-6a6b-47a4-aaa7-b229871220f9-maas-api-service-ca\") pod \"9e347093-6a6b-47a4-aaa7-b229871220f9\" (UID: \"9e347093-6a6b-47a4-aaa7-b229871220f9\") "
Jul 30 00:33:38.805856 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:38.805833    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e347093-6a6b-47a4-aaa7-b229871220f9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9e347093-6a6b-47a4-aaa7-b229871220f9" (UID: "9e347093-6a6b-47a4-aaa7-b229871220f9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:33:38.907123 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:38.907030    2527 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e347093-6a6b-47a4-aaa7-b229871220f9-maas-api-service-ca\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:33:39.563761 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:39.563732    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9092d698-4kv56"
Jul 30 00:33:39.563937 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:39.563795    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9092d698-4kv56" event={"ID":"9e347093-6a6b-47a4-aaa7-b229871220f9","Type":"ContainerDied","Data":"f3e7205a3b678a6a04e92804a53c7f21aa673540e86f4018acd5b6ccf044e7d9"}
Jul 30 00:33:39.563937 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:39.563844    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3e7205a3b678a6a04e92804a53c7f21aa673540e86f4018acd5b6ccf044e7d9"
Jul 30 00:33:41.738649 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:41.738615    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9092d698-644549c9df-9cdfq"]
Jul 30 00:33:41.739139 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:41.738885    2527 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9092d698-644549c9df-9cdfq" podUID="9dfdf654-8264-4bdf-bc46-948099d855f2" containerName="maas-api" containerID="cri-o://fbb34fbb67aa46f8dd4962962cce60f6a6e047a69eb8ca3b9967a4dbc614f91c" gracePeriod=30
Jul 30 00:33:41.915516 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:41.915465    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9092d698-4kv56"]
Jul 30 00:33:41.919087 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:41.919057    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9092d698-4kv56"]
Jul 30 00:33:42.010898 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:42.010866    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9092d698-644549c9df-9cdfq"
Jul 30 00:33:42.136849 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:42.136816    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dfdf654-8264-4bdf-bc46-948099d855f2-openshift-service-ca\") pod \"9dfdf654-8264-4bdf-bc46-948099d855f2\" (UID: \"9dfdf654-8264-4bdf-bc46-948099d855f2\") "
Jul 30 00:33:42.137028 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:42.136904    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dfdf654-8264-4bdf-bc46-948099d855f2-maas-api-tls\") pod \"9dfdf654-8264-4bdf-bc46-948099d855f2\" (UID: \"9dfdf654-8264-4bdf-bc46-948099d855f2\") "
Jul 30 00:33:42.137028 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:42.136924    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kzb2\" (UniqueName: \"kubernetes.io/projected/9dfdf654-8264-4bdf-bc46-948099d855f2-kube-api-access-9kzb2\") pod \"9dfdf654-8264-4bdf-bc46-948099d855f2\" (UID: \"9dfdf654-8264-4bdf-bc46-948099d855f2\") "
Jul 30 00:33:42.137306 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:42.137268    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dfdf654-8264-4bdf-bc46-948099d855f2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9dfdf654-8264-4bdf-bc46-948099d855f2" (UID: "9dfdf654-8264-4bdf-bc46-948099d855f2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:33:42.139377 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:42.139355    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dfdf654-8264-4bdf-bc46-948099d855f2-kube-api-access-9kzb2" (OuterVolumeSpecName: "kube-api-access-9kzb2") pod "9dfdf654-8264-4bdf-bc46-948099d855f2" (UID: "9dfdf654-8264-4bdf-bc46-948099d855f2"). InnerVolumeSpecName "kube-api-access-9kzb2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:33:42.139498 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:42.139381    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dfdf654-8264-4bdf-bc46-948099d855f2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9dfdf654-8264-4bdf-bc46-948099d855f2" (UID: "9dfdf654-8264-4bdf-bc46-948099d855f2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:33:42.217588 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:42.217549    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e347093-6a6b-47a4-aaa7-b229871220f9" path="/var/lib/kubelet/pods/9e347093-6a6b-47a4-aaa7-b229871220f9/volumes"
Jul 30 00:33:42.237635 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:42.237589    2527 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dfdf654-8264-4bdf-bc46-948099d855f2-maas-api-tls\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:33:42.237635 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:42.237632    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kzb2\" (UniqueName: \"kubernetes.io/projected/9dfdf654-8264-4bdf-bc46-948099d855f2-kube-api-access-9kzb2\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:33:42.237635 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:42.237643    2527 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dfdf654-8264-4bdf-bc46-948099d855f2-openshift-service-ca\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:33:42.583583 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:42.583542    2527 generic.go:356] "Generic (PLEG): container finished" podID="9dfdf654-8264-4bdf-bc46-948099d855f2" containerID="fbb34fbb67aa46f8dd4962962cce60f6a6e047a69eb8ca3b9967a4dbc614f91c" exitCode=0
Jul 30 00:33:42.583583 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:42.583581    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9092d698-644549c9df-9cdfq"
Jul 30 00:33:42.583806 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:42.583623    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9092d698-644549c9df-9cdfq" event={"ID":"9dfdf654-8264-4bdf-bc46-948099d855f2","Type":"ContainerDied","Data":"fbb34fbb67aa46f8dd4962962cce60f6a6e047a69eb8ca3b9967a4dbc614f91c"}
Jul 30 00:33:42.583806 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:42.583689    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9092d698-644549c9df-9cdfq" event={"ID":"9dfdf654-8264-4bdf-bc46-948099d855f2","Type":"ContainerDied","Data":"faef5ea0ce5b80611c654ca4cf0d1682a7be73064952b29c7c59dff785f18f08"}
Jul 30 00:33:42.583806 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:42.583717    2527 scope.go:117] "RemoveContainer" containerID="fbb34fbb67aa46f8dd4962962cce60f6a6e047a69eb8ca3b9967a4dbc614f91c"
Jul 30 00:33:42.596730 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:42.596700    2527 scope.go:117] "RemoveContainer" containerID="fbb34fbb67aa46f8dd4962962cce60f6a6e047a69eb8ca3b9967a4dbc614f91c"
Jul 30 00:33:42.597191 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:33:42.597144    2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbb34fbb67aa46f8dd4962962cce60f6a6e047a69eb8ca3b9967a4dbc614f91c\": container with ID starting with fbb34fbb67aa46f8dd4962962cce60f6a6e047a69eb8ca3b9967a4dbc614f91c not found: ID does not exist" containerID="fbb34fbb67aa46f8dd4962962cce60f6a6e047a69eb8ca3b9967a4dbc614f91c"
Jul 30 00:33:42.597293 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:42.597206    2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbb34fbb67aa46f8dd4962962cce60f6a6e047a69eb8ca3b9967a4dbc614f91c"} err="failed to get container status \"fbb34fbb67aa46f8dd4962962cce60f6a6e047a69eb8ca3b9967a4dbc614f91c\": rpc error: code = NotFound desc = could not find container \"fbb34fbb67aa46f8dd4962962cce60f6a6e047a69eb8ca3b9967a4dbc614f91c\": container with ID starting with fbb34fbb67aa46f8dd4962962cce60f6a6e047a69eb8ca3b9967a4dbc614f91c not found: ID does not exist"
Jul 30 00:33:42.602644 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:42.602617    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9092d698-644549c9df-9cdfq"]
Jul 30 00:33:42.606603 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:42.606578    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9092d698-644549c9df-9cdfq"]
Jul 30 00:33:44.216977 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:44.216941    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dfdf654-8264-4bdf-bc46-948099d855f2" path="/var/lib/kubelet/pods/9dfdf654-8264-4bdf-bc46-948099d855f2/volumes"
Jul 30 00:33:45.577540 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:45.577504    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr"]
Jul 30 00:33:45.578190 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:45.578136    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dfdf654-8264-4bdf-bc46-948099d855f2" containerName="maas-api"
Jul 30 00:33:45.578190 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:45.578177    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dfdf654-8264-4bdf-bc46-948099d855f2" containerName="maas-api"
Jul 30 00:33:45.578389 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:45.578227    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e347093-6a6b-47a4-aaa7-b229871220f9" containerName="revoke-keys"
Jul 30 00:33:45.578389 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:45.578238    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e347093-6a6b-47a4-aaa7-b229871220f9" containerName="revoke-keys"
Jul 30 00:33:45.578389 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:45.578355    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e347093-6a6b-47a4-aaa7-b229871220f9" containerName="revoke-keys"
Jul 30 00:33:45.578389 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:45.578373    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dfdf654-8264-4bdf-bc46-948099d855f2" containerName="maas-api"
Jul 30 00:33:45.583015 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:45.582994    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr"
Jul 30 00:33:45.585675 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:45.585649    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-e5dec626-serving-cert\""
Jul 30 00:33:45.585825 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:45.585712    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wft5v\""
Jul 30 00:33:45.586572 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:45.586549    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 00:33:45.586832 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:45.586811    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 30 00:33:45.591192 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:45.591136    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr"]
Jul 30 00:33:45.704934 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:45.704896    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:33:45.776287 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:45.776238    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7bkn\" (UniqueName: \"kubernetes.io/projected/b523b63b-34a0-4b8e-b791-8d2dc1b75d4e-kube-api-access-g7bkn\") pod \"maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr\" (UID: \"b523b63b-34a0-4b8e-b791-8d2dc1b75d4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr"
Jul 30 00:33:45.776287 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:45.776285    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b523b63b-34a0-4b8e-b791-8d2dc1b75d4e-openshift-service-ca\") pod \"maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr\" (UID: \"b523b63b-34a0-4b8e-b791-8d2dc1b75d4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr"
Jul 30 00:33:45.776523 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:45.776345    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b523b63b-34a0-4b8e-b791-8d2dc1b75d4e-maas-api-tls\") pod \"maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr\" (UID: \"b523b63b-34a0-4b8e-b791-8d2dc1b75d4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr"
Jul 30 00:33:45.877839 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:45.877726    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7bkn\" (UniqueName: \"kubernetes.io/projected/b523b63b-34a0-4b8e-b791-8d2dc1b75d4e-kube-api-access-g7bkn\") pod \"maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr\" (UID: \"b523b63b-34a0-4b8e-b791-8d2dc1b75d4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr"
Jul 30 00:33:45.877839 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:45.877796    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b523b63b-34a0-4b8e-b791-8d2dc1b75d4e-openshift-service-ca\") pod \"maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr\" (UID: \"b523b63b-34a0-4b8e-b791-8d2dc1b75d4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr"
Jul 30 00:33:45.877839 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:45.877839    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b523b63b-34a0-4b8e-b791-8d2dc1b75d4e-maas-api-tls\") pod \"maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr\" (UID: \"b523b63b-34a0-4b8e-b791-8d2dc1b75d4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr"
Jul 30 00:33:45.878189 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:33:45.878013    2527 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-e5dec626-serving-cert: secret "maas-api-e2e-migrate-e5dec626-serving-cert" not found
Jul 30 00:33:45.878189 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:33:45.878125    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b523b63b-34a0-4b8e-b791-8d2dc1b75d4e-maas-api-tls podName:b523b63b-34a0-4b8e-b791-8d2dc1b75d4e nodeName:}" failed. No retries permitted until 2026-07-30 00:33:46.378105413 +0000 UTC m=+1900.680553736 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b523b63b-34a0-4b8e-b791-8d2dc1b75d4e-maas-api-tls") pod "maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr" (UID: "b523b63b-34a0-4b8e-b791-8d2dc1b75d4e") : secret "maas-api-e2e-migrate-e5dec626-serving-cert" not found
Jul 30 00:33:45.878596 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:45.878574    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b523b63b-34a0-4b8e-b791-8d2dc1b75d4e-openshift-service-ca\") pod \"maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr\" (UID: \"b523b63b-34a0-4b8e-b791-8d2dc1b75d4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr"
Jul 30 00:33:45.894944 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:45.894914    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7bkn\" (UniqueName: \"kubernetes.io/projected/b523b63b-34a0-4b8e-b791-8d2dc1b75d4e-kube-api-access-g7bkn\") pod \"maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr\" (UID: \"b523b63b-34a0-4b8e-b791-8d2dc1b75d4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr"
Jul 30 00:33:46.381827 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:46.381783    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b523b63b-34a0-4b8e-b791-8d2dc1b75d4e-maas-api-tls\") pod \"maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr\" (UID: \"b523b63b-34a0-4b8e-b791-8d2dc1b75d4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr"
Jul 30 00:33:46.384478 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:46.384453    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b523b63b-34a0-4b8e-b791-8d2dc1b75d4e-maas-api-tls\") pod \"maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr\" (UID: \"b523b63b-34a0-4b8e-b791-8d2dc1b75d4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr"
Jul 30 00:33:46.497382 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:46.497326    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr"
Jul 30 00:33:46.647806 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:33:46.647759    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb523b63b_34a0_4b8e_b791_8d2dc1b75d4e.slice/crio-ed2fff4596bd851edd28d8a3f44f774682f1df3dbf299b7adb848119d19ca930 WatchSource:0}: Error finding container ed2fff4596bd851edd28d8a3f44f774682f1df3dbf299b7adb848119d19ca930: Status 404 returned error can't find the container with id ed2fff4596bd851edd28d8a3f44f774682f1df3dbf299b7adb848119d19ca930
Jul 30 00:33:46.650609 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:46.650580    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr"]
Jul 30 00:33:47.616955 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:47.616922    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr" event={"ID":"b523b63b-34a0-4b8e-b791-8d2dc1b75d4e","Type":"ContainerStarted","Data":"e8ee4618837a5afa5f730c436a974b31b70c84a45972db64cf2a584252af8569"}
Jul 30 00:33:47.617148 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:47.616974    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr" event={"ID":"b523b63b-34a0-4b8e-b791-8d2dc1b75d4e","Type":"ContainerStarted","Data":"ed2fff4596bd851edd28d8a3f44f774682f1df3dbf299b7adb848119d19ca930"}
Jul 30 00:33:47.617148 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:47.617058    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr"
Jul 30 00:33:47.634658 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:47.634597    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr" podStartSLOduration=2.302496548 podStartE2EDuration="2.634583662s" totalImagesPullingTime="332.087114ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:33:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:33:47.631773839 +0000 UTC m=+1901.934222208" watchObservedRunningTime="2026-07-30 00:33:47.634583662 +0000 UTC m=+1901.937032007"
Jul 30 00:33:53.630255 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:53.630215    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr"
Jul 30 00:33:56.500547 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:33:56.500509    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:34:10.488262 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:10.488221    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5dec626-2b592"]
Jul 30 00:34:10.492008 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:10.491990    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5dec626-2b592"
Jul 30 00:34:10.494772 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:10.494741    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t42rq\""
Jul 30 00:34:10.498212 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:10.498188    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5dec626-2b592"]
Jul 30 00:34:10.616085 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:10.616048    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b568b463-e342-44ce-8840-eac424c60b42-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-e5dec626-2b592\" (UID: \"b568b463-e342-44ce-8840-eac424c60b42\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5dec626-2b592"
Jul 30 00:34:10.716970 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:10.716925    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b568b463-e342-44ce-8840-eac424c60b42-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-e5dec626-2b592\" (UID: \"b568b463-e342-44ce-8840-eac424c60b42\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5dec626-2b592"
Jul 30 00:34:10.717592 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:10.717570    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b568b463-e342-44ce-8840-eac424c60b42-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-e5dec626-2b592\" (UID: \"b568b463-e342-44ce-8840-eac424c60b42\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5dec626-2b592"
Jul 30 00:34:10.805054 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:10.804967    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5dec626-2b592"
Jul 30 00:34:10.946769 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:10.946743    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5dec626-2b592"]
Jul 30 00:34:10.949537 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:34:10.949510    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb568b463_e342_44ce_8840_eac424c60b42.slice/crio-7ddc82104dd6a637d364c6f46e229edba1cde0652e8810f11b3830f336161846 WatchSource:0}: Error finding container 7ddc82104dd6a637d364c6f46e229edba1cde0652e8810f11b3830f336161846: Status 404 returned error can't find the container with id 7ddc82104dd6a637d364c6f46e229edba1cde0652e8810f11b3830f336161846
Jul 30 00:34:11.762664 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:11.762630    2527 generic.go:356] "Generic (PLEG): container finished" podID="b568b463-e342-44ce-8840-eac424c60b42" containerID="af8ff1ccbf16a8af9c4396443ef39b36c3ba218530094608ca5a089be1840df3" exitCode=0
Jul 30 00:34:11.763030 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:11.762690    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5dec626-2b592" event={"ID":"b568b463-e342-44ce-8840-eac424c60b42","Type":"ContainerDied","Data":"af8ff1ccbf16a8af9c4396443ef39b36c3ba218530094608ca5a089be1840df3"}
Jul 30 00:34:11.763030 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:11.762739    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5dec626-2b592" event={"ID":"b568b463-e342-44ce-8840-eac424c60b42","Type":"ContainerStarted","Data":"7ddc82104dd6a637d364c6f46e229edba1cde0652e8810f11b3830f336161846"}
Jul 30 00:34:12.915617 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:12.915589    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5dec626-2b592"
Jul 30 00:34:13.041901 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:13.041809    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b568b463-e342-44ce-8840-eac424c60b42-maas-api-service-ca\") pod \"b568b463-e342-44ce-8840-eac424c60b42\" (UID: \"b568b463-e342-44ce-8840-eac424c60b42\") "
Jul 30 00:34:13.042200 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:13.042147    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b568b463-e342-44ce-8840-eac424c60b42-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b568b463-e342-44ce-8840-eac424c60b42" (UID: "b568b463-e342-44ce-8840-eac424c60b42"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:34:13.143425 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:13.143389    2527 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b568b463-e342-44ce-8840-eac424c60b42-maas-api-service-ca\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:34:13.774801 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:13.774771    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5dec626-2b592"
Jul 30 00:34:13.774986 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:13.774779    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5dec626-2b592" event={"ID":"b568b463-e342-44ce-8840-eac424c60b42","Type":"ContainerDied","Data":"7ddc82104dd6a637d364c6f46e229edba1cde0652e8810f11b3830f336161846"}
Jul 30 00:34:13.774986 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:13.774895    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ddc82104dd6a637d364c6f46e229edba1cde0652e8810f11b3830f336161846"
Jul 30 00:34:16.266457 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:16.266417    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr"]
Jul 30 00:34:16.266943 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:16.266679    2527 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr" podUID="b523b63b-34a0-4b8e-b791-8d2dc1b75d4e" containerName="maas-api" containerID="cri-o://e8ee4618837a5afa5f730c436a974b31b70c84a45972db64cf2a584252af8569" gracePeriod=30
Jul 30 00:34:16.447187 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:16.446541    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5dec626-2b592"]
Jul 30 00:34:16.450566 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:16.450533    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5dec626-2b592"]
Jul 30 00:34:16.545107 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:16.545073    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr"
Jul 30 00:34:16.673848 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:16.673820    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b523b63b-34a0-4b8e-b791-8d2dc1b75d4e-openshift-service-ca\") pod \"b523b63b-34a0-4b8e-b791-8d2dc1b75d4e\" (UID: \"b523b63b-34a0-4b8e-b791-8d2dc1b75d4e\") "
Jul 30 00:34:16.674066 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:16.673893    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7bkn\" (UniqueName: \"kubernetes.io/projected/b523b63b-34a0-4b8e-b791-8d2dc1b75d4e-kube-api-access-g7bkn\") pod \"b523b63b-34a0-4b8e-b791-8d2dc1b75d4e\" (UID: \"b523b63b-34a0-4b8e-b791-8d2dc1b75d4e\") "
Jul 30 00:34:16.674066 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:16.674058    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b523b63b-34a0-4b8e-b791-8d2dc1b75d4e-maas-api-tls\") pod \"b523b63b-34a0-4b8e-b791-8d2dc1b75d4e\" (UID: \"b523b63b-34a0-4b8e-b791-8d2dc1b75d4e\") "
Jul 30 00:34:16.674281 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:16.674259    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b523b63b-34a0-4b8e-b791-8d2dc1b75d4e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b523b63b-34a0-4b8e-b791-8d2dc1b75d4e" (UID: "b523b63b-34a0-4b8e-b791-8d2dc1b75d4e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:34:16.674480 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:16.674462    2527 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b523b63b-34a0-4b8e-b791-8d2dc1b75d4e-openshift-service-ca\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:34:16.676229 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:16.676196    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b523b63b-34a0-4b8e-b791-8d2dc1b75d4e-kube-api-access-g7bkn" (OuterVolumeSpecName: "kube-api-access-g7bkn") pod "b523b63b-34a0-4b8e-b791-8d2dc1b75d4e" (UID: "b523b63b-34a0-4b8e-b791-8d2dc1b75d4e"). InnerVolumeSpecName "kube-api-access-g7bkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:34:16.676229 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:16.676204    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b523b63b-34a0-4b8e-b791-8d2dc1b75d4e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b523b63b-34a0-4b8e-b791-8d2dc1b75d4e" (UID: "b523b63b-34a0-4b8e-b791-8d2dc1b75d4e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:34:16.775042 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:16.774950    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7bkn\" (UniqueName: \"kubernetes.io/projected/b523b63b-34a0-4b8e-b791-8d2dc1b75d4e-kube-api-access-g7bkn\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:34:16.775042 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:16.774984    2527 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b523b63b-34a0-4b8e-b791-8d2dc1b75d4e-maas-api-tls\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:34:16.794819 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:16.794778    2527 generic.go:356] "Generic (PLEG): container finished" podID="b523b63b-34a0-4b8e-b791-8d2dc1b75d4e" containerID="e8ee4618837a5afa5f730c436a974b31b70c84a45972db64cf2a584252af8569" exitCode=0
Jul 30 00:34:16.794979 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:16.794830    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr"
Jul 30 00:34:16.794979 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:16.794860    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr" event={"ID":"b523b63b-34a0-4b8e-b791-8d2dc1b75d4e","Type":"ContainerDied","Data":"e8ee4618837a5afa5f730c436a974b31b70c84a45972db64cf2a584252af8569"}
Jul 30 00:34:16.794979 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:16.794920    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr" event={"ID":"b523b63b-34a0-4b8e-b791-8d2dc1b75d4e","Type":"ContainerDied","Data":"ed2fff4596bd851edd28d8a3f44f774682f1df3dbf299b7adb848119d19ca930"}
Jul 30 00:34:16.794979 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:16.794950    2527 scope.go:117] "RemoveContainer" containerID="e8ee4618837a5afa5f730c436a974b31b70c84a45972db64cf2a584252af8569"
Jul 30 00:34:16.805149 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:16.805123    2527 scope.go:117] "RemoveContainer" containerID="e8ee4618837a5afa5f730c436a974b31b70c84a45972db64cf2a584252af8569"
Jul 30 00:34:16.805452 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:34:16.805432    2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8ee4618837a5afa5f730c436a974b31b70c84a45972db64cf2a584252af8569\": container with ID starting with e8ee4618837a5afa5f730c436a974b31b70c84a45972db64cf2a584252af8569 not found: ID does not exist" containerID="e8ee4618837a5afa5f730c436a974b31b70c84a45972db64cf2a584252af8569"
Jul 30 00:34:16.805501 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:16.805464    2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8ee4618837a5afa5f730c436a974b31b70c84a45972db64cf2a584252af8569"} err="failed to get container status \"e8ee4618837a5afa5f730c436a974b31b70c84a45972db64cf2a584252af8569\": rpc error: code = NotFound desc = could not find container \"e8ee4618837a5afa5f730c436a974b31b70c84a45972db64cf2a584252af8569\": container with ID starting with e8ee4618837a5afa5f730c436a974b31b70c84a45972db64cf2a584252af8569 not found: ID does not exist"
Jul 30 00:34:16.816801 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:16.816775    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr"]
Jul 30 00:34:16.820483 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:16.820455    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e5dec626-c59777d8c-7mfbr"]
Jul 30 00:34:17.335603 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.335567    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"]
Jul 30 00:34:17.336261 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.336240    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b523b63b-34a0-4b8e-b791-8d2dc1b75d4e" containerName="maas-api"
Jul 30 00:34:17.336392 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.336265    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="b523b63b-34a0-4b8e-b791-8d2dc1b75d4e" containerName="maas-api"
Jul 30 00:34:17.336392 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.336276    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b568b463-e342-44ce-8840-eac424c60b42" containerName="revoke-keys"
Jul 30 00:34:17.336392 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.336282    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="b568b463-e342-44ce-8840-eac424c60b42" containerName="revoke-keys"
Jul 30 00:34:17.336392 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.336363    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="b523b63b-34a0-4b8e-b791-8d2dc1b75d4e" containerName="maas-api"
Jul 30 00:34:17.336392 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.336372    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="b568b463-e342-44ce-8840-eac424c60b42" containerName="revoke-keys"
Jul 30 00:34:17.341042 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.341023    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:17.343609 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.343587    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-cd573186-openshift-default-dockercfg-xklpz\""
Jul 30 00:34:17.351403 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.351375    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"]
Jul 30 00:34:17.482119 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.482075    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-istiod-ca-cert\") pod \"e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") " pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:17.482119 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.482126    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-istio-data\") pod \"e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") " pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:17.482377 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.482152    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-istio-envoy\") pod \"e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") " pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:17.482377 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.482252    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-credential-socket\") pod \"e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") " pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:17.482377 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.482342    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-istio-token\") pod \"e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") " pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:17.482474 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.482388    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-workload-socket\") pod \"e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") " pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:17.482474 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.482430    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-workload-certs\") pod \"e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") " pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:17.482474 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.482466    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj8sk\" (UniqueName: \"kubernetes.io/projected/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-kube-api-access-vj8sk\") pod \"e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") " pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:17.482612 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.482487    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-istio-podinfo\") pod \"e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") " pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:17.583494 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.583449    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj8sk\" (UniqueName: \"kubernetes.io/projected/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-kube-api-access-vj8sk\") pod \"e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") " pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:17.583494 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.583491    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-istio-podinfo\") pod \"e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") " pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:17.583763 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.583517    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-istiod-ca-cert\") pod \"e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") " pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:17.583763 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.583542    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-istio-data\") pod \"e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") " pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:17.583763 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.583567    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-istio-envoy\") pod \"e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") " pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:17.583763 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.583607    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-credential-socket\") pod \"e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") " pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:17.583763 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.583692    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-istio-token\") pod \"e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") " pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:17.583763 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.583743    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-workload-socket\") pod \"e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") " pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:17.584077 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.583786    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-workload-certs\") pod \"e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") " pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:17.584077 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.584030    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-istio-data\") pod \"e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") " pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:17.584231 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.584125    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-credential-socket\") pod \"e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") " pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:17.584231 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.584190    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-workload-certs\") pod \"e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") " pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:17.584414 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.584326    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-workload-socket\") pod \"e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") " pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:17.584640 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.584411    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-istiod-ca-cert\") pod \"e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") " pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:17.586229 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.586176    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-istio-envoy\") pod \"e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") " pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:17.586329 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.586311    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-istio-podinfo\") pod \"e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") " pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:17.610067 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.610028    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-istio-token\") pod \"e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") " pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:17.612370 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.612347    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj8sk\" (UniqueName: \"kubernetes.io/projected/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-kube-api-access-vj8sk\") pod \"e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") " pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:17.654061 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.654025    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:17.805670 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.805645    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"]
Jul 30 00:34:17.807144 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:34:17.807119    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b8b3fa5_437b_4f6b_9fc2_50172e87dedf.slice/crio-a5b5fb6314e93287eea0ab422dee2da2c48597d1e8e30a7aeef3014ea015c8e1 WatchSource:0}: Error finding container a5b5fb6314e93287eea0ab422dee2da2c48597d1e8e30a7aeef3014ea015c8e1: Status 404 returned error can't find the container with id a5b5fb6314e93287eea0ab422dee2da2c48597d1e8e30a7aeef3014ea015c8e1
Jul 30 00:34:17.809129 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.809100    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:34:17.809219 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.809185    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:34:17.809262 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:17.809225    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:34:18.216518 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:18.216487    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b523b63b-34a0-4b8e-b791-8d2dc1b75d4e" path="/var/lib/kubelet/pods/b523b63b-34a0-4b8e-b791-8d2dc1b75d4e/volumes"
Jul 30 00:34:18.216836 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:18.216822    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b568b463-e342-44ce-8840-eac424c60b42" path="/var/lib/kubelet/pods/b568b463-e342-44ce-8840-eac424c60b42/volumes"
Jul 30 00:34:18.810038 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:18.809995    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2" event={"ID":"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf","Type":"ContainerStarted","Data":"95e96f5a261d3bdf3897e0a2cca4772cde2a9c28f7fc1a866b363f2e8aa7972f"}
Jul 30 00:34:18.810486 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:18.810065    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2" event={"ID":"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf","Type":"ContainerStarted","Data":"a5b5fb6314e93287eea0ab422dee2da2c48597d1e8e30a7aeef3014ea015c8e1"}
Jul 30 00:34:18.831374 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:18.831320    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2" podStartSLOduration=1.831302282 podStartE2EDuration="1.831302282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:34:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:34:18.828886684 +0000 UTC m=+1933.131335029" watchObservedRunningTime="2026-07-30 00:34:18.831302282 +0000 UTC m=+1933.133750626"
Jul 30 00:34:19.654424 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:19.654380    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:19.659727 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:19.659701    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:19.816019 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:19.815987    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:19.817194 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:19.817140    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:20.505384 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:20.505347    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:34:32.204261 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:32.204224    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:34:34.818190 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:34.818146    2527 patch_prober.go:28] interesting pod/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 30 00:34:34.818588 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:34.818227    2527 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2" podUID="7b8b3fa5-437b-4f6b-9fc2-50172e87dedf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 30 00:34:34.919313 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:34.919229    2527 generic.go:356] "Generic (PLEG): container finished" podID="7b8b3fa5-437b-4f6b-9fc2-50172e87dedf" containerID="95e96f5a261d3bdf3897e0a2cca4772cde2a9c28f7fc1a866b363f2e8aa7972f" exitCode=0
Jul 30 00:34:34.919462 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:34.919308    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2" event={"ID":"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf","Type":"ContainerDied","Data":"95e96f5a261d3bdf3897e0a2cca4772cde2a9c28f7fc1a866b363f2e8aa7972f"}
Jul 30 00:34:34.919746 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:34.919730    2527 scope.go:117] "RemoveContainer" containerID="95e96f5a261d3bdf3897e0a2cca4772cde2a9c28f7fc1a866b363f2e8aa7972f"
Jul 30 00:34:34.920868 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:34.920841    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:34:34.920925 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:34.920913    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:34:34.920961 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:34.920949    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:34:35.927225 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:35.927154    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2" event={"ID":"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf","Type":"ContainerStarted","Data":"b2387a146277a149ab28c1d8f6e288d4a098229e03a74381072225f1fa9b3ca4"}
Jul 30 00:34:36.654555 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:36.654453    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:36.654555 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:36.654539    2527 patch_prober.go:28] interesting pod/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 30 00:34:36.654858 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:36.654593    2527 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2" podUID="7b8b3fa5-437b-4f6b-9fc2-50172e87dedf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 30 00:34:37.654729 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:37.654680    2527 patch_prober.go:28] interesting pod/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 30 00:34:37.655309 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:37.654759    2527 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2" podUID="7b8b3fa5-437b-4f6b-9fc2-50172e87dedf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 30 00:34:38.655044 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:38.654987    2527 patch_prober.go:28] interesting pod/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 30 00:34:38.655747 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:38.655710    2527 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2" podUID="7b8b3fa5-437b-4f6b-9fc2-50172e87dedf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 30 00:34:39.655224 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:39.655151    2527 patch_prober.go:28] interesting pod/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Jul 30 00:34:39.655748 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:39.655267    2527 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2" podUID="7b8b3fa5-437b-4f6b-9fc2-50172e87dedf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Jul 30 00:34:40.659297 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:40.659259    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:40.659795 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:40.659647    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:40.660264 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:40.660242    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:45.921190 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:45.921134    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cd573186-kzxhl"]
Jul 30 00:34:45.925060 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:45.925041    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cd573186-kzxhl"
Jul 30 00:34:45.928133 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:45.928093    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 00:34:45.928133 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:45.928093    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t42rq\""
Jul 30 00:34:45.930674 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:45.930642    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cd573186-kzxhl"]
Jul 30 00:34:45.964487 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:45.964447    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5902c156-263d-4ede-89c8-fc799a79c1aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-cd573186-kzxhl\" (UID: \"5902c156-263d-4ede-89c8-fc799a79c1aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cd573186-kzxhl"
Jul 30 00:34:46.065337 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:46.065297    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5902c156-263d-4ede-89c8-fc799a79c1aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-cd573186-kzxhl\" (UID: \"5902c156-263d-4ede-89c8-fc799a79c1aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cd573186-kzxhl"
Jul 30 00:34:46.065922 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:46.065901    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5902c156-263d-4ede-89c8-fc799a79c1aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-cd573186-kzxhl\" (UID: \"5902c156-263d-4ede-89c8-fc799a79c1aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cd573186-kzxhl"
Jul 30 00:34:46.237823 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:46.237786    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cd573186-kzxhl"
Jul 30 00:34:46.381002 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:46.380978    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cd573186-kzxhl"]
Jul 30 00:34:46.383546 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:34:46.383518    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5902c156_263d_4ede_89c8_fc799a79c1aa.slice/crio-aa5dece416896d7dd17412d19485b1af840ca8b8cb9a37918952cf739cd953ca WatchSource:0}: Error finding container aa5dece416896d7dd17412d19485b1af840ca8b8cb9a37918952cf739cd953ca: Status 404 returned error can't find the container with id aa5dece416896d7dd17412d19485b1af840ca8b8cb9a37918952cf739cd953ca
Jul 30 00:34:46.998657 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:46.998616    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cd573186-kzxhl" event={"ID":"5902c156-263d-4ede-89c8-fc799a79c1aa","Type":"ContainerStarted","Data":"a0f8694469544f635567d71e6faec75e4f1f167d080e212e33665e617a2754f8"}
Jul 30 00:34:46.999068 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:46.998678    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cd573186-kzxhl" event={"ID":"5902c156-263d-4ede-89c8-fc799a79c1aa","Type":"ContainerStarted","Data":"aa5dece416896d7dd17412d19485b1af840ca8b8cb9a37918952cf739cd953ca"}
Jul 30 00:34:47.013450 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:47.013399    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cd573186-kzxhl" podStartSLOduration=2.01338532 podStartE2EDuration="2.01338532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:34:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:34:47.011223495 +0000 UTC m=+1961.313671841" watchObservedRunningTime="2026-07-30 00:34:47.01338532 +0000 UTC m=+1961.315833664"
Jul 30 00:34:48.006679 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:48.006640    2527 generic.go:356] "Generic (PLEG): container finished" podID="5902c156-263d-4ede-89c8-fc799a79c1aa" containerID="a0f8694469544f635567d71e6faec75e4f1f167d080e212e33665e617a2754f8" exitCode=0
Jul 30 00:34:48.007137 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:48.006723    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cd573186-kzxhl" event={"ID":"5902c156-263d-4ede-89c8-fc799a79c1aa","Type":"ContainerDied","Data":"a0f8694469544f635567d71e6faec75e4f1f167d080e212e33665e617a2754f8"}
Jul 30 00:34:49.156113 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:49.156082    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cd573186-kzxhl"
Jul 30 00:34:49.197033 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:49.197000    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5902c156-263d-4ede-89c8-fc799a79c1aa-maas-api-service-ca\") pod \"5902c156-263d-4ede-89c8-fc799a79c1aa\" (UID: \"5902c156-263d-4ede-89c8-fc799a79c1aa\") "
Jul 30 00:34:49.197375 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:49.197355    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5902c156-263d-4ede-89c8-fc799a79c1aa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5902c156-263d-4ede-89c8-fc799a79c1aa" (UID: "5902c156-263d-4ede-89c8-fc799a79c1aa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:34:49.298493 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:49.298406    2527 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5902c156-263d-4ede-89c8-fc799a79c1aa-maas-api-service-ca\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:34:50.020091 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:50.020054    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cd573186-kzxhl"
Jul 30 00:34:50.020285 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:50.020050    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cd573186-kzxhl" event={"ID":"5902c156-263d-4ede-89c8-fc799a79c1aa","Type":"ContainerDied","Data":"aa5dece416896d7dd17412d19485b1af840ca8b8cb9a37918952cf739cd953ca"}
Jul 30 00:34:50.020285 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:50.020216    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa5dece416896d7dd17412d19485b1af840ca8b8cb9a37918952cf739cd953ca"
Jul 30 00:34:51.862972 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:51.862936    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cd573186-kzxhl"]
Jul 30 00:34:51.865424 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:51.865402    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cd573186-kzxhl"]
Jul 30 00:34:52.217302 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:52.217266    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5902c156-263d-4ede-89c8-fc799a79c1aa" path="/var/lib/kubelet/pods/5902c156-263d-4ede-89c8-fc799a79c1aa/volumes"
Jul 30 00:34:52.995691 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:52.995658    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"]
Jul 30 00:34:52.996115 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:52.995879    2527 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2" podUID="7b8b3fa5-437b-4f6b-9fc2-50172e87dedf" containerName="istio-proxy" containerID="cri-o://b2387a146277a149ab28c1d8f6e288d4a098229e03a74381072225f1fa9b3ca4" gracePeriod=30
Jul 30 00:34:54.896643 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:54.896592    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:34:55.662570 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:55.662534    2527 patch_prober.go:28] interesting pod/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 30 00:34:55.662741 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:55.662601    2527 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2" podUID="7b8b3fa5-437b-4f6b-9fc2-50172e87dedf" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 00:34:58.250822 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:58.250793    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:58.387928 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:58.387832    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-istio-data\") pod \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") "
Jul 30 00:34:58.387928 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:58.387881    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-istio-envoy\") pod \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") "
Jul 30 00:34:58.388244 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:58.387946    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-workload-socket\") pod \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") "
Jul 30 00:34:58.388244 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:58.387972    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-istiod-ca-cert\") pod \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") "
Jul 30 00:34:58.388244 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:58.388025    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-workload-certs\") pod \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") "
Jul 30 00:34:58.388244 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:58.388057    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-credential-socket\") pod \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") "
Jul 30 00:34:58.388244 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:58.388093    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-istio-token\") pod \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") "
Jul 30 00:34:58.388244 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:58.388118    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vj8sk\" (UniqueName: \"kubernetes.io/projected/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-kube-api-access-vj8sk\") pod \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") "
Jul 30 00:34:58.388244 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:58.388188    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-istio-podinfo\") pod \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\" (UID: \"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf\") "
Jul 30 00:34:58.388619 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:58.388321    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7b8b3fa5-437b-4f6b-9fc2-50172e87dedf" (UID: "7b8b3fa5-437b-4f6b-9fc2-50172e87dedf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:34:58.388619 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:58.388372    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7b8b3fa5-437b-4f6b-9fc2-50172e87dedf" (UID: "7b8b3fa5-437b-4f6b-9fc2-50172e87dedf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:34:58.388619 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:58.388420    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7b8b3fa5-437b-4f6b-9fc2-50172e87dedf" (UID: "7b8b3fa5-437b-4f6b-9fc2-50172e87dedf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:34:58.388619 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:58.388449    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7b8b3fa5-437b-4f6b-9fc2-50172e87dedf" (UID: "7b8b3fa5-437b-4f6b-9fc2-50172e87dedf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:34:58.388619 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:58.388611    2527 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-workload-certs\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:34:58.388843 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:58.388632    2527 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-credential-socket\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:34:58.388843 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:58.388648    2527 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-workload-socket\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:34:58.388843 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:58.388659    2527 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-istiod-ca-cert\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:34:58.388843 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:58.388758    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-istio-data" (OuterVolumeSpecName: "istio-data") pod "7b8b3fa5-437b-4f6b-9fc2-50172e87dedf" (UID: "7b8b3fa5-437b-4f6b-9fc2-50172e87dedf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:34:58.390569 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:58.390539    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-kube-api-access-vj8sk" (OuterVolumeSpecName: "kube-api-access-vj8sk") pod "7b8b3fa5-437b-4f6b-9fc2-50172e87dedf" (UID: "7b8b3fa5-437b-4f6b-9fc2-50172e87dedf"). InnerVolumeSpecName "kube-api-access-vj8sk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:34:58.390679 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:58.390629    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-istio-token" (OuterVolumeSpecName: "istio-token") pod "7b8b3fa5-437b-4f6b-9fc2-50172e87dedf" (UID: "7b8b3fa5-437b-4f6b-9fc2-50172e87dedf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:34:58.390943 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:58.390923    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7b8b3fa5-437b-4f6b-9fc2-50172e87dedf" (UID: "7b8b3fa5-437b-4f6b-9fc2-50172e87dedf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:34:58.390988 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:58.390957    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7b8b3fa5-437b-4f6b-9fc2-50172e87dedf" (UID: "7b8b3fa5-437b-4f6b-9fc2-50172e87dedf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 00:34:58.489819 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:58.489772    2527 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-istio-token\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:34:58.489819 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:58.489809    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vj8sk\" (UniqueName: \"kubernetes.io/projected/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-kube-api-access-vj8sk\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:34:58.489819 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:58.489819    2527 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-istio-podinfo\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:34:58.489819 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:58.489829    2527 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-istio-data\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:34:58.490098 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:58.489837    2527 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf-istio-envoy\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:34:59.082596 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:59.082551    2527 generic.go:356] "Generic (PLEG): container finished" podID="7b8b3fa5-437b-4f6b-9fc2-50172e87dedf" containerID="b2387a146277a149ab28c1d8f6e288d4a098229e03a74381072225f1fa9b3ca4" exitCode=0
Jul 30 00:34:59.082782 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:59.082601    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"
Jul 30 00:34:59.082782 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:59.082635    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2" event={"ID":"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf","Type":"ContainerDied","Data":"b2387a146277a149ab28c1d8f6e288d4a098229e03a74381072225f1fa9b3ca4"}
Jul 30 00:34:59.082782 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:59.082695    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2" event={"ID":"7b8b3fa5-437b-4f6b-9fc2-50172e87dedf","Type":"ContainerDied","Data":"a5b5fb6314e93287eea0ab422dee2da2c48597d1e8e30a7aeef3014ea015c8e1"}
Jul 30 00:34:59.082782 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:59.082724    2527 scope.go:117] "RemoveContainer" containerID="b2387a146277a149ab28c1d8f6e288d4a098229e03a74381072225f1fa9b3ca4"
Jul 30 00:34:59.093944 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:59.093923    2527 scope.go:117] "RemoveContainer" containerID="95e96f5a261d3bdf3897e0a2cca4772cde2a9c28f7fc1a866b363f2e8aa7972f"
Jul 30 00:34:59.103418 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:59.103396    2527 scope.go:117] "RemoveContainer" containerID="b2387a146277a149ab28c1d8f6e288d4a098229e03a74381072225f1fa9b3ca4"
Jul 30 00:34:59.103803 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:34:59.103759    2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2387a146277a149ab28c1d8f6e288d4a098229e03a74381072225f1fa9b3ca4\": container with ID starting with b2387a146277a149ab28c1d8f6e288d4a098229e03a74381072225f1fa9b3ca4 not found: ID does not exist" containerID="b2387a146277a149ab28c1d8f6e288d4a098229e03a74381072225f1fa9b3ca4"
Jul 30 00:34:59.103920 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:59.103806    2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2387a146277a149ab28c1d8f6e288d4a098229e03a74381072225f1fa9b3ca4"} err="failed to get container status \"b2387a146277a149ab28c1d8f6e288d4a098229e03a74381072225f1fa9b3ca4\": rpc error: code = NotFound desc = could not find container \"b2387a146277a149ab28c1d8f6e288d4a098229e03a74381072225f1fa9b3ca4\": container with ID starting with b2387a146277a149ab28c1d8f6e288d4a098229e03a74381072225f1fa9b3ca4 not found: ID does not exist"
Jul 30 00:34:59.103920 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:59.103832    2527 scope.go:117] "RemoveContainer" containerID="95e96f5a261d3bdf3897e0a2cca4772cde2a9c28f7fc1a866b363f2e8aa7972f"
Jul 30 00:34:59.104272 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:34:59.104149    2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95e96f5a261d3bdf3897e0a2cca4772cde2a9c28f7fc1a866b363f2e8aa7972f\": container with ID starting with 95e96f5a261d3bdf3897e0a2cca4772cde2a9c28f7fc1a866b363f2e8aa7972f not found: ID does not exist" containerID="95e96f5a261d3bdf3897e0a2cca4772cde2a9c28f7fc1a866b363f2e8aa7972f"
Jul 30 00:34:59.104272 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:59.104213    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"]
Jul 30 00:34:59.104272 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:59.104220    2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95e96f5a261d3bdf3897e0a2cca4772cde2a9c28f7fc1a866b363f2e8aa7972f"} err="failed to get container status \"95e96f5a261d3bdf3897e0a2cca4772cde2a9c28f7fc1a866b363f2e8aa7972f\": rpc error: code = NotFound desc = could not find container \"95e96f5a261d3bdf3897e0a2cca4772cde2a9c28f7fc1a866b363f2e8aa7972f\": container with ID starting with 95e96f5a261d3bdf3897e0a2cca4772cde2a9c28f7fc1a866b363f2e8aa7972f not found: ID does not exist"
Jul 30 00:34:59.111859 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:34:59.111833    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-cd573186-openshift-default-7cdd4b84bb-zgzr2"]
Jul 30 00:35:00.217805 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:00.217772    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b8b3fa5-437b-4f6b-9fc2-50172e87dedf" path="/var/lib/kubelet/pods/7b8b3fa5-437b-4f6b-9fc2-50172e87dedf/volumes"
Jul 30 00:35:05.098952 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:05.098910    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:35:20.536373 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:20.536338    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2de2fd7b-q8ptj"]
Jul 30 00:35:20.536986 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:20.536963    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5902c156-263d-4ede-89c8-fc799a79c1aa" containerName="revoke-keys"
Jul 30 00:35:20.537095 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:20.536989    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="5902c156-263d-4ede-89c8-fc799a79c1aa" containerName="revoke-keys"
Jul 30 00:35:20.537095 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:20.537026    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b8b3fa5-437b-4f6b-9fc2-50172e87dedf" containerName="istio-proxy"
Jul 30 00:35:20.537095 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:20.537035    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b8b3fa5-437b-4f6b-9fc2-50172e87dedf" containerName="istio-proxy"
Jul 30 00:35:20.537095 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:20.537044    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b8b3fa5-437b-4f6b-9fc2-50172e87dedf" containerName="istio-proxy"
Jul 30 00:35:20.537095 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:20.537052    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b8b3fa5-437b-4f6b-9fc2-50172e87dedf" containerName="istio-proxy"
Jul 30 00:35:20.537390 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:20.537192    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b8b3fa5-437b-4f6b-9fc2-50172e87dedf" containerName="istio-proxy"
Jul 30 00:35:20.537390 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:20.537206    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b8b3fa5-437b-4f6b-9fc2-50172e87dedf" containerName="istio-proxy"
Jul 30 00:35:20.537390 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:20.537214    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="5902c156-263d-4ede-89c8-fc799a79c1aa" containerName="revoke-keys"
Jul 30 00:35:20.540645 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:20.540624    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2de2fd7b-q8ptj"
Jul 30 00:35:20.543645 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:20.543483    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t42rq\""
Jul 30 00:35:20.543645 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:20.543497    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 00:35:20.546441 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:20.546414    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2de2fd7b-q8ptj"]
Jul 30 00:35:20.594916 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:20.594882    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9b0ba42-876b-43dd-bb51-52c1721ea7af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-2de2fd7b-q8ptj\" (UID: \"e9b0ba42-876b-43dd-bb51-52c1721ea7af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2de2fd7b-q8ptj"
Jul 30 00:35:20.695878 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:20.695778    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9b0ba42-876b-43dd-bb51-52c1721ea7af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-2de2fd7b-q8ptj\" (UID: \"e9b0ba42-876b-43dd-bb51-52c1721ea7af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2de2fd7b-q8ptj"
Jul 30 00:35:20.696494 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:20.696468    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9b0ba42-876b-43dd-bb51-52c1721ea7af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-2de2fd7b-q8ptj\" (UID: \"e9b0ba42-876b-43dd-bb51-52c1721ea7af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2de2fd7b-q8ptj"
Jul 30 00:35:20.854233 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:20.854141    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2de2fd7b-q8ptj"
Jul 30 00:35:20.991657 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:20.991631    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2de2fd7b-q8ptj"]
Jul 30 00:35:20.994046 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:35:20.994016    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9b0ba42_876b_43dd_bb51_52c1721ea7af.slice/crio-e6fb09591bdef8bf00433fd096f1121b2ed91816841a117fc5c44d1b198120ec WatchSource:0}: Error finding container e6fb09591bdef8bf00433fd096f1121b2ed91816841a117fc5c44d1b198120ec: Status 404 returned error can't find the container with id e6fb09591bdef8bf00433fd096f1121b2ed91816841a117fc5c44d1b198120ec
Jul 30 00:35:21.219738 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:21.219701    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2de2fd7b-q8ptj" event={"ID":"e9b0ba42-876b-43dd-bb51-52c1721ea7af","Type":"ContainerStarted","Data":"e6fb09591bdef8bf00433fd096f1121b2ed91816841a117fc5c44d1b198120ec"}
Jul 30 00:35:22.226635 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:22.226603    2527 generic.go:356] "Generic (PLEG): container finished" podID="e9b0ba42-876b-43dd-bb51-52c1721ea7af" containerID="0510cd833c3c6ad1fa809be18659665af309eebe95d881a0fa1ab5cec60def5d" exitCode=0
Jul 30 00:35:22.227045 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:22.226693    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2de2fd7b-q8ptj" event={"ID":"e9b0ba42-876b-43dd-bb51-52c1721ea7af","Type":"ContainerDied","Data":"0510cd833c3c6ad1fa809be18659665af309eebe95d881a0fa1ab5cec60def5d"}
Jul 30 00:35:23.377494 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:23.377462    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2de2fd7b-q8ptj"
Jul 30 00:35:23.424364 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:23.424332    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9b0ba42-876b-43dd-bb51-52c1721ea7af-maas-api-service-ca\") pod \"e9b0ba42-876b-43dd-bb51-52c1721ea7af\" (UID: \"e9b0ba42-876b-43dd-bb51-52c1721ea7af\") "
Jul 30 00:35:23.424693 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:23.424670    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9b0ba42-876b-43dd-bb51-52c1721ea7af-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e9b0ba42-876b-43dd-bb51-52c1721ea7af" (UID: "e9b0ba42-876b-43dd-bb51-52c1721ea7af"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:35:23.525478 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:23.525385    2527 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9b0ba42-876b-43dd-bb51-52c1721ea7af-maas-api-service-ca\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:35:24.239889 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:24.239847    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2de2fd7b-q8ptj" event={"ID":"e9b0ba42-876b-43dd-bb51-52c1721ea7af","Type":"ContainerDied","Data":"e6fb09591bdef8bf00433fd096f1121b2ed91816841a117fc5c44d1b198120ec"}
Jul 30 00:35:24.240058 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:24.239906    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e6fb09591bdef8bf00433fd096f1121b2ed91816841a117fc5c44d1b198120ec"
Jul 30 00:35:24.240058 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:24.239870    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2de2fd7b-q8ptj"
Jul 30 00:35:27.422144 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:27.422109    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2de2fd7b-q8ptj"]
Jul 30 00:35:27.424555 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:27.424532    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2de2fd7b-q8ptj"]
Jul 30 00:35:28.217819 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:28.217783    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9b0ba42-876b-43dd-bb51-52c1721ea7af" path="/var/lib/kubelet/pods/e9b0ba42-876b-43dd-bb51-52c1721ea7af/volumes"
Jul 30 00:35:31.091823 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:35:31.091787    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:36:51.999615 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:36:51.999529    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:36:58.704001 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:36:58.703967    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:37:08.304750 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:37:08.304713    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:37:09.895544 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:37:09.895503    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9cggv_c6b01a1f-c41e-4781-8c25-66b152e0d0e8/ovn-acl-logging/0.log"
Jul 30 00:37:09.909152 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:37:09.909120    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9cggv_c6b01a1f-c41e-4781-8c25-66b152e0d0e8/ovn-acl-logging/0.log"
Jul 30 00:37:19.108685 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:37:19.108643    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:37:43.881519 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:37:43.881477    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c9d47c1-cnvxp"]
Jul 30 00:37:43.882139 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:37:43.882119    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9b0ba42-876b-43dd-bb51-52c1721ea7af" containerName="revoke-keys"
Jul 30 00:37:43.882203 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:37:43.882141    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9b0ba42-876b-43dd-bb51-52c1721ea7af" containerName="revoke-keys"
Jul 30 00:37:43.882256 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:37:43.882246    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9b0ba42-876b-43dd-bb51-52c1721ea7af" containerName="revoke-keys"
Jul 30 00:37:43.885406 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:37:43.885384    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c9d47c1-cnvxp"
Jul 30 00:37:43.887734 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:37:43.887713    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t42rq\""
Jul 30 00:37:43.887848 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:37:43.887713    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 00:37:43.892728 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:37:43.892701    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c9d47c1-cnvxp"]
Jul 30 00:37:43.983306 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:37:43.983264    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/685ba64c-acd4-43bf-a638-0013347f2a56-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8c9d47c1-cnvxp\" (UID: \"685ba64c-acd4-43bf-a638-0013347f2a56\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c9d47c1-cnvxp"
Jul 30 00:37:44.084194 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:37:44.084120    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/685ba64c-acd4-43bf-a638-0013347f2a56-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8c9d47c1-cnvxp\" (UID: \"685ba64c-acd4-43bf-a638-0013347f2a56\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c9d47c1-cnvxp"
Jul 30 00:37:44.084741 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:37:44.084721    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/685ba64c-acd4-43bf-a638-0013347f2a56-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8c9d47c1-cnvxp\" (UID: \"685ba64c-acd4-43bf-a638-0013347f2a56\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c9d47c1-cnvxp"
Jul 30 00:37:44.199493 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:37:44.199464    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c9d47c1-cnvxp"
Jul 30 00:37:44.348756 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:37:44.348722    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c9d47c1-cnvxp"]
Jul 30 00:37:44.352547 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:37:44.352514    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod685ba64c_acd4_43bf_a638_0013347f2a56.slice/crio-4edd4315d5c30629afa6da2ca1a1a4f6cf731522eaedb252ab809d7312f4cacd WatchSource:0}: Error finding container 4edd4315d5c30629afa6da2ca1a1a4f6cf731522eaedb252ab809d7312f4cacd: Status 404 returned error can't find the container with id 4edd4315d5c30629afa6da2ca1a1a4f6cf731522eaedb252ab809d7312f4cacd
Jul 30 00:37:45.145916 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:37:45.145877    2527 generic.go:356] "Generic (PLEG): container finished" podID="685ba64c-acd4-43bf-a638-0013347f2a56" containerID="db18202b3a77669d0c10fdb2eb8dc46b769e7b8ffbbc40a5deb3100575164fb3" exitCode=0
Jul 30 00:37:45.145916 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:37:45.145918    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c9d47c1-cnvxp" event={"ID":"685ba64c-acd4-43bf-a638-0013347f2a56","Type":"ContainerDied","Data":"db18202b3a77669d0c10fdb2eb8dc46b769e7b8ffbbc40a5deb3100575164fb3"}
Jul 30 00:37:45.146386 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:37:45.145956    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c9d47c1-cnvxp" event={"ID":"685ba64c-acd4-43bf-a638-0013347f2a56","Type":"ContainerStarted","Data":"4edd4315d5c30629afa6da2ca1a1a4f6cf731522eaedb252ab809d7312f4cacd"}
Jul 30 00:37:46.294351 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:37:46.294322    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c9d47c1-cnvxp"
Jul 30 00:37:46.406611 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:37:46.406506    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/685ba64c-acd4-43bf-a638-0013347f2a56-maas-api-service-ca\") pod \"685ba64c-acd4-43bf-a638-0013347f2a56\" (UID: \"685ba64c-acd4-43bf-a638-0013347f2a56\") "
Jul 30 00:37:46.406934 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:37:46.406908    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/685ba64c-acd4-43bf-a638-0013347f2a56-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "685ba64c-acd4-43bf-a638-0013347f2a56" (UID: "685ba64c-acd4-43bf-a638-0013347f2a56"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:37:46.507959 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:37:46.507924    2527 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/685ba64c-acd4-43bf-a638-0013347f2a56-maas-api-service-ca\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:37:47.159200 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:37:47.159149    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c9d47c1-cnvxp"
Jul 30 00:37:47.159200 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:37:47.159185    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c9d47c1-cnvxp" event={"ID":"685ba64c-acd4-43bf-a638-0013347f2a56","Type":"ContainerDied","Data":"4edd4315d5c30629afa6da2ca1a1a4f6cf731522eaedb252ab809d7312f4cacd"}
Jul 30 00:37:47.159413 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:37:47.159236    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4edd4315d5c30629afa6da2ca1a1a4f6cf731522eaedb252ab809d7312f4cacd"
Jul 30 00:37:54.515830 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:37:54.515791    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c9d47c1-cnvxp"]
Jul 30 00:37:54.518900 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:37:54.518872    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c9d47c1-cnvxp"]
Jul 30 00:37:56.216677 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:37:56.216641    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="685ba64c-acd4-43bf-a638-0013347f2a56" path="/var/lib/kubelet/pods/685ba64c-acd4-43bf-a638-0013347f2a56/volumes"
Jul 30 00:37:57.596404 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:37:57.596318    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:38:28.197383 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:38:28.197343    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:39:00.399590 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:39:00.399558    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:39:12.706384 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:39:12.706348    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:39:17.270477 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:39:17.270441    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-99c2ecca-c66zn"]
Jul 30 00:39:17.270859 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:39:17.270846    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="685ba64c-acd4-43bf-a638-0013347f2a56" containerName="revoke-keys"
Jul 30 00:39:17.270859 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:39:17.270860    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="685ba64c-acd4-43bf-a638-0013347f2a56" containerName="revoke-keys"
Jul 30 00:39:17.270942 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:39:17.270933    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="685ba64c-acd4-43bf-a638-0013347f2a56" containerName="revoke-keys"
Jul 30 00:39:17.274083 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:39:17.274066    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-99c2ecca-c66zn"
Jul 30 00:39:17.276858 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:39:17.276842    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 00:39:17.276939 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:39:17.276840    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t42rq\""
Jul 30 00:39:17.283238 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:39:17.283216    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-99c2ecca-c66zn"]
Jul 30 00:39:17.361204 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:39:17.361154    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15d1d668-798c-457e-ba78-f9be1a10f27a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-99c2ecca-c66zn\" (UID: \"15d1d668-798c-457e-ba78-f9be1a10f27a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-99c2ecca-c66zn"
Jul 30 00:39:17.462276 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:39:17.462240    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15d1d668-798c-457e-ba78-f9be1a10f27a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-99c2ecca-c66zn\" (UID: \"15d1d668-798c-457e-ba78-f9be1a10f27a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-99c2ecca-c66zn"
Jul 30 00:39:17.462819 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:39:17.462799    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15d1d668-798c-457e-ba78-f9be1a10f27a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-99c2ecca-c66zn\" (UID: \"15d1d668-798c-457e-ba78-f9be1a10f27a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-99c2ecca-c66zn"
Jul 30 00:39:17.585301 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:39:17.585242    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-99c2ecca-c66zn"
Jul 30 00:39:17.721977 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:39:17.721941    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-99c2ecca-c66zn"]
Jul 30 00:39:17.723714 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:39:17.723690    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15d1d668_798c_457e_ba78_f9be1a10f27a.slice/crio-7e26c5e04ca7c5e898d8b3d48b5a3443e5f720b9406cdb30f70b2619c34987e8 WatchSource:0}: Error finding container 7e26c5e04ca7c5e898d8b3d48b5a3443e5f720b9406cdb30f70b2619c34987e8: Status 404 returned error can't find the container with id 7e26c5e04ca7c5e898d8b3d48b5a3443e5f720b9406cdb30f70b2619c34987e8
Jul 30 00:39:18.728151 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:39:18.728124    2527 generic.go:356] "Generic (PLEG): container finished" podID="15d1d668-798c-457e-ba78-f9be1a10f27a" containerID="4052f8106ab7017a2ead5dda5a3cb2d0275a092344fe73ace20b796c18155a77" exitCode=0
Jul 30 00:39:18.728541 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:39:18.728208    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-99c2ecca-c66zn" event={"ID":"15d1d668-798c-457e-ba78-f9be1a10f27a","Type":"ContainerDied","Data":"4052f8106ab7017a2ead5dda5a3cb2d0275a092344fe73ace20b796c18155a77"}
Jul 30 00:39:18.728541 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:39:18.728257    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-99c2ecca-c66zn" event={"ID":"15d1d668-798c-457e-ba78-f9be1a10f27a","Type":"ContainerStarted","Data":"7e26c5e04ca7c5e898d8b3d48b5a3443e5f720b9406cdb30f70b2619c34987e8"}
Jul 30 00:39:19.870148 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:39:19.870126    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-99c2ecca-c66zn"
Jul 30 00:39:19.982935 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:39:19.982908    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15d1d668-798c-457e-ba78-f9be1a10f27a-maas-api-service-ca\") pod \"15d1d668-798c-457e-ba78-f9be1a10f27a\" (UID: \"15d1d668-798c-457e-ba78-f9be1a10f27a\") "
Jul 30 00:39:19.983310 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:39:19.983291    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15d1d668-798c-457e-ba78-f9be1a10f27a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "15d1d668-798c-457e-ba78-f9be1a10f27a" (UID: "15d1d668-798c-457e-ba78-f9be1a10f27a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:39:20.084559 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:39:20.084495    2527 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15d1d668-798c-457e-ba78-f9be1a10f27a-maas-api-service-ca\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:39:20.740945 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:39:20.740911    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-99c2ecca-c66zn" event={"ID":"15d1d668-798c-457e-ba78-f9be1a10f27a","Type":"ContainerDied","Data":"7e26c5e04ca7c5e898d8b3d48b5a3443e5f720b9406cdb30f70b2619c34987e8"}
Jul 30 00:39:20.740945 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:39:20.740941    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-99c2ecca-c66zn"
Jul 30 00:39:20.741156 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:39:20.740959    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e26c5e04ca7c5e898d8b3d48b5a3443e5f720b9406cdb30f70b2619c34987e8"
Jul 30 00:39:31.101319 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:39:31.101243    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:39:32.921929 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:39:32.921895    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-99c2ecca-c66zn"]
Jul 30 00:39:32.924362 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:39:32.924338    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-99c2ecca-c66zn"]
Jul 30 00:39:34.216229 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:39:34.216199    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15d1d668-798c-457e-ba78-f9be1a10f27a" path="/var/lib/kubelet/pods/15d1d668-798c-457e-ba78-f9be1a10f27a/volumes"
Jul 30 00:39:40.201592 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:39:40.201558    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:40:06.391311 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:40:06.391280    2527 scope.go:117] "RemoveContainer" containerID="9d9797c4f7ac43d810c302e52a29d563f9a99097e8028102f7fe5050b93f2cb3"
Jul 30 00:40:27.403247 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:40:27.403215    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:40:39.314645 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:40:39.314603    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:41:06.415098 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:06.415024    2527 scope.go:117] "RemoveContainer" containerID="a0f8694469544f635567d71e6faec75e4f1f167d080e212e33665e617a2754f8"
Jul 30 00:41:06.427517 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:06.427498    2527 scope.go:117] "RemoveContainer" containerID="af8ff1ccbf16a8af9c4396443ef39b36c3ba218530094608ca5a089be1840df3"
Jul 30 00:41:23.008788 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:23.008754    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d11ca7-75649b6794-n544r"]
Jul 30 00:41:23.009225 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:23.009210    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15d1d668-798c-457e-ba78-f9be1a10f27a" containerName="revoke-keys"
Jul 30 00:41:23.009225 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:23.009225    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="15d1d668-798c-457e-ba78-f9be1a10f27a" containerName="revoke-keys"
Jul 30 00:41:23.009316 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:23.009287    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="15d1d668-798c-457e-ba78-f9be1a10f27a" containerName="revoke-keys"
Jul 30 00:41:23.012336 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:23.012321    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d11ca7-75649b6794-n544r"
Jul 30 00:41:23.016176 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:23.016133    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 00:41:23.016300 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:23.016278    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-d11ca7-serving-cert\""
Jul 30 00:41:23.016366 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:23.016294    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wft5v\""
Jul 30 00:41:23.016990 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:23.016975    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 30 00:41:23.032530 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:23.032511    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d11ca7-75649b6794-n544r"]
Jul 30 00:41:23.111461 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:23.111434    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b543a057-48ca-4641-9ceb-5b3b134419b6-maas-api-tls\") pod \"maas-api-e2e-inf-a-d11ca7-75649b6794-n544r\" (UID: \"b543a057-48ca-4641-9ceb-5b3b134419b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d11ca7-75649b6794-n544r"
Jul 30 00:41:23.111599 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:23.111473    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgvd5\" (UniqueName: \"kubernetes.io/projected/b543a057-48ca-4641-9ceb-5b3b134419b6-kube-api-access-xgvd5\") pod \"maas-api-e2e-inf-a-d11ca7-75649b6794-n544r\" (UID: \"b543a057-48ca-4641-9ceb-5b3b134419b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d11ca7-75649b6794-n544r"
Jul 30 00:41:23.111599 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:23.111552    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b543a057-48ca-4641-9ceb-5b3b134419b6-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d11ca7-75649b6794-n544r\" (UID: \"b543a057-48ca-4641-9ceb-5b3b134419b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d11ca7-75649b6794-n544r"
Jul 30 00:41:23.212032 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:23.212002    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b543a057-48ca-4641-9ceb-5b3b134419b6-maas-api-tls\") pod \"maas-api-e2e-inf-a-d11ca7-75649b6794-n544r\" (UID: \"b543a057-48ca-4641-9ceb-5b3b134419b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d11ca7-75649b6794-n544r"
Jul 30 00:41:23.212213 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:23.212041    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgvd5\" (UniqueName: \"kubernetes.io/projected/b543a057-48ca-4641-9ceb-5b3b134419b6-kube-api-access-xgvd5\") pod \"maas-api-e2e-inf-a-d11ca7-75649b6794-n544r\" (UID: \"b543a057-48ca-4641-9ceb-5b3b134419b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d11ca7-75649b6794-n544r"
Jul 30 00:41:23.212213 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:23.212074    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b543a057-48ca-4641-9ceb-5b3b134419b6-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d11ca7-75649b6794-n544r\" (UID: \"b543a057-48ca-4641-9ceb-5b3b134419b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d11ca7-75649b6794-n544r"
Jul 30 00:41:23.212336 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:41:23.212208    2527 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-d11ca7-serving-cert: secret "maas-api-e2e-inf-a-d11ca7-serving-cert" not found
Jul 30 00:41:23.212336 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:41:23.212273    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b543a057-48ca-4641-9ceb-5b3b134419b6-maas-api-tls podName:b543a057-48ca-4641-9ceb-5b3b134419b6 nodeName:}" failed. No retries permitted until 2026-07-30 00:41:23.712251791 +0000 UTC m=+2358.014700113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b543a057-48ca-4641-9ceb-5b3b134419b6-maas-api-tls") pod "maas-api-e2e-inf-a-d11ca7-75649b6794-n544r" (UID: "b543a057-48ca-4641-9ceb-5b3b134419b6") : secret "maas-api-e2e-inf-a-d11ca7-serving-cert" not found
Jul 30 00:41:23.212713 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:23.212695    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b543a057-48ca-4641-9ceb-5b3b134419b6-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d11ca7-75649b6794-n544r\" (UID: \"b543a057-48ca-4641-9ceb-5b3b134419b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d11ca7-75649b6794-n544r"
Jul 30 00:41:23.225003 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:23.224981    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgvd5\" (UniqueName: \"kubernetes.io/projected/b543a057-48ca-4641-9ceb-5b3b134419b6-kube-api-access-xgvd5\") pod \"maas-api-e2e-inf-a-d11ca7-75649b6794-n544r\" (UID: \"b543a057-48ca-4641-9ceb-5b3b134419b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d11ca7-75649b6794-n544r"
Jul 30 00:41:23.716514 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:23.716477    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b543a057-48ca-4641-9ceb-5b3b134419b6-maas-api-tls\") pod \"maas-api-e2e-inf-a-d11ca7-75649b6794-n544r\" (UID: \"b543a057-48ca-4641-9ceb-5b3b134419b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d11ca7-75649b6794-n544r"
Jul 30 00:41:23.718858 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:23.718837    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b543a057-48ca-4641-9ceb-5b3b134419b6-maas-api-tls\") pod \"maas-api-e2e-inf-a-d11ca7-75649b6794-n544r\" (UID: \"b543a057-48ca-4641-9ceb-5b3b134419b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d11ca7-75649b6794-n544r"
Jul 30 00:41:23.923071 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:23.923035    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d11ca7-75649b6794-n544r"
Jul 30 00:41:24.068295 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:24.068267    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d11ca7-75649b6794-n544r"]
Jul 30 00:41:24.069346 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:41:24.069317    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb543a057_48ca_4641_9ceb_5b3b134419b6.slice/crio-2ac32bf04157033d56a16394683cc3775cba641f9ebd422bca3e32700f13a45c WatchSource:0}: Error finding container 2ac32bf04157033d56a16394683cc3775cba641f9ebd422bca3e32700f13a45c: Status 404 returned error can't find the container with id 2ac32bf04157033d56a16394683cc3775cba641f9ebd422bca3e32700f13a45c
Jul 30 00:41:24.070709 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:24.070693    2527 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 00:41:24.500990 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:24.500963    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d11ca7-75649b6794-n544r" event={"ID":"b543a057-48ca-4641-9ceb-5b3b134419b6","Type":"ContainerStarted","Data":"2ac32bf04157033d56a16394683cc3775cba641f9ebd422bca3e32700f13a45c"}
Jul 30 00:41:25.508418 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:25.508378    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d11ca7-75649b6794-n544r" event={"ID":"b543a057-48ca-4641-9ceb-5b3b134419b6","Type":"ContainerStarted","Data":"69cf82d7a281c19cb3ccc5f857a4a430005ca067bc6e14a2a80aaad5880e3b35"}
Jul 30 00:41:25.508780 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:25.508466    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d11ca7-75649b6794-n544r"
Jul 30 00:41:25.525155 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:25.525109    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d11ca7-75649b6794-n544r" podStartSLOduration=3.11788573 podStartE2EDuration="3.525094803s" totalImagesPullingTime="407.209073ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:41:25.523972083 +0000 UTC m=+2359.826420442" watchObservedRunningTime="2026-07-30 00:41:25.525094803 +0000 UTC m=+2359.827543146"
Jul 30 00:41:26.800478 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:26.800447    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:41:31.519294 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:31.519267    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d11ca7-75649b6794-n544r"
Jul 30 00:41:51.184854 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:51.184820    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw"]
Jul 30 00:41:51.189304 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:51.189287    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw"
Jul 30 00:41:51.191413 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:51.191395    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-5f678c-serving-cert\""
Jul 30 00:41:51.198449 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:51.198391    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw"]
Jul 30 00:41:51.331101 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:51.331069    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnp7q\" (UniqueName: \"kubernetes.io/projected/5f8efb4d-fbca-46e0-90b8-6c5395f592fa-kube-api-access-bnp7q\") pod \"maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw\" (UID: \"5f8efb4d-fbca-46e0-90b8-6c5395f592fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw"
Jul 30 00:41:51.331266 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:51.331154    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f8efb4d-fbca-46e0-90b8-6c5395f592fa-openshift-service-ca\") pod \"maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw\" (UID: \"5f8efb4d-fbca-46e0-90b8-6c5395f592fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw"
Jul 30 00:41:51.331266 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:51.331221    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f8efb4d-fbca-46e0-90b8-6c5395f592fa-maas-api-tls\") pod \"maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw\" (UID: \"5f8efb4d-fbca-46e0-90b8-6c5395f592fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw"
Jul 30 00:41:51.431941 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:51.431914    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f8efb4d-fbca-46e0-90b8-6c5395f592fa-maas-api-tls\") pod \"maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw\" (UID: \"5f8efb4d-fbca-46e0-90b8-6c5395f592fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw"
Jul 30 00:41:51.432077 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:51.431972    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnp7q\" (UniqueName: \"kubernetes.io/projected/5f8efb4d-fbca-46e0-90b8-6c5395f592fa-kube-api-access-bnp7q\") pod \"maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw\" (UID: \"5f8efb4d-fbca-46e0-90b8-6c5395f592fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw"
Jul 30 00:41:51.432122 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:51.432076    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f8efb4d-fbca-46e0-90b8-6c5395f592fa-openshift-service-ca\") pod \"maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw\" (UID: \"5f8efb4d-fbca-46e0-90b8-6c5395f592fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw"
Jul 30 00:41:51.432700 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:51.432682    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f8efb4d-fbca-46e0-90b8-6c5395f592fa-openshift-service-ca\") pod \"maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw\" (UID: \"5f8efb4d-fbca-46e0-90b8-6c5395f592fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw"
Jul 30 00:41:51.434423 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:51.434407    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f8efb4d-fbca-46e0-90b8-6c5395f592fa-maas-api-tls\") pod \"maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw\" (UID: \"5f8efb4d-fbca-46e0-90b8-6c5395f592fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw"
Jul 30 00:41:51.439279 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:51.439241    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnp7q\" (UniqueName: \"kubernetes.io/projected/5f8efb4d-fbca-46e0-90b8-6c5395f592fa-kube-api-access-bnp7q\") pod \"maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw\" (UID: \"5f8efb4d-fbca-46e0-90b8-6c5395f592fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw"
Jul 30 00:41:51.501996 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:51.501968    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw"
Jul 30 00:41:51.645576 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:51.645549    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw"]
Jul 30 00:41:51.647691 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:41:51.647659    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f8efb4d_fbca_46e0_90b8_6c5395f592fa.slice/crio-e4ab501eefe755a96481666a728032df88596912065054388ef6a9485b7c3b99 WatchSource:0}: Error finding container e4ab501eefe755a96481666a728032df88596912065054388ef6a9485b7c3b99: Status 404 returned error can't find the container with id e4ab501eefe755a96481666a728032df88596912065054388ef6a9485b7c3b99
Jul 30 00:41:51.667822 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:51.667793    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw" event={"ID":"5f8efb4d-fbca-46e0-90b8-6c5395f592fa","Type":"ContainerStarted","Data":"e4ab501eefe755a96481666a728032df88596912065054388ef6a9485b7c3b99"}
Jul 30 00:41:52.674765 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:52.674686    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw" event={"ID":"5f8efb4d-fbca-46e0-90b8-6c5395f592fa","Type":"ContainerStarted","Data":"092ce068d6ca700dfabcf9ff25a7b7d65a3612268461bdf7153887772e78e1e6"}
Jul 30 00:41:52.675098 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:52.674773    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw"
Jul 30 00:41:52.689370 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:52.689325    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw" podStartSLOduration=1.040747822 podStartE2EDuration="1.689310913s" totalImagesPullingTime="648.563091ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:41:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:41:52.688693143 +0000 UTC m=+2386.991141487" watchObservedRunningTime="2026-07-30 00:41:52.689310913 +0000 UTC m=+2386.991759257"
Jul 30 00:41:56.899385 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:56.899354    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:41:58.686836 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:41:58.686803    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw"
Jul 30 00:42:06.453494 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:42:06.453464    2527 scope.go:117] "RemoveContainer" containerID="0510cd833c3c6ad1fa809be18659665af309eebe95d881a0fa1ab5cec60def5d"
Jul 30 00:42:09.935423 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:42:09.935394    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9cggv_c6b01a1f-c41e-4781-8c25-66b152e0d0e8/ovn-acl-logging/0.log"
Jul 30 00:42:09.958083 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:42:09.958056    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9cggv_c6b01a1f-c41e-4781-8c25-66b152e0d0e8/ovn-acl-logging/0.log"
Jul 30 00:42:24.394551 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:42:24.394517    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:42:58.307882 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:42:58.307806    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:43:11.601659 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:11.601631    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:43:45.836273 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:45.836238    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d11ca7-4qk47"]
Jul 30 00:43:45.839910 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:45.839893    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d11ca7-4qk47"
Jul 30 00:43:45.842395 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:45.842348    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t42rq\""
Jul 30 00:43:45.846509 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:45.846485    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d11ca7-4qk47"]
Jul 30 00:43:45.900657 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:45.900632    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c07abc5-a6c1-4b26-ae31-f82cd95de4fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d11ca7-4qk47\" (UID: \"0c07abc5-a6c1-4b26-ae31-f82cd95de4fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d11ca7-4qk47"
Jul 30 00:43:46.001809 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:46.001781    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c07abc5-a6c1-4b26-ae31-f82cd95de4fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d11ca7-4qk47\" (UID: \"0c07abc5-a6c1-4b26-ae31-f82cd95de4fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d11ca7-4qk47"
Jul 30 00:43:46.002357 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:46.002340    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c07abc5-a6c1-4b26-ae31-f82cd95de4fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d11ca7-4qk47\" (UID: \"0c07abc5-a6c1-4b26-ae31-f82cd95de4fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d11ca7-4qk47"
Jul 30 00:43:46.153805 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:46.153733    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d11ca7-4qk47"
Jul 30 00:43:46.293314 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:46.293284    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d11ca7-4qk47"]
Jul 30 00:43:46.294833 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:43:46.294799    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c07abc5_a6c1_4b26_ae31_f82cd95de4fc.slice/crio-0d0ff2db8e574a68a866c5d1208ff6869c83b1373c4965fc2b19d958187a5d79 WatchSource:0}: Error finding container 0d0ff2db8e574a68a866c5d1208ff6869c83b1373c4965fc2b19d958187a5d79: Status 404 returned error can't find the container with id 0d0ff2db8e574a68a866c5d1208ff6869c83b1373c4965fc2b19d958187a5d79
Jul 30 00:43:46.355098 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:46.355073    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d11ca7-4qk47" event={"ID":"0c07abc5-a6c1-4b26-ae31-f82cd95de4fc","Type":"ContainerStarted","Data":"0d0ff2db8e574a68a866c5d1208ff6869c83b1373c4965fc2b19d958187a5d79"}
Jul 30 00:43:47.362391 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:47.362312    2527 generic.go:356] "Generic (PLEG): container finished" podID="0c07abc5-a6c1-4b26-ae31-f82cd95de4fc" containerID="5d9eb37fa9b77fe8696e274818bcc88637691b24ef634be844b99b331de0bf48" exitCode=0
Jul 30 00:43:47.362746 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:47.362402    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d11ca7-4qk47" event={"ID":"0c07abc5-a6c1-4b26-ae31-f82cd95de4fc","Type":"ContainerDied","Data":"5d9eb37fa9b77fe8696e274818bcc88637691b24ef634be844b99b331de0bf48"}
Jul 30 00:43:48.507881 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:48.507856    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d11ca7-4qk47"
Jul 30 00:43:48.621840 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:48.621763    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c07abc5-a6c1-4b26-ae31-f82cd95de4fc-maas-api-service-ca\") pod \"0c07abc5-a6c1-4b26-ae31-f82cd95de4fc\" (UID: \"0c07abc5-a6c1-4b26-ae31-f82cd95de4fc\") "
Jul 30 00:43:48.622189 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:48.622145    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c07abc5-a6c1-4b26-ae31-f82cd95de4fc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0c07abc5-a6c1-4b26-ae31-f82cd95de4fc" (UID: "0c07abc5-a6c1-4b26-ae31-f82cd95de4fc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:43:48.723403 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:48.723378    2527 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c07abc5-a6c1-4b26-ae31-f82cd95de4fc-maas-api-service-ca\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:43:49.295704 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:49.295665    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:43:49.376248 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:49.376219    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d11ca7-4qk47"
Jul 30 00:43:49.376414 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:49.376250    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d11ca7-4qk47" event={"ID":"0c07abc5-a6c1-4b26-ae31-f82cd95de4fc","Type":"ContainerDied","Data":"0d0ff2db8e574a68a866c5d1208ff6869c83b1373c4965fc2b19d958187a5d79"}
Jul 30 00:43:49.376414 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:49.376296    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d0ff2db8e574a68a866c5d1208ff6869c83b1373c4965fc2b19d958187a5d79"
Jul 30 00:43:56.204634 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:56.204594    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d11ca7-75649b6794-n544r"]
Jul 30 00:43:56.205068 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:56.204903    2527 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d11ca7-75649b6794-n544r" podUID="b543a057-48ca-4641-9ceb-5b3b134419b6" containerName="maas-api" containerID="cri-o://69cf82d7a281c19cb3ccc5f857a4a430005ca067bc6e14a2a80aaad5880e3b35" gracePeriod=30
Jul 30 00:43:56.401715 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:56.401685    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d11ca7-4qk47"]
Jul 30 00:43:56.404257 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:56.404233    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d11ca7-4qk47"]
Jul 30 00:43:56.515402 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:56.515369    2527 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d11ca7-75649b6794-n544r" podUID="b543a057-48ca-4641-9ceb-5b3b134419b6" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.74:8443/health\": dial tcp 10.134.0.74:8443: connect: connection refused"
Jul 30 00:43:56.673041 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:56.673015    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d11ca7-75649b6794-n544r"
Jul 30 00:43:56.792393 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:56.792308    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b543a057-48ca-4641-9ceb-5b3b134419b6-maas-api-tls\") pod \"b543a057-48ca-4641-9ceb-5b3b134419b6\" (UID: \"b543a057-48ca-4641-9ceb-5b3b134419b6\") "
Jul 30 00:43:56.792393 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:56.792361    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b543a057-48ca-4641-9ceb-5b3b134419b6-openshift-service-ca\") pod \"b543a057-48ca-4641-9ceb-5b3b134419b6\" (UID: \"b543a057-48ca-4641-9ceb-5b3b134419b6\") "
Jul 30 00:43:56.792605 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:56.792438    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgvd5\" (UniqueName: \"kubernetes.io/projected/b543a057-48ca-4641-9ceb-5b3b134419b6-kube-api-access-xgvd5\") pod \"b543a057-48ca-4641-9ceb-5b3b134419b6\" (UID: \"b543a057-48ca-4641-9ceb-5b3b134419b6\") "
Jul 30 00:43:56.792657 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:56.792632    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b543a057-48ca-4641-9ceb-5b3b134419b6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b543a057-48ca-4641-9ceb-5b3b134419b6" (UID: "b543a057-48ca-4641-9ceb-5b3b134419b6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:43:56.792735 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:56.792714    2527 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b543a057-48ca-4641-9ceb-5b3b134419b6-openshift-service-ca\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:43:56.794602 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:56.794583    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b543a057-48ca-4641-9ceb-5b3b134419b6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b543a057-48ca-4641-9ceb-5b3b134419b6" (UID: "b543a057-48ca-4641-9ceb-5b3b134419b6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:43:56.794676 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:56.794632    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b543a057-48ca-4641-9ceb-5b3b134419b6-kube-api-access-xgvd5" (OuterVolumeSpecName: "kube-api-access-xgvd5") pod "b543a057-48ca-4641-9ceb-5b3b134419b6" (UID: "b543a057-48ca-4641-9ceb-5b3b134419b6"). InnerVolumeSpecName "kube-api-access-xgvd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:43:56.894103 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:56.894078    2527 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b543a057-48ca-4641-9ceb-5b3b134419b6-maas-api-tls\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:43:56.894103 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:56.894101    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgvd5\" (UniqueName: \"kubernetes.io/projected/b543a057-48ca-4641-9ceb-5b3b134419b6-kube-api-access-xgvd5\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:43:57.427492 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:57.427457    2527 generic.go:356] "Generic (PLEG): container finished" podID="b543a057-48ca-4641-9ceb-5b3b134419b6" containerID="69cf82d7a281c19cb3ccc5f857a4a430005ca067bc6e14a2a80aaad5880e3b35" exitCode=0
Jul 30 00:43:57.427936 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:57.427506    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d11ca7-75649b6794-n544r"
Jul 30 00:43:57.427936 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:57.427536    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d11ca7-75649b6794-n544r" event={"ID":"b543a057-48ca-4641-9ceb-5b3b134419b6","Type":"ContainerDied","Data":"69cf82d7a281c19cb3ccc5f857a4a430005ca067bc6e14a2a80aaad5880e3b35"}
Jul 30 00:43:57.427936 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:57.427589    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d11ca7-75649b6794-n544r" event={"ID":"b543a057-48ca-4641-9ceb-5b3b134419b6","Type":"ContainerDied","Data":"2ac32bf04157033d56a16394683cc3775cba641f9ebd422bca3e32700f13a45c"}
Jul 30 00:43:57.427936 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:57.427611    2527 scope.go:117] "RemoveContainer" containerID="69cf82d7a281c19cb3ccc5f857a4a430005ca067bc6e14a2a80aaad5880e3b35"
Jul 30 00:43:57.437882 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:57.437859    2527 scope.go:117] "RemoveContainer" containerID="69cf82d7a281c19cb3ccc5f857a4a430005ca067bc6e14a2a80aaad5880e3b35"
Jul 30 00:43:57.438147 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:43:57.438127    2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69cf82d7a281c19cb3ccc5f857a4a430005ca067bc6e14a2a80aaad5880e3b35\": container with ID starting with 69cf82d7a281c19cb3ccc5f857a4a430005ca067bc6e14a2a80aaad5880e3b35 not found: ID does not exist" containerID="69cf82d7a281c19cb3ccc5f857a4a430005ca067bc6e14a2a80aaad5880e3b35"
Jul 30 00:43:57.438234 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:57.438157    2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69cf82d7a281c19cb3ccc5f857a4a430005ca067bc6e14a2a80aaad5880e3b35"} err="failed to get container status \"69cf82d7a281c19cb3ccc5f857a4a430005ca067bc6e14a2a80aaad5880e3b35\": rpc error: code = NotFound desc = could not find container \"69cf82d7a281c19cb3ccc5f857a4a430005ca067bc6e14a2a80aaad5880e3b35\": container with ID starting with 69cf82d7a281c19cb3ccc5f857a4a430005ca067bc6e14a2a80aaad5880e3b35 not found: ID does not exist"
Jul 30 00:43:57.447574 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:57.447552    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d11ca7-75649b6794-n544r"]
Jul 30 00:43:57.451189 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:57.451154    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d11ca7-75649b6794-n544r"]
Jul 30 00:43:58.217291 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:58.217255    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c07abc5-a6c1-4b26-ae31-f82cd95de4fc" path="/var/lib/kubelet/pods/0c07abc5-a6c1-4b26-ae31-f82cd95de4fc/volumes"
Jul 30 00:43:58.217674 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:43:58.217658    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b543a057-48ca-4641-9ceb-5b3b134419b6" path="/var/lib/kubelet/pods/b543a057-48ca-4641-9ceb-5b3b134419b6/volumes"
Jul 30 00:44:03.040423 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:03.040380    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5f678c-2m7bv"]
Jul 30 00:44:03.040835 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:03.040821    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b543a057-48ca-4641-9ceb-5b3b134419b6" containerName="maas-api"
Jul 30 00:44:03.040883 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:03.040836    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="b543a057-48ca-4641-9ceb-5b3b134419b6" containerName="maas-api"
Jul 30 00:44:03.040883 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:03.040854    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c07abc5-a6c1-4b26-ae31-f82cd95de4fc" containerName="revoke-keys"
Jul 30 00:44:03.040883 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:03.040860    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c07abc5-a6c1-4b26-ae31-f82cd95de4fc" containerName="revoke-keys"
Jul 30 00:44:03.041000 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:03.040915    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c07abc5-a6c1-4b26-ae31-f82cd95de4fc" containerName="revoke-keys"
Jul 30 00:44:03.041000 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:03.040925    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="b543a057-48ca-4641-9ceb-5b3b134419b6" containerName="maas-api"
Jul 30 00:44:03.045960 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:03.045941    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5f678c-2m7bv"
Jul 30 00:44:03.048623 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:03.048599    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t42rq\""
Jul 30 00:44:03.050936 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:03.050893    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5f678c-2m7bv"]
Jul 30 00:44:03.149633 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:03.149593    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a8c84e2-1315-4d2e-b99a-cbe492ef9dc8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-5f678c-2m7bv\" (UID: \"7a8c84e2-1315-4d2e-b99a-cbe492ef9dc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5f678c-2m7bv"
Jul 30 00:44:03.251234 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:03.251201    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a8c84e2-1315-4d2e-b99a-cbe492ef9dc8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-5f678c-2m7bv\" (UID: \"7a8c84e2-1315-4d2e-b99a-cbe492ef9dc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5f678c-2m7bv"
Jul 30 00:44:03.251744 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:03.251725    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a8c84e2-1315-4d2e-b99a-cbe492ef9dc8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-5f678c-2m7bv\" (UID: \"7a8c84e2-1315-4d2e-b99a-cbe492ef9dc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5f678c-2m7bv"
Jul 30 00:44:03.358538 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:03.358464    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5f678c-2m7bv"
Jul 30 00:44:03.501490 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:03.501466    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5f678c-2m7bv"]
Jul 30 00:44:03.503398 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:44:03.503373    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a8c84e2_1315_4d2e_b99a_cbe492ef9dc8.slice/crio-4935ef7a247213bfdd1879fb8208450c905e9b6a1ffe44ea4965c06fd3eb3bcb WatchSource:0}: Error finding container 4935ef7a247213bfdd1879fb8208450c905e9b6a1ffe44ea4965c06fd3eb3bcb: Status 404 returned error can't find the container with id 4935ef7a247213bfdd1879fb8208450c905e9b6a1ffe44ea4965c06fd3eb3bcb
Jul 30 00:44:04.473345 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:04.473315    2527 generic.go:356] "Generic (PLEG): container finished" podID="7a8c84e2-1315-4d2e-b99a-cbe492ef9dc8" containerID="1306a731316ac0aacedde6efb0f46e8e90b24176953b51721633ab57cc17b40c" exitCode=0
Jul 30 00:44:04.473715 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:04.473363    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5f678c-2m7bv" event={"ID":"7a8c84e2-1315-4d2e-b99a-cbe492ef9dc8","Type":"ContainerDied","Data":"1306a731316ac0aacedde6efb0f46e8e90b24176953b51721633ab57cc17b40c"}
Jul 30 00:44:04.473715 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:04.473416    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5f678c-2m7bv" event={"ID":"7a8c84e2-1315-4d2e-b99a-cbe492ef9dc8","Type":"ContainerStarted","Data":"4935ef7a247213bfdd1879fb8208450c905e9b6a1ffe44ea4965c06fd3eb3bcb"}
Jul 30 00:44:05.197127 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:05.197087    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:44:05.619336 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:05.619309    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5f678c-2m7bv"
Jul 30 00:44:05.673586 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:05.673561    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a8c84e2-1315-4d2e-b99a-cbe492ef9dc8-maas-api-service-ca\") pod \"7a8c84e2-1315-4d2e-b99a-cbe492ef9dc8\" (UID: \"7a8c84e2-1315-4d2e-b99a-cbe492ef9dc8\") "
Jul 30 00:44:05.673907 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:05.673884    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a8c84e2-1315-4d2e-b99a-cbe492ef9dc8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7a8c84e2-1315-4d2e-b99a-cbe492ef9dc8" (UID: "7a8c84e2-1315-4d2e-b99a-cbe492ef9dc8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:44:05.774148 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:05.774086    2527 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a8c84e2-1315-4d2e-b99a-cbe492ef9dc8-maas-api-service-ca\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:44:06.484223 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:06.484125    2527 scope.go:117] "RemoveContainer" containerID="db18202b3a77669d0c10fdb2eb8dc46b769e7b8ffbbc40a5deb3100575164fb3"
Jul 30 00:44:06.485890 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:06.485868    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5f678c-2m7bv"
Jul 30 00:44:06.485999 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:06.485900    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5f678c-2m7bv" event={"ID":"7a8c84e2-1315-4d2e-b99a-cbe492ef9dc8","Type":"ContainerDied","Data":"4935ef7a247213bfdd1879fb8208450c905e9b6a1ffe44ea4965c06fd3eb3bcb"}
Jul 30 00:44:06.485999 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:06.485971    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4935ef7a247213bfdd1879fb8208450c905e9b6a1ffe44ea4965c06fd3eb3bcb"
Jul 30 00:44:13.405922 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:13.405888    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw"]
Jul 30 00:44:13.526863 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:13.526817    2527 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw" podUID="5f8efb4d-fbca-46e0-90b8-6c5395f592fa" containerName="maas-api" containerID="cri-o://092ce068d6ca700dfabcf9ff25a7b7d65a3612268461bdf7153887772e78e1e6" gracePeriod=30
Jul 30 00:44:13.581645 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:13.581619    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5f678c-2m7bv"]
Jul 30 00:44:13.584083 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:13.584063    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-5f678c-2m7bv"]
Jul 30 00:44:13.681346 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:13.681261    2527 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw" podUID="5f8efb4d-fbca-46e0-90b8-6c5395f592fa" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.75:8443/health\": dial tcp 10.134.0.75:8443: connect: connection refused"
Jul 30 00:44:13.795730 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:13.795706    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw"
Jul 30 00:44:13.840487 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:13.840459    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f8efb4d-fbca-46e0-90b8-6c5395f592fa-openshift-service-ca\") pod \"5f8efb4d-fbca-46e0-90b8-6c5395f592fa\" (UID: \"5f8efb4d-fbca-46e0-90b8-6c5395f592fa\") "
Jul 30 00:44:13.840632 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:13.840493    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnp7q\" (UniqueName: \"kubernetes.io/projected/5f8efb4d-fbca-46e0-90b8-6c5395f592fa-kube-api-access-bnp7q\") pod \"5f8efb4d-fbca-46e0-90b8-6c5395f592fa\" (UID: \"5f8efb4d-fbca-46e0-90b8-6c5395f592fa\") "
Jul 30 00:44:13.840632 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:13.840555    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f8efb4d-fbca-46e0-90b8-6c5395f592fa-maas-api-tls\") pod \"5f8efb4d-fbca-46e0-90b8-6c5395f592fa\" (UID: \"5f8efb4d-fbca-46e0-90b8-6c5395f592fa\") "
Jul 30 00:44:13.840779 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:13.840755    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f8efb4d-fbca-46e0-90b8-6c5395f592fa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5f8efb4d-fbca-46e0-90b8-6c5395f592fa" (UID: "5f8efb4d-fbca-46e0-90b8-6c5395f592fa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:44:13.840871 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:13.840857    2527 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f8efb4d-fbca-46e0-90b8-6c5395f592fa-openshift-service-ca\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:44:13.842803 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:13.842774    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f8efb4d-fbca-46e0-90b8-6c5395f592fa-kube-api-access-bnp7q" (OuterVolumeSpecName: "kube-api-access-bnp7q") pod "5f8efb4d-fbca-46e0-90b8-6c5395f592fa" (UID: "5f8efb4d-fbca-46e0-90b8-6c5395f592fa"). InnerVolumeSpecName "kube-api-access-bnp7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:44:13.843052 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:13.843028    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f8efb4d-fbca-46e0-90b8-6c5395f592fa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5f8efb4d-fbca-46e0-90b8-6c5395f592fa" (UID: "5f8efb4d-fbca-46e0-90b8-6c5395f592fa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:44:13.941567 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:13.941502    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnp7q\" (UniqueName: \"kubernetes.io/projected/5f8efb4d-fbca-46e0-90b8-6c5395f592fa-kube-api-access-bnp7q\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:44:13.941567 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:13.941525    2527 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f8efb4d-fbca-46e0-90b8-6c5395f592fa-maas-api-tls\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:44:14.216097 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:14.216066    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a8c84e2-1315-4d2e-b99a-cbe492ef9dc8" path="/var/lib/kubelet/pods/7a8c84e2-1315-4d2e-b99a-cbe492ef9dc8/volumes"
Jul 30 00:44:14.534806 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:14.534727    2527 generic.go:356] "Generic (PLEG): container finished" podID="5f8efb4d-fbca-46e0-90b8-6c5395f592fa" containerID="092ce068d6ca700dfabcf9ff25a7b7d65a3612268461bdf7153887772e78e1e6" exitCode=0
Jul 30 00:44:14.534806 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:14.534764    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw" event={"ID":"5f8efb4d-fbca-46e0-90b8-6c5395f592fa","Type":"ContainerDied","Data":"092ce068d6ca700dfabcf9ff25a7b7d65a3612268461bdf7153887772e78e1e6"}
Jul 30 00:44:14.535258 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:14.534817    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw" event={"ID":"5f8efb4d-fbca-46e0-90b8-6c5395f592fa","Type":"ContainerDied","Data":"e4ab501eefe755a96481666a728032df88596912065054388ef6a9485b7c3b99"}
Jul 30 00:44:14.535258 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:14.534776    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw"
Jul 30 00:44:14.535258 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:14.534844    2527 scope.go:117] "RemoveContainer" containerID="092ce068d6ca700dfabcf9ff25a7b7d65a3612268461bdf7153887772e78e1e6"
Jul 30 00:44:14.545230 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:14.545208    2527 scope.go:117] "RemoveContainer" containerID="092ce068d6ca700dfabcf9ff25a7b7d65a3612268461bdf7153887772e78e1e6"
Jul 30 00:44:14.545522 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:44:14.545489    2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"092ce068d6ca700dfabcf9ff25a7b7d65a3612268461bdf7153887772e78e1e6\": container with ID starting with 092ce068d6ca700dfabcf9ff25a7b7d65a3612268461bdf7153887772e78e1e6 not found: ID does not exist" containerID="092ce068d6ca700dfabcf9ff25a7b7d65a3612268461bdf7153887772e78e1e6"
Jul 30 00:44:14.545616 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:14.545531    2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"092ce068d6ca700dfabcf9ff25a7b7d65a3612268461bdf7153887772e78e1e6"} err="failed to get container status \"092ce068d6ca700dfabcf9ff25a7b7d65a3612268461bdf7153887772e78e1e6\": rpc error: code = NotFound desc = could not find container \"092ce068d6ca700dfabcf9ff25a7b7d65a3612268461bdf7153887772e78e1e6\": container with ID starting with 092ce068d6ca700dfabcf9ff25a7b7d65a3612268461bdf7153887772e78e1e6 not found: ID does not exist"
Jul 30 00:44:14.551282 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:14.551261    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw"]
Jul 30 00:44:14.557136 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:14.557113    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5f678c-75c5b5679-fd8mw"]
Jul 30 00:44:16.217096 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:16.217061    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f8efb4d-fbca-46e0-90b8-6c5395f592fa" path="/var/lib/kubelet/pods/5f8efb4d-fbca-46e0-90b8-6c5395f592fa/volumes"
Jul 30 00:44:16.697579 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:16.697551    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:44:20.839397 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.839361    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"]
Jul 30 00:44:20.839835 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.839799    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f8efb4d-fbca-46e0-90b8-6c5395f592fa" containerName="maas-api"
Jul 30 00:44:20.839835 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.839811    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f8efb4d-fbca-46e0-90b8-6c5395f592fa" containerName="maas-api"
Jul 30 00:44:20.839835 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.839829    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a8c84e2-1315-4d2e-b99a-cbe492ef9dc8" containerName="revoke-keys"
Jul 30 00:44:20.839835 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.839834    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a8c84e2-1315-4d2e-b99a-cbe492ef9dc8" containerName="revoke-keys"
Jul 30 00:44:20.840044 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.839895    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a8c84e2-1315-4d2e-b99a-cbe492ef9dc8" containerName="revoke-keys"
Jul 30 00:44:20.840044 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.839907    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f8efb4d-fbca-46e0-90b8-6c5395f592fa" containerName="maas-api"
Jul 30 00:44:20.843486 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.843463    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:20.846084 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.846066    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-dc78bf-openshift-default-dockercfg-6bjmd\""
Jul 30 00:44:20.855476 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.855454    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"]
Jul 30 00:44:20.894835 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.894815    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40df3b5e-80fc-484e-be1c-6a3d68340e8b-istio-envoy\") pod \"e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") " pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:20.894949 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.894863    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40df3b5e-80fc-484e-be1c-6a3d68340e8b-istio-token\") pod \"e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") " pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:20.894949 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.894923    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb9dh\" (UniqueName: \"kubernetes.io/projected/40df3b5e-80fc-484e-be1c-6a3d68340e8b-kube-api-access-lb9dh\") pod \"e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") " pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:20.895024 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.894973    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40df3b5e-80fc-484e-be1c-6a3d68340e8b-istio-podinfo\") pod \"e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") " pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:20.895024 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.895008    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40df3b5e-80fc-484e-be1c-6a3d68340e8b-credential-socket\") pod \"e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") " pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:20.895089 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.895031    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40df3b5e-80fc-484e-be1c-6a3d68340e8b-workload-certs\") pod \"e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") " pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:20.895089 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.895070    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40df3b5e-80fc-484e-be1c-6a3d68340e8b-istiod-ca-cert\") pod \"e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") " pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:20.895155 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.895090    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40df3b5e-80fc-484e-be1c-6a3d68340e8b-workload-socket\") pod \"e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") " pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:20.895220 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.895202    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40df3b5e-80fc-484e-be1c-6a3d68340e8b-istio-data\") pod \"e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") " pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:20.996617 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.996584    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40df3b5e-80fc-484e-be1c-6a3d68340e8b-istio-data\") pod \"e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") " pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:20.996759 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.996624    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40df3b5e-80fc-484e-be1c-6a3d68340e8b-istio-envoy\") pod \"e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") " pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:20.996759 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.996653    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40df3b5e-80fc-484e-be1c-6a3d68340e8b-istio-token\") pod \"e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") " pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:20.996835 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.996765    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lb9dh\" (UniqueName: \"kubernetes.io/projected/40df3b5e-80fc-484e-be1c-6a3d68340e8b-kube-api-access-lb9dh\") pod \"e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") " pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:20.996835 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.996823    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40df3b5e-80fc-484e-be1c-6a3d68340e8b-istio-podinfo\") pod \"e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") " pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:20.996939 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.996868    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40df3b5e-80fc-484e-be1c-6a3d68340e8b-credential-socket\") pod \"e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") " pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:20.996939 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.996897    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40df3b5e-80fc-484e-be1c-6a3d68340e8b-workload-certs\") pod \"e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") " pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:20.996939 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.996917    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40df3b5e-80fc-484e-be1c-6a3d68340e8b-istio-data\") pod \"e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") " pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:20.997116 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.996920    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40df3b5e-80fc-484e-be1c-6a3d68340e8b-istiod-ca-cert\") pod \"e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") " pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:20.997116 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.996979    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40df3b5e-80fc-484e-be1c-6a3d68340e8b-workload-socket\") pod \"e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") " pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:20.997341 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.997320    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40df3b5e-80fc-484e-be1c-6a3d68340e8b-credential-socket\") pod \"e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") " pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:20.997423 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.997345    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40df3b5e-80fc-484e-be1c-6a3d68340e8b-workload-certs\") pod \"e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") " pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:20.997586 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.997567    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40df3b5e-80fc-484e-be1c-6a3d68340e8b-workload-socket\") pod \"e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") " pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:20.997676 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.997660    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40df3b5e-80fc-484e-be1c-6a3d68340e8b-istiod-ca-cert\") pod \"e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") " pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:20.999006 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.998986    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40df3b5e-80fc-484e-be1c-6a3d68340e8b-istio-envoy\") pod \"e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") " pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:20.999317 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:20.999300    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40df3b5e-80fc-484e-be1c-6a3d68340e8b-istio-podinfo\") pod \"e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") " pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:21.004357 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:21.004338    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40df3b5e-80fc-484e-be1c-6a3d68340e8b-istio-token\") pod \"e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") " pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:21.004595 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:21.004577    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb9dh\" (UniqueName: \"kubernetes.io/projected/40df3b5e-80fc-484e-be1c-6a3d68340e8b-kube-api-access-lb9dh\") pod \"e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") " pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:21.156692 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:21.156628    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:21.300958 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:21.300930    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"]
Jul 30 00:44:21.302346 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:44:21.302319    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40df3b5e_80fc_484e_be1c_6a3d68340e8b.slice/crio-8c98b351fba6d6aa9b90a50d57bbf3c4bc43321e67f7bc35d9ced51939d1790a WatchSource:0}: Error finding container 8c98b351fba6d6aa9b90a50d57bbf3c4bc43321e67f7bc35d9ced51939d1790a: Status 404 returned error can't find the container with id 8c98b351fba6d6aa9b90a50d57bbf3c4bc43321e67f7bc35d9ced51939d1790a
Jul 30 00:44:21.304598 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:21.304567    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:44:21.304677 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:21.304632    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:44:21.304677 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:21.304658    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:44:21.582507 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:21.582467    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6" event={"ID":"40df3b5e-80fc-484e-be1c-6a3d68340e8b","Type":"ContainerStarted","Data":"e52d840a28f64d97e18ae38a91882bf7d422b00ee3c6cd50b1c008378130f70e"}
Jul 30 00:44:21.582700 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:21.582527    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6" event={"ID":"40df3b5e-80fc-484e-be1c-6a3d68340e8b","Type":"ContainerStarted","Data":"8c98b351fba6d6aa9b90a50d57bbf3c4bc43321e67f7bc35d9ced51939d1790a"}
Jul 30 00:44:21.601204 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:21.601134    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6" podStartSLOduration=1.601115112 podStartE2EDuration="1.601115112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:44:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:44:21.600429272 +0000 UTC m=+2535.902877619" watchObservedRunningTime="2026-07-30 00:44:21.601115112 +0000 UTC m=+2535.903563457"
Jul 30 00:44:22.157479 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:22.157445    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:22.162626 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:22.162601    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:22.589440 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:22.589406    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:22.590421 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:22.590402    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:28.903483 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:28.903446    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:44:37.591028 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:37.590993    2527 patch_prober.go:28] interesting pod/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Jul 30 00:44:37.591470 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:37.591059    2527 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6" podUID="40df3b5e-80fc-484e-be1c-6a3d68340e8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Jul 30 00:44:37.694856 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:37.694822    2527 generic.go:356] "Generic (PLEG): container finished" podID="40df3b5e-80fc-484e-be1c-6a3d68340e8b" containerID="e52d840a28f64d97e18ae38a91882bf7d422b00ee3c6cd50b1c008378130f70e" exitCode=0
Jul 30 00:44:37.694996 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:37.694894    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6" event={"ID":"40df3b5e-80fc-484e-be1c-6a3d68340e8b","Type":"ContainerDied","Data":"e52d840a28f64d97e18ae38a91882bf7d422b00ee3c6cd50b1c008378130f70e"}
Jul 30 00:44:37.695301 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:37.695288    2527 scope.go:117] "RemoveContainer" containerID="e52d840a28f64d97e18ae38a91882bf7d422b00ee3c6cd50b1c008378130f70e"
Jul 30 00:44:37.696299 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:37.696272    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:44:37.696361 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:37.696339    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:44:37.696408 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:37.696379    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:44:38.703242 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:38.703205    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6" event={"ID":"40df3b5e-80fc-484e-be1c-6a3d68340e8b","Type":"ContainerStarted","Data":"b472a24bd6361a4193c6c500fff40b2d8e033e057af4cdbbd9b0773356a7ffa7"}
Jul 30 00:44:39.157219 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:39.157105    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:39.157395 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:39.157242    2527 patch_prober.go:28] interesting pod/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Jul 30 00:44:39.157395 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:39.157284    2527 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6" podUID="40df3b5e-80fc-484e-be1c-6a3d68340e8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Jul 30 00:44:40.157145 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:40.157102    2527 patch_prober.go:28] interesting pod/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Jul 30 00:44:40.157666 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:40.157196    2527 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6" podUID="40df3b5e-80fc-484e-be1c-6a3d68340e8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Jul 30 00:44:41.158152 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:41.158117    2527 patch_prober.go:28] interesting pod/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Jul 30 00:44:41.158666 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:41.158204    2527 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6" podUID="40df3b5e-80fc-484e-be1c-6a3d68340e8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Jul 30 00:44:42.157545 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:42.157505    2527 patch_prober.go:28] interesting pod/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Jul 30 00:44:42.158944 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:42.158910    2527 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6" podUID="40df3b5e-80fc-484e-be1c-6a3d68340e8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Jul 30 00:44:43.161293 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:43.161264    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:43.161685 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:43.161595    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:43.162250 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:43.162230    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:44:53.601640 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:53.601608    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9"]
Jul 30 00:44:53.605409 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:53.605390    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9"
Jul 30 00:44:53.607949 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:53.607927    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-fb2e9f-dockercfg-bdqf6\""
Jul 30 00:44:53.608060 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:53.607929    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-fb2e9f\""
Jul 30 00:44:53.614603 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:53.614582    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9"]
Jul 30 00:44:53.794216 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:53.794179    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e1ac0e7-11e7-49b1-95a1-4825ffde4c40-plugins-config-volume\") pod \"payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9\" (UID: \"2e1ac0e7-11e7-49b1-95a1-4825ffde4c40\") " pod="openshift-ingress/payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9"
Jul 30 00:44:53.794381 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:53.794229    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9xpv\" (UniqueName: \"kubernetes.io/projected/2e1ac0e7-11e7-49b1-95a1-4825ffde4c40-kube-api-access-t9xpv\") pod \"payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9\" (UID: \"2e1ac0e7-11e7-49b1-95a1-4825ffde4c40\") " pod="openshift-ingress/payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9"
Jul 30 00:44:53.895270 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:53.895192    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9xpv\" (UniqueName: \"kubernetes.io/projected/2e1ac0e7-11e7-49b1-95a1-4825ffde4c40-kube-api-access-t9xpv\") pod \"payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9\" (UID: \"2e1ac0e7-11e7-49b1-95a1-4825ffde4c40\") " pod="openshift-ingress/payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9"
Jul 30 00:44:53.895398 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:53.895334    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e1ac0e7-11e7-49b1-95a1-4825ffde4c40-plugins-config-volume\") pod \"payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9\" (UID: \"2e1ac0e7-11e7-49b1-95a1-4825ffde4c40\") " pod="openshift-ingress/payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9"
Jul 30 00:44:53.895950 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:53.895931    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e1ac0e7-11e7-49b1-95a1-4825ffde4c40-plugins-config-volume\") pod \"payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9\" (UID: \"2e1ac0e7-11e7-49b1-95a1-4825ffde4c40\") " pod="openshift-ingress/payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9"
Jul 30 00:44:53.903301 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:53.903280    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9xpv\" (UniqueName: \"kubernetes.io/projected/2e1ac0e7-11e7-49b1-95a1-4825ffde4c40-kube-api-access-t9xpv\") pod \"payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9\" (UID: \"2e1ac0e7-11e7-49b1-95a1-4825ffde4c40\") " pod="openshift-ingress/payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9"
Jul 30 00:44:53.917302 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:53.917279    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9"
Jul 30 00:44:54.262152 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:54.262126    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9"]
Jul 30 00:44:54.263488 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:44:54.263461    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e1ac0e7_11e7_49b1_95a1_4825ffde4c40.slice/crio-4aada6c2095d88288f655c46d6c2c1b39cb889bfea9188916c7d0e2e7fec6497 WatchSource:0}: Error finding container 4aada6c2095d88288f655c46d6c2c1b39cb889bfea9188916c7d0e2e7fec6497: Status 404 returned error can't find the container with id 4aada6c2095d88288f655c46d6c2c1b39cb889bfea9188916c7d0e2e7fec6497
Jul 30 00:44:54.799654 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:54.799622    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9" event={"ID":"2e1ac0e7-11e7-49b1-95a1-4825ffde4c40","Type":"ContainerStarted","Data":"afc7947fe1872d7de0bd93e30cb2b136d36060cfbefc47bea2b30fabeca8c390"}
Jul 30 00:44:54.800189 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:54.799697    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9" event={"ID":"2e1ac0e7-11e7-49b1-95a1-4825ffde4c40","Type":"ContainerStarted","Data":"4aada6c2095d88288f655c46d6c2c1b39cb889bfea9188916c7d0e2e7fec6497"}
Jul 30 00:44:54.800189 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:54.799726    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9"
Jul 30 00:44:54.815593 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:44:54.815541    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9" podStartSLOduration=1.815526678 podStartE2EDuration="1.815526678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:44:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:44:54.813325842 +0000 UTC m=+2569.115774190" watchObservedRunningTime="2026-07-30 00:44:54.815526678 +0000 UTC m=+2569.117975023"
Jul 30 00:45:00.134377 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:00.134343    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb2e9f-29756205-gqxmb"]
Jul 30 00:45:00.138608 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:00.138587    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-dc78bf-29756205-d2vgw"]
Jul 30 00:45:00.138723 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:00.138704    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb2e9f-29756205-gqxmb"
Jul 30 00:45:00.141109 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:00.141085    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t42rq\""
Jul 30 00:45:00.141778 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:00.141756    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29756205-lkpws"]
Jul 30 00:45:00.141890 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:00.141878    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-dc78bf-29756205-d2vgw"
Jul 30 00:45:00.146554 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:00.146533    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb2e9f-29756205-gqxmb"]
Jul 30 00:45:00.146704 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:00.146683    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756205-lkpws"
Jul 30 00:45:00.150525 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:00.150502    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29756205-lkpws"]
Jul 30 00:45:00.154187 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:00.154151    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-dc78bf-29756205-d2vgw"]
Jul 30 00:45:00.154315 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:00.154297    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb2e9f-29756205-gqxmb"
Jul 30 00:45:00.162956 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:00.162937    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-dc78bf-29756205-d2vgw"
Jul 30 00:45:00.170317 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:00.170297    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756205-lkpws"
Jul 30 00:45:00.204199 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:00.204104    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:45:00.538411 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:00.538389    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb2e9f-29756205-gqxmb"]
Jul 30 00:45:00.539857 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:45:00.539807    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod473feace_b5f0_44f3_8b47_7c526fe681a9.slice/crio-91ea5ce77756c212e5121b050cde8091bc51410bfaece381adb4567f55b58933 WatchSource:0}: Error finding container 91ea5ce77756c212e5121b050cde8091bc51410bfaece381adb4567f55b58933: Status 404 returned error can't find the container with id 91ea5ce77756c212e5121b050cde8091bc51410bfaece381adb4567f55b58933
Jul 30 00:45:00.583070 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:00.583020    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-dc78bf-29756205-d2vgw"]
Jul 30 00:45:00.584411 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:45:00.584244    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod665fcecc_a55a_42c1_b1e0_7758682def9c.slice/crio-84e21bf39c4391e4b3da7180a4b05f13a7c586b8edc452a6f0a230f0abaf29e4 WatchSource:0}: Error finding container 84e21bf39c4391e4b3da7180a4b05f13a7c586b8edc452a6f0a230f0abaf29e4: Status 404 returned error can't find the container with id 84e21bf39c4391e4b3da7180a4b05f13a7c586b8edc452a6f0a230f0abaf29e4
Jul 30 00:45:00.585249 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:45:00.585084    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4301486_3993_465d_a77a_d7e22127f00a.slice/crio-3af3e6eed43161cafb543b7aa394c3f2cf6af26e0dcb19b5d37429cd93c8062a WatchSource:0}: Error finding container 3af3e6eed43161cafb543b7aa394c3f2cf6af26e0dcb19b5d37429cd93c8062a: Status 404 returned error can't find the container with id 3af3e6eed43161cafb543b7aa394c3f2cf6af26e0dcb19b5d37429cd93c8062a
Jul 30 00:45:00.587141 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:00.587052    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29756205-lkpws"]
Jul 30 00:45:00.835475 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:00.835398    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-dc78bf-29756205-d2vgw" event={"ID":"665fcecc-a55a-42c1-b1e0-7758682def9c","Type":"ContainerStarted","Data":"84e21bf39c4391e4b3da7180a4b05f13a7c586b8edc452a6f0a230f0abaf29e4"}
Jul 30 00:45:00.836594 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:00.836568    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756205-lkpws" event={"ID":"a4301486-3993-465d-a77a-d7e22127f00a","Type":"ContainerStarted","Data":"3af3e6eed43161cafb543b7aa394c3f2cf6af26e0dcb19b5d37429cd93c8062a"}
Jul 30 00:45:00.837738 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:00.837716    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb2e9f-29756205-gqxmb" event={"ID":"473feace-b5f0-44f3-8b47-7c526fe681a9","Type":"ContainerStarted","Data":"91ea5ce77756c212e5121b050cde8091bc51410bfaece381adb4567f55b58933"}
Jul 30 00:45:01.850283 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:01.850246    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756205-lkpws" event={"ID":"a4301486-3993-465d-a77a-d7e22127f00a","Type":"ContainerStarted","Data":"9c665cd5b569db7f2232f376ced3cf1d8cd0690f3f5d56c123aacf32ea4eb34e"}
Jul 30 00:45:01.852678 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:01.852652    2527 generic.go:356] "Generic (PLEG): container finished" podID="473feace-b5f0-44f3-8b47-7c526fe681a9" containerID="28aa20f916cca8529e6248e66cc3a069fee63019e12e3f133c302f9f7f5c5698" exitCode=0
Jul 30 00:45:01.852808 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:01.852747    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb2e9f-29756205-gqxmb" event={"ID":"473feace-b5f0-44f3-8b47-7c526fe681a9","Type":"ContainerDied","Data":"28aa20f916cca8529e6248e66cc3a069fee63019e12e3f133c302f9f7f5c5698"}
Jul 30 00:45:01.854419 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:01.854397    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-dc78bf-29756205-d2vgw" event={"ID":"665fcecc-a55a-42c1-b1e0-7758682def9c","Type":"ContainerStarted","Data":"c23db815a4a0229f754acfabc2db6743f62a69915bed751f52a3e5941ed17d46"}
Jul 30 00:45:01.866285 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:01.866246    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756205-lkpws" podStartSLOduration=1.866234329 podStartE2EDuration="1.866234329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:45:01.864615318 +0000 UTC m=+2576.167063665" watchObservedRunningTime="2026-07-30 00:45:01.866234329 +0000 UTC m=+2576.168682674"
Jul 30 00:45:02.862067 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:02.862034    2527 generic.go:356] "Generic (PLEG): container finished" podID="a4301486-3993-465d-a77a-d7e22127f00a" containerID="9c665cd5b569db7f2232f376ced3cf1d8cd0690f3f5d56c123aacf32ea4eb34e" exitCode=0
Jul 30 00:45:02.862493 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:02.862119    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756205-lkpws" event={"ID":"a4301486-3993-465d-a77a-d7e22127f00a","Type":"ContainerDied","Data":"9c665cd5b569db7f2232f376ced3cf1d8cd0690f3f5d56c123aacf32ea4eb34e"}
Jul 30 00:45:02.863732 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:02.863711    2527 generic.go:356] "Generic (PLEG): container finished" podID="665fcecc-a55a-42c1-b1e0-7758682def9c" containerID="c23db815a4a0229f754acfabc2db6743f62a69915bed751f52a3e5941ed17d46" exitCode=0
Jul 30 00:45:02.863825 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:02.863789    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-dc78bf-29756205-d2vgw" event={"ID":"665fcecc-a55a-42c1-b1e0-7758682def9c","Type":"ContainerDied","Data":"c23db815a4a0229f754acfabc2db6743f62a69915bed751f52a3e5941ed17d46"}
Jul 30 00:45:03.007488 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:03.007462    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb2e9f-29756205-gqxmb"
Jul 30 00:45:03.039444 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:03.039412    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-dc78bf-29756205-d2vgw"
Jul 30 00:45:03.872563 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:03.872534    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb2e9f-29756205-gqxmb"
Jul 30 00:45:03.872975 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:03.872578    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb2e9f-29756205-gqxmb" event={"ID":"473feace-b5f0-44f3-8b47-7c526fe681a9","Type":"ContainerDied","Data":"91ea5ce77756c212e5121b050cde8091bc51410bfaece381adb4567f55b58933"}
Jul 30 00:45:03.872975 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:03.872625    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91ea5ce77756c212e5121b050cde8091bc51410bfaece381adb4567f55b58933"
Jul 30 00:45:03.873991 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:03.873967    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-dc78bf-29756205-d2vgw" event={"ID":"665fcecc-a55a-42c1-b1e0-7758682def9c","Type":"ContainerDied","Data":"84e21bf39c4391e4b3da7180a4b05f13a7c586b8edc452a6f0a230f0abaf29e4"}
Jul 30 00:45:03.874110 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:03.873997    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-dc78bf-29756205-d2vgw"
Jul 30 00:45:03.874110 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:03.874015    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84e21bf39c4391e4b3da7180a4b05f13a7c586b8edc452a6f0a230f0abaf29e4"
Jul 30 00:45:04.009890 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:04.009866    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756205-lkpws"
Jul 30 00:45:04.880998 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:04.880974    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756205-lkpws"
Jul 30 00:45:04.881387 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:04.881020    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756205-lkpws" event={"ID":"a4301486-3993-465d-a77a-d7e22127f00a","Type":"ContainerDied","Data":"3af3e6eed43161cafb543b7aa394c3f2cf6af26e0dcb19b5d37429cd93c8062a"}
Jul 30 00:45:04.881387 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:04.881069    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3af3e6eed43161cafb543b7aa394c3f2cf6af26e0dcb19b5d37429cd93c8062a"
Jul 30 00:45:05.807453 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:05.807426    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9"
Jul 30 00:45:19.635768 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:19.635724    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc78bf-jxb5t"]
Jul 30 00:45:19.636360 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:19.636342    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="665fcecc-a55a-42c1-b1e0-7758682def9c" containerName="cleanup"
Jul 30 00:45:19.636473 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:19.636363    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="665fcecc-a55a-42c1-b1e0-7758682def9c" containerName="cleanup"
Jul 30 00:45:19.636473 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:19.636387    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4301486-3993-465d-a77a-d7e22127f00a" containerName="cleanup"
Jul 30 00:45:19.636473 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:19.636402    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4301486-3993-465d-a77a-d7e22127f00a" containerName="cleanup"
Jul 30 00:45:19.636473 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:19.636429    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="473feace-b5f0-44f3-8b47-7c526fe681a9" containerName="cleanup"
Jul 30 00:45:19.636473 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:19.636438    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="473feace-b5f0-44f3-8b47-7c526fe681a9" containerName="cleanup"
Jul 30 00:45:19.636722 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:19.636551    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="665fcecc-a55a-42c1-b1e0-7758682def9c" containerName="cleanup"
Jul 30 00:45:19.636722 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:19.636567    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4301486-3993-465d-a77a-d7e22127f00a" containerName="cleanup"
Jul 30 00:45:19.636722 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:19.636578    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="473feace-b5f0-44f3-8b47-7c526fe681a9" containerName="cleanup"
Jul 30 00:45:19.639712 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:19.639692    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc78bf-jxb5t"
Jul 30 00:45:19.642187 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:19.642126    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 00:45:19.642277 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:19.642215    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t42rq\""
Jul 30 00:45:19.647390 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:19.647370    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc78bf-jxb5t"]
Jul 30 00:45:19.715039 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:19.715015    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c887616f-19ff-4cef-afb9-1f95fd9318e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-dc78bf-jxb5t\" (UID: \"c887616f-19ff-4cef-afb9-1f95fd9318e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc78bf-jxb5t"
Jul 30 00:45:19.816302 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:19.816275    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c887616f-19ff-4cef-afb9-1f95fd9318e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-dc78bf-jxb5t\" (UID: \"c887616f-19ff-4cef-afb9-1f95fd9318e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc78bf-jxb5t"
Jul 30 00:45:19.816814 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:19.816796    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c887616f-19ff-4cef-afb9-1f95fd9318e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-dc78bf-jxb5t\" (UID: \"c887616f-19ff-4cef-afb9-1f95fd9318e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc78bf-jxb5t"
Jul 30 00:45:19.954708 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:19.954678    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc78bf-jxb5t"
Jul 30 00:45:20.301474 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:20.301447    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc78bf-jxb5t"]
Jul 30 00:45:20.302648 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:45:20.302625    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc887616f_19ff_4cef_afb9_1f95fd9318e7.slice/crio-765450b616b82b41cde41bdaa1d85acfbb6d5dd223e0fbbf08e2983e32cf2983 WatchSource:0}: Error finding container 765450b616b82b41cde41bdaa1d85acfbb6d5dd223e0fbbf08e2983e32cf2983: Status 404 returned error can't find the container with id 765450b616b82b41cde41bdaa1d85acfbb6d5dd223e0fbbf08e2983e32cf2983
Jul 30 00:45:20.995401 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:20.995369    2527 generic.go:356] "Generic (PLEG): container finished" podID="c887616f-19ff-4cef-afb9-1f95fd9318e7" containerID="57b4409023733b6418486b130e4f75cac15a94cd630e8b824ad9807266fa6270" exitCode=0
Jul 30 00:45:20.995729 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:20.995415    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc78bf-jxb5t" event={"ID":"c887616f-19ff-4cef-afb9-1f95fd9318e7","Type":"ContainerDied","Data":"57b4409023733b6418486b130e4f75cac15a94cd630e8b824ad9807266fa6270"}
Jul 30 00:45:20.995729 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:20.995473    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc78bf-jxb5t" event={"ID":"c887616f-19ff-4cef-afb9-1f95fd9318e7","Type":"ContainerStarted","Data":"765450b616b82b41cde41bdaa1d85acfbb6d5dd223e0fbbf08e2983e32cf2983"}
Jul 30 00:45:22.142941 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:22.142917    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc78bf-jxb5t"
Jul 30 00:45:22.238460 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:22.238431    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c887616f-19ff-4cef-afb9-1f95fd9318e7-maas-api-service-ca\") pod \"c887616f-19ff-4cef-afb9-1f95fd9318e7\" (UID: \"c887616f-19ff-4cef-afb9-1f95fd9318e7\") "
Jul 30 00:45:22.238739 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:22.238718    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c887616f-19ff-4cef-afb9-1f95fd9318e7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c887616f-19ff-4cef-afb9-1f95fd9318e7" (UID: "c887616f-19ff-4cef-afb9-1f95fd9318e7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:45:22.339072 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:22.339006    2527 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c887616f-19ff-4cef-afb9-1f95fd9318e7-maas-api-service-ca\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:45:23.012959 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:23.012931    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc78bf-jxb5t"
Jul 30 00:45:23.012959 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:23.012939    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc78bf-jxb5t" event={"ID":"c887616f-19ff-4cef-afb9-1f95fd9318e7","Type":"ContainerDied","Data":"765450b616b82b41cde41bdaa1d85acfbb6d5dd223e0fbbf08e2983e32cf2983"}
Jul 30 00:45:23.013155 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:23.013025    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="765450b616b82b41cde41bdaa1d85acfbb6d5dd223e0fbbf08e2983e32cf2983"
Jul 30 00:45:35.781371 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:35.781268    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-dc78bf-29756205-d2vgw"]
Jul 30 00:45:35.784036 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:35.784017    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-dc78bf-29756205-d2vgw"]
Jul 30 00:45:35.958787 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:35.958745    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc78bf-jxb5t"]
Jul 30 00:45:35.961695 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:35.961671    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc78bf-jxb5t"]
Jul 30 00:45:36.216906 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:36.216873    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="665fcecc-a55a-42c1-b1e0-7758682def9c" path="/var/lib/kubelet/pods/665fcecc-a55a-42c1-b1e0-7758682def9c/volumes"
Jul 30 00:45:36.217192 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:36.217179    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c887616f-19ff-4cef-afb9-1f95fd9318e7" path="/var/lib/kubelet/pods/c887616f-19ff-4cef-afb9-1f95fd9318e7/volumes"
Jul 30 00:45:41.898569 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:41.898534    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:45:42.309912 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:42.309882    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"]
Jul 30 00:45:42.310111 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:42.310079    2527 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6" podUID="40df3b5e-80fc-484e-be1c-6a3d68340e8b" containerName="istio-proxy" containerID="cri-o://b472a24bd6361a4193c6c500fff40b2d8e033e057af4cdbbd9b0773356a7ffa7" gracePeriod=30
Jul 30 00:45:43.164279 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:43.164233    2527 patch_prober.go:28] interesting pod/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 00:45:43.164693 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:43.164309    2527 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6" podUID="40df3b5e-80fc-484e-be1c-6a3d68340e8b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 00:45:47.563643 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:47.563618    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:45:47.757827 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:47.757796    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40df3b5e-80fc-484e-be1c-6a3d68340e8b-workload-certs\") pod \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") "
Jul 30 00:45:47.758036 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:47.757842    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40df3b5e-80fc-484e-be1c-6a3d68340e8b-istio-data\") pod \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") "
Jul 30 00:45:47.758036 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:47.757888    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40df3b5e-80fc-484e-be1c-6a3d68340e8b-istio-envoy\") pod \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") "
Jul 30 00:45:47.758036 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:47.757926    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40df3b5e-80fc-484e-be1c-6a3d68340e8b-istio-podinfo\") pod \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") "
Jul 30 00:45:47.758036 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:47.757948    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40df3b5e-80fc-484e-be1c-6a3d68340e8b-workload-socket\") pod \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") "
Jul 30 00:45:47.758036 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:47.757979    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lb9dh\" (UniqueName: \"kubernetes.io/projected/40df3b5e-80fc-484e-be1c-6a3d68340e8b-kube-api-access-lb9dh\") pod \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") "
Jul 30 00:45:47.758368 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:47.758116    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40df3b5e-80fc-484e-be1c-6a3d68340e8b-credential-socket\") pod \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") "
Jul 30 00:45:47.758368 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:47.758137    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40df3b5e-80fc-484e-be1c-6a3d68340e8b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "40df3b5e-80fc-484e-be1c-6a3d68340e8b" (UID: "40df3b5e-80fc-484e-be1c-6a3d68340e8b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:45:47.758368 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:47.758205    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40df3b5e-80fc-484e-be1c-6a3d68340e8b-istiod-ca-cert\") pod \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") "
Jul 30 00:45:47.758368 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:47.758243    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40df3b5e-80fc-484e-be1c-6a3d68340e8b-istio-token\") pod \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\" (UID: \"40df3b5e-80fc-484e-be1c-6a3d68340e8b\") "
Jul 30 00:45:47.758569 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:47.758416    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40df3b5e-80fc-484e-be1c-6a3d68340e8b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "40df3b5e-80fc-484e-be1c-6a3d68340e8b" (UID: "40df3b5e-80fc-484e-be1c-6a3d68340e8b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:45:47.758569 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:47.758519    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40df3b5e-80fc-484e-be1c-6a3d68340e8b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "40df3b5e-80fc-484e-be1c-6a3d68340e8b" (UID: "40df3b5e-80fc-484e-be1c-6a3d68340e8b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:45:47.758673 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:47.758586    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40df3b5e-80fc-484e-be1c-6a3d68340e8b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "40df3b5e-80fc-484e-be1c-6a3d68340e8b" (UID: "40df3b5e-80fc-484e-be1c-6a3d68340e8b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:45:47.758772 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:47.758752    2527 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40df3b5e-80fc-484e-be1c-6a3d68340e8b-workload-certs\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:45:47.758825 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:47.758778    2527 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40df3b5e-80fc-484e-be1c-6a3d68340e8b-workload-socket\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:45:47.758825 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:47.758792    2527 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40df3b5e-80fc-484e-be1c-6a3d68340e8b-credential-socket\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:45:47.758825 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:47.758806    2527 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40df3b5e-80fc-484e-be1c-6a3d68340e8b-istiod-ca-cert\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:45:47.758954 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:47.758847    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40df3b5e-80fc-484e-be1c-6a3d68340e8b-istio-data" (OuterVolumeSpecName: "istio-data") pod "40df3b5e-80fc-484e-be1c-6a3d68340e8b" (UID: "40df3b5e-80fc-484e-be1c-6a3d68340e8b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:45:47.760552 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:47.760524    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40df3b5e-80fc-484e-be1c-6a3d68340e8b-istio-token" (OuterVolumeSpecName: "istio-token") pod "40df3b5e-80fc-484e-be1c-6a3d68340e8b" (UID: "40df3b5e-80fc-484e-be1c-6a3d68340e8b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:45:47.760668 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:47.760615    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40df3b5e-80fc-484e-be1c-6a3d68340e8b-kube-api-access-lb9dh" (OuterVolumeSpecName: "kube-api-access-lb9dh") pod "40df3b5e-80fc-484e-be1c-6a3d68340e8b" (UID: "40df3b5e-80fc-484e-be1c-6a3d68340e8b"). InnerVolumeSpecName "kube-api-access-lb9dh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:45:47.760853 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:47.760833    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40df3b5e-80fc-484e-be1c-6a3d68340e8b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "40df3b5e-80fc-484e-be1c-6a3d68340e8b" (UID: "40df3b5e-80fc-484e-be1c-6a3d68340e8b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:45:47.760929 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:47.760858    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/40df3b5e-80fc-484e-be1c-6a3d68340e8b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "40df3b5e-80fc-484e-be1c-6a3d68340e8b" (UID: "40df3b5e-80fc-484e-be1c-6a3d68340e8b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 00:45:47.859714 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:47.859684    2527 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40df3b5e-80fc-484e-be1c-6a3d68340e8b-istio-data\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:45:47.859714 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:47.859708    2527 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40df3b5e-80fc-484e-be1c-6a3d68340e8b-istio-envoy\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:45:47.859714 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:47.859716    2527 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40df3b5e-80fc-484e-be1c-6a3d68340e8b-istio-podinfo\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:45:47.859918 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:47.859729    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lb9dh\" (UniqueName: \"kubernetes.io/projected/40df3b5e-80fc-484e-be1c-6a3d68340e8b-kube-api-access-lb9dh\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:45:47.859918 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:47.859737    2527 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40df3b5e-80fc-484e-be1c-6a3d68340e8b-istio-token\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:45:48.180229 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:48.180136    2527 generic.go:356] "Generic (PLEG): container finished" podID="40df3b5e-80fc-484e-be1c-6a3d68340e8b" containerID="b472a24bd6361a4193c6c500fff40b2d8e033e057af4cdbbd9b0773356a7ffa7" exitCode=0
Jul 30 00:45:48.180229 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:48.180223    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"
Jul 30 00:45:48.180434 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:48.180221    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6" event={"ID":"40df3b5e-80fc-484e-be1c-6a3d68340e8b","Type":"ContainerDied","Data":"b472a24bd6361a4193c6c500fff40b2d8e033e057af4cdbbd9b0773356a7ffa7"}
Jul 30 00:45:48.180434 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:48.180340    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6" event={"ID":"40df3b5e-80fc-484e-be1c-6a3d68340e8b","Type":"ContainerDied","Data":"8c98b351fba6d6aa9b90a50d57bbf3c4bc43321e67f7bc35d9ced51939d1790a"}
Jul 30 00:45:48.180434 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:48.180362    2527 scope.go:117] "RemoveContainer" containerID="b472a24bd6361a4193c6c500fff40b2d8e033e057af4cdbbd9b0773356a7ffa7"
Jul 30 00:45:48.190805 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:48.190788    2527 scope.go:117] "RemoveContainer" containerID="e52d840a28f64d97e18ae38a91882bf7d422b00ee3c6cd50b1c008378130f70e"
Jul 30 00:45:48.199453 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:48.199422    2527 scope.go:117] "RemoveContainer" containerID="b472a24bd6361a4193c6c500fff40b2d8e033e057af4cdbbd9b0773356a7ffa7"
Jul 30 00:45:48.199701 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:45:48.199678    2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b472a24bd6361a4193c6c500fff40b2d8e033e057af4cdbbd9b0773356a7ffa7\": container with ID starting with b472a24bd6361a4193c6c500fff40b2d8e033e057af4cdbbd9b0773356a7ffa7 not found: ID does not exist" containerID="b472a24bd6361a4193c6c500fff40b2d8e033e057af4cdbbd9b0773356a7ffa7"
Jul 30 00:45:48.199786 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:48.199711    2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b472a24bd6361a4193c6c500fff40b2d8e033e057af4cdbbd9b0773356a7ffa7"} err="failed to get container status \"b472a24bd6361a4193c6c500fff40b2d8e033e057af4cdbbd9b0773356a7ffa7\": rpc error: code = NotFound desc = could not find container \"b472a24bd6361a4193c6c500fff40b2d8e033e057af4cdbbd9b0773356a7ffa7\": container with ID starting with b472a24bd6361a4193c6c500fff40b2d8e033e057af4cdbbd9b0773356a7ffa7 not found: ID does not exist"
Jul 30 00:45:48.199786 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:48.199734    2527 scope.go:117] "RemoveContainer" containerID="e52d840a28f64d97e18ae38a91882bf7d422b00ee3c6cd50b1c008378130f70e"
Jul 30 00:45:48.199999 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:45:48.199977    2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e52d840a28f64d97e18ae38a91882bf7d422b00ee3c6cd50b1c008378130f70e\": container with ID starting with e52d840a28f64d97e18ae38a91882bf7d422b00ee3c6cd50b1c008378130f70e not found: ID does not exist" containerID="e52d840a28f64d97e18ae38a91882bf7d422b00ee3c6cd50b1c008378130f70e"
Jul 30 00:45:48.200044 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:48.200008    2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e52d840a28f64d97e18ae38a91882bf7d422b00ee3c6cd50b1c008378130f70e"} err="failed to get container status \"e52d840a28f64d97e18ae38a91882bf7d422b00ee3c6cd50b1c008378130f70e\": rpc error: code = NotFound desc = could not find container \"e52d840a28f64d97e18ae38a91882bf7d422b00ee3c6cd50b1c008378130f70e\": container with ID starting with e52d840a28f64d97e18ae38a91882bf7d422b00ee3c6cd50b1c008378130f70e not found: ID does not exist"
Jul 30 00:45:48.201733 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:48.201714    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"]
Jul 30 00:45:48.205114 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:48.205095    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-dc78bf-openshift-default-5cd7cdd7b4-fl8b6"]
Jul 30 00:45:48.215960 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:48.215939    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40df3b5e-80fc-484e-be1c-6a3d68340e8b" path="/var/lib/kubelet/pods/40df3b5e-80fc-484e-be1c-6a3d68340e8b/volumes"
Jul 30 00:45:58.063771 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:58.063739    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb2e9f-29756205-gqxmb"]
Jul 30 00:45:58.066231 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:58.066206    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb2e9f-29756205-gqxmb"]
Jul 30 00:45:58.086220 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:58.086191    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9"]
Jul 30 00:45:58.086521 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:58.086493    2527 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9" podUID="2e1ac0e7-11e7-49b1-95a1-4825ffde4c40" containerName="payload-processing" containerID="cri-o://afc7947fe1872d7de0bd93e30cb2b136d36060cfbefc47bea2b30fabeca8c390" gracePeriod=30
Jul 30 00:45:58.216616 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:58.216580    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="473feace-b5f0-44f3-8b47-7c526fe681a9" path="/var/lib/kubelet/pods/473feace-b5f0-44f3-8b47-7c526fe681a9/volumes"
Jul 30 00:45:58.253266 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:58.253225    2527 generic.go:356] "Generic (PLEG): container finished" podID="2e1ac0e7-11e7-49b1-95a1-4825ffde4c40" containerID="afc7947fe1872d7de0bd93e30cb2b136d36060cfbefc47bea2b30fabeca8c390" exitCode=0
Jul 30 00:45:58.253433 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:58.253297    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9" event={"ID":"2e1ac0e7-11e7-49b1-95a1-4825ffde4c40","Type":"ContainerDied","Data":"afc7947fe1872d7de0bd93e30cb2b136d36060cfbefc47bea2b30fabeca8c390"}
Jul 30 00:45:58.361507 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:58.361483    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9"
Jul 30 00:45:58.456651 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:58.456622    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9xpv\" (UniqueName: \"kubernetes.io/projected/2e1ac0e7-11e7-49b1-95a1-4825ffde4c40-kube-api-access-t9xpv\") pod \"2e1ac0e7-11e7-49b1-95a1-4825ffde4c40\" (UID: \"2e1ac0e7-11e7-49b1-95a1-4825ffde4c40\") "
Jul 30 00:45:58.456827 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:58.456723    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e1ac0e7-11e7-49b1-95a1-4825ffde4c40-plugins-config-volume\") pod \"2e1ac0e7-11e7-49b1-95a1-4825ffde4c40\" (UID: \"2e1ac0e7-11e7-49b1-95a1-4825ffde4c40\") "
Jul 30 00:45:58.457109 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:58.457084    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e1ac0e7-11e7-49b1-95a1-4825ffde4c40-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2e1ac0e7-11e7-49b1-95a1-4825ffde4c40" (UID: "2e1ac0e7-11e7-49b1-95a1-4825ffde4c40"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:45:58.458922 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:58.458897    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e1ac0e7-11e7-49b1-95a1-4825ffde4c40-kube-api-access-t9xpv" (OuterVolumeSpecName: "kube-api-access-t9xpv") pod "2e1ac0e7-11e7-49b1-95a1-4825ffde4c40" (UID: "2e1ac0e7-11e7-49b1-95a1-4825ffde4c40"). InnerVolumeSpecName "kube-api-access-t9xpv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:45:58.558199 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:58.558147    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9xpv\" (UniqueName: \"kubernetes.io/projected/2e1ac0e7-11e7-49b1-95a1-4825ffde4c40-kube-api-access-t9xpv\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:45:58.558199 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:58.558197    2527 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e1ac0e7-11e7-49b1-95a1-4825ffde4c40-plugins-config-volume\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:45:59.263141 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:59.263100    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9" event={"ID":"2e1ac0e7-11e7-49b1-95a1-4825ffde4c40","Type":"ContainerDied","Data":"4aada6c2095d88288f655c46d6c2c1b39cb889bfea9188916c7d0e2e7fec6497"}
Jul 30 00:45:59.263631 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:59.263189    2527 scope.go:117] "RemoveContainer" containerID="afc7947fe1872d7de0bd93e30cb2b136d36060cfbefc47bea2b30fabeca8c390"
Jul 30 00:45:59.263631 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:59.263262    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9"
Jul 30 00:45:59.284573 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:59.284538    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9"]
Jul 30 00:45:59.288459 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:45:59.288436    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-fb2e9f-668c67d7fd-mhrn9"]
Jul 30 00:46:00.217246 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:00.217217    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e1ac0e7-11e7-49b1-95a1-4825ffde4c40" path="/var/lib/kubelet/pods/2e1ac0e7-11e7-49b1-95a1-4825ffde4c40/volumes"
Jul 30 00:46:02.514617 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:02.514582    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:46:06.524889 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:06.524858    2527 scope.go:117] "RemoveContainer" containerID="4052f8106ab7017a2ead5dda5a3cb2d0275a092344fe73ace20b796c18155a77"
Jul 30 00:46:09.196916 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:09.196869    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4ef902-6848d59769-vshkf"]
Jul 30 00:46:09.197474 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:09.197455    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e1ac0e7-11e7-49b1-95a1-4825ffde4c40" containerName="payload-processing"
Jul 30 00:46:09.197518 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:09.197476    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e1ac0e7-11e7-49b1-95a1-4825ffde4c40" containerName="payload-processing"
Jul 30 00:46:09.197518 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:09.197498    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40df3b5e-80fc-484e-be1c-6a3d68340e8b" containerName="istio-proxy"
Jul 30 00:46:09.197518 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:09.197503    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="40df3b5e-80fc-484e-be1c-6a3d68340e8b" containerName="istio-proxy"
Jul 30 00:46:09.197518 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:09.197511    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c887616f-19ff-4cef-afb9-1f95fd9318e7" containerName="revoke-keys"
Jul 30 00:46:09.197518 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:09.197517    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="c887616f-19ff-4cef-afb9-1f95fd9318e7" containerName="revoke-keys"
Jul 30 00:46:09.197683 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:09.197590    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="40df3b5e-80fc-484e-be1c-6a3d68340e8b" containerName="istio-proxy"
Jul 30 00:46:09.197683 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:09.197597    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="c887616f-19ff-4cef-afb9-1f95fd9318e7" containerName="revoke-keys"
Jul 30 00:46:09.197683 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:09.197605    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e1ac0e7-11e7-49b1-95a1-4825ffde4c40" containerName="payload-processing"
Jul 30 00:46:09.202396 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:09.202377    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4ef902-6848d59769-vshkf"
Jul 30 00:46:09.204774 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:09.204752    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 30 00:46:09.205847 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:09.205828    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-4ef902-serving-cert\""
Jul 30 00:46:09.206001 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:09.205968    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 00:46:09.206123 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:09.206094    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wft5v\""
Jul 30 00:46:09.209579 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:09.209555    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4ef902-6848d59769-vshkf"]
Jul 30 00:46:09.251438 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:09.251398    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9978509-95b5-4f27-b63d-9ed764beaca5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-4ef902-6848d59769-vshkf\" (UID: \"c9978509-95b5-4f27-b63d-9ed764beaca5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4ef902-6848d59769-vshkf"
Jul 30 00:46:09.251831 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:09.251495    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9978509-95b5-4f27-b63d-9ed764beaca5-maas-api-tls\") pod \"maas-api-e2e-shared-a-4ef902-6848d59769-vshkf\" (UID: \"c9978509-95b5-4f27-b63d-9ed764beaca5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4ef902-6848d59769-vshkf"
Jul 30 00:46:09.251831 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:09.251523    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hvml\" (UniqueName: \"kubernetes.io/projected/c9978509-95b5-4f27-b63d-9ed764beaca5-kube-api-access-2hvml\") pod \"maas-api-e2e-shared-a-4ef902-6848d59769-vshkf\" (UID: \"c9978509-95b5-4f27-b63d-9ed764beaca5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4ef902-6848d59769-vshkf"
Jul 30 00:46:09.352430 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:09.352391    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9978509-95b5-4f27-b63d-9ed764beaca5-maas-api-tls\") pod \"maas-api-e2e-shared-a-4ef902-6848d59769-vshkf\" (UID: \"c9978509-95b5-4f27-b63d-9ed764beaca5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4ef902-6848d59769-vshkf"
Jul 30 00:46:09.352430 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:09.352432    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hvml\" (UniqueName: \"kubernetes.io/projected/c9978509-95b5-4f27-b63d-9ed764beaca5-kube-api-access-2hvml\") pod \"maas-api-e2e-shared-a-4ef902-6848d59769-vshkf\" (UID: \"c9978509-95b5-4f27-b63d-9ed764beaca5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4ef902-6848d59769-vshkf"
Jul 30 00:46:09.352639 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:09.352500    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9978509-95b5-4f27-b63d-9ed764beaca5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-4ef902-6848d59769-vshkf\" (UID: \"c9978509-95b5-4f27-b63d-9ed764beaca5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4ef902-6848d59769-vshkf"
Jul 30 00:46:09.352639 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:46:09.352540    2527 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-4ef902-serving-cert: secret "maas-api-e2e-shared-a-4ef902-serving-cert" not found
Jul 30 00:46:09.352639 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:46:09.352627    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9978509-95b5-4f27-b63d-9ed764beaca5-maas-api-tls podName:c9978509-95b5-4f27-b63d-9ed764beaca5 nodeName:}" failed. No retries permitted until 2026-07-30 00:46:09.852605762 +0000 UTC m=+2644.155054098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c9978509-95b5-4f27-b63d-9ed764beaca5-maas-api-tls") pod "maas-api-e2e-shared-a-4ef902-6848d59769-vshkf" (UID: "c9978509-95b5-4f27-b63d-9ed764beaca5") : secret "maas-api-e2e-shared-a-4ef902-serving-cert" not found
Jul 30 00:46:09.353077 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:09.353060    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9978509-95b5-4f27-b63d-9ed764beaca5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-4ef902-6848d59769-vshkf\" (UID: \"c9978509-95b5-4f27-b63d-9ed764beaca5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4ef902-6848d59769-vshkf"
Jul 30 00:46:09.361778 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:09.361749    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hvml\" (UniqueName: \"kubernetes.io/projected/c9978509-95b5-4f27-b63d-9ed764beaca5-kube-api-access-2hvml\") pod \"maas-api-e2e-shared-a-4ef902-6848d59769-vshkf\" (UID: \"c9978509-95b5-4f27-b63d-9ed764beaca5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4ef902-6848d59769-vshkf"
Jul 30 00:46:09.857701 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:09.857659    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9978509-95b5-4f27-b63d-9ed764beaca5-maas-api-tls\") pod \"maas-api-e2e-shared-a-4ef902-6848d59769-vshkf\" (UID: \"c9978509-95b5-4f27-b63d-9ed764beaca5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4ef902-6848d59769-vshkf"
Jul 30 00:46:09.860362 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:09.860334    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9978509-95b5-4f27-b63d-9ed764beaca5-maas-api-tls\") pod \"maas-api-e2e-shared-a-4ef902-6848d59769-vshkf\" (UID: \"c9978509-95b5-4f27-b63d-9ed764beaca5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4ef902-6848d59769-vshkf"
Jul 30 00:46:10.114987 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:10.114899    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4ef902-6848d59769-vshkf"
Jul 30 00:46:10.261379 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:10.261349    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4ef902-6848d59769-vshkf"]
Jul 30 00:46:10.262812 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:46:10.262786    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9978509_95b5_4f27_b63d_9ed764beaca5.slice/crio-45f71b6711e0884fad9987213bf951b7a9f9b68c765f95508eb2f1e3b777d057 WatchSource:0}: Error finding container 45f71b6711e0884fad9987213bf951b7a9f9b68c765f95508eb2f1e3b777d057: Status 404 returned error can't find the container with id 45f71b6711e0884fad9987213bf951b7a9f9b68c765f95508eb2f1e3b777d057
Jul 30 00:46:10.339800 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:10.339760    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4ef902-6848d59769-vshkf" event={"ID":"c9978509-95b5-4f27-b63d-9ed764beaca5","Type":"ContainerStarted","Data":"45f71b6711e0884fad9987213bf951b7a9f9b68c765f95508eb2f1e3b777d057"}
Jul 30 00:46:11.349040 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:11.348958    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4ef902-6848d59769-vshkf" event={"ID":"c9978509-95b5-4f27-b63d-9ed764beaca5","Type":"ContainerStarted","Data":"ccc892bcc04ae414a29f163919daee5c76d4a6c3258eb72aa0a618029ec39170"}
Jul 30 00:46:11.349470 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:11.349147    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4ef902-6848d59769-vshkf"
Jul 30 00:46:11.364865 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:11.364761    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4ef902-6848d59769-vshkf" podStartSLOduration=2.015725342 podStartE2EDuration="2.364742915s" totalImagesPullingTime="349.017573ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:46:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:46:11.364382161 +0000 UTC m=+2645.666830507" watchObservedRunningTime="2026-07-30 00:46:11.364742915 +0000 UTC m=+2645.667191261"
Jul 30 00:46:13.404744 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:13.404712    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:46:17.360790 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:17.360756    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4ef902-6848d59769-vshkf"
Jul 30 00:46:37.292839 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:37.292805    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm"]
Jul 30 00:46:37.293460 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:37.293441    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40df3b5e-80fc-484e-be1c-6a3d68340e8b" containerName="istio-proxy"
Jul 30 00:46:37.293514 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:37.293464    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="40df3b5e-80fc-484e-be1c-6a3d68340e8b" containerName="istio-proxy"
Jul 30 00:46:37.293576 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:37.293566    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="40df3b5e-80fc-484e-be1c-6a3d68340e8b" containerName="istio-proxy"
Jul 30 00:46:37.297610 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:37.297591    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm"
Jul 30 00:46:37.299829 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:37.299805    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-0b2dae-serving-cert\""
Jul 30 00:46:37.306512 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:37.306490    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm"]
Jul 30 00:46:37.391225 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:37.391196    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvj44\" (UniqueName: \"kubernetes.io/projected/69709453-4eec-47ae-b14c-6741742bbd4e-kube-api-access-wvj44\") pod \"maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm\" (UID: \"69709453-4eec-47ae-b14c-6741742bbd4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm"
Jul 30 00:46:37.391390 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:37.391239    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69709453-4eec-47ae-b14c-6741742bbd4e-maas-api-tls\") pod \"maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm\" (UID: \"69709453-4eec-47ae-b14c-6741742bbd4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm"
Jul 30 00:46:37.391390 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:37.391327    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69709453-4eec-47ae-b14c-6741742bbd4e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm\" (UID: \"69709453-4eec-47ae-b14c-6741742bbd4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm"
Jul 30 00:46:37.491742 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:37.491713    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvj44\" (UniqueName: \"kubernetes.io/projected/69709453-4eec-47ae-b14c-6741742bbd4e-kube-api-access-wvj44\") pod \"maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm\" (UID: \"69709453-4eec-47ae-b14c-6741742bbd4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm"
Jul 30 00:46:37.491742 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:37.491743    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69709453-4eec-47ae-b14c-6741742bbd4e-maas-api-tls\") pod \"maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm\" (UID: \"69709453-4eec-47ae-b14c-6741742bbd4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm"
Jul 30 00:46:37.491955 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:37.491785    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69709453-4eec-47ae-b14c-6741742bbd4e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm\" (UID: \"69709453-4eec-47ae-b14c-6741742bbd4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm"
Jul 30 00:46:37.492473 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:37.492455    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69709453-4eec-47ae-b14c-6741742bbd4e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm\" (UID: \"69709453-4eec-47ae-b14c-6741742bbd4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm"
Jul 30 00:46:37.494243 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:37.494226    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69709453-4eec-47ae-b14c-6741742bbd4e-maas-api-tls\") pod \"maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm\" (UID: \"69709453-4eec-47ae-b14c-6741742bbd4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm"
Jul 30 00:46:37.499788 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:37.499772    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvj44\" (UniqueName: \"kubernetes.io/projected/69709453-4eec-47ae-b14c-6741742bbd4e-kube-api-access-wvj44\") pod \"maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm\" (UID: \"69709453-4eec-47ae-b14c-6741742bbd4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm"
Jul 30 00:46:37.611202 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:37.611097    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm"
Jul 30 00:46:37.746043 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:37.746018    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm"]
Jul 30 00:46:37.748625 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:46:37.748597    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69709453_4eec_47ae_b14c_6741742bbd4e.slice/crio-d108e96b54fdc6a2c9e2be02a022c92408c4f36215570d7e151ea90278a3bee5 WatchSource:0}: Error finding container d108e96b54fdc6a2c9e2be02a022c92408c4f36215570d7e151ea90278a3bee5: Status 404 returned error can't find the container with id d108e96b54fdc6a2c9e2be02a022c92408c4f36215570d7e151ea90278a3bee5
Jul 30 00:46:37.750134 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:37.750115    2527 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 00:46:38.521239 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:38.521197    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm" event={"ID":"69709453-4eec-47ae-b14c-6741742bbd4e","Type":"ContainerStarted","Data":"8ff093bb11e503360679b18bd80b8ad2c609bf51feef10fafd8f5608cc801717"}
Jul 30 00:46:38.521646 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:38.521262    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm" event={"ID":"69709453-4eec-47ae-b14c-6741742bbd4e","Type":"ContainerStarted","Data":"d108e96b54fdc6a2c9e2be02a022c92408c4f36215570d7e151ea90278a3bee5"}
Jul 30 00:46:38.521646 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:38.521309    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm"
Jul 30 00:46:38.543664 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:38.543611    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm" podStartSLOduration=1.175310225 podStartE2EDuration="1.543592619s" totalImagesPullingTime="368.282394ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:46:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:46:38.539922729 +0000 UTC m=+2672.842371087" watchObservedRunningTime="2026-07-30 00:46:38.543592619 +0000 UTC m=+2672.846040967"
Jul 30 00:46:41.204582 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:41.204543    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:46:44.535356 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:46:44.535326    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm"
Jul 30 00:47:09.977990 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:47:09.977903    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9cggv_c6b01a1f-c41e-4781-8c25-66b152e0d0e8/ovn-acl-logging/0.log"
Jul 30 00:47:10.001341 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:47:10.001316    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9cggv_c6b01a1f-c41e-4781-8c25-66b152e0d0e8/ovn-acl-logging/0.log"
Jul 30 00:47:13.498714 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:47:13.498676    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:48:02.596901 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:48:02.596855    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:48:28.094147 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:48:28.094053    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:48:48.800037 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:48:48.800000    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:49:05.703022 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:49:05.702992    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:49:27.100996 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:49:27.100962    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:49:45.498647 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:49:45.498610    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:50:06.598629 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:50:06.598539    2527 scope.go:117] "RemoveContainer" containerID="5d9eb37fa9b77fe8696e274818bcc88637691b24ef634be844b99b331de0bf48"
Jul 30 00:50:06.607874 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:50:06.607845    2527 scope.go:117] "RemoveContainer" containerID="1306a731316ac0aacedde6efb0f46e8e90b24176953b51721633ab57cc17b40c"
Jul 30 00:50:06.795213 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:50:06.794123    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:50:23.890893 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:50:23.890852    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:50:44.595527 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:50:44.595496    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:50:56.908239 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:50:56.908204    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:51:06.635957 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:51:06.635926    2527 scope.go:117] "RemoveContainer" containerID="28aa20f916cca8529e6248e66cc3a069fee63019e12e3f133c302f9f7f5c5698"
Jul 30 00:51:06.646744 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:51:06.646726    2527 scope.go:117] "RemoveContainer" containerID="c23db815a4a0229f754acfabc2db6743f62a69915bed751f52a3e5941ed17d46"
Jul 30 00:51:18.601898 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:51:18.601863    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:51:32.698911 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:51:32.698822    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:51:44.900059 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:51:44.900023    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:52:02.992909 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:02.992877    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:52:06.672862 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:06.672826    2527 scope.go:117] "RemoveContainer" containerID="57b4409023733b6418486b130e4f75cac15a94cd630e8b824ad9807266fa6270"
Jul 30 00:52:10.016378 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:10.016353    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9cggv_c6b01a1f-c41e-4781-8c25-66b152e0d0e8/ovn-acl-logging/0.log"
Jul 30 00:52:10.041528 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:10.041502    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9cggv_c6b01a1f-c41e-4781-8c25-66b152e0d0e8/ovn-acl-logging/0.log"
Jul 30 00:52:12.885141 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:12.885106    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"]
Jul 30 00:52:12.888751 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:12.888735    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"
Jul 30 00:52:12.891933 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:12.891911    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4ef902\"/\"default-dockercfg-nvlpj\""
Jul 30 00:52:12.892029 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:12.891974    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4ef902\"/\"sub-test-model-4ef902-kserve-self-signed-certs\""
Jul 30 00:52:12.892082 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:12.892023    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4ef902\"/\"kube-root-ca.crt\""
Jul 30 00:52:12.892237 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:12.892214    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4ef902\"/\"openshift-service-ca.crt\""
Jul 30 00:52:12.898812 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:12.898789    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"]
Jul 30 00:52:13.032407 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:13.032381    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03a58761-0b0a-415e-a99a-601fc99b0d14-tls-certs\") pod \"sub-test-model-4ef902-kserve-867448d66c-6kfx8\" (UID: \"03a58761-0b0a-415e-a99a-601fc99b0d14\") " pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"
Jul 30 00:52:13.032574 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:13.032419    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03a58761-0b0a-415e-a99a-601fc99b0d14-dshm\") pod \"sub-test-model-4ef902-kserve-867448d66c-6kfx8\" (UID: \"03a58761-0b0a-415e-a99a-601fc99b0d14\") " pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"
Jul 30 00:52:13.032574 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:13.032457    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03a58761-0b0a-415e-a99a-601fc99b0d14-tmp-dir\") pod \"sub-test-model-4ef902-kserve-867448d66c-6kfx8\" (UID: \"03a58761-0b0a-415e-a99a-601fc99b0d14\") " pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"
Jul 30 00:52:13.032574 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:13.032539    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h275\" (UniqueName: \"kubernetes.io/projected/03a58761-0b0a-415e-a99a-601fc99b0d14-kube-api-access-9h275\") pod \"sub-test-model-4ef902-kserve-867448d66c-6kfx8\" (UID: \"03a58761-0b0a-415e-a99a-601fc99b0d14\") " pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"
Jul 30 00:52:13.032739 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:13.032598    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03a58761-0b0a-415e-a99a-601fc99b0d14-home\") pod \"sub-test-model-4ef902-kserve-867448d66c-6kfx8\" (UID: \"03a58761-0b0a-415e-a99a-601fc99b0d14\") " pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"
Jul 30 00:52:13.032739 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:13.032635    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03a58761-0b0a-415e-a99a-601fc99b0d14-model-cache\") pod \"sub-test-model-4ef902-kserve-867448d66c-6kfx8\" (UID: \"03a58761-0b0a-415e-a99a-601fc99b0d14\") " pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"
Jul 30 00:52:13.134039 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:13.134012    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h275\" (UniqueName: \"kubernetes.io/projected/03a58761-0b0a-415e-a99a-601fc99b0d14-kube-api-access-9h275\") pod \"sub-test-model-4ef902-kserve-867448d66c-6kfx8\" (UID: \"03a58761-0b0a-415e-a99a-601fc99b0d14\") " pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"
Jul 30 00:52:13.134211 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:13.134053    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03a58761-0b0a-415e-a99a-601fc99b0d14-home\") pod \"sub-test-model-4ef902-kserve-867448d66c-6kfx8\" (UID: \"03a58761-0b0a-415e-a99a-601fc99b0d14\") " pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"
Jul 30 00:52:13.134211 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:13.134079    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03a58761-0b0a-415e-a99a-601fc99b0d14-model-cache\") pod \"sub-test-model-4ef902-kserve-867448d66c-6kfx8\" (UID: \"03a58761-0b0a-415e-a99a-601fc99b0d14\") " pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"
Jul 30 00:52:13.134211 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:13.134115    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03a58761-0b0a-415e-a99a-601fc99b0d14-tls-certs\") pod \"sub-test-model-4ef902-kserve-867448d66c-6kfx8\" (UID: \"03a58761-0b0a-415e-a99a-601fc99b0d14\") " pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"
Jul 30 00:52:13.134211 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:13.134132    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03a58761-0b0a-415e-a99a-601fc99b0d14-dshm\") pod \"sub-test-model-4ef902-kserve-867448d66c-6kfx8\" (UID: \"03a58761-0b0a-415e-a99a-601fc99b0d14\") " pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"
Jul 30 00:52:13.134211 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:13.134207    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03a58761-0b0a-415e-a99a-601fc99b0d14-tmp-dir\") pod \"sub-test-model-4ef902-kserve-867448d66c-6kfx8\" (UID: \"03a58761-0b0a-415e-a99a-601fc99b0d14\") " pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"
Jul 30 00:52:13.134473 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:13.134415    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03a58761-0b0a-415e-a99a-601fc99b0d14-home\") pod \"sub-test-model-4ef902-kserve-867448d66c-6kfx8\" (UID: \"03a58761-0b0a-415e-a99a-601fc99b0d14\") " pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"
Jul 30 00:52:13.134511 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:13.134469    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03a58761-0b0a-415e-a99a-601fc99b0d14-model-cache\") pod \"sub-test-model-4ef902-kserve-867448d66c-6kfx8\" (UID: \"03a58761-0b0a-415e-a99a-601fc99b0d14\") " pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"
Jul 30 00:52:13.134549 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:13.134519    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03a58761-0b0a-415e-a99a-601fc99b0d14-tmp-dir\") pod \"sub-test-model-4ef902-kserve-867448d66c-6kfx8\" (UID: \"03a58761-0b0a-415e-a99a-601fc99b0d14\") " pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"
Jul 30 00:52:13.136580 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:13.136530    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03a58761-0b0a-415e-a99a-601fc99b0d14-dshm\") pod \"sub-test-model-4ef902-kserve-867448d66c-6kfx8\" (UID: \"03a58761-0b0a-415e-a99a-601fc99b0d14\") " pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"
Jul 30 00:52:13.136707 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:13.136690    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03a58761-0b0a-415e-a99a-601fc99b0d14-tls-certs\") pod \"sub-test-model-4ef902-kserve-867448d66c-6kfx8\" (UID: \"03a58761-0b0a-415e-a99a-601fc99b0d14\") " pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"
Jul 30 00:52:13.143365 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:13.143340    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h275\" (UniqueName: \"kubernetes.io/projected/03a58761-0b0a-415e-a99a-601fc99b0d14-kube-api-access-9h275\") pod \"sub-test-model-4ef902-kserve-867448d66c-6kfx8\" (UID: \"03a58761-0b0a-415e-a99a-601fc99b0d14\") " pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"
Jul 30 00:52:13.199005 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:13.198981    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"
Jul 30 00:52:13.554664 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:13.554638    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"]
Jul 30 00:52:13.555727 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:52:13.555703    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03a58761_0b0a_415e_a99a_601fc99b0d14.slice/crio-458d85d38325de79867ad9663336761317b9ecc2188fa35d0c21d2ecaaf0736f WatchSource:0}: Error finding container 458d85d38325de79867ad9663336761317b9ecc2188fa35d0c21d2ecaaf0736f: Status 404 returned error can't find the container with id 458d85d38325de79867ad9663336761317b9ecc2188fa35d0c21d2ecaaf0736f
Jul 30 00:52:13.584339 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:13.584314    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8" event={"ID":"03a58761-0b0a-415e-a99a-601fc99b0d14","Type":"ContainerStarted","Data":"458d85d38325de79867ad9663336761317b9ecc2188fa35d0c21d2ecaaf0736f"}
Jul 30 00:52:14.592266 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:14.592225    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8" event={"ID":"03a58761-0b0a-415e-a99a-601fc99b0d14","Type":"ContainerStarted","Data":"72a821c6de88f5d49172e0a9bd03c149a16d7d86afdb3a5918e5ce1c4488583b"}
Jul 30 00:52:14.608534 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:14.608480    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8" podStartSLOduration=2.60846474 podStartE2EDuration="2.60846474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:52:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:52:14.606698361 +0000 UTC m=+3008.909146707" watchObservedRunningTime="2026-07-30 00:52:14.60846474 +0000 UTC m=+3008.910913103"
Jul 30 00:52:18.399261 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:18.399227    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:52:23.199979 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:23.199947    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"
Jul 30 00:52:23.200479 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:23.199989    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"
Jul 30 00:52:23.212746 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:23.212723    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"
Jul 30 00:52:23.662121 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:23.662036    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"
Jul 30 00:52:44.394740 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:52:44.394711    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:53:21.498197 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:53:21.498150    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:53:40.503114 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:53:40.503074    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:53:46.006205 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:53:46.006151    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"]
Jul 30 00:53:57.499874 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:53:57.499832    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:54:01.027717 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:54:01.027682    2527 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8" podUID="03a58761-0b0a-415e-a99a-601fc99b0d14" containerName="main" containerID="cri-o://72a821c6de88f5d49172e0a9bd03c149a16d7d86afdb3a5918e5ce1c4488583b" gracePeriod=45
Jul 30 00:54:01.234704 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:54:01.234674    2527 generic.go:356] "Generic (PLEG): container finished" podID="03a58761-0b0a-415e-a99a-601fc99b0d14" containerID="72a821c6de88f5d49172e0a9bd03c149a16d7d86afdb3a5918e5ce1c4488583b" exitCode=0
Jul 30 00:54:01.234843 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:54:01.234717    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8" event={"ID":"03a58761-0b0a-415e-a99a-601fc99b0d14","Type":"ContainerDied","Data":"72a821c6de88f5d49172e0a9bd03c149a16d7d86afdb3a5918e5ce1c4488583b"}
Jul 30 00:54:01.284944 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:54:01.284892    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"
Jul 30 00:54:01.443358 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:54:01.443330    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03a58761-0b0a-415e-a99a-601fc99b0d14-home\") pod \"03a58761-0b0a-415e-a99a-601fc99b0d14\" (UID: \"03a58761-0b0a-415e-a99a-601fc99b0d14\") "
Jul 30 00:54:01.443358 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:54:01.443365    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03a58761-0b0a-415e-a99a-601fc99b0d14-tmp-dir\") pod \"03a58761-0b0a-415e-a99a-601fc99b0d14\" (UID: \"03a58761-0b0a-415e-a99a-601fc99b0d14\") "
Jul 30 00:54:01.443615 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:54:01.443415    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9h275\" (UniqueName: \"kubernetes.io/projected/03a58761-0b0a-415e-a99a-601fc99b0d14-kube-api-access-9h275\") pod \"03a58761-0b0a-415e-a99a-601fc99b0d14\" (UID: \"03a58761-0b0a-415e-a99a-601fc99b0d14\") "
Jul 30 00:54:01.443615 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:54:01.443442    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03a58761-0b0a-415e-a99a-601fc99b0d14-tls-certs\") pod \"03a58761-0b0a-415e-a99a-601fc99b0d14\" (UID: \"03a58761-0b0a-415e-a99a-601fc99b0d14\") "
Jul 30 00:54:01.443615 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:54:01.443507    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03a58761-0b0a-415e-a99a-601fc99b0d14-dshm\") pod \"03a58761-0b0a-415e-a99a-601fc99b0d14\" (UID: \"03a58761-0b0a-415e-a99a-601fc99b0d14\") "
Jul 30 00:54:01.443615 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:54:01.443530    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03a58761-0b0a-415e-a99a-601fc99b0d14-model-cache\") pod \"03a58761-0b0a-415e-a99a-601fc99b0d14\" (UID: \"03a58761-0b0a-415e-a99a-601fc99b0d14\") "
Jul 30 00:54:01.443845 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:54:01.443652    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03a58761-0b0a-415e-a99a-601fc99b0d14-home" (OuterVolumeSpecName: "home") pod "03a58761-0b0a-415e-a99a-601fc99b0d14" (UID: "03a58761-0b0a-415e-a99a-601fc99b0d14"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:54:01.443845 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:54:01.443667    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03a58761-0b0a-415e-a99a-601fc99b0d14-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "03a58761-0b0a-415e-a99a-601fc99b0d14" (UID: "03a58761-0b0a-415e-a99a-601fc99b0d14"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:54:01.443960 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:54:01.443860    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03a58761-0b0a-415e-a99a-601fc99b0d14-model-cache" (OuterVolumeSpecName: "model-cache") pod "03a58761-0b0a-415e-a99a-601fc99b0d14" (UID: "03a58761-0b0a-415e-a99a-601fc99b0d14"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:54:01.444026 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:54:01.443954    2527 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03a58761-0b0a-415e-a99a-601fc99b0d14-home\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:54:01.444026 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:54:01.443993    2527 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03a58761-0b0a-415e-a99a-601fc99b0d14-tmp-dir\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:54:01.444026 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:54:01.444008    2527 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03a58761-0b0a-415e-a99a-601fc99b0d14-model-cache\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:54:01.446042 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:54:01.446005    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03a58761-0b0a-415e-a99a-601fc99b0d14-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "03a58761-0b0a-415e-a99a-601fc99b0d14" (UID: "03a58761-0b0a-415e-a99a-601fc99b0d14"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:54:01.446179 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:54:01.446135    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03a58761-0b0a-415e-a99a-601fc99b0d14-kube-api-access-9h275" (OuterVolumeSpecName: "kube-api-access-9h275") pod "03a58761-0b0a-415e-a99a-601fc99b0d14" (UID: "03a58761-0b0a-415e-a99a-601fc99b0d14"). InnerVolumeSpecName "kube-api-access-9h275". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:54:01.446313 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:54:01.446292    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03a58761-0b0a-415e-a99a-601fc99b0d14-dshm" (OuterVolumeSpecName: "dshm") pod "03a58761-0b0a-415e-a99a-601fc99b0d14" (UID: "03a58761-0b0a-415e-a99a-601fc99b0d14"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 00:54:01.544803 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:54:01.544737    2527 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03a58761-0b0a-415e-a99a-601fc99b0d14-tls-certs\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:54:01.544803 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:54:01.544761    2527 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03a58761-0b0a-415e-a99a-601fc99b0d14-dshm\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:54:01.544803 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:54:01.544771    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9h275\" (UniqueName: \"kubernetes.io/projected/03a58761-0b0a-415e-a99a-601fc99b0d14-kube-api-access-9h275\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:54:02.241695 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:54:02.241665    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"
Jul 30 00:54:02.242193 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:54:02.241691    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8" event={"ID":"03a58761-0b0a-415e-a99a-601fc99b0d14","Type":"ContainerDied","Data":"458d85d38325de79867ad9663336761317b9ecc2188fa35d0c21d2ecaaf0736f"}
Jul 30 00:54:02.242193 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:54:02.241751    2527 scope.go:117] "RemoveContainer" containerID="72a821c6de88f5d49172e0a9bd03c149a16d7d86afdb3a5918e5ce1c4488583b"
Jul 30 00:54:02.259286 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:54:02.259260    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"]
Jul 30 00:54:02.264756 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:54:02.264733    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-4ef902/sub-test-model-4ef902-kserve-867448d66c-6kfx8"]
Jul 30 00:54:04.217024 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:54:04.216988    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03a58761-0b0a-415e-a99a-601fc99b0d14" path="/var/lib/kubelet/pods/03a58761-0b0a-415e-a99a-601fc99b0d14/volumes"
Jul 30 00:54:11.101628 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:54:11.101598    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:54:39.593087 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:54:39.593059    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:55:26.202190 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:55:26.202121    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:55:39.804089 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:55:39.804055    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:55:54.497771 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:55:54.497738    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:56:00.464663 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:00.464584    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7575-139944139321136"]
Jul 30 00:56:00.465113 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:00.465001    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03a58761-0b0a-415e-a99a-601fc99b0d14" containerName="main"
Jul 30 00:56:00.465113 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:00.465012    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="03a58761-0b0a-415e-a99a-601fc99b0d14" containerName="main"
Jul 30 00:56:00.465113 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:00.465085    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="03a58761-0b0a-415e-a99a-601fc99b0d14" containerName="main"
Jul 30 00:56:00.468245 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:00.468228    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7575-139944139321136"
Jul 30 00:56:00.470789 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:00.470761    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ml8lx\""
Jul 30 00:56:00.473018 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:00.472995    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7575-139944139321136"]
Jul 30 00:56:00.509534 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:00.509502    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcvg7\" (UniqueName: \"kubernetes.io/projected/5300e029-27d4-4ff1-ba48-6725d3e68ec6-kube-api-access-xcvg7\") pod \"test-curl-7575-139944139321136\" (UID: \"5300e029-27d4-4ff1-ba48-6725d3e68ec6\") " pod="opendatahub/test-curl-7575-139944139321136"
Jul 30 00:56:00.610426 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:00.610396    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcvg7\" (UniqueName: \"kubernetes.io/projected/5300e029-27d4-4ff1-ba48-6725d3e68ec6-kube-api-access-xcvg7\") pod \"test-curl-7575-139944139321136\" (UID: \"5300e029-27d4-4ff1-ba48-6725d3e68ec6\") " pod="opendatahub/test-curl-7575-139944139321136"
Jul 30 00:56:00.617562 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:00.617540    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcvg7\" (UniqueName: \"kubernetes.io/projected/5300e029-27d4-4ff1-ba48-6725d3e68ec6-kube-api-access-xcvg7\") pod \"test-curl-7575-139944139321136\" (UID: \"5300e029-27d4-4ff1-ba48-6725d3e68ec6\") " pod="opendatahub/test-curl-7575-139944139321136"
Jul 30 00:56:00.778907 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:00.778846    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7575-139944139321136"
Jul 30 00:56:01.125281 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:01.125257    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7575-139944139321136"]
Jul 30 00:56:01.126911 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:56:01.126885    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5300e029_27d4_4ff1_ba48_6725d3e68ec6.slice/crio-d2e1b380fe1460bfdb81bf8df8b0f07a937efe688e026b4598031c431c616277 WatchSource:0}: Error finding container d2e1b380fe1460bfdb81bf8df8b0f07a937efe688e026b4598031c431c616277: Status 404 returned error can't find the container with id d2e1b380fe1460bfdb81bf8df8b0f07a937efe688e026b4598031c431c616277
Jul 30 00:56:01.128216 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:01.128197    2527 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 00:56:01.940732 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:01.940706    2527 generic.go:356] "Generic (PLEG): container finished" podID="5300e029-27d4-4ff1-ba48-6725d3e68ec6" containerID="5fa1ef75de106d404d6f7d845ad7cbe7fddfcc5d3d8ddc4af725032e37c590ad" exitCode=0
Jul 30 00:56:01.941020 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:01.940785    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7575-139944139321136" event={"ID":"5300e029-27d4-4ff1-ba48-6725d3e68ec6","Type":"ContainerDied","Data":"5fa1ef75de106d404d6f7d845ad7cbe7fddfcc5d3d8ddc4af725032e37c590ad"}
Jul 30 00:56:01.941020 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:01.940829    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7575-139944139321136" event={"ID":"5300e029-27d4-4ff1-ba48-6725d3e68ec6","Type":"ContainerStarted","Data":"d2e1b380fe1460bfdb81bf8df8b0f07a937efe688e026b4598031c431c616277"}
Jul 30 00:56:03.093730 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:03.093701    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7575-139944139321136"
Jul 30 00:56:03.125205 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:03.125154    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7575-139944139321136_5300e029-27d4-4ff1-ba48-6725d3e68ec6/test-curl-7575-139944139321136/0.log"
Jul 30 00:56:03.134444 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:03.134419    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcvg7\" (UniqueName: \"kubernetes.io/projected/5300e029-27d4-4ff1-ba48-6725d3e68ec6-kube-api-access-xcvg7\") pod \"5300e029-27d4-4ff1-ba48-6725d3e68ec6\" (UID: \"5300e029-27d4-4ff1-ba48-6725d3e68ec6\") "
Jul 30 00:56:03.136597 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:03.136564    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5300e029-27d4-4ff1-ba48-6725d3e68ec6-kube-api-access-xcvg7" (OuterVolumeSpecName: "kube-api-access-xcvg7") pod "5300e029-27d4-4ff1-ba48-6725d3e68ec6" (UID: "5300e029-27d4-4ff1-ba48-6725d3e68ec6"). InnerVolumeSpecName "kube-api-access-xcvg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:56:03.149053 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:03.149027    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7575-139944139321136"]
Jul 30 00:56:03.151563 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:03.151543    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7575-139944139321136"]
Jul 30 00:56:03.235345 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:03.235257    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcvg7\" (UniqueName: \"kubernetes.io/projected/5300e029-27d4-4ff1-ba48-6725d3e68ec6-kube-api-access-xcvg7\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:56:03.267017 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:03.266982    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7575-139944139317808"]
Jul 30 00:56:03.267637 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:03.267615    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5300e029-27d4-4ff1-ba48-6725d3e68ec6" containerName="test-curl-7575-139944139321136"
Jul 30 00:56:03.267637 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:03.267637    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="5300e029-27d4-4ff1-ba48-6725d3e68ec6" containerName="test-curl-7575-139944139321136"
Jul 30 00:56:03.267842 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:03.267755    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="5300e029-27d4-4ff1-ba48-6725d3e68ec6" containerName="test-curl-7575-139944139321136"
Jul 30 00:56:03.271321 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:03.271300    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7575-139944139317808"
Jul 30 00:56:03.276226 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:03.276202    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7575-139944139317808"]
Jul 30 00:56:03.335903 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:03.335869    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfm52\" (UniqueName: \"kubernetes.io/projected/272d4a62-b3e5-44d3-9e3e-d573485836f5-kube-api-access-jfm52\") pod \"test-curl-7575-139944139317808\" (UID: \"272d4a62-b3e5-44d3-9e3e-d573485836f5\") " pod="opendatahub/test-curl-7575-139944139317808"
Jul 30 00:56:03.437352 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:03.437315    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfm52\" (UniqueName: \"kubernetes.io/projected/272d4a62-b3e5-44d3-9e3e-d573485836f5-kube-api-access-jfm52\") pod \"test-curl-7575-139944139317808\" (UID: \"272d4a62-b3e5-44d3-9e3e-d573485836f5\") " pod="opendatahub/test-curl-7575-139944139317808"
Jul 30 00:56:03.445244 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:03.445217    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfm52\" (UniqueName: \"kubernetes.io/projected/272d4a62-b3e5-44d3-9e3e-d573485836f5-kube-api-access-jfm52\") pod \"test-curl-7575-139944139317808\" (UID: \"272d4a62-b3e5-44d3-9e3e-d573485836f5\") " pod="opendatahub/test-curl-7575-139944139317808"
Jul 30 00:56:03.584612 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:03.584532    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7575-139944139317808"
Jul 30 00:56:03.930110 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:03.930085    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7575-139944139317808"]
Jul 30 00:56:03.931355 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:56:03.931328    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod272d4a62_b3e5_44d3_9e3e_d573485836f5.slice/crio-7da609bdca0219bb734aa2906a6c2c166e0ef940ce1c44eb2d21d2da7a83d819 WatchSource:0}: Error finding container 7da609bdca0219bb734aa2906a6c2c166e0ef940ce1c44eb2d21d2da7a83d819: Status 404 returned error can't find the container with id 7da609bdca0219bb734aa2906a6c2c166e0ef940ce1c44eb2d21d2da7a83d819
Jul 30 00:56:03.954386 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:03.954359    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7575-139944139321136"
Jul 30 00:56:03.954490 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:03.954402    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d2e1b380fe1460bfdb81bf8df8b0f07a937efe688e026b4598031c431c616277"
Jul 30 00:56:03.955663 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:03.955643    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7575-139944139317808" event={"ID":"272d4a62-b3e5-44d3-9e3e-d573485836f5","Type":"ContainerStarted","Data":"7da609bdca0219bb734aa2906a6c2c166e0ef940ce1c44eb2d21d2da7a83d819"}
Jul 30 00:56:03.965044 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:56:03.965020    2527 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7575-139944139321136\" is forbidden: User \"system:node:ip-10-0-137-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-198.ec2.internal' and this object" podUID="5300e029-27d4-4ff1-ba48-6725d3e68ec6" pod="opendatahub/test-curl-7575-139944139321136"
Jul 30 00:56:04.216885 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:04.216858    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5300e029-27d4-4ff1-ba48-6725d3e68ec6" path="/var/lib/kubelet/pods/5300e029-27d4-4ff1-ba48-6725d3e68ec6/volumes"
Jul 30 00:56:04.963302 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:04.963267    2527 generic.go:356] "Generic (PLEG): container finished" podID="272d4a62-b3e5-44d3-9e3e-d573485836f5" containerID="229761cf955953713ada1cc31cb833a2ef566796f3fac5de9dd7d64b2aeed9ba" exitCode=0
Jul 30 00:56:04.963468 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:04.963329    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7575-139944139317808" event={"ID":"272d4a62-b3e5-44d3-9e3e-d573485836f5","Type":"ContainerDied","Data":"229761cf955953713ada1cc31cb833a2ef566796f3fac5de9dd7d64b2aeed9ba"}
Jul 30 00:56:06.112643 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:06.112617    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7575-139944139317808"
Jul 30 00:56:06.132476 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:06.132449    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7575-139944139317808_272d4a62-b3e5-44d3-9e3e-d573485836f5/test-curl-7575-139944139317808/0.log"
Jul 30 00:56:06.154702 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:06.154676    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7575-139944139317808"]
Jul 30 00:56:06.157462 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:06.157430    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7575-139944139317808"]
Jul 30 00:56:06.163147 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:06.163128    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfm52\" (UniqueName: \"kubernetes.io/projected/272d4a62-b3e5-44d3-9e3e-d573485836f5-kube-api-access-jfm52\") pod \"272d4a62-b3e5-44d3-9e3e-d573485836f5\" (UID: \"272d4a62-b3e5-44d3-9e3e-d573485836f5\") "
Jul 30 00:56:06.165232 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:06.165209    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/272d4a62-b3e5-44d3-9e3e-d573485836f5-kube-api-access-jfm52" (OuterVolumeSpecName: "kube-api-access-jfm52") pod "272d4a62-b3e5-44d3-9e3e-d573485836f5" (UID: "272d4a62-b3e5-44d3-9e3e-d573485836f5"). InnerVolumeSpecName "kube-api-access-jfm52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:56:06.217530 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:06.217507    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="272d4a62-b3e5-44d3-9e3e-d573485836f5" path="/var/lib/kubelet/pods/272d4a62-b3e5-44d3-9e3e-d573485836f5/volumes"
Jul 30 00:56:06.264511 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:06.264479    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfm52\" (UniqueName: \"kubernetes.io/projected/272d4a62-b3e5-44d3-9e3e-d573485836f5-kube-api-access-jfm52\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:56:06.304673 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:06.304651    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7575-139944139196432"]
Jul 30 00:56:06.305070 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:06.305058    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="272d4a62-b3e5-44d3-9e3e-d573485836f5" containerName="test-curl-7575-139944139317808"
Jul 30 00:56:06.305113 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:06.305072    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="272d4a62-b3e5-44d3-9e3e-d573485836f5" containerName="test-curl-7575-139944139317808"
Jul 30 00:56:06.305156 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:06.305147    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="272d4a62-b3e5-44d3-9e3e-d573485836f5" containerName="test-curl-7575-139944139317808"
Jul 30 00:56:06.308355 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:06.308331    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7575-139944139196432"
Jul 30 00:56:06.314189 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:06.314141    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7575-139944139196432"]
Jul 30 00:56:06.365223 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:06.365198    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt89q\" (UniqueName: \"kubernetes.io/projected/ba9f7497-4c2e-4da1-b7aa-cde18c9d36f1-kube-api-access-tt89q\") pod \"test-curl-7575-139944139196432\" (UID: \"ba9f7497-4c2e-4da1-b7aa-cde18c9d36f1\") " pod="opendatahub/test-curl-7575-139944139196432"
Jul 30 00:56:06.466536 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:06.466511    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt89q\" (UniqueName: \"kubernetes.io/projected/ba9f7497-4c2e-4da1-b7aa-cde18c9d36f1-kube-api-access-tt89q\") pod \"test-curl-7575-139944139196432\" (UID: \"ba9f7497-4c2e-4da1-b7aa-cde18c9d36f1\") " pod="opendatahub/test-curl-7575-139944139196432"
Jul 30 00:56:06.473680 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:06.473654    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt89q\" (UniqueName: \"kubernetes.io/projected/ba9f7497-4c2e-4da1-b7aa-cde18c9d36f1-kube-api-access-tt89q\") pod \"test-curl-7575-139944139196432\" (UID: \"ba9f7497-4c2e-4da1-b7aa-cde18c9d36f1\") " pod="opendatahub/test-curl-7575-139944139196432"
Jul 30 00:56:06.619078 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:06.619014    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7575-139944139196432"
Jul 30 00:56:06.757588 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:06.757555    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7575-139944139196432"]
Jul 30 00:56:06.763656 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:56:06.763627    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba9f7497_4c2e_4da1_b7aa_cde18c9d36f1.slice/crio-105f8a85a2bccf4f724d0128a4815fdd9bdd68c6a2581323dd12ae9ed08005e5 WatchSource:0}: Error finding container 105f8a85a2bccf4f724d0128a4815fdd9bdd68c6a2581323dd12ae9ed08005e5: Status 404 returned error can't find the container with id 105f8a85a2bccf4f724d0128a4815fdd9bdd68c6a2581323dd12ae9ed08005e5
Jul 30 00:56:06.975610 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:06.975577    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7575-139944139196432" event={"ID":"ba9f7497-4c2e-4da1-b7aa-cde18c9d36f1","Type":"ContainerStarted","Data":"105f8a85a2bccf4f724d0128a4815fdd9bdd68c6a2581323dd12ae9ed08005e5"}
Jul 30 00:56:06.976751 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:06.976724    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7575-139944139317808"
Jul 30 00:56:06.976896 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:06.976763    2527 scope.go:117] "RemoveContainer" containerID="229761cf955953713ada1cc31cb833a2ef566796f3fac5de9dd7d64b2aeed9ba"
Jul 30 00:56:07.985525 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:07.985489    2527 generic.go:356] "Generic (PLEG): container finished" podID="ba9f7497-4c2e-4da1-b7aa-cde18c9d36f1" containerID="c993791680ba618bc4e72be062fb3dfaab4da0e7daa50599f960eb049e868399" exitCode=0
Jul 30 00:56:07.985922 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:07.985573    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7575-139944139196432" event={"ID":"ba9f7497-4c2e-4da1-b7aa-cde18c9d36f1","Type":"ContainerDied","Data":"c993791680ba618bc4e72be062fb3dfaab4da0e7daa50599f960eb049e868399"}
Jul 30 00:56:09.139329 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:09.139307    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7575-139944139196432"
Jul 30 00:56:09.158097 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:09.158065    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7575-139944139196432_ba9f7497-4c2e-4da1-b7aa-cde18c9d36f1/test-curl-7575-139944139196432/0.log"
Jul 30 00:56:09.180575 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:09.180547    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7575-139944139196432"]
Jul 30 00:56:09.184994 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:09.184970    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7575-139944139196432"]
Jul 30 00:56:09.289881 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:09.289803    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tt89q\" (UniqueName: \"kubernetes.io/projected/ba9f7497-4c2e-4da1-b7aa-cde18c9d36f1-kube-api-access-tt89q\") pod \"ba9f7497-4c2e-4da1-b7aa-cde18c9d36f1\" (UID: \"ba9f7497-4c2e-4da1-b7aa-cde18c9d36f1\") "
Jul 30 00:56:09.291989 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:09.291966    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba9f7497-4c2e-4da1-b7aa-cde18c9d36f1-kube-api-access-tt89q" (OuterVolumeSpecName: "kube-api-access-tt89q") pod "ba9f7497-4c2e-4da1-b7aa-cde18c9d36f1" (UID: "ba9f7497-4c2e-4da1-b7aa-cde18c9d36f1"). InnerVolumeSpecName "kube-api-access-tt89q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:56:09.302870 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:09.302848    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7575-139944139196432"]
Jul 30 00:56:09.303325 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:09.303311    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba9f7497-4c2e-4da1-b7aa-cde18c9d36f1" containerName="test-curl-7575-139944139196432"
Jul 30 00:56:09.303377 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:09.303328    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba9f7497-4c2e-4da1-b7aa-cde18c9d36f1" containerName="test-curl-7575-139944139196432"
Jul 30 00:56:09.303431 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:09.303421    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba9f7497-4c2e-4da1-b7aa-cde18c9d36f1" containerName="test-curl-7575-139944139196432"
Jul 30 00:56:09.306423 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:09.306408    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7575-139944139196432"
Jul 30 00:56:09.312532 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:09.312506    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7575-139944139196432"]
Jul 30 00:56:09.391406 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:09.391376    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sknfg\" (UniqueName: \"kubernetes.io/projected/2d17f863-b396-4dcb-b0e6-07c0d38c14ea-kube-api-access-sknfg\") pod \"test-curl-7575-139944139196432\" (UID: \"2d17f863-b396-4dcb-b0e6-07c0d38c14ea\") " pod="opendatahub/test-curl-7575-139944139196432"
Jul 30 00:56:09.391552 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:09.391530    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tt89q\" (UniqueName: \"kubernetes.io/projected/ba9f7497-4c2e-4da1-b7aa-cde18c9d36f1-kube-api-access-tt89q\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:56:09.492013 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:09.491982    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sknfg\" (UniqueName: \"kubernetes.io/projected/2d17f863-b396-4dcb-b0e6-07c0d38c14ea-kube-api-access-sknfg\") pod \"test-curl-7575-139944139196432\" (UID: \"2d17f863-b396-4dcb-b0e6-07c0d38c14ea\") " pod="opendatahub/test-curl-7575-139944139196432"
Jul 30 00:56:09.499538 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:09.499510    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sknfg\" (UniqueName: \"kubernetes.io/projected/2d17f863-b396-4dcb-b0e6-07c0d38c14ea-kube-api-access-sknfg\") pod \"test-curl-7575-139944139196432\" (UID: \"2d17f863-b396-4dcb-b0e6-07c0d38c14ea\") " pod="opendatahub/test-curl-7575-139944139196432"
Jul 30 00:56:09.617927 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:09.617852    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7575-139944139196432"
Jul 30 00:56:09.961378 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:09.961352    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7575-139944139196432"]
Jul 30 00:56:09.963107 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:56:09.963081    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d17f863_b396_4dcb_b0e6_07c0d38c14ea.slice/crio-3297149a8a4851d51ea882160955420795a026372089f8ad40cfbfe4cc8cf4d2 WatchSource:0}: Error finding container 3297149a8a4851d51ea882160955420795a026372089f8ad40cfbfe4cc8cf4d2: Status 404 returned error can't find the container with id 3297149a8a4851d51ea882160955420795a026372089f8ad40cfbfe4cc8cf4d2
Jul 30 00:56:10.000751 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:10.000720    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7575-139944139196432" event={"ID":"2d17f863-b396-4dcb-b0e6-07c0d38c14ea","Type":"ContainerStarted","Data":"3297149a8a4851d51ea882160955420795a026372089f8ad40cfbfe4cc8cf4d2"}
Jul 30 00:56:10.001955 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:10.001936    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="105f8a85a2bccf4f724d0128a4815fdd9bdd68c6a2581323dd12ae9ed08005e5"
Jul 30 00:56:10.002041 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:10.001969    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7575-139944139196432"
Jul 30 00:56:10.013320 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:10.013286    2527 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7575-139944139196432" oldPodUID="ba9f7497-4c2e-4da1-b7aa-cde18c9d36f1" podUID="2d17f863-b396-4dcb-b0e6-07c0d38c14ea"
Jul 30 00:56:10.219673 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:10.219606    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba9f7497-4c2e-4da1-b7aa-cde18c9d36f1" path="/var/lib/kubelet/pods/ba9f7497-4c2e-4da1-b7aa-cde18c9d36f1/volumes"
Jul 30 00:56:11.009021 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:11.008991    2527 generic.go:356] "Generic (PLEG): container finished" podID="2d17f863-b396-4dcb-b0e6-07c0d38c14ea" containerID="178620144b435a74614d7022ea596e514191e75cf6f851bd03345ced7e7e33e2" exitCode=0
Jul 30 00:56:11.009205 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:11.009079    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7575-139944139196432" event={"ID":"2d17f863-b396-4dcb-b0e6-07c0d38c14ea","Type":"ContainerDied","Data":"178620144b435a74614d7022ea596e514191e75cf6f851bd03345ced7e7e33e2"}
Jul 30 00:56:11.195583 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:11.195553    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:56:12.161500 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:12.161476    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7575-139944139196432"
Jul 30 00:56:12.180339 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:12.180314    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7575-139944139196432_2d17f863-b396-4dcb-b0e6-07c0d38c14ea/test-curl-7575-139944139196432/0.log"
Jul 30 00:56:12.202123 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:12.202094    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7575-139944139196432"]
Jul 30 00:56:12.205324 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:12.205302    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7575-139944139196432"]
Jul 30 00:56:12.212545 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:12.212527    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sknfg\" (UniqueName: \"kubernetes.io/projected/2d17f863-b396-4dcb-b0e6-07c0d38c14ea-kube-api-access-sknfg\") pod \"2d17f863-b396-4dcb-b0e6-07c0d38c14ea\" (UID: \"2d17f863-b396-4dcb-b0e6-07c0d38c14ea\") "
Jul 30 00:56:12.215047 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:12.215018    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d17f863-b396-4dcb-b0e6-07c0d38c14ea-kube-api-access-sknfg" (OuterVolumeSpecName: "kube-api-access-sknfg") pod "2d17f863-b396-4dcb-b0e6-07c0d38c14ea" (UID: "2d17f863-b396-4dcb-b0e6-07c0d38c14ea"). InnerVolumeSpecName "kube-api-access-sknfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:56:12.216998 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:12.216976    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d17f863-b396-4dcb-b0e6-07c0d38c14ea" path="/var/lib/kubelet/pods/2d17f863-b396-4dcb-b0e6-07c0d38c14ea/volumes"
Jul 30 00:56:12.313993 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:12.313927    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sknfg\" (UniqueName: \"kubernetes.io/projected/2d17f863-b396-4dcb-b0e6-07c0d38c14ea-kube-api-access-sknfg\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:56:12.324867 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:12.324844    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7575-139944139197440"]
Jul 30 00:56:12.325278 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:12.325265    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d17f863-b396-4dcb-b0e6-07c0d38c14ea" containerName="test-curl-7575-139944139196432"
Jul 30 00:56:12.325333 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:12.325279    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d17f863-b396-4dcb-b0e6-07c0d38c14ea" containerName="test-curl-7575-139944139196432"
Jul 30 00:56:12.325367 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:12.325347    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d17f863-b396-4dcb-b0e6-07c0d38c14ea" containerName="test-curl-7575-139944139196432"
Jul 30 00:56:12.328607 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:12.328589    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7575-139944139197440"
Jul 30 00:56:12.332584 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:12.332564    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7575-139944139197440"]
Jul 30 00:56:12.415388 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:12.415359    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6xl9\" (UniqueName: \"kubernetes.io/projected/8c0474f0-06ce-4cc1-ad5d-23964985d218-kube-api-access-x6xl9\") pod \"test-curl-7575-139944139197440\" (UID: \"8c0474f0-06ce-4cc1-ad5d-23964985d218\") " pod="opendatahub/test-curl-7575-139944139197440"
Jul 30 00:56:12.516759 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:12.516729    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6xl9\" (UniqueName: \"kubernetes.io/projected/8c0474f0-06ce-4cc1-ad5d-23964985d218-kube-api-access-x6xl9\") pod \"test-curl-7575-139944139197440\" (UID: \"8c0474f0-06ce-4cc1-ad5d-23964985d218\") " pod="opendatahub/test-curl-7575-139944139197440"
Jul 30 00:56:12.525758 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:12.525735    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6xl9\" (UniqueName: \"kubernetes.io/projected/8c0474f0-06ce-4cc1-ad5d-23964985d218-kube-api-access-x6xl9\") pod \"test-curl-7575-139944139197440\" (UID: \"8c0474f0-06ce-4cc1-ad5d-23964985d218\") " pod="opendatahub/test-curl-7575-139944139197440"
Jul 30 00:56:12.640268 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:12.640215    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7575-139944139197440"
Jul 30 00:56:12.773494 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:12.773469    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7575-139944139197440"]
Jul 30 00:56:12.775204 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:56:12.775150    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c0474f0_06ce_4cc1_ad5d_23964985d218.slice/crio-69b236cdd341b5d8e3bdb7efee15270909aeea2653d2c82e4af639f1991ffabd WatchSource:0}: Error finding container 69b236cdd341b5d8e3bdb7efee15270909aeea2653d2c82e4af639f1991ffabd: Status 404 returned error can't find the container with id 69b236cdd341b5d8e3bdb7efee15270909aeea2653d2c82e4af639f1991ffabd
Jul 30 00:56:13.023054 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:13.023034    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7575-139944139196432"
Jul 30 00:56:13.023209 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:13.023082    2527 scope.go:117] "RemoveContainer" containerID="178620144b435a74614d7022ea596e514191e75cf6f851bd03345ced7e7e33e2"
Jul 30 00:56:13.024491 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:13.024469    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7575-139944139197440" event={"ID":"8c0474f0-06ce-4cc1-ad5d-23964985d218","Type":"ContainerStarted","Data":"69b236cdd341b5d8e3bdb7efee15270909aeea2653d2c82e4af639f1991ffabd"}
Jul 30 00:56:14.032241 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:14.032206    2527 generic.go:356] "Generic (PLEG): container finished" podID="8c0474f0-06ce-4cc1-ad5d-23964985d218" containerID="0726534be58e4f5407fda2a33ef5e45df5f01871fe95e5abecd617e5d77f049f" exitCode=0
Jul 30 00:56:14.032611 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:14.032291    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7575-139944139197440" event={"ID":"8c0474f0-06ce-4cc1-ad5d-23964985d218","Type":"ContainerDied","Data":"0726534be58e4f5407fda2a33ef5e45df5f01871fe95e5abecd617e5d77f049f"}
Jul 30 00:56:15.184864 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:15.184837    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7575-139944139197440"
Jul 30 00:56:15.203380 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:15.203355    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7575-139944139197440_8c0474f0-06ce-4cc1-ad5d-23964985d218/test-curl-7575-139944139197440/0.log"
Jul 30 00:56:15.224956 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:15.224933    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7575-139944139197440"]
Jul 30 00:56:15.227456 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:15.227437    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7575-139944139197440"]
Jul 30 00:56:15.239486 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:15.239464    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6xl9\" (UniqueName: \"kubernetes.io/projected/8c0474f0-06ce-4cc1-ad5d-23964985d218-kube-api-access-x6xl9\") pod \"8c0474f0-06ce-4cc1-ad5d-23964985d218\" (UID: \"8c0474f0-06ce-4cc1-ad5d-23964985d218\") "
Jul 30 00:56:15.241842 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:15.241819    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c0474f0-06ce-4cc1-ad5d-23964985d218-kube-api-access-x6xl9" (OuterVolumeSpecName: "kube-api-access-x6xl9") pod "8c0474f0-06ce-4cc1-ad5d-23964985d218" (UID: "8c0474f0-06ce-4cc1-ad5d-23964985d218"). InnerVolumeSpecName "kube-api-access-x6xl9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:56:15.340974 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:15.340916    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6xl9\" (UniqueName: \"kubernetes.io/projected/8c0474f0-06ce-4cc1-ad5d-23964985d218-kube-api-access-x6xl9\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:56:15.352564 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:15.352540    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7575-139944139197440"]
Jul 30 00:56:15.353212 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:15.353197    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c0474f0-06ce-4cc1-ad5d-23964985d218" containerName="test-curl-7575-139944139197440"
Jul 30 00:56:15.353268 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:15.353216    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c0474f0-06ce-4cc1-ad5d-23964985d218" containerName="test-curl-7575-139944139197440"
Jul 30 00:56:15.353326 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:15.353313    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c0474f0-06ce-4cc1-ad5d-23964985d218" containerName="test-curl-7575-139944139197440"
Jul 30 00:56:15.356953 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:15.356929    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7575-139944139197440"
Jul 30 00:56:15.358247 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:15.358224    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7575-139944139197440"]
Jul 30 00:56:15.441907 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:15.441876    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2bv7\" (UniqueName: \"kubernetes.io/projected/d214d9bc-6a76-4922-857e-58a678e173cf-kube-api-access-p2bv7\") pod \"test-curl-7575-139944139197440\" (UID: \"d214d9bc-6a76-4922-857e-58a678e173cf\") " pod="opendatahub/test-curl-7575-139944139197440"
Jul 30 00:56:15.542823 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:15.542797    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2bv7\" (UniqueName: \"kubernetes.io/projected/d214d9bc-6a76-4922-857e-58a678e173cf-kube-api-access-p2bv7\") pod \"test-curl-7575-139944139197440\" (UID: \"d214d9bc-6a76-4922-857e-58a678e173cf\") " pod="opendatahub/test-curl-7575-139944139197440"
Jul 30 00:56:15.550404 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:15.550383    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2bv7\" (UniqueName: \"kubernetes.io/projected/d214d9bc-6a76-4922-857e-58a678e173cf-kube-api-access-p2bv7\") pod \"test-curl-7575-139944139197440\" (UID: \"d214d9bc-6a76-4922-857e-58a678e173cf\") " pod="opendatahub/test-curl-7575-139944139197440"
Jul 30 00:56:15.666897 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:15.666841    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7575-139944139197440"
Jul 30 00:56:15.802435 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:15.802408    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7575-139944139197440"]
Jul 30 00:56:15.804127 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:56:15.804092    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd214d9bc_6a76_4922_857e_58a678e173cf.slice/crio-55c628180274538f2c403851ca9040bf294e1ccd40583d3c1fd0cbf731d74ba7 WatchSource:0}: Error finding container 55c628180274538f2c403851ca9040bf294e1ccd40583d3c1fd0cbf731d74ba7: Status 404 returned error can't find the container with id 55c628180274538f2c403851ca9040bf294e1ccd40583d3c1fd0cbf731d74ba7
Jul 30 00:56:16.044787 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:16.044757    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7575-139944139197440" event={"ID":"d214d9bc-6a76-4922-857e-58a678e173cf","Type":"ContainerStarted","Data":"55c628180274538f2c403851ca9040bf294e1ccd40583d3c1fd0cbf731d74ba7"}
Jul 30 00:56:16.046096 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:16.046080    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="69b236cdd341b5d8e3bdb7efee15270909aeea2653d2c82e4af639f1991ffabd"
Jul 30 00:56:16.046096 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:16.046080    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7575-139944139197440"
Jul 30 00:56:16.057254 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:16.057232    2527 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7575-139944139197440" oldPodUID="8c0474f0-06ce-4cc1-ad5d-23964985d218" podUID="d214d9bc-6a76-4922-857e-58a678e173cf"
Jul 30 00:56:16.216542 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:16.216516    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c0474f0-06ce-4cc1-ad5d-23964985d218" path="/var/lib/kubelet/pods/8c0474f0-06ce-4cc1-ad5d-23964985d218/volumes"
Jul 30 00:56:17.054739 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:17.054704    2527 generic.go:356] "Generic (PLEG): container finished" podID="d214d9bc-6a76-4922-857e-58a678e173cf" containerID="24402e1807b4a3071627e337b842e3c8eb751d093fb4d5c3a0a9c71b60fac9f8" exitCode=0
Jul 30 00:56:17.054912 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:17.054744    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7575-139944139197440" event={"ID":"d214d9bc-6a76-4922-857e-58a678e173cf","Type":"ContainerDied","Data":"24402e1807b4a3071627e337b842e3c8eb751d093fb4d5c3a0a9c71b60fac9f8"}
Jul 30 00:56:18.198552 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:18.198527    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7575-139944139197440"
Jul 30 00:56:18.215838 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:18.215803    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7575-139944139197440_d214d9bc-6a76-4922-857e-58a678e173cf/test-curl-7575-139944139197440/0.log"
Jul 30 00:56:18.235895 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:18.235862    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7575-139944139197440"]
Jul 30 00:56:18.240023 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:18.239994    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7575-139944139197440"]
Jul 30 00:56:18.266791 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:18.266763    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2bv7\" (UniqueName: \"kubernetes.io/projected/d214d9bc-6a76-4922-857e-58a678e173cf-kube-api-access-p2bv7\") pod \"d214d9bc-6a76-4922-857e-58a678e173cf\" (UID: \"d214d9bc-6a76-4922-857e-58a678e173cf\") "
Jul 30 00:56:18.268920 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:18.268896    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d214d9bc-6a76-4922-857e-58a678e173cf-kube-api-access-p2bv7" (OuterVolumeSpecName: "kube-api-access-p2bv7") pod "d214d9bc-6a76-4922-857e-58a678e173cf" (UID: "d214d9bc-6a76-4922-857e-58a678e173cf"). InnerVolumeSpecName "kube-api-access-p2bv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:56:18.368103 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:18.368047    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2bv7\" (UniqueName: \"kubernetes.io/projected/d214d9bc-6a76-4922-857e-58a678e173cf-kube-api-access-p2bv7\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:56:19.001553 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.001523    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"]
Jul 30 00:56:19.001961 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.001949    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d214d9bc-6a76-4922-857e-58a678e173cf" containerName="test-curl-7575-139944139197440"
Jul 30 00:56:19.002004 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.001963    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="d214d9bc-6a76-4922-857e-58a678e173cf" containerName="test-curl-7575-139944139197440"
Jul 30 00:56:19.002050 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.002043    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="d214d9bc-6a76-4922-857e-58a678e173cf" containerName="test-curl-7575-139944139197440"
Jul 30 00:56:19.005134 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.005112    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:19.007307 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.007285    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-7fa598-openshift-default-dockercfg-4q6cb\""
Jul 30 00:56:19.016785 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.016763    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"]
Jul 30 00:56:19.067298 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.067272    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7575-139944139197440"
Jul 30 00:56:19.067298 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.067293    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55c628180274538f2c403851ca9040bf294e1ccd40583d3c1fd0cbf731d74ba7"
Jul 30 00:56:19.072456 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.072431    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aba9b1cf-b88a-47ba-bd53-646be165bbda-workload-socket\") pod \"e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") " pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:19.072590 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.072478    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aba9b1cf-b88a-47ba-bd53-646be165bbda-istio-token\") pod \"e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") " pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:19.072590 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.072513    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aba9b1cf-b88a-47ba-bd53-646be165bbda-istio-data\") pod \"e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") " pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:19.072590 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.072582    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aba9b1cf-b88a-47ba-bd53-646be165bbda-istio-envoy\") pod \"e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") " pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:19.072764 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.072627    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aba9b1cf-b88a-47ba-bd53-646be165bbda-istiod-ca-cert\") pod \"e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") " pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:19.072764 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.072673    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtxz5\" (UniqueName: \"kubernetes.io/projected/aba9b1cf-b88a-47ba-bd53-646be165bbda-kube-api-access-rtxz5\") pod \"e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") " pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:19.072764 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.072702    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aba9b1cf-b88a-47ba-bd53-646be165bbda-credential-socket\") pod \"e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") " pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:19.072764 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.072733    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aba9b1cf-b88a-47ba-bd53-646be165bbda-istio-podinfo\") pod \"e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") " pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:19.072973 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.072782    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aba9b1cf-b88a-47ba-bd53-646be165bbda-workload-certs\") pod \"e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") " pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:19.077099 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:56:19.077074    2527 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7575-139944139197440\" is forbidden: User \"system:node:ip-10-0-137-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-198.ec2.internal' and this object" podUID="d214d9bc-6a76-4922-857e-58a678e173cf" pod="opendatahub/test-curl-7575-139944139197440"
Jul 30 00:56:19.174249 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.174218    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aba9b1cf-b88a-47ba-bd53-646be165bbda-credential-socket\") pod \"e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") " pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:19.174394 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.174272    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aba9b1cf-b88a-47ba-bd53-646be165bbda-istio-podinfo\") pod \"e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") " pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:19.174394 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.174300    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aba9b1cf-b88a-47ba-bd53-646be165bbda-workload-certs\") pod \"e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") " pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:19.174394 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.174327    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aba9b1cf-b88a-47ba-bd53-646be165bbda-workload-socket\") pod \"e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") " pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:19.174548 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.174481    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aba9b1cf-b88a-47ba-bd53-646be165bbda-istio-token\") pod \"e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") " pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:19.174548 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.174538    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aba9b1cf-b88a-47ba-bd53-646be165bbda-istio-data\") pod \"e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") " pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:19.174659 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.174572    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aba9b1cf-b88a-47ba-bd53-646be165bbda-istio-envoy\") pod \"e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") " pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:19.174659 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.174623    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aba9b1cf-b88a-47ba-bd53-646be165bbda-credential-socket\") pod \"e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") " pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:19.174659 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.174631    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aba9b1cf-b88a-47ba-bd53-646be165bbda-istiod-ca-cert\") pod \"e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") " pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:19.174808 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.174656    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aba9b1cf-b88a-47ba-bd53-646be165bbda-workload-socket\") pod \"e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") " pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:19.174808 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.174694    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtxz5\" (UniqueName: \"kubernetes.io/projected/aba9b1cf-b88a-47ba-bd53-646be165bbda-kube-api-access-rtxz5\") pod \"e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") " pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:19.174808 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.174721    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aba9b1cf-b88a-47ba-bd53-646be165bbda-workload-certs\") pod \"e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") " pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:19.174998 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.174980    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aba9b1cf-b88a-47ba-bd53-646be165bbda-istio-data\") pod \"e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") " pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:19.175327 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.175306    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aba9b1cf-b88a-47ba-bd53-646be165bbda-istiod-ca-cert\") pod \"e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") " pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:19.176760 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.176742    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aba9b1cf-b88a-47ba-bd53-646be165bbda-istio-envoy\") pod \"e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") " pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:19.176936 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.176916    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aba9b1cf-b88a-47ba-bd53-646be165bbda-istio-podinfo\") pod \"e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") " pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:19.182399 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.182371    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aba9b1cf-b88a-47ba-bd53-646be165bbda-istio-token\") pod \"e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") " pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:19.182477 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.182402    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtxz5\" (UniqueName: \"kubernetes.io/projected/aba9b1cf-b88a-47ba-bd53-646be165bbda-kube-api-access-rtxz5\") pod \"e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") " pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:19.321508 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.321449    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:19.466608 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.466575    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"]
Jul 30 00:56:19.469807 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:56:19.469780    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaba9b1cf_b88a_47ba_bd53_646be165bbda.slice/crio-88c143cad1255dbfbb93d2d922a4e8d833582323c521136c7e32336a70f2d6a3 WatchSource:0}: Error finding container 88c143cad1255dbfbb93d2d922a4e8d833582323c521136c7e32336a70f2d6a3: Status 404 returned error can't find the container with id 88c143cad1255dbfbb93d2d922a4e8d833582323c521136c7e32336a70f2d6a3
Jul 30 00:56:19.472533 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.472501    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:56:19.472625 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.472570    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:56:19.472625 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:19.472596    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:56:20.075451 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:20.075413    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg" event={"ID":"aba9b1cf-b88a-47ba-bd53-646be165bbda","Type":"ContainerStarted","Data":"787aaa7a6f964a73ab1a8330865d0472de5251f4137d6233f7e6656280f6e00d"}
Jul 30 00:56:20.075606 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:20.075472    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg" event={"ID":"aba9b1cf-b88a-47ba-bd53-646be165bbda","Type":"ContainerStarted","Data":"88c143cad1255dbfbb93d2d922a4e8d833582323c521136c7e32336a70f2d6a3"}
Jul 30 00:56:20.093622 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:56:20.093583    2527 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7575-139944139197440\" is forbidden: User \"system:node:ip-10-0-137-198.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-198.ec2.internal' and this object" podUID="d214d9bc-6a76-4922-857e-58a678e173cf" pod="opendatahub/test-curl-7575-139944139197440"
Jul 30 00:56:20.095117 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:20.095074    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg" podStartSLOduration=2.095059593 podStartE2EDuration="2.095059593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:56:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:56:20.091427682 +0000 UTC m=+3254.393876031" watchObservedRunningTime="2026-07-30 00:56:20.095059593 +0000 UTC m=+3254.397507937"
Jul 30 00:56:20.217936 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:20.217905    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d214d9bc-6a76-4922-857e-58a678e173cf" path="/var/lib/kubelet/pods/d214d9bc-6a76-4922-857e-58a678e173cf/volumes"
Jul 30 00:56:20.321673 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:20.321649    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:20.326562 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:20.326506    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:21.081995 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:21.081969    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:21.082972 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:21.082955    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:29.999546 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:29.999511    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:56:37.123312 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:37.123279    2527 patch_prober.go:28] interesting pod/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 30 00:56:37.123831 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:37.123343    2527 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg" podUID="aba9b1cf-b88a-47ba-bd53-646be165bbda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 30 00:56:38.212799 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:38.212761    2527 generic.go:356] "Generic (PLEG): container finished" podID="aba9b1cf-b88a-47ba-bd53-646be165bbda" containerID="787aaa7a6f964a73ab1a8330865d0472de5251f4137d6233f7e6656280f6e00d" exitCode=0
Jul 30 00:56:38.217785 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:38.217755    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg" event={"ID":"aba9b1cf-b88a-47ba-bd53-646be165bbda","Type":"ContainerDied","Data":"787aaa7a6f964a73ab1a8330865d0472de5251f4137d6233f7e6656280f6e00d"}
Jul 30 00:56:38.218181 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:38.218141    2527 scope.go:117] "RemoveContainer" containerID="787aaa7a6f964a73ab1a8330865d0472de5251f4137d6233f7e6656280f6e00d"
Jul 30 00:56:38.219373 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:38.219339    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:56:38.219461 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:38.219444    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:56:38.219502 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:38.219491    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:56:39.220646 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:39.220614    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg" event={"ID":"aba9b1cf-b88a-47ba-bd53-646be165bbda","Type":"ContainerStarted","Data":"1168af7efc180c4a4c10be7c03f59ddebfe62819be5b7719d2be75e11f4875ec"}
Jul 30 00:56:39.321732 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:39.321700    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:39.321936 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:39.321882    2527 patch_prober.go:28] interesting pod/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Jul 30 00:56:39.322013 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:39.321938    2527 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg" podUID="aba9b1cf-b88a-47ba-bd53-646be165bbda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Jul 30 00:56:40.321693 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:40.321657    2527 patch_prober.go:28] interesting pod/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Jul 30 00:56:40.322084 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:40.321713    2527 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg" podUID="aba9b1cf-b88a-47ba-bd53-646be165bbda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Jul 30 00:56:41.322755 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:41.322721    2527 patch_prober.go:28] interesting pod/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Jul 30 00:56:41.323143 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:41.322773    2527 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg" podUID="aba9b1cf-b88a-47ba-bd53-646be165bbda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Jul 30 00:56:42.321957 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:42.321920    2527 patch_prober.go:28] interesting pod/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Jul 30 00:56:42.322140 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:42.321971    2527 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg" podUID="aba9b1cf-b88a-47ba-bd53-646be165bbda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Jul 30 00:56:43.325065 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:43.325032    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:43.325530 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:43.325460    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:43.326072 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:43.326052    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 00:56:50.042473 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:50.042435    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-prbfh"]
Jul 30 00:56:50.046082 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:50.046064    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-prbfh"
Jul 30 00:56:50.052934 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:50.052912    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-prbfh"]
Jul 30 00:56:50.162306 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:50.162276    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls7bv\" (UniqueName: \"kubernetes.io/projected/a080aee1-2a4e-47b9-bcaf-aa41f359e4cb-kube-api-access-ls7bv\") pod \"kuadrant-operator-catalog-prbfh\" (UID: \"a080aee1-2a4e-47b9-bcaf-aa41f359e4cb\") " pod="kuadrant-system/kuadrant-operator-catalog-prbfh"
Jul 30 00:56:50.263538 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:50.263507    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls7bv\" (UniqueName: \"kubernetes.io/projected/a080aee1-2a4e-47b9-bcaf-aa41f359e4cb-kube-api-access-ls7bv\") pod \"kuadrant-operator-catalog-prbfh\" (UID: \"a080aee1-2a4e-47b9-bcaf-aa41f359e4cb\") " pod="kuadrant-system/kuadrant-operator-catalog-prbfh"
Jul 30 00:56:50.271312 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:50.271285    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls7bv\" (UniqueName: \"kubernetes.io/projected/a080aee1-2a4e-47b9-bcaf-aa41f359e4cb-kube-api-access-ls7bv\") pod \"kuadrant-operator-catalog-prbfh\" (UID: \"a080aee1-2a4e-47b9-bcaf-aa41f359e4cb\") " pod="kuadrant-system/kuadrant-operator-catalog-prbfh"
Jul 30 00:56:50.356975 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:50.356915    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-prbfh"
Jul 30 00:56:50.499353 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:50.499321    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-prbfh"]
Jul 30 00:56:50.500512 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:56:50.500488    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda080aee1_2a4e_47b9_bcaf_aa41f359e4cb.slice/crio-fb46b9fc981febdf7ed77bd32afb0b7237c6da2fc691f4d22ab49cfee1ffe675 WatchSource:0}: Error finding container fb46b9fc981febdf7ed77bd32afb0b7237c6da2fc691f4d22ab49cfee1ffe675: Status 404 returned error can't find the container with id fb46b9fc981febdf7ed77bd32afb0b7237c6da2fc691f4d22ab49cfee1ffe675
Jul 30 00:56:51.293324 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:51.293295    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-prbfh" event={"ID":"a080aee1-2a4e-47b9-bcaf-aa41f359e4cb","Type":"ContainerStarted","Data":"7d55c393f61c43c4ff6fc7e0b43333dcfa98c3e74a59fe4d7a48c1728dbada4a"}
Jul 30 00:56:51.293703 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:51.293344    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-prbfh" event={"ID":"a080aee1-2a4e-47b9-bcaf-aa41f359e4cb","Type":"ContainerStarted","Data":"fb46b9fc981febdf7ed77bd32afb0b7237c6da2fc691f4d22ab49cfee1ffe675"}
Jul 30 00:56:51.307644 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:51.307604    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-prbfh" podStartSLOduration=0.914029204 podStartE2EDuration="1.307585939s" totalImagesPullingTime="393.556735ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:56:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:56:51.306444523 +0000 UTC m=+3285.608892880" watchObservedRunningTime="2026-07-30 00:56:51.307585939 +0000 UTC m=+3285.610034285"
Jul 30 00:56:53.040609 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.040576    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"]
Jul 30 00:56:53.045201 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.045175    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:53.047590 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.047569    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-edaa93-openshift-default-dockercfg-tm944\""
Jul 30 00:56:53.058807 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.058784    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"]
Jul 30 00:56:53.086991 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.086967    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0eb883b-4891-4abe-926d-e824685c076a-istio-token\") pod \"e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") " pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:53.087106 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.086997    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0eb883b-4891-4abe-926d-e824685c076a-istiod-ca-cert\") pod \"e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") " pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:53.087106 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.087036    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0eb883b-4891-4abe-926d-e824685c076a-workload-certs\") pod \"e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") " pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:53.087218 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.087116    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0eb883b-4891-4abe-926d-e824685c076a-istio-data\") pod \"e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") " pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:53.087279 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.087234    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0eb883b-4891-4abe-926d-e824685c076a-istio-envoy\") pod \"e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") " pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:53.087333 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.087277    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzkjv\" (UniqueName: \"kubernetes.io/projected/c0eb883b-4891-4abe-926d-e824685c076a-kube-api-access-rzkjv\") pod \"e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") " pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:53.087405 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.087384    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0eb883b-4891-4abe-926d-e824685c076a-workload-socket\") pod \"e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") " pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:53.087453 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.087438    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0eb883b-4891-4abe-926d-e824685c076a-istio-podinfo\") pod \"e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") " pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:53.087495 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.087479    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0eb883b-4891-4abe-926d-e824685c076a-credential-socket\") pod \"e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") " pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:53.188703 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.188667    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0eb883b-4891-4abe-926d-e824685c076a-istio-envoy\") pod \"e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") " pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:53.188886 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.188711    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzkjv\" (UniqueName: \"kubernetes.io/projected/c0eb883b-4891-4abe-926d-e824685c076a-kube-api-access-rzkjv\") pod \"e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") " pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:53.188886 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.188782    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0eb883b-4891-4abe-926d-e824685c076a-workload-socket\") pod \"e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") " pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:53.188886 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.188821    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0eb883b-4891-4abe-926d-e824685c076a-istio-podinfo\") pod \"e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") " pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:53.189058 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.188995    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0eb883b-4891-4abe-926d-e824685c076a-credential-socket\") pod \"e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") " pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:53.189058 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.189046    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0eb883b-4891-4abe-926d-e824685c076a-istio-token\") pod \"e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") " pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:53.189245 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.189081    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0eb883b-4891-4abe-926d-e824685c076a-istiod-ca-cert\") pod \"e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") " pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:53.189245 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.189113    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0eb883b-4891-4abe-926d-e824685c076a-workload-certs\") pod \"e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") " pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:53.189245 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.189150    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0eb883b-4891-4abe-926d-e824685c076a-istio-data\") pod \"e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") " pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:53.189395 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.189269    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0eb883b-4891-4abe-926d-e824685c076a-workload-socket\") pod \"e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") " pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:53.189434 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.189392    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0eb883b-4891-4abe-926d-e824685c076a-credential-socket\") pod \"e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") " pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:53.189536 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.189469    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0eb883b-4891-4abe-926d-e824685c076a-workload-certs\") pod \"e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") " pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:53.189590 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.189534    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0eb883b-4891-4abe-926d-e824685c076a-istio-data\") pod \"e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") " pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:53.189814 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.189796    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0eb883b-4891-4abe-926d-e824685c076a-istiod-ca-cert\") pod \"e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") " pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:53.191288 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.191269    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0eb883b-4891-4abe-926d-e824685c076a-istio-envoy\") pod \"e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") " pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:53.191393 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.191311    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0eb883b-4891-4abe-926d-e824685c076a-istio-podinfo\") pod \"e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") " pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:53.196679 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.196659    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0eb883b-4891-4abe-926d-e824685c076a-istio-token\") pod \"e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") " pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:53.196787 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.196723    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzkjv\" (UniqueName: \"kubernetes.io/projected/c0eb883b-4891-4abe-926d-e824685c076a-kube-api-access-rzkjv\") pod \"e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") " pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:53.358294 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.358216    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:53.498577 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.498553    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"]
Jul 30 00:56:53.500269 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:56:53.500241    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0eb883b_4891_4abe_926d_e824685c076a.slice/crio-e611414cb87e1ef009f02b987c9ea230a6b03ea3acef9cca55d26637a4500daf WatchSource:0}: Error finding container e611414cb87e1ef009f02b987c9ea230a6b03ea3acef9cca55d26637a4500daf: Status 404 returned error can't find the container with id e611414cb87e1ef009f02b987c9ea230a6b03ea3acef9cca55d26637a4500daf
Jul 30 00:56:53.502436 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.502401    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:56:53.502533 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.502464    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:56:53.502533 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:53.502495    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:56:54.313019 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:54.312980    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4" event={"ID":"c0eb883b-4891-4abe-926d-e824685c076a","Type":"ContainerStarted","Data":"45a9c6f2ac4934bc0a8a93da81fda47d39db52e19d81ea668c7b935829662c3c"}
Jul 30 00:56:54.313424 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:54.313039    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4" event={"ID":"c0eb883b-4891-4abe-926d-e824685c076a","Type":"ContainerStarted","Data":"e611414cb87e1ef009f02b987c9ea230a6b03ea3acef9cca55d26637a4500daf"}
Jul 30 00:56:54.335956 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:54.335908    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4" podStartSLOduration=1.335894242 podStartE2EDuration="1.335894242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:56:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:56:54.333098219 +0000 UTC m=+3288.635546574" watchObservedRunningTime="2026-07-30 00:56:54.335894242 +0000 UTC m=+3288.638342598"
Jul 30 00:56:54.358516 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:54.358488    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:54.363559 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:54.363538    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:55.319746 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:55.319713    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:56:55.320753 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:56:55.320729    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:57:00.357289 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:00.357259    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-prbfh"
Jul 30 00:57:00.357801 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:00.357316    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-prbfh"
Jul 30 00:57:00.379132 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:00.379110    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-prbfh"
Jul 30 00:57:01.378891 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:01.378863    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-prbfh"
Jul 30 00:57:01.408426 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:01.408383    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-prbfh"]
Jul 30 00:57:03.368782 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:03.368734    2527 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-prbfh" podUID="a080aee1-2a4e-47b9-bcaf-aa41f359e4cb" containerName="registry-server" containerID="cri-o://7d55c393f61c43c4ff6fc7e0b43333dcfa98c3e74a59fe4d7a48c1728dbada4a" gracePeriod=2
Jul 30 00:57:03.627840 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:03.627783    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-prbfh"
Jul 30 00:57:03.781136 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:03.781110    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ls7bv\" (UniqueName: \"kubernetes.io/projected/a080aee1-2a4e-47b9-bcaf-aa41f359e4cb-kube-api-access-ls7bv\") pod \"a080aee1-2a4e-47b9-bcaf-aa41f359e4cb\" (UID: \"a080aee1-2a4e-47b9-bcaf-aa41f359e4cb\") "
Jul 30 00:57:03.783289 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:03.783264    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a080aee1-2a4e-47b9-bcaf-aa41f359e4cb-kube-api-access-ls7bv" (OuterVolumeSpecName: "kube-api-access-ls7bv") pod "a080aee1-2a4e-47b9-bcaf-aa41f359e4cb" (UID: "a080aee1-2a4e-47b9-bcaf-aa41f359e4cb"). InnerVolumeSpecName "kube-api-access-ls7bv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:57:03.882108 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:03.882049    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ls7bv\" (UniqueName: \"kubernetes.io/projected/a080aee1-2a4e-47b9-bcaf-aa41f359e4cb-kube-api-access-ls7bv\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:57:04.376472 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:04.376440    2527 generic.go:356] "Generic (PLEG): container finished" podID="a080aee1-2a4e-47b9-bcaf-aa41f359e4cb" containerID="7d55c393f61c43c4ff6fc7e0b43333dcfa98c3e74a59fe4d7a48c1728dbada4a" exitCode=0
Jul 30 00:57:04.376896 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:04.376476    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-prbfh"
Jul 30 00:57:04.376896 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:04.376519    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-prbfh" event={"ID":"a080aee1-2a4e-47b9-bcaf-aa41f359e4cb","Type":"ContainerDied","Data":"7d55c393f61c43c4ff6fc7e0b43333dcfa98c3e74a59fe4d7a48c1728dbada4a"}
Jul 30 00:57:04.376896 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:04.376569    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-prbfh" event={"ID":"a080aee1-2a4e-47b9-bcaf-aa41f359e4cb","Type":"ContainerDied","Data":"fb46b9fc981febdf7ed77bd32afb0b7237c6da2fc691f4d22ab49cfee1ffe675"}
Jul 30 00:57:04.376896 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:04.376590    2527 scope.go:117] "RemoveContainer" containerID="7d55c393f61c43c4ff6fc7e0b43333dcfa98c3e74a59fe4d7a48c1728dbada4a"
Jul 30 00:57:04.386718 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:04.386701    2527 scope.go:117] "RemoveContainer" containerID="7d55c393f61c43c4ff6fc7e0b43333dcfa98c3e74a59fe4d7a48c1728dbada4a"
Jul 30 00:57:04.386983 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:57:04.386962    2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d55c393f61c43c4ff6fc7e0b43333dcfa98c3e74a59fe4d7a48c1728dbada4a\": container with ID starting with 7d55c393f61c43c4ff6fc7e0b43333dcfa98c3e74a59fe4d7a48c1728dbada4a not found: ID does not exist" containerID="7d55c393f61c43c4ff6fc7e0b43333dcfa98c3e74a59fe4d7a48c1728dbada4a"
Jul 30 00:57:04.387037 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:04.386992    2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d55c393f61c43c4ff6fc7e0b43333dcfa98c3e74a59fe4d7a48c1728dbada4a"} err="failed to get container status \"7d55c393f61c43c4ff6fc7e0b43333dcfa98c3e74a59fe4d7a48c1728dbada4a\": rpc error: code = NotFound desc = could not find container \"7d55c393f61c43c4ff6fc7e0b43333dcfa98c3e74a59fe4d7a48c1728dbada4a\": container with ID starting with 7d55c393f61c43c4ff6fc7e0b43333dcfa98c3e74a59fe4d7a48c1728dbada4a not found: ID does not exist"
Jul 30 00:57:04.392150 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:04.392102    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-prbfh"]
Jul 30 00:57:04.403111 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:04.395762    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-prbfh"]
Jul 30 00:57:05.499360 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:05.499328    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:57:06.217108 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:06.217072    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a080aee1-2a4e-47b9-bcaf-aa41f359e4cb" path="/var/lib/kubelet/pods/a080aee1-2a4e-47b9-bcaf-aa41f359e4cb/volumes"
Jul 30 00:57:10.069504 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:10.069469    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9cggv_c6b01a1f-c41e-4781-8c25-66b152e0d0e8/ovn-acl-logging/0.log"
Jul 30 00:57:10.094850 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:10.094823    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9cggv_c6b01a1f-c41e-4781-8c25-66b152e0d0e8/ovn-acl-logging/0.log"
Jul 30 00:57:11.361333 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:11.361294    2527 patch_prober.go:28] interesting pod/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 30 00:57:11.361743 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:11.361347    2527 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4" podUID="c0eb883b-4891-4abe-926d-e824685c076a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 30 00:57:13.437570 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:13.437486    2527 generic.go:356] "Generic (PLEG): container finished" podID="c0eb883b-4891-4abe-926d-e824685c076a" containerID="45a9c6f2ac4934bc0a8a93da81fda47d39db52e19d81ea668c7b935829662c3c" exitCode=0
Jul 30 00:57:13.438055 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:13.437564    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4" event={"ID":"c0eb883b-4891-4abe-926d-e824685c076a","Type":"ContainerDied","Data":"45a9c6f2ac4934bc0a8a93da81fda47d39db52e19d81ea668c7b935829662c3c"}
Jul 30 00:57:13.438055 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:13.438029    2527 scope.go:117] "RemoveContainer" containerID="45a9c6f2ac4934bc0a8a93da81fda47d39db52e19d81ea668c7b935829662c3c"
Jul 30 00:57:13.439108 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:13.439081    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:57:13.439182 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:13.439151    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:57:13.439226 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:13.439207    2527 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 30 00:57:14.448390 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:14.448346    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4" event={"ID":"c0eb883b-4891-4abe-926d-e824685c076a","Type":"ContainerStarted","Data":"860f8815983f18695638b1276a791e1b8a51d7b33a89d6fa4f7ad826cb461847"}
Jul 30 00:57:15.359138 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:15.359105    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:57:15.359650 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:15.359614    2527 patch_prober.go:28] interesting pod/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Jul 30 00:57:15.359784 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:15.359716    2527 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4" podUID="c0eb883b-4891-4abe-926d-e824685c076a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Jul 30 00:57:16.365584 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:16.365547    2527 patch_prober.go:28] interesting pod/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Jul 30 00:57:16.366146 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:16.366116    2527 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4" podUID="c0eb883b-4891-4abe-926d-e824685c076a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Jul 30 00:57:17.359035 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:17.358994    2527 patch_prober.go:28] interesting pod/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Jul 30 00:57:17.359262 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:17.359057    2527 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4" podUID="c0eb883b-4891-4abe-926d-e824685c076a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Jul 30 00:57:18.362452 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:18.362423    2527 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:57:18.362909 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:18.362878    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:57:18.363472 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:18.363453    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 00:57:51.695852 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:57:51.695776    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:58:18.194466 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:18.194426    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:58:33.263107 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:33.263072    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4"]
Jul 30 00:58:33.263807 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:33.263786    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a080aee1-2a4e-47b9-bcaf-aa41f359e4cb" containerName="registry-server"
Jul 30 00:58:33.263859 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:33.263813    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="a080aee1-2a4e-47b9-bcaf-aa41f359e4cb" containerName="registry-server"
Jul 30 00:58:33.263981 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:33.263967    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="a080aee1-2a4e-47b9-bcaf-aa41f359e4cb" containerName="registry-server"
Jul 30 00:58:33.267890 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:33.267866    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4"
Jul 30 00:58:33.270410 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:33.270388    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-859003-serving-cert\""
Jul 30 00:58:33.277275 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:33.276920    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4"]
Jul 30 00:58:33.384937 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:33.384902    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wl89\" (UniqueName: \"kubernetes.io/projected/220cdf9d-c9f8-415a-822b-731927f40993-kube-api-access-8wl89\") pod \"maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4\" (UID: \"220cdf9d-c9f8-415a-822b-731927f40993\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4"
Jul 30 00:58:33.385153 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:33.385004    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/220cdf9d-c9f8-415a-822b-731927f40993-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4\" (UID: \"220cdf9d-c9f8-415a-822b-731927f40993\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4"
Jul 30 00:58:33.385153 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:33.385095    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/220cdf9d-c9f8-415a-822b-731927f40993-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4\" (UID: \"220cdf9d-c9f8-415a-822b-731927f40993\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4"
Jul 30 00:58:33.486274 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:33.486243    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/220cdf9d-c9f8-415a-822b-731927f40993-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4\" (UID: \"220cdf9d-c9f8-415a-822b-731927f40993\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4"
Jul 30 00:58:33.486417 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:33.486302    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/220cdf9d-c9f8-415a-822b-731927f40993-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4\" (UID: \"220cdf9d-c9f8-415a-822b-731927f40993\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4"
Jul 30 00:58:33.486417 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:33.486347    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wl89\" (UniqueName: \"kubernetes.io/projected/220cdf9d-c9f8-415a-822b-731927f40993-kube-api-access-8wl89\") pod \"maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4\" (UID: \"220cdf9d-c9f8-415a-822b-731927f40993\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4"
Jul 30 00:58:33.486491 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:58:33.486461    2527 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-859003-serving-cert: secret "maas-api-e2e-ipp-cleanup-859003-serving-cert" not found
Jul 30 00:58:33.486552 ip-10-0-137-198 kubenswrapper[2527]: E0730 00:58:33.486540    2527 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/220cdf9d-c9f8-415a-822b-731927f40993-maas-api-tls podName:220cdf9d-c9f8-415a-822b-731927f40993 nodeName:}" failed. No retries permitted until 2026-07-30 00:58:33.986515742 +0000 UTC m=+3388.288964085 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/220cdf9d-c9f8-415a-822b-731927f40993-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4" (UID: "220cdf9d-c9f8-415a-822b-731927f40993") : secret "maas-api-e2e-ipp-cleanup-859003-serving-cert" not found
Jul 30 00:58:33.486943 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:33.486926    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/220cdf9d-c9f8-415a-822b-731927f40993-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4\" (UID: \"220cdf9d-c9f8-415a-822b-731927f40993\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4"
Jul 30 00:58:33.496917 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:33.496885    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wl89\" (UniqueName: \"kubernetes.io/projected/220cdf9d-c9f8-415a-822b-731927f40993-kube-api-access-8wl89\") pod \"maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4\" (UID: \"220cdf9d-c9f8-415a-822b-731927f40993\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4"
Jul 30 00:58:33.990409 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:33.990376    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/220cdf9d-c9f8-415a-822b-731927f40993-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4\" (UID: \"220cdf9d-c9f8-415a-822b-731927f40993\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4"
Jul 30 00:58:33.992896 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:33.992870    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/220cdf9d-c9f8-415a-822b-731927f40993-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4\" (UID: \"220cdf9d-c9f8-415a-822b-731927f40993\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4"
Jul 30 00:58:34.181521 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:34.181493    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4"
Jul 30 00:58:34.334757 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:34.334733    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4"]
Jul 30 00:58:34.335737 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:58:34.335713    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod220cdf9d_c9f8_415a_822b_731927f40993.slice/crio-808099edeba03964ca025002bfdeb4597fc0a9312b8b42ad24cbf08c73fe09bc WatchSource:0}: Error finding container 808099edeba03964ca025002bfdeb4597fc0a9312b8b42ad24cbf08c73fe09bc: Status 404 returned error can't find the container with id 808099edeba03964ca025002bfdeb4597fc0a9312b8b42ad24cbf08c73fe09bc
Jul 30 00:58:34.954916 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:34.954878    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4" event={"ID":"220cdf9d-c9f8-415a-822b-731927f40993","Type":"ContainerStarted","Data":"53134fba005b7496ac80b5bc420d13b07d164b50ea576970eff118c96bc8b0bf"}
Jul 30 00:58:34.955146 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:34.954944    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4" event={"ID":"220cdf9d-c9f8-415a-822b-731927f40993","Type":"ContainerStarted","Data":"808099edeba03964ca025002bfdeb4597fc0a9312b8b42ad24cbf08c73fe09bc"}
Jul 30 00:58:34.955146 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:34.954973    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4"
Jul 30 00:58:34.972689 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:34.972634    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4" podStartSLOduration=1.570548509 podStartE2EDuration="1.972618905s" totalImagesPullingTime="402.070396ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 00:58:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 00:58:34.969679959 +0000 UTC m=+3389.272128305" watchObservedRunningTime="2026-07-30 00:58:34.972618905 +0000 UTC m=+3389.275067242"
Jul 30 00:58:37.200248 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:37.200219    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:58:40.967845 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:40.967816    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4"
Jul 30 00:58:57.803337 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:57.803265    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-859003-bfcfl"]
Jul 30 00:58:57.807038 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:57.807020    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-859003-bfcfl"
Jul 30 00:58:57.809368 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:57.809350    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t42rq\""
Jul 30 00:58:57.813914 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:57.813777    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-859003-bfcfl"]
Jul 30 00:58:57.895057 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:57.895029    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb5f1375-52d5-427a-aea6-e74dc288ab54-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-859003-bfcfl\" (UID: \"bb5f1375-52d5-427a-aea6-e74dc288ab54\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-859003-bfcfl"
Jul 30 00:58:57.996300 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:57.996267    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb5f1375-52d5-427a-aea6-e74dc288ab54-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-859003-bfcfl\" (UID: \"bb5f1375-52d5-427a-aea6-e74dc288ab54\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-859003-bfcfl"
Jul 30 00:58:57.996837 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:57.996821    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb5f1375-52d5-427a-aea6-e74dc288ab54-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-859003-bfcfl\" (UID: \"bb5f1375-52d5-427a-aea6-e74dc288ab54\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-859003-bfcfl"
Jul 30 00:58:58.120687 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:58.120625    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-859003-bfcfl"
Jul 30 00:58:58.262302 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:58.262259    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-859003-bfcfl"]
Jul 30 00:58:58.265267 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:58:58.265239    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb5f1375_52d5_427a_aea6_e74dc288ab54.slice/crio-27a3db39b222a765bdd59f14689032392ce568c403e5bfb9e9dfb872446aa1d7 WatchSource:0}: Error finding container 27a3db39b222a765bdd59f14689032392ce568c403e5bfb9e9dfb872446aa1d7: Status 404 returned error can't find the container with id 27a3db39b222a765bdd59f14689032392ce568c403e5bfb9e9dfb872446aa1d7
Jul 30 00:58:59.103121 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:59.103089    2527 generic.go:356] "Generic (PLEG): container finished" podID="bb5f1375-52d5-427a-aea6-e74dc288ab54" containerID="59f2f52935ead94f41a0bd7a21c209527d1d68be30e71304f1f0166b562633b3" exitCode=0
Jul 30 00:58:59.103497 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:59.103183    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-859003-bfcfl" event={"ID":"bb5f1375-52d5-427a-aea6-e74dc288ab54","Type":"ContainerDied","Data":"59f2f52935ead94f41a0bd7a21c209527d1d68be30e71304f1f0166b562633b3"}
Jul 30 00:58:59.103497 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:58:59.103222    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-859003-bfcfl" event={"ID":"bb5f1375-52d5-427a-aea6-e74dc288ab54","Type":"ContainerStarted","Data":"27a3db39b222a765bdd59f14689032392ce568c403e5bfb9e9dfb872446aa1d7"}
Jul 30 00:59:00.254779 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:00.254754    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-859003-bfcfl"
Jul 30 00:59:00.415513 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:00.415429    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb5f1375-52d5-427a-aea6-e74dc288ab54-maas-api-service-ca\") pod \"bb5f1375-52d5-427a-aea6-e74dc288ab54\" (UID: \"bb5f1375-52d5-427a-aea6-e74dc288ab54\") "
Jul 30 00:59:00.415843 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:00.415818    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb5f1375-52d5-427a-aea6-e74dc288ab54-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bb5f1375-52d5-427a-aea6-e74dc288ab54" (UID: "bb5f1375-52d5-427a-aea6-e74dc288ab54"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:59:00.516650 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:00.516626    2527 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb5f1375-52d5-427a-aea6-e74dc288ab54-maas-api-service-ca\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:59:01.117457 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:01.117428    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-859003-bfcfl"
Jul 30 00:59:01.117631 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:01.117454    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-859003-bfcfl" event={"ID":"bb5f1375-52d5-427a-aea6-e74dc288ab54","Type":"ContainerDied","Data":"27a3db39b222a765bdd59f14689032392ce568c403e5bfb9e9dfb872446aa1d7"}
Jul 30 00:59:01.117631 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:01.117502    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27a3db39b222a765bdd59f14689032392ce568c403e5bfb9e9dfb872446aa1d7"
Jul 30 00:59:03.869042 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:03.869009    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4"]
Jul 30 00:59:03.870337 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:03.870258    2527 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4" podUID="220cdf9d-c9f8-415a-822b-731927f40993" containerName="maas-api" containerID="cri-o://53134fba005b7496ac80b5bc420d13b07d164b50ea576970eff118c96bc8b0bf" gracePeriod=30
Jul 30 00:59:04.059453 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:04.058923    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-859003-bfcfl"]
Jul 30 00:59:04.063456 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:04.063425    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-859003-bfcfl"]
Jul 30 00:59:04.138355 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:04.138323    2527 generic.go:356] "Generic (PLEG): container finished" podID="220cdf9d-c9f8-415a-822b-731927f40993" containerID="53134fba005b7496ac80b5bc420d13b07d164b50ea576970eff118c96bc8b0bf" exitCode=0
Jul 30 00:59:04.138475 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:04.138363    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4" event={"ID":"220cdf9d-c9f8-415a-822b-731927f40993","Type":"ContainerDied","Data":"53134fba005b7496ac80b5bc420d13b07d164b50ea576970eff118c96bc8b0bf"}
Jul 30 00:59:04.138475 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:04.138428    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4" event={"ID":"220cdf9d-c9f8-415a-822b-731927f40993","Type":"ContainerDied","Data":"808099edeba03964ca025002bfdeb4597fc0a9312b8b42ad24cbf08c73fe09bc"}
Jul 30 00:59:04.138475 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:04.138447    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="808099edeba03964ca025002bfdeb4597fc0a9312b8b42ad24cbf08c73fe09bc"
Jul 30 00:59:04.143779 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:04.143756    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4"
Jul 30 00:59:04.215998 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:04.215970    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb5f1375-52d5-427a-aea6-e74dc288ab54" path="/var/lib/kubelet/pods/bb5f1375-52d5-427a-aea6-e74dc288ab54/volumes"
Jul 30 00:59:04.250096 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:04.250070    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/220cdf9d-c9f8-415a-822b-731927f40993-openshift-service-ca\") pod \"220cdf9d-c9f8-415a-822b-731927f40993\" (UID: \"220cdf9d-c9f8-415a-822b-731927f40993\") "
Jul 30 00:59:04.250294 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:04.250139    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wl89\" (UniqueName: \"kubernetes.io/projected/220cdf9d-c9f8-415a-822b-731927f40993-kube-api-access-8wl89\") pod \"220cdf9d-c9f8-415a-822b-731927f40993\" (UID: \"220cdf9d-c9f8-415a-822b-731927f40993\") "
Jul 30 00:59:04.250294 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:04.250185    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/220cdf9d-c9f8-415a-822b-731927f40993-maas-api-tls\") pod \"220cdf9d-c9f8-415a-822b-731927f40993\" (UID: \"220cdf9d-c9f8-415a-822b-731927f40993\") "
Jul 30 00:59:04.250454 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:04.250422    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/220cdf9d-c9f8-415a-822b-731927f40993-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "220cdf9d-c9f8-415a-822b-731927f40993" (UID: "220cdf9d-c9f8-415a-822b-731927f40993"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:59:04.250600 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:04.250561    2527 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/220cdf9d-c9f8-415a-822b-731927f40993-openshift-service-ca\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:59:04.252376 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:04.252350    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/220cdf9d-c9f8-415a-822b-731927f40993-kube-api-access-8wl89" (OuterVolumeSpecName: "kube-api-access-8wl89") pod "220cdf9d-c9f8-415a-822b-731927f40993" (UID: "220cdf9d-c9f8-415a-822b-731927f40993"). InnerVolumeSpecName "kube-api-access-8wl89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 00:59:04.252577 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:04.252556    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/220cdf9d-c9f8-415a-822b-731927f40993-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "220cdf9d-c9f8-415a-822b-731927f40993" (UID: "220cdf9d-c9f8-415a-822b-731927f40993"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 00:59:04.351191 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:04.351146    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wl89\" (UniqueName: \"kubernetes.io/projected/220cdf9d-c9f8-415a-822b-731927f40993-kube-api-access-8wl89\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:59:04.351191 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:04.351190    2527 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/220cdf9d-c9f8-415a-822b-731927f40993-maas-api-tls\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:59:05.144526 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:05.144493    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4"
Jul 30 00:59:05.166067 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:05.166038    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4"]
Jul 30 00:59:05.169489 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:05.169463    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-859003-77ffff96c-p8ks4"]
Jul 30 00:59:06.217259 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:06.217229    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="220cdf9d-c9f8-415a-822b-731927f40993" path="/var/lib/kubelet/pods/220cdf9d-c9f8-415a-822b-731927f40993/volumes"
Jul 30 00:59:08.698069 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:08.698039    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:59:13.814002 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:13.813967    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7fa598-m5lj5"]
Jul 30 00:59:13.814464 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:13.814448    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb5f1375-52d5-427a-aea6-e74dc288ab54" containerName="revoke-keys"
Jul 30 00:59:13.814511 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:13.814465    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb5f1375-52d5-427a-aea6-e74dc288ab54" containerName="revoke-keys"
Jul 30 00:59:13.814511 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:13.814495    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="220cdf9d-c9f8-415a-822b-731927f40993" containerName="maas-api"
Jul 30 00:59:13.814511 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:13.814501    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="220cdf9d-c9f8-415a-822b-731927f40993" containerName="maas-api"
Jul 30 00:59:13.814608 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:13.814563    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="220cdf9d-c9f8-415a-822b-731927f40993" containerName="maas-api"
Jul 30 00:59:13.814608 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:13.814576    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb5f1375-52d5-427a-aea6-e74dc288ab54" containerName="revoke-keys"
Jul 30 00:59:13.819122 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:13.819106    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7fa598-m5lj5"
Jul 30 00:59:13.821681 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:13.821656    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t42rq\""
Jul 30 00:59:13.824879 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:13.824852    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7fa598-m5lj5"]
Jul 30 00:59:13.830693 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:13.830672    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c12df14-844d-4c24-892f-bd6c0038e519-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-7fa598-m5lj5\" (UID: \"1c12df14-844d-4c24-892f-bd6c0038e519\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7fa598-m5lj5"
Jul 30 00:59:13.931563 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:13.931538    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c12df14-844d-4c24-892f-bd6c0038e519-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-7fa598-m5lj5\" (UID: \"1c12df14-844d-4c24-892f-bd6c0038e519\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7fa598-m5lj5"
Jul 30 00:59:13.932074 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:13.932054    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c12df14-844d-4c24-892f-bd6c0038e519-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-7fa598-m5lj5\" (UID: \"1c12df14-844d-4c24-892f-bd6c0038e519\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7fa598-m5lj5"
Jul 30 00:59:14.133251 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:14.133189    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7fa598-m5lj5"
Jul 30 00:59:14.273578 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:14.273552    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7fa598-m5lj5"]
Jul 30 00:59:14.275140 ip-10-0-137-198 kubenswrapper[2527]: W0730 00:59:14.275101    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c12df14_844d_4c24_892f_bd6c0038e519.slice/crio-539657d22834a0818732b751558f442be61b13a27739b5b534194d6e52dd684d WatchSource:0}: Error finding container 539657d22834a0818732b751558f442be61b13a27739b5b534194d6e52dd684d: Status 404 returned error can't find the container with id 539657d22834a0818732b751558f442be61b13a27739b5b534194d6e52dd684d
Jul 30 00:59:15.213625 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:15.213593    2527 generic.go:356] "Generic (PLEG): container finished" podID="1c12df14-844d-4c24-892f-bd6c0038e519" containerID="5bbfe7de2b446180cbd5daf0d050daa70cca1fbbfcb8d9d0194ec16202ec253f" exitCode=0
Jul 30 00:59:15.213997 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:15.213631    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7fa598-m5lj5" event={"ID":"1c12df14-844d-4c24-892f-bd6c0038e519","Type":"ContainerDied","Data":"5bbfe7de2b446180cbd5daf0d050daa70cca1fbbfcb8d9d0194ec16202ec253f"}
Jul 30 00:59:15.213997 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:15.213664    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7fa598-m5lj5" event={"ID":"1c12df14-844d-4c24-892f-bd6c0038e519","Type":"ContainerStarted","Data":"539657d22834a0818732b751558f442be61b13a27739b5b534194d6e52dd684d"}
Jul 30 00:59:16.365095 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:16.365073    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7fa598-m5lj5"
Jul 30 00:59:16.453750 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:16.453721    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c12df14-844d-4c24-892f-bd6c0038e519-maas-api-service-ca\") pod \"1c12df14-844d-4c24-892f-bd6c0038e519\" (UID: \"1c12df14-844d-4c24-892f-bd6c0038e519\") "
Jul 30 00:59:16.454086 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:16.454063    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c12df14-844d-4c24-892f-bd6c0038e519-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1c12df14-844d-4c24-892f-bd6c0038e519" (UID: "1c12df14-844d-4c24-892f-bd6c0038e519"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 00:59:16.554649 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:16.554572    2527 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c12df14-844d-4c24-892f-bd6c0038e519-maas-api-service-ca\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 00:59:17.226092 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:17.226060    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7fa598-m5lj5"
Jul 30 00:59:17.226273 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:17.226111    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7fa598-m5lj5" event={"ID":"1c12df14-844d-4c24-892f-bd6c0038e519","Type":"ContainerDied","Data":"539657d22834a0818732b751558f442be61b13a27739b5b534194d6e52dd684d"}
Jul 30 00:59:17.226273 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:17.226150    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="539657d22834a0818732b751558f442be61b13a27739b5b534194d6e52dd684d"
Jul 30 00:59:28.203104 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:28.203060    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 00:59:29.419954 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:29.419921    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7fa598-m5lj5"]
Jul 30 00:59:29.422461 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:29.422438    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7fa598-m5lj5"]
Jul 30 00:59:30.218128 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:30.218096    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c12df14-844d-4c24-892f-bd6c0038e519" path="/var/lib/kubelet/pods/1c12df14-844d-4c24-892f-bd6c0038e519/volumes"
Jul 30 00:59:39.000696 ip-10-0-137-198 kubenswrapper[2527]: I0730 00:59:39.000664    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 01:00:00.203695 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:00.203663    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-0b2dae-29756220-wksq8"]
Jul 30 01:00:00.204129 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:00.204107    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c12df14-844d-4c24-892f-bd6c0038e519" containerName="revoke-keys"
Jul 30 01:00:00.204129 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:00.204119    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c12df14-844d-4c24-892f-bd6c0038e519" containerName="revoke-keys"
Jul 30 01:00:00.204249 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:00.204238    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c12df14-844d-4c24-892f-bd6c0038e519" containerName="revoke-keys"
Jul 30 01:00:00.207457 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:00.207440    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-0b2dae-29756220-wksq8"
Jul 30 01:00:00.212151 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:00.212129    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t42rq\""
Jul 30 01:00:00.218640 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:00.218616    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29756220-5dc8l"]
Jul 30 01:00:00.219053 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:00.219031    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-0b2dae-29756220-wksq8"
Jul 30 01:00:00.222344 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:00.222325    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-edaa93-29756220-mxjvq"]
Jul 30 01:00:00.222422 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:00.222410    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756220-5dc8l"
Jul 30 01:00:00.226257 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:00.226228    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-edaa93-29756220-mxjvq"
Jul 30 01:00:00.253687 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:00.253656    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-0b2dae-29756220-wksq8"]
Jul 30 01:00:00.253915 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:00.253901    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29756220-5dc8l"]
Jul 30 01:00:00.281206 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:00.281153    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756220-5dc8l"
Jul 30 01:00:00.290966 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:00.290928    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-edaa93-29756220-mxjvq"
Jul 30 01:00:00.301318 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:00.301146    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-edaa93-29756220-mxjvq"]
Jul 30 01:00:00.424469 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:00.424440    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-0b2dae-29756220-wksq8"]
Jul 30 01:00:00.427722 ip-10-0-137-198 kubenswrapper[2527]: W0730 01:00:00.427699    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3273672b_b2d1_4d8b_bac1_68170177800a.slice/crio-355e345e11b2d3c896a998dede23266640afb38e460a231f0e176d0f7ed78040 WatchSource:0}: Error finding container 355e345e11b2d3c896a998dede23266640afb38e460a231f0e176d0f7ed78040: Status 404 returned error can't find the container with id 355e345e11b2d3c896a998dede23266640afb38e460a231f0e176d0f7ed78040
Jul 30 01:00:00.474872 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:00.474843    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29756220-5dc8l"]
Jul 30 01:00:00.476501 ip-10-0-137-198 kubenswrapper[2527]: W0730 01:00:00.476474    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod930c3ca1_6673_4b57_8b50_de16a350e4ad.slice/crio-458be76eadcb97679538d314827e19d7d3c557f76800aae6eb699ea5292ac662 WatchSource:0}: Error finding container 458be76eadcb97679538d314827e19d7d3c557f76800aae6eb699ea5292ac662: Status 404 returned error can't find the container with id 458be76eadcb97679538d314827e19d7d3c557f76800aae6eb699ea5292ac662
Jul 30 01:00:00.502076 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:00.502049    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756220-5dc8l" event={"ID":"930c3ca1-6673-4b57-8b50-de16a350e4ad","Type":"ContainerStarted","Data":"458be76eadcb97679538d314827e19d7d3c557f76800aae6eb699ea5292ac662"}
Jul 30 01:00:00.502622 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:00.502599    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-edaa93-29756220-mxjvq"]
Jul 30 01:00:00.503243 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:00.503223    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-0b2dae-29756220-wksq8" event={"ID":"3273672b-b2d1-4d8b-bac1-68170177800a","Type":"ContainerStarted","Data":"355e345e11b2d3c896a998dede23266640afb38e460a231f0e176d0f7ed78040"}
Jul 30 01:00:00.508288 ip-10-0-137-198 kubenswrapper[2527]: W0730 01:00:00.508265    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod321bef04_a6e3_4fe8_934a_eed4f229a904.slice/crio-f7b1108ef97cd6af668458b0a8449ff0a75be9b10ea3f2df293fbadf4f2b5609 WatchSource:0}: Error finding container f7b1108ef97cd6af668458b0a8449ff0a75be9b10ea3f2df293fbadf4f2b5609: Status 404 returned error can't find the container with id f7b1108ef97cd6af668458b0a8449ff0a75be9b10ea3f2df293fbadf4f2b5609
Jul 30 01:00:01.513360 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:01.513334    2527 generic.go:356] "Generic (PLEG): container finished" podID="930c3ca1-6673-4b57-8b50-de16a350e4ad" containerID="2205c1efdeb086ab3c3d60dbd5faa19a9743f9474a68a91f3285c443f31b4f6d" exitCode=0
Jul 30 01:00:01.513719 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:01.513419    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756220-5dc8l" event={"ID":"930c3ca1-6673-4b57-8b50-de16a350e4ad","Type":"ContainerDied","Data":"2205c1efdeb086ab3c3d60dbd5faa19a9743f9474a68a91f3285c443f31b4f6d"}
Jul 30 01:00:01.514860 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:01.514839    2527 generic.go:356] "Generic (PLEG): container finished" podID="3273672b-b2d1-4d8b-bac1-68170177800a" containerID="510ff8ce2340365f352c02480317d4c017968c4c8985a1a43de31aa50813ab00" exitCode=0
Jul 30 01:00:01.514945 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:01.514923    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-0b2dae-29756220-wksq8" event={"ID":"3273672b-b2d1-4d8b-bac1-68170177800a","Type":"ContainerDied","Data":"510ff8ce2340365f352c02480317d4c017968c4c8985a1a43de31aa50813ab00"}
Jul 30 01:00:01.516248 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:01.516231    2527 generic.go:356] "Generic (PLEG): container finished" podID="321bef04-a6e3-4fe8-934a-eed4f229a904" containerID="a27d1d2a45cf5a9a328ec828efadba150ab0aa14adb62b621c1128ce985d01d0" exitCode=0
Jul 30 01:00:01.516328 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:01.516262    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-edaa93-29756220-mxjvq" event={"ID":"321bef04-a6e3-4fe8-934a-eed4f229a904","Type":"ContainerDied","Data":"a27d1d2a45cf5a9a328ec828efadba150ab0aa14adb62b621c1128ce985d01d0"}
Jul 30 01:00:01.516328 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:01.516305    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-edaa93-29756220-mxjvq" event={"ID":"321bef04-a6e3-4fe8-934a-eed4f229a904","Type":"ContainerStarted","Data":"f7b1108ef97cd6af668458b0a8449ff0a75be9b10ea3f2df293fbadf4f2b5609"}
Jul 30 01:00:02.691061 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:02.691032    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756220-5dc8l"
Jul 30 01:00:02.738824 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:02.738796    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-edaa93-29756220-mxjvq"
Jul 30 01:00:02.743025 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:02.743005    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-0b2dae-29756220-wksq8"
Jul 30 01:00:03.530412 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:03.530383    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-edaa93-29756220-mxjvq"
Jul 30 01:00:03.530580 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:03.530423    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-edaa93-29756220-mxjvq" event={"ID":"321bef04-a6e3-4fe8-934a-eed4f229a904","Type":"ContainerDied","Data":"f7b1108ef97cd6af668458b0a8449ff0a75be9b10ea3f2df293fbadf4f2b5609"}
Jul 30 01:00:03.530580 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:03.530469    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f7b1108ef97cd6af668458b0a8449ff0a75be9b10ea3f2df293fbadf4f2b5609"
Jul 30 01:00:03.531781 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:03.531764    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756220-5dc8l"
Jul 30 01:00:03.531781 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:03.531768    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29756220-5dc8l" event={"ID":"930c3ca1-6673-4b57-8b50-de16a350e4ad","Type":"ContainerDied","Data":"458be76eadcb97679538d314827e19d7d3c557f76800aae6eb699ea5292ac662"}
Jul 30 01:00:03.531940 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:03.531797    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="458be76eadcb97679538d314827e19d7d3c557f76800aae6eb699ea5292ac662"
Jul 30 01:00:03.533216 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:03.533197    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-0b2dae-29756220-wksq8" event={"ID":"3273672b-b2d1-4d8b-bac1-68170177800a","Type":"ContainerDied","Data":"355e345e11b2d3c896a998dede23266640afb38e460a231f0e176d0f7ed78040"}
Jul 30 01:00:03.533314 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:03.533223    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-0b2dae-29756220-wksq8"
Jul 30 01:00:03.533314 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:03.533235    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="355e345e11b2d3c896a998dede23266640afb38e460a231f0e176d0f7ed78040"
Jul 30 01:00:31.968051 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:31.967965    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"]
Jul 30 01:00:31.968606 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:31.968276    2527 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg" podUID="aba9b1cf-b88a-47ba-bd53-646be165bbda" containerName="istio-proxy" containerID="cri-o://1168af7efc180c4a4c10be7c03f59ddebfe62819be5b7719d2be75e11f4875ec" gracePeriod=30
Jul 30 01:00:32.373655 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:32.373581    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-edaa93-ks2l8"]
Jul 30 01:00:32.374016 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:32.374003    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="930c3ca1-6673-4b57-8b50-de16a350e4ad" containerName="cleanup"
Jul 30 01:00:32.374059 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:32.374019    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="930c3ca1-6673-4b57-8b50-de16a350e4ad" containerName="cleanup"
Jul 30 01:00:32.374059 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:32.374031    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="321bef04-a6e3-4fe8-934a-eed4f229a904" containerName="cleanup"
Jul 30 01:00:32.374059 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:32.374036    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="321bef04-a6e3-4fe8-934a-eed4f229a904" containerName="cleanup"
Jul 30 01:00:32.374059 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:32.374051    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3273672b-b2d1-4d8b-bac1-68170177800a" containerName="cleanup"
Jul 30 01:00:32.374059 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:32.374057    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="3273672b-b2d1-4d8b-bac1-68170177800a" containerName="cleanup"
Jul 30 01:00:32.374231 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:32.374130    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="321bef04-a6e3-4fe8-934a-eed4f229a904" containerName="cleanup"
Jul 30 01:00:32.374231 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:32.374141    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="930c3ca1-6673-4b57-8b50-de16a350e4ad" containerName="cleanup"
Jul 30 01:00:32.374231 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:32.374149    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="3273672b-b2d1-4d8b-bac1-68170177800a" containerName="cleanup"
Jul 30 01:00:32.378549 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:32.378525    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-edaa93-ks2l8"
Jul 30 01:00:32.380902 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:32.380878    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t42rq\""
Jul 30 01:00:32.383603 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:32.383579    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-edaa93-ks2l8"]
Jul 30 01:00:32.527323 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:32.527284    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19636a62-6efc-4844-978e-bf55328fd115-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-edaa93-ks2l8\" (UID: \"19636a62-6efc-4844-978e-bf55328fd115\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-edaa93-ks2l8"
Jul 30 01:00:32.628575 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:32.628492    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19636a62-6efc-4844-978e-bf55328fd115-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-edaa93-ks2l8\" (UID: \"19636a62-6efc-4844-978e-bf55328fd115\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-edaa93-ks2l8"
Jul 30 01:00:32.629118 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:32.629094    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19636a62-6efc-4844-978e-bf55328fd115-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-edaa93-ks2l8\" (UID: \"19636a62-6efc-4844-978e-bf55328fd115\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-edaa93-ks2l8"
Jul 30 01:00:32.692218 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:32.692192    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-edaa93-ks2l8"
Jul 30 01:00:32.839912 ip-10-0-137-198 kubenswrapper[2527]: W0730 01:00:32.839886    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19636a62_6efc_4844_978e_bf55328fd115.slice/crio-c1d6941402118ddae29f28065a4c351ce33643a1a76970da2dab1145efd6c3b6 WatchSource:0}: Error finding container c1d6941402118ddae29f28065a4c351ce33643a1a76970da2dab1145efd6c3b6: Status 404 returned error can't find the container with id c1d6941402118ddae29f28065a4c351ce33643a1a76970da2dab1145efd6c3b6
Jul 30 01:00:32.840066 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:32.840039    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-edaa93-ks2l8"]
Jul 30 01:00:33.736236 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:33.736207    2527 generic.go:356] "Generic (PLEG): container finished" podID="19636a62-6efc-4844-978e-bf55328fd115" containerID="6edbf39462d4aac4755dfbae4b4f56b5896660a697d3508804d13290d63ca0c5" exitCode=0
Jul 30 01:00:33.736580 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:33.736291    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-edaa93-ks2l8" event={"ID":"19636a62-6efc-4844-978e-bf55328fd115","Type":"ContainerDied","Data":"6edbf39462d4aac4755dfbae4b4f56b5896660a697d3508804d13290d63ca0c5"}
Jul 30 01:00:33.736580 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:33.736344    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-edaa93-ks2l8" event={"ID":"19636a62-6efc-4844-978e-bf55328fd115","Type":"ContainerStarted","Data":"c1d6941402118ddae29f28065a4c351ce33643a1a76970da2dab1145efd6c3b6"}
Jul 30 01:00:34.881215 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:34.881190    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-edaa93-ks2l8"
Jul 30 01:00:34.955906 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:34.955877    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19636a62-6efc-4844-978e-bf55328fd115-maas-api-service-ca\") pod \"19636a62-6efc-4844-978e-bf55328fd115\" (UID: \"19636a62-6efc-4844-978e-bf55328fd115\") "
Jul 30 01:00:34.956203 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:34.956157    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19636a62-6efc-4844-978e-bf55328fd115-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "19636a62-6efc-4844-978e-bf55328fd115" (UID: "19636a62-6efc-4844-978e-bf55328fd115"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 01:00:35.057244 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:35.057192    2527 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19636a62-6efc-4844-978e-bf55328fd115-maas-api-service-ca\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 01:00:35.750302 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:35.750271    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-edaa93-ks2l8"
Jul 30 01:00:35.750497 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:35.750319    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-edaa93-ks2l8" event={"ID":"19636a62-6efc-4844-978e-bf55328fd115","Type":"ContainerDied","Data":"c1d6941402118ddae29f28065a4c351ce33643a1a76970da2dab1145efd6c3b6"}
Jul 30 01:00:35.750497 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:35.750391    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c1d6941402118ddae29f28065a4c351ce33643a1a76970da2dab1145efd6c3b6"
Jul 30 01:00:37.055203 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.055146    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-edaa93-29756220-mxjvq"]
Jul 30 01:00:37.059642 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.059610    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-edaa93-29756220-mxjvq"]
Jul 30 01:00:37.233592 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.233539    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 01:00:37.250307 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.250261    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-edaa93-ks2l8"]
Jul 30 01:00:37.256423 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.256005    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-edaa93-ks2l8"]
Jul 30 01:00:37.375055 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.375024    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtxz5\" (UniqueName: \"kubernetes.io/projected/aba9b1cf-b88a-47ba-bd53-646be165bbda-kube-api-access-rtxz5\") pod \"aba9b1cf-b88a-47ba-bd53-646be165bbda\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") "
Jul 30 01:00:37.375055 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.375060    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aba9b1cf-b88a-47ba-bd53-646be165bbda-istiod-ca-cert\") pod \"aba9b1cf-b88a-47ba-bd53-646be165bbda\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") "
Jul 30 01:00:37.375388 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.375104    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aba9b1cf-b88a-47ba-bd53-646be165bbda-workload-socket\") pod \"aba9b1cf-b88a-47ba-bd53-646be165bbda\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") "
Jul 30 01:00:37.375388 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.375144    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aba9b1cf-b88a-47ba-bd53-646be165bbda-credential-socket\") pod \"aba9b1cf-b88a-47ba-bd53-646be165bbda\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") "
Jul 30 01:00:37.375388 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.375193    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aba9b1cf-b88a-47ba-bd53-646be165bbda-istio-data\") pod \"aba9b1cf-b88a-47ba-bd53-646be165bbda\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") "
Jul 30 01:00:37.375388 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.375226    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aba9b1cf-b88a-47ba-bd53-646be165bbda-istio-podinfo\") pod \"aba9b1cf-b88a-47ba-bd53-646be165bbda\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") "
Jul 30 01:00:37.375388 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.375259    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aba9b1cf-b88a-47ba-bd53-646be165bbda-istio-token\") pod \"aba9b1cf-b88a-47ba-bd53-646be165bbda\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") "
Jul 30 01:00:37.375388 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.375288    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aba9b1cf-b88a-47ba-bd53-646be165bbda-istio-envoy\") pod \"aba9b1cf-b88a-47ba-bd53-646be165bbda\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") "
Jul 30 01:00:37.375388 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.375315    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aba9b1cf-b88a-47ba-bd53-646be165bbda-workload-certs\") pod \"aba9b1cf-b88a-47ba-bd53-646be165bbda\" (UID: \"aba9b1cf-b88a-47ba-bd53-646be165bbda\") "
Jul 30 01:00:37.375762 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.375429    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aba9b1cf-b88a-47ba-bd53-646be165bbda-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aba9b1cf-b88a-47ba-bd53-646be165bbda" (UID: "aba9b1cf-b88a-47ba-bd53-646be165bbda"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 01:00:37.375762 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.375479    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aba9b1cf-b88a-47ba-bd53-646be165bbda-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aba9b1cf-b88a-47ba-bd53-646be165bbda" (UID: "aba9b1cf-b88a-47ba-bd53-646be165bbda"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 01:00:37.375762 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.375534    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aba9b1cf-b88a-47ba-bd53-646be165bbda-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aba9b1cf-b88a-47ba-bd53-646be165bbda" (UID: "aba9b1cf-b88a-47ba-bd53-646be165bbda"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 01:00:37.375762 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.375638    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aba9b1cf-b88a-47ba-bd53-646be165bbda-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aba9b1cf-b88a-47ba-bd53-646be165bbda" (UID: "aba9b1cf-b88a-47ba-bd53-646be165bbda"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 01:00:37.376149 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.375874    2527 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aba9b1cf-b88a-47ba-bd53-646be165bbda-workload-certs\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 01:00:37.376149 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.375896    2527 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aba9b1cf-b88a-47ba-bd53-646be165bbda-istiod-ca-cert\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 01:00:37.376149 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.375912    2527 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aba9b1cf-b88a-47ba-bd53-646be165bbda-workload-socket\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 01:00:37.376149 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.375926    2527 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aba9b1cf-b88a-47ba-bd53-646be165bbda-credential-socket\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 01:00:37.376149 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.376075    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aba9b1cf-b88a-47ba-bd53-646be165bbda-istio-data" (OuterVolumeSpecName: "istio-data") pod "aba9b1cf-b88a-47ba-bd53-646be165bbda" (UID: "aba9b1cf-b88a-47ba-bd53-646be165bbda"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 01:00:37.377606 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.377582    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aba9b1cf-b88a-47ba-bd53-646be165bbda-kube-api-access-rtxz5" (OuterVolumeSpecName: "kube-api-access-rtxz5") pod "aba9b1cf-b88a-47ba-bd53-646be165bbda" (UID: "aba9b1cf-b88a-47ba-bd53-646be165bbda"). InnerVolumeSpecName "kube-api-access-rtxz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 01:00:37.377703 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.377653    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aba9b1cf-b88a-47ba-bd53-646be165bbda-istio-token" (OuterVolumeSpecName: "istio-token") pod "aba9b1cf-b88a-47ba-bd53-646be165bbda" (UID: "aba9b1cf-b88a-47ba-bd53-646be165bbda"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 01:00:37.377992 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.377973    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aba9b1cf-b88a-47ba-bd53-646be165bbda-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aba9b1cf-b88a-47ba-bd53-646be165bbda" (UID: "aba9b1cf-b88a-47ba-bd53-646be165bbda"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 01:00:37.378074 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.378058    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aba9b1cf-b88a-47ba-bd53-646be165bbda-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aba9b1cf-b88a-47ba-bd53-646be165bbda" (UID: "aba9b1cf-b88a-47ba-bd53-646be165bbda"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 01:00:37.477291 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.477264    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtxz5\" (UniqueName: \"kubernetes.io/projected/aba9b1cf-b88a-47ba-bd53-646be165bbda-kube-api-access-rtxz5\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 01:00:37.477291 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.477290    2527 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aba9b1cf-b88a-47ba-bd53-646be165bbda-istio-data\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 01:00:37.477470 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.477298    2527 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aba9b1cf-b88a-47ba-bd53-646be165bbda-istio-podinfo\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 01:00:37.477470 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.477306    2527 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aba9b1cf-b88a-47ba-bd53-646be165bbda-istio-token\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 01:00:37.477470 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.477314    2527 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aba9b1cf-b88a-47ba-bd53-646be165bbda-istio-envoy\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 01:00:37.764811 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.764776    2527 generic.go:356] "Generic (PLEG): container finished" podID="aba9b1cf-b88a-47ba-bd53-646be165bbda" containerID="1168af7efc180c4a4c10be7c03f59ddebfe62819be5b7719d2be75e11f4875ec" exitCode=0
Jul 30 01:00:37.764998 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.764828    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"
Jul 30 01:00:37.764998 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.764869    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg" event={"ID":"aba9b1cf-b88a-47ba-bd53-646be165bbda","Type":"ContainerDied","Data":"1168af7efc180c4a4c10be7c03f59ddebfe62819be5b7719d2be75e11f4875ec"}
Jul 30 01:00:37.764998 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.764937    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg" event={"ID":"aba9b1cf-b88a-47ba-bd53-646be165bbda","Type":"ContainerDied","Data":"88c143cad1255dbfbb93d2d922a4e8d833582323c521136c7e32336a70f2d6a3"}
Jul 30 01:00:37.764998 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.764967    2527 scope.go:117] "RemoveContainer" containerID="1168af7efc180c4a4c10be7c03f59ddebfe62819be5b7719d2be75e11f4875ec"
Jul 30 01:00:37.775846 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.775829    2527 scope.go:117] "RemoveContainer" containerID="787aaa7a6f964a73ab1a8330865d0472de5251f4137d6233f7e6656280f6e00d"
Jul 30 01:00:37.785132 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.785105    2527 scope.go:117] "RemoveContainer" containerID="1168af7efc180c4a4c10be7c03f59ddebfe62819be5b7719d2be75e11f4875ec"
Jul 30 01:00:37.785398 ip-10-0-137-198 kubenswrapper[2527]: E0730 01:00:37.785376    2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1168af7efc180c4a4c10be7c03f59ddebfe62819be5b7719d2be75e11f4875ec\": container with ID starting with 1168af7efc180c4a4c10be7c03f59ddebfe62819be5b7719d2be75e11f4875ec not found: ID does not exist" containerID="1168af7efc180c4a4c10be7c03f59ddebfe62819be5b7719d2be75e11f4875ec"
Jul 30 01:00:37.785450 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.785411    2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1168af7efc180c4a4c10be7c03f59ddebfe62819be5b7719d2be75e11f4875ec"} err="failed to get container status \"1168af7efc180c4a4c10be7c03f59ddebfe62819be5b7719d2be75e11f4875ec\": rpc error: code = NotFound desc = could not find container \"1168af7efc180c4a4c10be7c03f59ddebfe62819be5b7719d2be75e11f4875ec\": container with ID starting with 1168af7efc180c4a4c10be7c03f59ddebfe62819be5b7719d2be75e11f4875ec not found: ID does not exist"
Jul 30 01:00:37.785450 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.785434    2527 scope.go:117] "RemoveContainer" containerID="787aaa7a6f964a73ab1a8330865d0472de5251f4137d6233f7e6656280f6e00d"
Jul 30 01:00:37.785724 ip-10-0-137-198 kubenswrapper[2527]: E0730 01:00:37.785703    2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"787aaa7a6f964a73ab1a8330865d0472de5251f4137d6233f7e6656280f6e00d\": container with ID starting with 787aaa7a6f964a73ab1a8330865d0472de5251f4137d6233f7e6656280f6e00d not found: ID does not exist" containerID="787aaa7a6f964a73ab1a8330865d0472de5251f4137d6233f7e6656280f6e00d"
Jul 30 01:00:37.785806 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.785727    2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"787aaa7a6f964a73ab1a8330865d0472de5251f4137d6233f7e6656280f6e00d"} err="failed to get container status \"787aaa7a6f964a73ab1a8330865d0472de5251f4137d6233f7e6656280f6e00d\": rpc error: code = NotFound desc = could not find container \"787aaa7a6f964a73ab1a8330865d0472de5251f4137d6233f7e6656280f6e00d\": container with ID starting with 787aaa7a6f964a73ab1a8330865d0472de5251f4137d6233f7e6656280f6e00d not found: ID does not exist"
Jul 30 01:00:37.789120 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.789099    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"]
Jul 30 01:00:37.793093 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:37.793076    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-7fa598-openshift-default-6d897d5658-fcftg"]
Jul 30 01:00:38.217107 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:38.217065    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19636a62-6efc-4844-978e-bf55328fd115" path="/var/lib/kubelet/pods/19636a62-6efc-4844-978e-bf55328fd115/volumes"
Jul 30 01:00:38.217603 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:38.217541    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="321bef04-a6e3-4fe8-934a-eed4f229a904" path="/var/lib/kubelet/pods/321bef04-a6e3-4fe8-934a-eed4f229a904/volumes"
Jul 30 01:00:38.217966 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:38.217946    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aba9b1cf-b88a-47ba-bd53-646be165bbda" path="/var/lib/kubelet/pods/aba9b1cf-b88a-47ba-bd53-646be165bbda/volumes"
Jul 30 01:00:40.699944 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:40.699910    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 01:00:43.730098 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:43.730056    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"]
Jul 30 01:00:43.730493 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:43.730346    2527 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4" podUID="c0eb883b-4891-4abe-926d-e824685c076a" containerName="istio-proxy" containerID="cri-o://860f8815983f18695638b1276a791e1b8a51d7b33a89d6fa4f7ad826cb461847" gracePeriod=30
Jul 30 01:00:44.107027 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:44.106948    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4ef902-m8rdr"]
Jul 30 01:00:44.107428 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:44.107415    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aba9b1cf-b88a-47ba-bd53-646be165bbda" containerName="istio-proxy"
Jul 30 01:00:44.107503 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:44.107430    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="aba9b1cf-b88a-47ba-bd53-646be165bbda" containerName="istio-proxy"
Jul 30 01:00:44.107503 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:44.107450    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aba9b1cf-b88a-47ba-bd53-646be165bbda" containerName="istio-proxy"
Jul 30 01:00:44.107503 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:44.107455    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="aba9b1cf-b88a-47ba-bd53-646be165bbda" containerName="istio-proxy"
Jul 30 01:00:44.107503 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:44.107472    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19636a62-6efc-4844-978e-bf55328fd115" containerName="revoke-keys"
Jul 30 01:00:44.107503 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:44.107478    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="19636a62-6efc-4844-978e-bf55328fd115" containerName="revoke-keys"
Jul 30 01:00:44.107660 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:44.107548    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="aba9b1cf-b88a-47ba-bd53-646be165bbda" containerName="istio-proxy"
Jul 30 01:00:44.107660 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:44.107566    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="aba9b1cf-b88a-47ba-bd53-646be165bbda" containerName="istio-proxy"
Jul 30 01:00:44.107660 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:44.107572    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="19636a62-6efc-4844-978e-bf55328fd115" containerName="revoke-keys"
Jul 30 01:00:44.112385 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:44.112365    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4ef902-m8rdr"
Jul 30 01:00:44.115139 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:44.115108    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t42rq\""
Jul 30 01:00:44.118645 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:44.118620    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4ef902-m8rdr"]
Jul 30 01:00:44.236299 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:44.236262    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbd312d0-cc1c-40dd-b9f8-b76d39e13bf4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-4ef902-m8rdr\" (UID: \"fbd312d0-cc1c-40dd-b9f8-b76d39e13bf4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4ef902-m8rdr"
Jul 30 01:00:44.336949 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:44.336919    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbd312d0-cc1c-40dd-b9f8-b76d39e13bf4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-4ef902-m8rdr\" (UID: \"fbd312d0-cc1c-40dd-b9f8-b76d39e13bf4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4ef902-m8rdr"
Jul 30 01:00:44.337600 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:44.337582    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbd312d0-cc1c-40dd-b9f8-b76d39e13bf4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-4ef902-m8rdr\" (UID: \"fbd312d0-cc1c-40dd-b9f8-b76d39e13bf4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4ef902-m8rdr"
Jul 30 01:00:44.425750 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:44.425681    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4ef902-m8rdr"
Jul 30 01:00:44.564096 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:44.564065    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4ef902-m8rdr"]
Jul 30 01:00:44.565357 ip-10-0-137-198 kubenswrapper[2527]: W0730 01:00:44.565315    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbd312d0_cc1c_40dd_b9f8_b76d39e13bf4.slice/crio-27725df20b5044367b2fc53d35f962a2ae3712cd16952bdb9216f0fbf1c6478b WatchSource:0}: Error finding container 27725df20b5044367b2fc53d35f962a2ae3712cd16952bdb9216f0fbf1c6478b: Status 404 returned error can't find the container with id 27725df20b5044367b2fc53d35f962a2ae3712cd16952bdb9216f0fbf1c6478b
Jul 30 01:00:44.816660 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:44.816632    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4ef902-m8rdr" event={"ID":"fbd312d0-cc1c-40dd-b9f8-b76d39e13bf4","Type":"ContainerStarted","Data":"27725df20b5044367b2fc53d35f962a2ae3712cd16952bdb9216f0fbf1c6478b"}
Jul 30 01:00:45.824110 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:45.824074    2527 generic.go:356] "Generic (PLEG): container finished" podID="fbd312d0-cc1c-40dd-b9f8-b76d39e13bf4" containerID="590f6e48c66c76d41268c4041ee7beb70cbb2be226a7c2d540f50aa5e9458427" exitCode=0
Jul 30 01:00:45.824536 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:45.824181    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4ef902-m8rdr" event={"ID":"fbd312d0-cc1c-40dd-b9f8-b76d39e13bf4","Type":"ContainerDied","Data":"590f6e48c66c76d41268c4041ee7beb70cbb2be226a7c2d540f50aa5e9458427"}
Jul 30 01:00:46.977071 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:46.977048    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4ef902-m8rdr"
Jul 30 01:00:47.164490 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:47.164410    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbd312d0-cc1c-40dd-b9f8-b76d39e13bf4-maas-api-service-ca\") pod \"fbd312d0-cc1c-40dd-b9f8-b76d39e13bf4\" (UID: \"fbd312d0-cc1c-40dd-b9f8-b76d39e13bf4\") "
Jul 30 01:00:47.164726 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:47.164706    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbd312d0-cc1c-40dd-b9f8-b76d39e13bf4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fbd312d0-cc1c-40dd-b9f8-b76d39e13bf4" (UID: "fbd312d0-cc1c-40dd-b9f8-b76d39e13bf4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 01:00:47.265748 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:47.265718    2527 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbd312d0-cc1c-40dd-b9f8-b76d39e13bf4-maas-api-service-ca\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 01:00:47.838486 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:47.838460    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4ef902-m8rdr"
Jul 30 01:00:47.838916 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:47.838485    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4ef902-m8rdr" event={"ID":"fbd312d0-cc1c-40dd-b9f8-b76d39e13bf4","Type":"ContainerDied","Data":"27725df20b5044367b2fc53d35f962a2ae3712cd16952bdb9216f0fbf1c6478b"}
Jul 30 01:00:47.838916 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:47.838531    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27725df20b5044367b2fc53d35f962a2ae3712cd16952bdb9216f0fbf1c6478b"
Jul 30 01:00:48.365134 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:48.365096    2527 patch_prober.go:28] interesting pod/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 01:00:48.365533 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:48.365156    2527 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4" podUID="c0eb883b-4891-4abe-926d-e824685c076a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 01:00:49.001108 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.001052    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 01:00:49.180561 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.180530    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzkjv\" (UniqueName: \"kubernetes.io/projected/c0eb883b-4891-4abe-926d-e824685c076a-kube-api-access-rzkjv\") pod \"c0eb883b-4891-4abe-926d-e824685c076a\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") "
Jul 30 01:00:49.180748 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.180581    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0eb883b-4891-4abe-926d-e824685c076a-istiod-ca-cert\") pod \"c0eb883b-4891-4abe-926d-e824685c076a\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") "
Jul 30 01:00:49.180748 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.180611    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0eb883b-4891-4abe-926d-e824685c076a-workload-certs\") pod \"c0eb883b-4891-4abe-926d-e824685c076a\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") "
Jul 30 01:00:49.180748 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.180640    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0eb883b-4891-4abe-926d-e824685c076a-istio-envoy\") pod \"c0eb883b-4891-4abe-926d-e824685c076a\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") "
Jul 30 01:00:49.180748 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.180662    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0eb883b-4891-4abe-926d-e824685c076a-credential-socket\") pod \"c0eb883b-4891-4abe-926d-e824685c076a\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") "
Jul 30 01:00:49.180748 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.180686    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0eb883b-4891-4abe-926d-e824685c076a-istio-podinfo\") pod \"c0eb883b-4891-4abe-926d-e824685c076a\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") "
Jul 30 01:00:49.180748 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.180706    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0eb883b-4891-4abe-926d-e824685c076a-istio-token\") pod \"c0eb883b-4891-4abe-926d-e824685c076a\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") "
Jul 30 01:00:49.181071 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.180768    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0eb883b-4891-4abe-926d-e824685c076a-workload-socket\") pod \"c0eb883b-4891-4abe-926d-e824685c076a\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") "
Jul 30 01:00:49.181071 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.180856    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0eb883b-4891-4abe-926d-e824685c076a-istio-data\") pod \"c0eb883b-4891-4abe-926d-e824685c076a\" (UID: \"c0eb883b-4891-4abe-926d-e824685c076a\") "
Jul 30 01:00:49.181071 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.180929    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0eb883b-4891-4abe-926d-e824685c076a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c0eb883b-4891-4abe-926d-e824685c076a" (UID: "c0eb883b-4891-4abe-926d-e824685c076a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 01:00:49.181071 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.180972    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0eb883b-4891-4abe-926d-e824685c076a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c0eb883b-4891-4abe-926d-e824685c076a" (UID: "c0eb883b-4891-4abe-926d-e824685c076a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 01:00:49.181315 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.181133    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0eb883b-4891-4abe-926d-e824685c076a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c0eb883b-4891-4abe-926d-e824685c076a" (UID: "c0eb883b-4891-4abe-926d-e824685c076a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 01:00:49.181315 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.181073    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0eb883b-4891-4abe-926d-e824685c076a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c0eb883b-4891-4abe-926d-e824685c076a" (UID: "c0eb883b-4891-4abe-926d-e824685c076a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 01:00:49.181315 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.181300    2527 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0eb883b-4891-4abe-926d-e824685c076a-istiod-ca-cert\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 01:00:49.181451 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.181320    2527 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0eb883b-4891-4abe-926d-e824685c076a-workload-certs\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 01:00:49.181451 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.181334    2527 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0eb883b-4891-4abe-926d-e824685c076a-credential-socket\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 01:00:49.181451 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.181349    2527 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0eb883b-4891-4abe-926d-e824685c076a-workload-socket\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 01:00:49.182101 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.182078    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0eb883b-4891-4abe-926d-e824685c076a-istio-data" (OuterVolumeSpecName: "istio-data") pod "c0eb883b-4891-4abe-926d-e824685c076a" (UID: "c0eb883b-4891-4abe-926d-e824685c076a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 01:00:49.183065 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.183044    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c0eb883b-4891-4abe-926d-e824685c076a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c0eb883b-4891-4abe-926d-e824685c076a" (UID: "c0eb883b-4891-4abe-926d-e824685c076a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 01:00:49.183178 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.183137    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0eb883b-4891-4abe-926d-e824685c076a-istio-token" (OuterVolumeSpecName: "istio-token") pod "c0eb883b-4891-4abe-926d-e824685c076a" (UID: "c0eb883b-4891-4abe-926d-e824685c076a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 01:00:49.183475 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.183448    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0eb883b-4891-4abe-926d-e824685c076a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c0eb883b-4891-4abe-926d-e824685c076a" (UID: "c0eb883b-4891-4abe-926d-e824685c076a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 01:00:49.183571 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.183552    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0eb883b-4891-4abe-926d-e824685c076a-kube-api-access-rzkjv" (OuterVolumeSpecName: "kube-api-access-rzkjv") pod "c0eb883b-4891-4abe-926d-e824685c076a" (UID: "c0eb883b-4891-4abe-926d-e824685c076a"). InnerVolumeSpecName "kube-api-access-rzkjv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 01:00:49.282028 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.281943    2527 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0eb883b-4891-4abe-926d-e824685c076a-istio-data\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 01:00:49.282028 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.281971    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzkjv\" (UniqueName: \"kubernetes.io/projected/c0eb883b-4891-4abe-926d-e824685c076a-kube-api-access-rzkjv\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 01:00:49.282028 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.281981    2527 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0eb883b-4891-4abe-926d-e824685c076a-istio-envoy\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 01:00:49.282028 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.281989    2527 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0eb883b-4891-4abe-926d-e824685c076a-istio-podinfo\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 01:00:49.282028 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.281997    2527 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0eb883b-4891-4abe-926d-e824685c076a-istio-token\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 01:00:49.855814 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.855782    2527 generic.go:356] "Generic (PLEG): container finished" podID="c0eb883b-4891-4abe-926d-e824685c076a" containerID="860f8815983f18695638b1276a791e1b8a51d7b33a89d6fa4f7ad826cb461847" exitCode=0
Jul 30 01:00:49.856296 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.855833    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"
Jul 30 01:00:49.856296 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.855871    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4" event={"ID":"c0eb883b-4891-4abe-926d-e824685c076a","Type":"ContainerDied","Data":"860f8815983f18695638b1276a791e1b8a51d7b33a89d6fa4f7ad826cb461847"}
Jul 30 01:00:49.856296 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.855942    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4" event={"ID":"c0eb883b-4891-4abe-926d-e824685c076a","Type":"ContainerDied","Data":"e611414cb87e1ef009f02b987c9ea230a6b03ea3acef9cca55d26637a4500daf"}
Jul 30 01:00:49.856296 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.855977    2527 scope.go:117] "RemoveContainer" containerID="860f8815983f18695638b1276a791e1b8a51d7b33a89d6fa4f7ad826cb461847"
Jul 30 01:00:49.867336 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.867320    2527 scope.go:117] "RemoveContainer" containerID="45a9c6f2ac4934bc0a8a93da81fda47d39db52e19d81ea668c7b935829662c3c"
Jul 30 01:00:49.875905 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.875886    2527 scope.go:117] "RemoveContainer" containerID="860f8815983f18695638b1276a791e1b8a51d7b33a89d6fa4f7ad826cb461847"
Jul 30 01:00:49.876325 ip-10-0-137-198 kubenswrapper[2527]: E0730 01:00:49.876291    2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"860f8815983f18695638b1276a791e1b8a51d7b33a89d6fa4f7ad826cb461847\": container with ID starting with 860f8815983f18695638b1276a791e1b8a51d7b33a89d6fa4f7ad826cb461847 not found: ID does not exist" containerID="860f8815983f18695638b1276a791e1b8a51d7b33a89d6fa4f7ad826cb461847"
Jul 30 01:00:49.876427 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.876321    2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"860f8815983f18695638b1276a791e1b8a51d7b33a89d6fa4f7ad826cb461847"} err="failed to get container status \"860f8815983f18695638b1276a791e1b8a51d7b33a89d6fa4f7ad826cb461847\": rpc error: code = NotFound desc = could not find container \"860f8815983f18695638b1276a791e1b8a51d7b33a89d6fa4f7ad826cb461847\": container with ID starting with 860f8815983f18695638b1276a791e1b8a51d7b33a89d6fa4f7ad826cb461847 not found: ID does not exist"
Jul 30 01:00:49.876427 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.876343    2527 scope.go:117] "RemoveContainer" containerID="45a9c6f2ac4934bc0a8a93da81fda47d39db52e19d81ea668c7b935829662c3c"
Jul 30 01:00:49.876579 ip-10-0-137-198 kubenswrapper[2527]: E0730 01:00:49.876564    2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45a9c6f2ac4934bc0a8a93da81fda47d39db52e19d81ea668c7b935829662c3c\": container with ID starting with 45a9c6f2ac4934bc0a8a93da81fda47d39db52e19d81ea668c7b935829662c3c not found: ID does not exist" containerID="45a9c6f2ac4934bc0a8a93da81fda47d39db52e19d81ea668c7b935829662c3c"
Jul 30 01:00:49.876620 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.876584    2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45a9c6f2ac4934bc0a8a93da81fda47d39db52e19d81ea668c7b935829662c3c"} err="failed to get container status \"45a9c6f2ac4934bc0a8a93da81fda47d39db52e19d81ea668c7b935829662c3c\": rpc error: code = NotFound desc = could not find container \"45a9c6f2ac4934bc0a8a93da81fda47d39db52e19d81ea668c7b935829662c3c\": container with ID starting with 45a9c6f2ac4934bc0a8a93da81fda47d39db52e19d81ea668c7b935829662c3c not found: ID does not exist"
Jul 30 01:00:49.878979 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.878959    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"]
Jul 30 01:00:49.882475 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:49.882458    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-edaa93-openshift-default-6dc6ddc47d-vvqc4"]
Jul 30 01:00:50.216328 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:50.216299    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0eb883b-4891-4abe-926d-e824685c076a" path="/var/lib/kubelet/pods/c0eb883b-4891-4abe-926d-e824685c076a/volumes"
Jul 30 01:00:54.592111 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:54.592079    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4ef902-6848d59769-vshkf"]
Jul 30 01:00:54.595464 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:54.595430    2527 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4ef902-6848d59769-vshkf" podUID="c9978509-95b5-4f27-b63d-9ed764beaca5" containerName="maas-api" containerID="cri-o://ccc892bcc04ae414a29f163919daee5c76d4a6c3258eb72aa0a618029ec39170" gracePeriod=30
Jul 30 01:00:54.784243 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:54.784215    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4ef902-m8rdr"]
Jul 30 01:00:54.786889 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:54.786862    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-4ef902-m8rdr"]
Jul 30 01:00:54.848725 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:54.848653    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4ef902-6848d59769-vshkf"
Jul 30 01:00:54.890009 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:54.889981    2527 generic.go:356] "Generic (PLEG): container finished" podID="c9978509-95b5-4f27-b63d-9ed764beaca5" containerID="ccc892bcc04ae414a29f163919daee5c76d4a6c3258eb72aa0a618029ec39170" exitCode=0
Jul 30 01:00:54.890155 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:54.890023    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4ef902-6848d59769-vshkf"
Jul 30 01:00:54.890155 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:54.890070    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4ef902-6848d59769-vshkf" event={"ID":"c9978509-95b5-4f27-b63d-9ed764beaca5","Type":"ContainerDied","Data":"ccc892bcc04ae414a29f163919daee5c76d4a6c3258eb72aa0a618029ec39170"}
Jul 30 01:00:54.890155 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:54.890116    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4ef902-6848d59769-vshkf" event={"ID":"c9978509-95b5-4f27-b63d-9ed764beaca5","Type":"ContainerDied","Data":"45f71b6711e0884fad9987213bf951b7a9f9b68c765f95508eb2f1e3b777d057"}
Jul 30 01:00:54.890155 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:54.890137    2527 scope.go:117] "RemoveContainer" containerID="ccc892bcc04ae414a29f163919daee5c76d4a6c3258eb72aa0a618029ec39170"
Jul 30 01:00:54.899744 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:54.899725    2527 scope.go:117] "RemoveContainer" containerID="ccc892bcc04ae414a29f163919daee5c76d4a6c3258eb72aa0a618029ec39170"
Jul 30 01:00:54.900000 ip-10-0-137-198 kubenswrapper[2527]: E0730 01:00:54.899982    2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccc892bcc04ae414a29f163919daee5c76d4a6c3258eb72aa0a618029ec39170\": container with ID starting with ccc892bcc04ae414a29f163919daee5c76d4a6c3258eb72aa0a618029ec39170 not found: ID does not exist" containerID="ccc892bcc04ae414a29f163919daee5c76d4a6c3258eb72aa0a618029ec39170"
Jul 30 01:00:54.900046 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:54.900007    2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccc892bcc04ae414a29f163919daee5c76d4a6c3258eb72aa0a618029ec39170"} err="failed to get container status \"ccc892bcc04ae414a29f163919daee5c76d4a6c3258eb72aa0a618029ec39170\": rpc error: code = NotFound desc = could not find container \"ccc892bcc04ae414a29f163919daee5c76d4a6c3258eb72aa0a618029ec39170\": container with ID starting with ccc892bcc04ae414a29f163919daee5c76d4a6c3258eb72aa0a618029ec39170 not found: ID does not exist"
Jul 30 01:00:54.923259 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:54.923237    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hvml\" (UniqueName: \"kubernetes.io/projected/c9978509-95b5-4f27-b63d-9ed764beaca5-kube-api-access-2hvml\") pod \"c9978509-95b5-4f27-b63d-9ed764beaca5\" (UID: \"c9978509-95b5-4f27-b63d-9ed764beaca5\") "
Jul 30 01:00:54.923358 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:54.923277    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9978509-95b5-4f27-b63d-9ed764beaca5-openshift-service-ca\") pod \"c9978509-95b5-4f27-b63d-9ed764beaca5\" (UID: \"c9978509-95b5-4f27-b63d-9ed764beaca5\") "
Jul 30 01:00:54.923358 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:54.923354    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9978509-95b5-4f27-b63d-9ed764beaca5-maas-api-tls\") pod \"c9978509-95b5-4f27-b63d-9ed764beaca5\" (UID: \"c9978509-95b5-4f27-b63d-9ed764beaca5\") "
Jul 30 01:00:54.923698 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:54.923673    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9978509-95b5-4f27-b63d-9ed764beaca5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c9978509-95b5-4f27-b63d-9ed764beaca5" (UID: "c9978509-95b5-4f27-b63d-9ed764beaca5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 01:00:54.925383 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:54.925359    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9978509-95b5-4f27-b63d-9ed764beaca5-kube-api-access-2hvml" (OuterVolumeSpecName: "kube-api-access-2hvml") pod "c9978509-95b5-4f27-b63d-9ed764beaca5" (UID: "c9978509-95b5-4f27-b63d-9ed764beaca5"). InnerVolumeSpecName "kube-api-access-2hvml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 01:00:54.925450 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:54.925435    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9978509-95b5-4f27-b63d-9ed764beaca5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c9978509-95b5-4f27-b63d-9ed764beaca5" (UID: "c9978509-95b5-4f27-b63d-9ed764beaca5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 01:00:55.024898 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:55.024866    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hvml\" (UniqueName: \"kubernetes.io/projected/c9978509-95b5-4f27-b63d-9ed764beaca5-kube-api-access-2hvml\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 01:00:55.024898 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:55.024895    2527 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9978509-95b5-4f27-b63d-9ed764beaca5-openshift-service-ca\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 01:00:55.025077 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:55.024908    2527 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9978509-95b5-4f27-b63d-9ed764beaca5-maas-api-tls\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 01:00:55.211829 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:55.211796    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4ef902-6848d59769-vshkf"]
Jul 30 01:00:55.218206 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:55.218183    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4ef902-6848d59769-vshkf"]
Jul 30 01:00:56.216105 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:56.216071    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9978509-95b5-4f27-b63d-9ed764beaca5" path="/var/lib/kubelet/pods/c9978509-95b5-4f27-b63d-9ed764beaca5/volumes"
Jul 30 01:00:56.216501 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:56.216424    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbd312d0-cc1c-40dd-b9f8-b76d39e13bf4" path="/var/lib/kubelet/pods/fbd312d0-cc1c-40dd-b9f8-b76d39e13bf4/volumes"
Jul 30 01:00:57.997395 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:00:57.997360    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 01:01:01.602323 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:01.602289    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0b2dae-6mrc8"]
Jul 30 01:01:01.602718 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:01.602705    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9978509-95b5-4f27-b63d-9ed764beaca5" containerName="maas-api"
Jul 30 01:01:01.602772 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:01.602719    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9978509-95b5-4f27-b63d-9ed764beaca5" containerName="maas-api"
Jul 30 01:01:01.602772 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:01.602733    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbd312d0-cc1c-40dd-b9f8-b76d39e13bf4" containerName="revoke-keys"
Jul 30 01:01:01.602772 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:01.602739    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbd312d0-cc1c-40dd-b9f8-b76d39e13bf4" containerName="revoke-keys"
Jul 30 01:01:01.602772 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:01.602753    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0eb883b-4891-4abe-926d-e824685c076a" containerName="istio-proxy"
Jul 30 01:01:01.602772 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:01.602759    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0eb883b-4891-4abe-926d-e824685c076a" containerName="istio-proxy"
Jul 30 01:01:01.602772 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:01.602768    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0eb883b-4891-4abe-926d-e824685c076a" containerName="istio-proxy"
Jul 30 01:01:01.602772 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:01.602773    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0eb883b-4891-4abe-926d-e824685c076a" containerName="istio-proxy"
Jul 30 01:01:01.602989 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:01.602837    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0eb883b-4891-4abe-926d-e824685c076a" containerName="istio-proxy"
Jul 30 01:01:01.602989 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:01.602847    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbd312d0-cc1c-40dd-b9f8-b76d39e13bf4" containerName="revoke-keys"
Jul 30 01:01:01.602989 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:01.602853    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9978509-95b5-4f27-b63d-9ed764beaca5" containerName="maas-api"
Jul 30 01:01:01.607373 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:01.607357    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0b2dae-6mrc8"
Jul 30 01:01:01.609876 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:01.609852    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t42rq\""
Jul 30 01:01:01.613287 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:01.613262    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0b2dae-6mrc8"]
Jul 30 01:01:01.683481 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:01.683444    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57fe9bd4-8b6f-4b40-a529-4e57dafaaf63-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-0b2dae-6mrc8\" (UID: \"57fe9bd4-8b6f-4b40-a529-4e57dafaaf63\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0b2dae-6mrc8"
Jul 30 01:01:01.784464 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:01.784432    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57fe9bd4-8b6f-4b40-a529-4e57dafaaf63-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-0b2dae-6mrc8\" (UID: \"57fe9bd4-8b6f-4b40-a529-4e57dafaaf63\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0b2dae-6mrc8"
Jul 30 01:01:01.785072 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:01.785053    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57fe9bd4-8b6f-4b40-a529-4e57dafaaf63-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-0b2dae-6mrc8\" (UID: \"57fe9bd4-8b6f-4b40-a529-4e57dafaaf63\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0b2dae-6mrc8"
Jul 30 01:01:01.919430 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:01.919345    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0b2dae-6mrc8"
Jul 30 01:01:02.079486 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:02.079457    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0b2dae-6mrc8"]
Jul 30 01:01:02.081121 ip-10-0-137-198 kubenswrapper[2527]: W0730 01:01:02.081093    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57fe9bd4_8b6f_4b40_a529_4e57dafaaf63.slice/crio-7a3a09dd4dfc01c5f5b1d2f1e75833b469591f9d60dbfb70c5b741283ab92e1b WatchSource:0}: Error finding container 7a3a09dd4dfc01c5f5b1d2f1e75833b469591f9d60dbfb70c5b741283ab92e1b: Status 404 returned error can't find the container with id 7a3a09dd4dfc01c5f5b1d2f1e75833b469591f9d60dbfb70c5b741283ab92e1b
Jul 30 01:01:02.945119 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:02.945079    2527 generic.go:356] "Generic (PLEG): container finished" podID="57fe9bd4-8b6f-4b40-a529-4e57dafaaf63" containerID="41ebd01814a6c7bbf1c7b8cc9c074c0d9e4adbfcc62ea6d7899e82adab9d3837" exitCode=0
Jul 30 01:01:02.945607 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:02.945181    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0b2dae-6mrc8" event={"ID":"57fe9bd4-8b6f-4b40-a529-4e57dafaaf63","Type":"ContainerDied","Data":"41ebd01814a6c7bbf1c7b8cc9c074c0d9e4adbfcc62ea6d7899e82adab9d3837"}
Jul 30 01:01:02.945607 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:02.945258    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0b2dae-6mrc8" event={"ID":"57fe9bd4-8b6f-4b40-a529-4e57dafaaf63","Type":"ContainerStarted","Data":"7a3a09dd4dfc01c5f5b1d2f1e75833b469591f9d60dbfb70c5b741283ab92e1b"}
Jul 30 01:01:04.094373 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:04.094350    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0b2dae-6mrc8"
Jul 30 01:01:04.207085 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:04.207012    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57fe9bd4-8b6f-4b40-a529-4e57dafaaf63-maas-api-service-ca\") pod \"57fe9bd4-8b6f-4b40-a529-4e57dafaaf63\" (UID: \"57fe9bd4-8b6f-4b40-a529-4e57dafaaf63\") "
Jul 30 01:01:04.207371 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:04.207348    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57fe9bd4-8b6f-4b40-a529-4e57dafaaf63-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "57fe9bd4-8b6f-4b40-a529-4e57dafaaf63" (UID: "57fe9bd4-8b6f-4b40-a529-4e57dafaaf63"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 01:01:04.308048 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:04.308022    2527 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57fe9bd4-8b6f-4b40-a529-4e57dafaaf63-maas-api-service-ca\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 01:01:04.959206 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:04.959175    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0b2dae-6mrc8"
Jul 30 01:01:04.959369 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:04.959215    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0b2dae-6mrc8" event={"ID":"57fe9bd4-8b6f-4b40-a529-4e57dafaaf63","Type":"ContainerDied","Data":"7a3a09dd4dfc01c5f5b1d2f1e75833b469591f9d60dbfb70c5b741283ab92e1b"}
Jul 30 01:01:04.959369 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:04.959257    2527 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a3a09dd4dfc01c5f5b1d2f1e75833b469591f9d60dbfb70c5b741283ab92e1b"
Jul 30 01:01:12.073936 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:12.073897    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm"]
Jul 30 01:01:12.074362 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:12.074185    2527 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm" podUID="69709453-4eec-47ae-b14c-6741742bbd4e" containerName="maas-api" containerID="cri-o://8ff093bb11e503360679b18bd80b8ad2c609bf51feef10fafd8f5608cc801717" gracePeriod=30
Jul 30 01:01:12.091964 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:12.091937    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-0b2dae-29756220-wksq8"]
Jul 30 01:01:12.095625 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:12.095601    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-0b2dae-29756220-wksq8"]
Jul 30 01:01:12.216131 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:12.216102    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3273672b-b2d1-4d8b-bac1-68170177800a" path="/var/lib/kubelet/pods/3273672b-b2d1-4d8b-bac1-68170177800a/volumes"
Jul 30 01:01:12.244463 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:12.244434    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0b2dae-6mrc8"]
Jul 30 01:01:12.248135 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:12.248109    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-0b2dae-6mrc8"]
Jul 30 01:01:12.340209 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:12.340178    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm"
Jul 30 01:01:12.371923 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:12.371892    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69709453-4eec-47ae-b14c-6741742bbd4e-maas-api-tls\") pod \"69709453-4eec-47ae-b14c-6741742bbd4e\" (UID: \"69709453-4eec-47ae-b14c-6741742bbd4e\") "
Jul 30 01:01:12.372068 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:12.371937    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvj44\" (UniqueName: \"kubernetes.io/projected/69709453-4eec-47ae-b14c-6741742bbd4e-kube-api-access-wvj44\") pod \"69709453-4eec-47ae-b14c-6741742bbd4e\" (UID: \"69709453-4eec-47ae-b14c-6741742bbd4e\") "
Jul 30 01:01:12.372068 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:12.371983    2527 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69709453-4eec-47ae-b14c-6741742bbd4e-openshift-service-ca\") pod \"69709453-4eec-47ae-b14c-6741742bbd4e\" (UID: \"69709453-4eec-47ae-b14c-6741742bbd4e\") "
Jul 30 01:01:12.372391 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:12.372365    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69709453-4eec-47ae-b14c-6741742bbd4e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "69709453-4eec-47ae-b14c-6741742bbd4e" (UID: "69709453-4eec-47ae-b14c-6741742bbd4e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 01:01:12.374117 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:12.374098    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69709453-4eec-47ae-b14c-6741742bbd4e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "69709453-4eec-47ae-b14c-6741742bbd4e" (UID: "69709453-4eec-47ae-b14c-6741742bbd4e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 01:01:12.374243 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:12.374203    2527 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69709453-4eec-47ae-b14c-6741742bbd4e-kube-api-access-wvj44" (OuterVolumeSpecName: "kube-api-access-wvj44") pod "69709453-4eec-47ae-b14c-6741742bbd4e" (UID: "69709453-4eec-47ae-b14c-6741742bbd4e"). InnerVolumeSpecName "kube-api-access-wvj44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 01:01:12.473392 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:12.473362    2527 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69709453-4eec-47ae-b14c-6741742bbd4e-openshift-service-ca\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 01:01:12.473392 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:12.473390    2527 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69709453-4eec-47ae-b14c-6741742bbd4e-maas-api-tls\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 01:01:12.473392 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:12.473399    2527 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvj44\" (UniqueName: \"kubernetes.io/projected/69709453-4eec-47ae-b14c-6741742bbd4e-kube-api-access-wvj44\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\""
Jul 30 01:01:13.009372 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:13.009342    2527 generic.go:356] "Generic (PLEG): container finished" podID="69709453-4eec-47ae-b14c-6741742bbd4e" containerID="8ff093bb11e503360679b18bd80b8ad2c609bf51feef10fafd8f5608cc801717" exitCode=0
Jul 30 01:01:13.009552 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:13.009394    2527 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm"
Jul 30 01:01:13.009552 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:13.009432    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm" event={"ID":"69709453-4eec-47ae-b14c-6741742bbd4e","Type":"ContainerDied","Data":"8ff093bb11e503360679b18bd80b8ad2c609bf51feef10fafd8f5608cc801717"}
Jul 30 01:01:13.009552 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:13.009489    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm" event={"ID":"69709453-4eec-47ae-b14c-6741742bbd4e","Type":"ContainerDied","Data":"d108e96b54fdc6a2c9e2be02a022c92408c4f36215570d7e151ea90278a3bee5"}
Jul 30 01:01:13.009552 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:13.009524    2527 scope.go:117] "RemoveContainer" containerID="8ff093bb11e503360679b18bd80b8ad2c609bf51feef10fafd8f5608cc801717"
Jul 30 01:01:13.020222 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:13.020192    2527 scope.go:117] "RemoveContainer" containerID="8ff093bb11e503360679b18bd80b8ad2c609bf51feef10fafd8f5608cc801717"
Jul 30 01:01:13.020530 ip-10-0-137-198 kubenswrapper[2527]: E0730 01:01:13.020507    2527 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ff093bb11e503360679b18bd80b8ad2c609bf51feef10fafd8f5608cc801717\": container with ID starting with 8ff093bb11e503360679b18bd80b8ad2c609bf51feef10fafd8f5608cc801717 not found: ID does not exist" containerID="8ff093bb11e503360679b18bd80b8ad2c609bf51feef10fafd8f5608cc801717"
Jul 30 01:01:13.020628 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:13.020538    2527 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ff093bb11e503360679b18bd80b8ad2c609bf51feef10fafd8f5608cc801717"} err="failed to get container status \"8ff093bb11e503360679b18bd80b8ad2c609bf51feef10fafd8f5608cc801717\": rpc error: code = NotFound desc = could not find container \"8ff093bb11e503360679b18bd80b8ad2c609bf51feef10fafd8f5608cc801717\": container with ID starting with 8ff093bb11e503360679b18bd80b8ad2c609bf51feef10fafd8f5608cc801717 not found: ID does not exist"
Jul 30 01:01:13.032591 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:13.032565    2527 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm"]
Jul 30 01:01:13.036022 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:13.035992    2527 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-0b2dae-5f965fd68d-562pm"]
Jul 30 01:01:14.215829 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:14.215793    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57fe9bd4-8b6f-4b40-a529-4e57dafaaf63" path="/var/lib/kubelet/pods/57fe9bd4-8b6f-4b40-a529-4e57dafaaf63/volumes"
Jul 30 01:01:14.216241 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:14.216226    2527 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69709453-4eec-47ae-b14c-6741742bbd4e" path="/var/lib/kubelet/pods/69709453-4eec-47ae-b14c-6741742bbd4e/volumes"
Jul 30 01:01:15.001628 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:15.001591    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n9cd2"]
Jul 30 01:01:19.235733 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:19.235697    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-594b58bf5d-hmvmk_f63cc435-1192-4f73-9a41-83295000cd12/authorino/0.log"
Jul 30 01:01:24.506722 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:24.506690    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-pgjck_53c02a2c-1f8d-40ba-9588-86b6095c66d5/manager/0.log"
Jul 30 01:01:24.622289 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:24.622258    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-lsms4_b365a8d9-4d98-4393-9397-f9cf62216844/manager/0.log"
Jul 30 01:01:24.854305 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:24.854207    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-dxmkc_ed4ef1a3-710d-4624-ac0d-e9c2936eb4e4/server/0.log"
Jul 30 01:01:24.972518 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:24.972493    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-m99gw_049847b4-1696-4282-a0b6-9a0390fcf7c8/manager/0.log"
Jul 30 01:01:25.081431 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:25.081410    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-655d97b687-hw4df_a3c837d8-482b-4e77-a307-857876f402a5/copy-manifests/0.log"
Jul 30 01:01:25.087626 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:25.087605    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-655d97b687-hw4df_a3c837d8-482b-4e77-a307-857876f402a5/manager/0.log"
Jul 30 01:01:25.797975 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:25.797945    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29756190-2nn72_b23a8ac9-66c7-4985-b2df-f0afd6bde8f9/cleanup/0.log"
Jul 30 01:01:25.902992 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:25.902967    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29756205-lkpws_a4301486-3993-465d-a77a-d7e22127f00a/cleanup/0.log"
Jul 30 01:01:26.008075 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:26.008052    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29756220-5dc8l_930c3ca1-6673-4b57-8b50-de16a350e4ad/cleanup/0.log"
Jul 30 01:01:26.858007 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:26.857981    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv_432642b0-8a24-46e8-8171-54cb5a47333d/util/0.log"
Jul 30 01:01:26.864188 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:26.864146    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv_432642b0-8a24-46e8-8171-54cb5a47333d/pull/0.log"
Jul 30 01:01:26.869926 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:26.869910    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv_432642b0-8a24-46e8-8171-54cb5a47333d/extract/0.log"
Jul 30 01:01:26.974817 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:26.974779    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv_a07a831c-5ef0-4cfc-8518-01fec916575e/util/0.log"
Jul 30 01:01:26.979847 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:26.979827    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv_a07a831c-5ef0-4cfc-8518-01fec916575e/pull/0.log"
Jul 30 01:01:26.985265 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:26.985238    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv_a07a831c-5ef0-4cfc-8518-01fec916575e/extract/0.log"
Jul 30 01:01:27.090330 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:27.090311    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc_1adef8ac-c1e9-48d6-b890-d7dd478706f9/pull/0.log"
Jul 30 01:01:27.096135 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:27.096120    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc_1adef8ac-c1e9-48d6-b890-d7dd478706f9/extract/0.log"
Jul 30 01:01:27.100784 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:27.100768    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc_1adef8ac-c1e9-48d6-b890-d7dd478706f9/util/0.log"
Jul 30 01:01:27.207787 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:27.207767    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc_0c9d642f-2895-4771-84bf-2e93ed55f350/util/0.log"
Jul 30 01:01:27.214614 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:27.214585    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc_0c9d642f-2895-4771-84bf-2e93ed55f350/pull/0.log"
Jul 30 01:01:27.219984 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:27.219965    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc_0c9d642f-2895-4771-84bf-2e93ed55f350/extract/0.log"
Jul 30 01:01:27.341521 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:27.341497    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-594b58bf5d-hmvmk_f63cc435-1192-4f73-9a41-83295000cd12/authorino/0.log"
Jul 30 01:01:27.453899 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:27.453877    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-tgdh9_667956b5-c05b-4b82-94ae-3bba71fd9dfb/manager/0.log"
Jul 30 01:01:27.567808 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:27.567753    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-s5n4l_98c93779-1196-4e2a-84c6-1de5f700e0c3/manager/0.log"
Jul 30 01:01:27.703213 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:27.703189    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-2fn4p_bd4e0fff-93e7-4843-831d-811d747c02fd/kuadrant-console-plugin/0.log"
Jul 30 01:01:27.829721 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:27.829651    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-gqwnf_a2d3cdd5-4aff-4532-b1db-327b20f9eb76/registry-server/0.log"
Jul 30 01:01:27.951020 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:27.950995    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-7n87j_562b861b-de2e-4e5b-b7f3-71930849a297/manager/0.log"
Jul 30 01:01:28.056360 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:28.056340    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-n9cd2_f438f7c1-89e4-4172-9dae-a6d582cee115/limitador/0.log"
Jul 30 01:01:28.752863 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:28.752837    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59c4b4bfcf-6rm4r_0cb52402-a865-4042-bd66-cd5dbd55cbaf/kube-auth-proxy/0.log"
Jul 30 01:01:28.979108 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:28.979076    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-sjrkr_2c3a4be4-9ee5-4e76-9047-c600284aec82/istio-proxy/1.log"
Jul 30 01:01:29.102591 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:29.102503    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-8xmlm_e241e5ee-2fa2-4fb3-a8a2-e028fec62a89/payload-pre-processing/0.log"
Jul 30 01:01:29.331712 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:29.331679    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d4699ff7f-xg2hr_e1d50049-e6de-4aa9-80fc-457a51653449/router/0.log"
Jul 30 01:01:30.001800 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:30.001774    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsrxn6_7531a470-f060-4c28-ad99-ecb007bc1ce2/main/0.log"
Jul 30 01:01:35.973043 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:35.973015    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mf94r/must-gather-mjm6w"]
Jul 30 01:01:35.973447 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:35.973434    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69709453-4eec-47ae-b14c-6741742bbd4e" containerName="maas-api"
Jul 30 01:01:35.973493 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:35.973449    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="69709453-4eec-47ae-b14c-6741742bbd4e" containerName="maas-api"
Jul 30 01:01:35.973493 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:35.973462    2527 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57fe9bd4-8b6f-4b40-a529-4e57dafaaf63" containerName="revoke-keys"
Jul 30 01:01:35.973493 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:35.973467    2527 state_mem.go:107] "Deleted CPUSet assignment" podUID="57fe9bd4-8b6f-4b40-a529-4e57dafaaf63" containerName="revoke-keys"
Jul 30 01:01:35.973586 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:35.973535    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="69709453-4eec-47ae-b14c-6741742bbd4e" containerName="maas-api"
Jul 30 01:01:35.973586 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:35.973545    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0eb883b-4891-4abe-926d-e824685c076a" containerName="istio-proxy"
Jul 30 01:01:35.973586 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:35.973552    2527 memory_manager.go:368] "RemoveStaleState removing state" podUID="57fe9bd4-8b6f-4b40-a529-4e57dafaaf63" containerName="revoke-keys"
Jul 30 01:01:35.980687 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:35.980655    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mf94r/must-gather-mjm6w"
Jul 30 01:01:35.984329 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:35.984300    2527 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mf94r\"/\"default-dockercfg-crx64\""
Jul 30 01:01:35.985225 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:35.985198    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mf94r\"/\"openshift-service-ca.crt\""
Jul 30 01:01:35.985733 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:35.985715    2527 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mf94r\"/\"kube-root-ca.crt\""
Jul 30 01:01:35.987157 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:35.987135    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mf94r/must-gather-mjm6w"]
Jul 30 01:01:36.064575 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:36.064547    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smdrj\" (UniqueName: \"kubernetes.io/projected/5c45c6b9-2dfb-46b1-9156-e0324ad229e1-kube-api-access-smdrj\") pod \"must-gather-mjm6w\" (UID: \"5c45c6b9-2dfb-46b1-9156-e0324ad229e1\") " pod="openshift-must-gather-mf94r/must-gather-mjm6w"
Jul 30 01:01:36.064703 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:36.064591    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5c45c6b9-2dfb-46b1-9156-e0324ad229e1-must-gather-output\") pod \"must-gather-mjm6w\" (UID: \"5c45c6b9-2dfb-46b1-9156-e0324ad229e1\") " pod="openshift-must-gather-mf94r/must-gather-mjm6w"
Jul 30 01:01:36.165886 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:36.165861    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smdrj\" (UniqueName: \"kubernetes.io/projected/5c45c6b9-2dfb-46b1-9156-e0324ad229e1-kube-api-access-smdrj\") pod \"must-gather-mjm6w\" (UID: \"5c45c6b9-2dfb-46b1-9156-e0324ad229e1\") " pod="openshift-must-gather-mf94r/must-gather-mjm6w"
Jul 30 01:01:36.166012 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:36.165898    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5c45c6b9-2dfb-46b1-9156-e0324ad229e1-must-gather-output\") pod \"must-gather-mjm6w\" (UID: \"5c45c6b9-2dfb-46b1-9156-e0324ad229e1\") " pod="openshift-must-gather-mf94r/must-gather-mjm6w"
Jul 30 01:01:36.166218 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:36.166201    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5c45c6b9-2dfb-46b1-9156-e0324ad229e1-must-gather-output\") pod \"must-gather-mjm6w\" (UID: \"5c45c6b9-2dfb-46b1-9156-e0324ad229e1\") " pod="openshift-must-gather-mf94r/must-gather-mjm6w"
Jul 30 01:01:36.174123 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:36.174100    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smdrj\" (UniqueName: \"kubernetes.io/projected/5c45c6b9-2dfb-46b1-9156-e0324ad229e1-kube-api-access-smdrj\") pod \"must-gather-mjm6w\" (UID: \"5c45c6b9-2dfb-46b1-9156-e0324ad229e1\") " pod="openshift-must-gather-mf94r/must-gather-mjm6w"
Jul 30 01:01:36.291466 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:36.291412    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mf94r/must-gather-mjm6w"
Jul 30 01:01:36.426654 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:36.426626    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mf94r/must-gather-mjm6w"]
Jul 30 01:01:36.427941 ip-10-0-137-198 kubenswrapper[2527]: W0730 01:01:36.427914    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c45c6b9_2dfb_46b1_9156_e0324ad229e1.slice/crio-4911cc9e7218cbac7bb307e33309da128ce35bef5835a2e2c1608cdcf373a02c WatchSource:0}: Error finding container 4911cc9e7218cbac7bb307e33309da128ce35bef5835a2e2c1608cdcf373a02c: Status 404 returned error can't find the container with id 4911cc9e7218cbac7bb307e33309da128ce35bef5835a2e2c1608cdcf373a02c
Jul 30 01:01:36.429775 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:36.429758    2527 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 01:01:37.164249 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:37.164207    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mf94r/must-gather-mjm6w" event={"ID":"5c45c6b9-2dfb-46b1-9156-e0324ad229e1","Type":"ContainerStarted","Data":"4911cc9e7218cbac7bb307e33309da128ce35bef5835a2e2c1608cdcf373a02c"}
Jul 30 01:01:38.176479 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:38.176437    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mf94r/must-gather-mjm6w" event={"ID":"5c45c6b9-2dfb-46b1-9156-e0324ad229e1","Type":"ContainerStarted","Data":"15a5bec62cba7a6fed2cba0187bfa52f7d56911fe7c173cebc32a22fa6afc04a"}
Jul 30 01:01:38.176978 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:38.176498    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mf94r/must-gather-mjm6w" event={"ID":"5c45c6b9-2dfb-46b1-9156-e0324ad229e1","Type":"ContainerStarted","Data":"72063677c6e8c1b56f3416cfa6052d2067a4942cf74e6c8a40739eceb34da24c"}
Jul 30 01:01:38.194695 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:38.194650    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mf94r/must-gather-mjm6w" podStartSLOduration=2.033961003 podStartE2EDuration="3.194635116s" totalImagesPullingTime="1.160674113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 01:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 01:01:38.19154497 +0000 UTC m=+3572.493993316" watchObservedRunningTime="2026-07-30 01:01:38.194635116 +0000 UTC m=+3572.497083473"
Jul 30 01:01:39.219871 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:39.219840    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tmsc5_fefc207e-2848-4204-b460-39c933e7b127/global-pull-secret-syncer/0.log"
Jul 30 01:01:39.376787 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:39.376750    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pnbrq_877bba44-0778-4142-b6f7-aa03eb30a724/konnectivity-agent/0.log"
Jul 30 01:01:39.461557 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:39.461511    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-198.ec2.internal_07e6b3dc508eb1747236dbb1b614bc57/haproxy/0.log"
Jul 30 01:01:43.609360 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:43.609322    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv_432642b0-8a24-46e8-8171-54cb5a47333d/extract/0.log"
Jul 30 01:01:43.631928 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:43.631884    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv_432642b0-8a24-46e8-8171-54cb5a47333d/util/0.log"
Jul 30 01:01:43.653775 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:43.653729    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759s5wsv_432642b0-8a24-46e8-8171-54cb5a47333d/pull/0.log"
Jul 30 01:01:43.685641 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:43.685611    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv_a07a831c-5ef0-4cfc-8518-01fec916575e/extract/0.log"
Jul 30 01:01:43.706449 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:43.706418    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv_a07a831c-5ef0-4cfc-8518-01fec916575e/util/0.log"
Jul 30 01:01:43.730642 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:43.730613    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmfv_a07a831c-5ef0-4cfc-8518-01fec916575e/pull/0.log"
Jul 30 01:01:43.759205 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:43.759152    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc_1adef8ac-c1e9-48d6-b890-d7dd478706f9/extract/0.log"
Jul 30 01:01:43.781697 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:43.781649    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc_1adef8ac-c1e9-48d6-b890-d7dd478706f9/util/0.log"
Jul 30 01:01:43.814787 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:43.814759    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vcmkc_1adef8ac-c1e9-48d6-b890-d7dd478706f9/pull/0.log"
Jul 30 01:01:43.841887 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:43.841857    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc_0c9d642f-2895-4771-84bf-2e93ed55f350/extract/0.log"
Jul 30 01:01:43.864624 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:43.864538    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc_0c9d642f-2895-4771-84bf-2e93ed55f350/util/0.log"
Jul 30 01:01:43.885093 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:43.885053    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14jblc_0c9d642f-2895-4771-84bf-2e93ed55f350/pull/0.log"
Jul 30 01:01:44.515187 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:44.514137    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-594b58bf5d-hmvmk_f63cc435-1192-4f73-9a41-83295000cd12/authorino/0.log"
Jul 30 01:01:44.551052 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:44.550793    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-tgdh9_667956b5-c05b-4b82-94ae-3bba71fd9dfb/manager/0.log"
Jul 30 01:01:44.580343 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:44.580307    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-s5n4l_98c93779-1196-4e2a-84c6-1de5f700e0c3/manager/0.log"
Jul 30 01:01:44.605553 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:44.605525    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-2fn4p_bd4e0fff-93e7-4843-831d-811d747c02fd/kuadrant-console-plugin/0.log"
Jul 30 01:01:44.668717 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:44.666066    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-gqwnf_a2d3cdd5-4aff-4532-b1db-327b20f9eb76/registry-server/0.log"
Jul 30 01:01:44.895972 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:44.895865    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-7n87j_562b861b-de2e-4e5b-b7f3-71930849a297/manager/0.log"
Jul 30 01:01:44.926789 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:44.926757    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-n9cd2_f438f7c1-89e4-4172-9dae-a6d582cee115/limitador/0.log"
Jul 30 01:01:46.644493 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:46.644414    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bcd07664-bb84-4f8c-8f59-a970892dbce7/alertmanager/0.log"
Jul 30 01:01:46.670609 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:46.670518    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bcd07664-bb84-4f8c-8f59-a970892dbce7/config-reloader/0.log"
Jul 30 01:01:46.694677 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:46.694653    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bcd07664-bb84-4f8c-8f59-a970892dbce7/kube-rbac-proxy-web/0.log"
Jul 30 01:01:46.716964 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:46.716941    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bcd07664-bb84-4f8c-8f59-a970892dbce7/kube-rbac-proxy/0.log"
Jul 30 01:01:46.765649 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:46.765623    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bcd07664-bb84-4f8c-8f59-a970892dbce7/kube-rbac-proxy-metric/0.log"
Jul 30 01:01:46.823003 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:46.822981    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bcd07664-bb84-4f8c-8f59-a970892dbce7/prom-label-proxy/0.log"
Jul 30 01:01:46.867563 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:46.867530    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bcd07664-bb84-4f8c-8f59-a970892dbce7/init-config-reloader/0.log"
Jul 30 01:01:46.918137 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:46.918056    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-fwpz8_872d3ff4-c766-4f3b-8e98-4e622f016146/cluster-monitoring-operator/0.log"
Jul 30 01:01:46.958726 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:46.958687    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-xzrt8_8ce6bb72-448c-4cde-be75-5e093fa7ed40/kube-state-metrics/0.log"
Jul 30 01:01:46.974947 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:46.974901    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-xzrt8_8ce6bb72-448c-4cde-be75-5e093fa7ed40/kube-rbac-proxy-main/0.log"
Jul 30 01:01:46.995582 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:46.995525    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-xzrt8_8ce6bb72-448c-4cde-be75-5e093fa7ed40/kube-rbac-proxy-self/0.log"
Jul 30 01:01:47.023353 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:47.023322    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5cdf79f7f9-5vgql_185238c8-7ceb-4ddc-934b-114adc2a97bb/metrics-server/0.log"
Jul 30 01:01:47.161402 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:47.161371    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-spd92_2c16aaf3-1bdc-4793-a8b9-6196a0701910/node-exporter/0.log"
Jul 30 01:01:47.182743 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:47.182653    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-spd92_2c16aaf3-1bdc-4793-a8b9-6196a0701910/kube-rbac-proxy/0.log"
Jul 30 01:01:47.205272 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:47.205246    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-spd92_2c16aaf3-1bdc-4793-a8b9-6196a0701910/init-textfile/0.log"
Jul 30 01:01:47.304282 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:47.304247    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-wd4t4_228f12e0-8eb0-4202-b030-4ae9e68dfd7c/kube-rbac-proxy-main/0.log"
Jul 30 01:01:47.334350 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:47.334301    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-wd4t4_228f12e0-8eb0-4202-b030-4ae9e68dfd7c/kube-rbac-proxy-self/0.log"
Jul 30 01:01:47.361656 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:47.361624    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-wd4t4_228f12e0-8eb0-4202-b030-4ae9e68dfd7c/openshift-state-metrics/0.log"
Jul 30 01:01:47.621484 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:47.621447    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-cdbd4f948-wkrgg_31475f89-e98a-4065-abe2-1dc78512ba3a/telemeter-client/0.log"
Jul 30 01:01:47.642467 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:47.642440    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-cdbd4f948-wkrgg_31475f89-e98a-4065-abe2-1dc78512ba3a/reload/0.log"
Jul 30 01:01:47.664877 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:47.664849    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-cdbd4f948-wkrgg_31475f89-e98a-4065-abe2-1dc78512ba3a/kube-rbac-proxy/0.log"
Jul 30 01:01:49.707605 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:49.707566    2527 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mf94r/perf-node-gather-daemonset-t48kh"]
Jul 30 01:01:49.713883 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:49.713849    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-t48kh"
Jul 30 01:01:49.721100 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:49.721070    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mf94r/perf-node-gather-daemonset-t48kh"]
Jul 30 01:01:49.740246 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:49.740219    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27a0818c-421e-45b8-b75a-44cd3282f702-sys\") pod \"perf-node-gather-daemonset-t48kh\" (UID: \"27a0818c-421e-45b8-b75a-44cd3282f702\") " pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-t48kh"
Jul 30 01:01:49.740434 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:49.740269    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz2vv\" (UniqueName: \"kubernetes.io/projected/27a0818c-421e-45b8-b75a-44cd3282f702-kube-api-access-lz2vv\") pod \"perf-node-gather-daemonset-t48kh\" (UID: \"27a0818c-421e-45b8-b75a-44cd3282f702\") " pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-t48kh"
Jul 30 01:01:49.740434 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:49.740326    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/27a0818c-421e-45b8-b75a-44cd3282f702-proc\") pod \"perf-node-gather-daemonset-t48kh\" (UID: \"27a0818c-421e-45b8-b75a-44cd3282f702\") " pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-t48kh"
Jul 30 01:01:49.740434 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:49.740372    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/27a0818c-421e-45b8-b75a-44cd3282f702-podres\") pod \"perf-node-gather-daemonset-t48kh\" (UID: \"27a0818c-421e-45b8-b75a-44cd3282f702\") " pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-t48kh"
Jul 30 01:01:49.740434 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:49.740406    2527 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/27a0818c-421e-45b8-b75a-44cd3282f702-lib-modules\") pod \"perf-node-gather-daemonset-t48kh\" (UID: \"27a0818c-421e-45b8-b75a-44cd3282f702\") " pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-t48kh"
Jul 30 01:01:49.841739 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:49.841699    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/27a0818c-421e-45b8-b75a-44cd3282f702-proc\") pod \"perf-node-gather-daemonset-t48kh\" (UID: \"27a0818c-421e-45b8-b75a-44cd3282f702\") " pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-t48kh"
Jul 30 01:01:49.841943 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:49.841766    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/27a0818c-421e-45b8-b75a-44cd3282f702-podres\") pod \"perf-node-gather-daemonset-t48kh\" (UID: \"27a0818c-421e-45b8-b75a-44cd3282f702\") " pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-t48kh"
Jul 30 01:01:49.841943 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:49.841805    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/27a0818c-421e-45b8-b75a-44cd3282f702-lib-modules\") pod \"perf-node-gather-daemonset-t48kh\" (UID: \"27a0818c-421e-45b8-b75a-44cd3282f702\") " pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-t48kh"
Jul 30 01:01:49.841943 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:49.841896    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27a0818c-421e-45b8-b75a-44cd3282f702-sys\") pod \"perf-node-gather-daemonset-t48kh\" (UID: \"27a0818c-421e-45b8-b75a-44cd3282f702\") " pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-t48kh"
Jul 30 01:01:49.842117 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:49.841948    2527 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz2vv\" (UniqueName: \"kubernetes.io/projected/27a0818c-421e-45b8-b75a-44cd3282f702-kube-api-access-lz2vv\") pod \"perf-node-gather-daemonset-t48kh\" (UID: \"27a0818c-421e-45b8-b75a-44cd3282f702\") " pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-t48kh"
Jul 30 01:01:49.842441 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:49.842327    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/27a0818c-421e-45b8-b75a-44cd3282f702-podres\") pod \"perf-node-gather-daemonset-t48kh\" (UID: \"27a0818c-421e-45b8-b75a-44cd3282f702\") " pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-t48kh"
Jul 30 01:01:49.842441 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:49.842402    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/27a0818c-421e-45b8-b75a-44cd3282f702-proc\") pod \"perf-node-gather-daemonset-t48kh\" (UID: \"27a0818c-421e-45b8-b75a-44cd3282f702\") " pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-t48kh"
Jul 30 01:01:49.842441 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:49.842403    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/27a0818c-421e-45b8-b75a-44cd3282f702-lib-modules\") pod \"perf-node-gather-daemonset-t48kh\" (UID: \"27a0818c-421e-45b8-b75a-44cd3282f702\") " pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-t48kh"
Jul 30 01:01:49.842666 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:49.842445    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27a0818c-421e-45b8-b75a-44cd3282f702-sys\") pod \"perf-node-gather-daemonset-t48kh\" (UID: \"27a0818c-421e-45b8-b75a-44cd3282f702\") " pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-t48kh"
Jul 30 01:01:49.854047 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:49.854005    2527 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz2vv\" (UniqueName: \"kubernetes.io/projected/27a0818c-421e-45b8-b75a-44cd3282f702-kube-api-access-lz2vv\") pod \"perf-node-gather-daemonset-t48kh\" (UID: \"27a0818c-421e-45b8-b75a-44cd3282f702\") " pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-t48kh"
Jul 30 01:01:50.029363 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:50.029277    2527 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-t48kh"
Jul 30 01:01:50.098916 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:50.098887    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-8wqrt_4fb5f19c-d21a-4d0a-9682-3cfc7f7c284a/download-server/0.log"
Jul 30 01:01:50.231956 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:50.231422    2527 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mf94r/perf-node-gather-daemonset-t48kh"]
Jul 30 01:01:50.235530 ip-10-0-137-198 kubenswrapper[2527]: W0730 01:01:50.235267    2527 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod27a0818c_421e_45b8_b75a_44cd3282f702.slice/crio-8774de765d3142c3496ed37a9b3006c1d532d676f4fc6b5ad00065fe7f05616f WatchSource:0}: Error finding container 8774de765d3142c3496ed37a9b3006c1d532d676f4fc6b5ad00065fe7f05616f: Status 404 returned error can't find the container with id 8774de765d3142c3496ed37a9b3006c1d532d676f4fc6b5ad00065fe7f05616f
Jul 30 01:01:50.362305 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:50.362278    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-t48kh" event={"ID":"27a0818c-421e-45b8-b75a-44cd3282f702","Type":"ContainerStarted","Data":"8774de765d3142c3496ed37a9b3006c1d532d676f4fc6b5ad00065fe7f05616f"}
Jul 30 01:01:51.374442 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:51.374399    2527 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-t48kh" event={"ID":"27a0818c-421e-45b8-b75a-44cd3282f702","Type":"ContainerStarted","Data":"1c47d1478446b3b45d877327c32d5f8eec5b4071306ad4de69e6cf02b54f7059"}
Jul 30 01:01:51.374858 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:51.374537    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-t48kh"
Jul 30 01:01:51.393616 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:51.393554    2527 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-t48kh" podStartSLOduration=2.393535861 podStartE2EDuration="2.393535861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 01:01:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 01:01:51.389091708 +0000 UTC m=+3585.691540068" watchObservedRunningTime="2026-07-30 01:01:51.393535861 +0000 UTC m=+3585.695984206"
Jul 30 01:01:51.775328 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:51.775294    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jvbw8_ac196c9d-ff1e-4ed5-a85a-80ba51fa9819/dns/0.log"
Jul 30 01:01:51.797667 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:51.797617    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jvbw8_ac196c9d-ff1e-4ed5-a85a-80ba51fa9819/kube-rbac-proxy/0.log"
Jul 30 01:01:51.889557 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:51.889522    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tq4hc_abd0f838-14de-4c5c-899a-8364a6084905/dns-node-resolver/0.log"
Jul 30 01:01:52.468628 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:52.468591    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2g9tl_b0821896-954e-4d42-a259-11685665d109/node-ca/0.log"
Jul 30 01:01:53.597388 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:53.597352    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59c4b4bfcf-6rm4r_0cb52402-a865-4042-bd66-cd5dbd55cbaf/kube-auth-proxy/0.log"
Jul 30 01:01:53.655834 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:53.655799    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-sjrkr_2c3a4be4-9ee5-4e76-9047-c600284aec82/istio-proxy/0.log"
Jul 30 01:01:53.717026 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:53.716988    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-sjrkr_2c3a4be4-9ee5-4e76-9047-c600284aec82/istio-proxy/1.log"
Jul 30 01:01:53.757053 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:53.757021    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-8xmlm_e241e5ee-2fa2-4fb3-a8a2-e028fec62a89/payload-pre-processing/0.log"
Jul 30 01:01:53.819699 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:53.819658    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d4699ff7f-xg2hr_e1d50049-e6de-4aa9-80fc-457a51653449/router/0.log"
Jul 30 01:01:54.626139 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:54.626097    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2kfjd_581ec3fe-74ca-4046-ba10-3ff893cd16a5/serve-healthcheck-canary/0.log"
Jul 30 01:01:55.325847 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:55.325814    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xwfd8_d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8/kube-rbac-proxy/0.log"
Jul 30 01:01:55.349879 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:55.349853    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xwfd8_d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8/exporter/0.log"
Jul 30 01:01:55.372424 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:55.372383    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xwfd8_d6a4f1d2-7b1e-46f4-8619-6dad53e5fdd8/extractor/0.log"
Jul 30 01:01:57.393676 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:57.393595    2527 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mf94r/perf-node-gather-daemonset-t48kh"
Jul 30 01:01:57.446086 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:57.446046    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-pgjck_53c02a2c-1f8d-40ba-9588-86b6095c66d5/manager/0.log"
Jul 30 01:01:57.861871 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:57.861823    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-lsms4_b365a8d9-4d98-4393-9397-f9cf62216844/manager/0.log"
Jul 30 01:01:58.019268 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:58.019236    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-dxmkc_ed4ef1a3-710d-4624-ac0d-e9c2936eb4e4/server/0.log"
Jul 30 01:01:58.138087 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:58.138010    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-m99gw_049847b4-1696-4282-a0b6-9a0390fcf7c8/manager/0.log"
Jul 30 01:01:58.166406 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:58.166375    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-655d97b687-hw4df_a3c837d8-482b-4e77-a307-857876f402a5/manager/0.log"
Jul 30 01:01:58.188013 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:01:58.187988    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-655d97b687-hw4df_a3c837d8-482b-4e77-a307-857876f402a5/copy-manifests/0.log"
Jul 30 01:02:00.051645 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:02:00.051567    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59c4b4bfcf-6rm4r_0cb52402-a865-4042-bd66-cd5dbd55cbaf/kube-auth-proxy/0.log"
Jul 30 01:02:00.083806 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:02:00.083771    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-sjrkr_2c3a4be4-9ee5-4e76-9047-c600284aec82/istio-proxy/0.log"
Jul 30 01:02:00.131093 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:02:00.131058    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-sjrkr_2c3a4be4-9ee5-4e76-9047-c600284aec82/istio-proxy/1.log"
Jul 30 01:02:00.161907 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:02:00.161856    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-8xmlm_e241e5ee-2fa2-4fb3-a8a2-e028fec62a89/payload-pre-processing/0.log"
Jul 30 01:02:00.207859 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:02:00.207834    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d4699ff7f-xg2hr_e1d50049-e6de-4aa9-80fc-457a51653449/router/0.log"
Jul 30 01:02:01.733876 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:02:01.733838    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59c4b4bfcf-6rm4r_0cb52402-a865-4042-bd66-cd5dbd55cbaf/kube-auth-proxy/0.log"
Jul 30 01:02:01.773777 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:02:01.773667    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-sjrkr_2c3a4be4-9ee5-4e76-9047-c600284aec82/istio-proxy/0.log"
Jul 30 01:02:01.826685 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:02:01.826644    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-sjrkr_2c3a4be4-9ee5-4e76-9047-c600284aec82/istio-proxy/1.log"
Jul 30 01:02:01.858076 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:02:01.858043    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-8xmlm_e241e5ee-2fa2-4fb3-a8a2-e028fec62a89/payload-pre-processing/0.log"
Jul 30 01:02:01.915028 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:02:01.914995    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d4699ff7f-xg2hr_e1d50049-e6de-4aa9-80fc-457a51653449/router/0.log"
Jul 30 01:02:05.098179 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:02:05.098139    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-gbjkc_61402020-403f-44d7-ab55-7d01ccb8d185/kube-storage-version-migrator-operator/1.log"
Jul 30 01:02:05.100086 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:02:05.100048    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-gbjkc_61402020-403f-44d7-ab55-7d01ccb8d185/kube-storage-version-migrator-operator/0.log"
Jul 30 01:02:06.036313 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:02:06.036282    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kzqq8_6e3c15d8-57fd-413b-bc96-74ee9feb2f8b/kube-multus-additional-cni-plugins/0.log"
Jul 30 01:02:06.059281 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:02:06.059254    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kzqq8_6e3c15d8-57fd-413b-bc96-74ee9feb2f8b/egress-router-binary-copy/0.log"
Jul 30 01:02:06.079796 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:02:06.079776    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kzqq8_6e3c15d8-57fd-413b-bc96-74ee9feb2f8b/cni-plugins/0.log"
Jul 30 01:02:06.100263 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:02:06.100237    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kzqq8_6e3c15d8-57fd-413b-bc96-74ee9feb2f8b/bond-cni-plugin/0.log"
Jul 30 01:02:06.120774 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:02:06.120757    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kzqq8_6e3c15d8-57fd-413b-bc96-74ee9feb2f8b/routeoverride-cni/0.log"
Jul 30 01:02:06.140156 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:02:06.140134    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kzqq8_6e3c15d8-57fd-413b-bc96-74ee9feb2f8b/whereabouts-cni-bincopy/0.log"
Jul 30 01:02:06.160358 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:02:06.160341    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kzqq8_6e3c15d8-57fd-413b-bc96-74ee9feb2f8b/whereabouts-cni/0.log"
Jul 30 01:02:06.539732 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:02:06.539701    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rwkfx_ee4035d2-1fba-4a57-ae6f-39b1010f098b/kube-multus/0.log"
Jul 30 01:02:06.648920 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:02:06.648887    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lj2rz_47b042b2-e9c2-45fd-ae41-9608eaf6aa4d/network-metrics-daemon/0.log"
Jul 30 01:02:06.663765 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:02:06.663736    2527 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lj2rz_47b042b2-e9c2-45fd-ae41-9608eaf6aa4d/kube-rbac-proxy/0.log"
Jul 30 01:02:06.848158 ip-10-0-137-198 kubenswrapper[2527]: I0730 01:02:06.848073    2527 scope.go:117] "RemoveContainer" containerID="5fa1ef75de106d404d6f7d845ad7cbe7fddfcc5d3d8ddc4af725032e37c590ad"