Sep 17 14:04:43.645170 ip-10-0-142-22 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 17 14:04:43.645183 ip-10-0-142-22 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 17 14:04:43.645193 ip-10-0-142-22 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 17 14:04:43.645417 ip-10-0-142-22 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 17 14:04:53.884745 ip-10-0-142-22 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 17 14:04:53.884759 ip-10-0-142-22 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 59906319461e459f84715c106c9cc13f --
Sep 17 14:06:51.276408 ip-10-0-142-22 systemd[1]: Starting Kubernetes Kubelet...
Sep 17 14:06:51.643200 ip-10-0-142-22 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 14:06:51.643200 ip-10-0-142-22 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 17 14:06:51.643200 ip-10-0-142-22 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 14:06:51.643200 ip-10-0-142-22 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 17 14:06:51.643200 ip-10-0-142-22 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 14:06:51.644013 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.643931    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 17 14:06:51.649059 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649042    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 14:06:51.649117 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649061    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 14:06:51.649117 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649066    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 14:06:51.649117 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649069    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 14:06:51.649117 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649072    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 14:06:51.649117 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649076    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 14:06:51.649117 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649078    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 14:06:51.649117 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649081    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 14:06:51.649117 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649084    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 14:06:51.649117 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649087    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 14:06:51.649117 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649090    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 14:06:51.649117 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649092    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 14:06:51.649117 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649111    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 14:06:51.649117 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649115    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 14:06:51.649117 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649118    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 14:06:51.649117 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649121    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 14:06:51.649117 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649124    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 14:06:51.649117 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649127    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 14:06:51.649520 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649130    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 14:06:51.649520 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649136    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 14:06:51.649520 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649139    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 14:06:51.649520 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649142    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 14:06:51.649520 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649144    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 14:06:51.649520 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649147    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 14:06:51.649520 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649149    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 14:06:51.649520 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649152    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 14:06:51.649520 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649155    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 14:06:51.649520 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649157    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 14:06:51.649520 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649160    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 14:06:51.649520 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649162    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 14:06:51.649520 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649165    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 14:06:51.649520 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649168    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 14:06:51.649520 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649170    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 14:06:51.649520 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649173    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 14:06:51.649520 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649175    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 14:06:51.649520 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649178    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 14:06:51.649520 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649180    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 14:06:51.649520 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649183    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 14:06:51.649999 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649185    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 14:06:51.649999 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649188    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 14:06:51.649999 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649190    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 14:06:51.649999 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649194    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 14:06:51.649999 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649196    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 14:06:51.649999 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649199    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 14:06:51.649999 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649201    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 14:06:51.649999 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649204    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 14:06:51.649999 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649206    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 14:06:51.649999 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649209    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 14:06:51.649999 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649211    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 14:06:51.649999 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649214    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 14:06:51.649999 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649217    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 14:06:51.649999 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649220    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 14:06:51.649999 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649224    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 14:06:51.649999 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649227    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 14:06:51.649999 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649230    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 14:06:51.649999 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649232    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 14:06:51.649999 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649235    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 14:06:51.649999 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649238    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 14:06:51.650499 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649241    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 14:06:51.650499 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649243    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 14:06:51.650499 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649246    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 14:06:51.650499 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649248    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 14:06:51.650499 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649252    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 14:06:51.650499 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649254    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 14:06:51.650499 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649257    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 14:06:51.650499 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649260    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 14:06:51.650499 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649263    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 14:06:51.650499 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649265    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 14:06:51.650499 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649268    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 14:06:51.650499 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649270    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 14:06:51.650499 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649273    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 14:06:51.650499 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649276    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 14:06:51.650499 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649279    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 14:06:51.650499 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649282    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 14:06:51.650499 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649284    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 14:06:51.650499 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649287    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 14:06:51.650499 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649291    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 14:06:51.650499 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649294    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 14:06:51.651001 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649297    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 14:06:51.651001 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649300    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 14:06:51.651001 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649302    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 14:06:51.651001 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649305    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 14:06:51.651001 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649308    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 14:06:51.651001 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649311    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 14:06:51.651001 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649314    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 14:06:51.651001 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649317    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 14:06:51.651001 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649319    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 14:06:51.651001 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649322    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 14:06:51.651001 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649325    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 14:06:51.651001 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649327    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 14:06:51.651001 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649330    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 14:06:51.651001 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649332    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 14:06:51.651001 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649335    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 14:06:51.651001 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649337    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 14:06:51.651001 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649340    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 14:06:51.651001 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649342    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 14:06:51.651001 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649345    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 14:06:51.651649 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649348    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 14:06:51.651649 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.649350    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 14:06:51.651649 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650032    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 14:06:51.651649 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650039    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 14:06:51.651649 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650042    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 14:06:51.651649 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650045    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 14:06:51.651649 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650048    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 14:06:51.651649 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650050    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 14:06:51.651649 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650054    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 14:06:51.651649 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650057    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 14:06:51.651649 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650060    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 14:06:51.651649 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650063    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 14:06:51.651649 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650066    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 14:06:51.651649 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650068    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 14:06:51.651649 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650071    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 14:06:51.651649 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650074    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 14:06:51.651649 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650076    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 14:06:51.651649 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650080    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 14:06:51.651649 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650083    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 14:06:51.651649 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650086    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 14:06:51.652238 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650088    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 14:06:51.652238 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650091    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 14:06:51.652238 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650109    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 14:06:51.652238 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650113    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 14:06:51.652238 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650115    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 14:06:51.652238 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650118    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 14:06:51.652238 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650120    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 14:06:51.652238 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650124    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 14:06:51.652238 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650127    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 14:06:51.652238 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650130    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 14:06:51.652238 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650132    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 14:06:51.652238 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650135    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 14:06:51.652238 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650138    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 14:06:51.652238 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650140    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 14:06:51.652238 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650143    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 14:06:51.652238 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650146    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 14:06:51.652238 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650148    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 14:06:51.652238 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650150    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 14:06:51.652238 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650153    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 14:06:51.652855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650156    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 14:06:51.652855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650158    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 14:06:51.652855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650161    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 14:06:51.652855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650164    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 14:06:51.652855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650167    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 14:06:51.652855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650170    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 14:06:51.652855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650173    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 14:06:51.652855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650175    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 14:06:51.652855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650177    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 14:06:51.652855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650180    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 14:06:51.652855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650184    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 14:06:51.652855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650187    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 14:06:51.652855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650190    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 14:06:51.652855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650192    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 14:06:51.652855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650195    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 14:06:51.652855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650198    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 14:06:51.652855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650201    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 14:06:51.652855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650204    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 14:06:51.652855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650206    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 14:06:51.652855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650209    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 14:06:51.653359 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650211    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 14:06:51.653359 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650215    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 14:06:51.653359 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650218    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 14:06:51.653359 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650220    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 14:06:51.653359 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650223    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 14:06:51.653359 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650225    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 14:06:51.653359 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650228    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 14:06:51.653359 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650231    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 14:06:51.653359 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650233    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 14:06:51.653359 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650236    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 14:06:51.653359 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650238    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 14:06:51.653359 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650241    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 14:06:51.653359 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650244    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 14:06:51.653359 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650246    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 14:06:51.653359 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650249    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 14:06:51.653359 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650255    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 14:06:51.653359 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650258    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 14:06:51.653359 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650261    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 14:06:51.653359 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650263    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 14:06:51.653359 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650266    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 14:06:51.653850 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650269    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 14:06:51.653850 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650271    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 14:06:51.653850 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650274    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 14:06:51.653850 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650278    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 14:06:51.653850 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650280    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 14:06:51.653850 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650283    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 14:06:51.653850 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650286    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 14:06:51.653850 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650288    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 14:06:51.653850 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650291    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 14:06:51.653850 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650294    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 14:06:51.653850 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650297    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 14:06:51.653850 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650299    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 14:06:51.653850 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650302    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 14:06:51.653850 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650304    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 14:06:51.653850 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650307    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 14:06:51.653850 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650311    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 14:06:51.653850 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650314    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 14:06:51.653850 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650319    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 14:06:51.653850 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650322    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 14:06:51.654322 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650325    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 14:06:51.654322 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650328    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 14:06:51.654322 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650331    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 14:06:51.654322 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650704    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 14:06:51.654322 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650710    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 14:06:51.654322 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650714    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 14:06:51.654322 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650717    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 14:06:51.654322 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650720    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 14:06:51.654322 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650725    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 14:06:51.654322 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650747    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 14:06:51.654322 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650751    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 14:06:51.654322 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650754    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 14:06:51.654322 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650757    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 14:06:51.654322 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650760    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 14:06:51.654322 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650763    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 14:06:51.654322 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650766    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 14:06:51.654322 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650769    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 14:06:51.654322 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650773    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 14:06:51.654322 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650777    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 14:06:51.654799 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650781    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 14:06:51.654799 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650784    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 14:06:51.654799 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650788    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 14:06:51.654799 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650791    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 14:06:51.654799 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650794    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 14:06:51.654799 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650797    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 14:06:51.654799 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650800    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 14:06:51.654799 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650803    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 14:06:51.654799 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650806    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 14:06:51.654799 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650808    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 14:06:51.654799 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650811    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 14:06:51.654799 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650813    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 14:06:51.654799 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650816    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 14:06:51.654799 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650818    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 14:06:51.654799 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650821    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 14:06:51.654799 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650824    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 14:06:51.654799 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650826    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 14:06:51.654799 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650828    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 14:06:51.654799 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650831    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 14:06:51.654799 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650833    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 14:06:51.655307 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650836    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 14:06:51.655307 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650840    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 14:06:51.655307 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650843    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 14:06:51.655307 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650845    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 14:06:51.655307 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650848    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 14:06:51.655307 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650850    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 14:06:51.655307 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650853    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 14:06:51.655307 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650856    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 14:06:51.655307 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650860    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 14:06:51.655307 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650863    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 14:06:51.655307 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650865    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 14:06:51.655307 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650868    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 14:06:51.655307 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650870    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 14:06:51.655307 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650873    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 14:06:51.655307 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650875    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 14:06:51.655307 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650878    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 14:06:51.655307 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650881    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 14:06:51.655307 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650883    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 14:06:51.655307 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650886    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 14:06:51.655307 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650906    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 14:06:51.655786 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650928    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 14:06:51.655786 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650933    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 14:06:51.655786 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650938    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 14:06:51.655786 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650942    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 14:06:51.655786 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650945    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 14:06:51.655786 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650948    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 14:06:51.655786 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650952    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 14:06:51.655786 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650956    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 14:06:51.655786 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650960    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 14:06:51.655786 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650968    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 14:06:51.655786 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650971    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 14:06:51.655786 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650973    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 14:06:51.655786 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650976    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 14:06:51.655786 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650979    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 14:06:51.655786 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650981    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 14:06:51.655786 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650984    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 14:06:51.655786 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650987    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 14:06:51.655786 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650989    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 14:06:51.655786 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650992    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 14:06:51.656269 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650996    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 14:06:51.656269 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.650999    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 14:06:51.656269 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.651002    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 14:06:51.656269 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.651005    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 14:06:51.656269 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.651007    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 14:06:51.656269 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.651012    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 14:06:51.656269 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.651015    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 14:06:51.656269 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.651018    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 14:06:51.656269 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.651021    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 14:06:51.656269 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.651024    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 14:06:51.656269 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.651026    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 14:06:51.656269 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.651029    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 14:06:51.656269 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.651032    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 14:06:51.656269 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.651035    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 14:06:51.656269 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.651038    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 14:06:51.656269 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.651041    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 14:06:51.656269 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.651043    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 14:06:51.656269 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.651046    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 14:06:51.656269 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.651049    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 14:06:51.656269 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.651051    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 14:06:51.656783 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.651054    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 14:06:51.656783 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.651057    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 14:06:51.656783 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.651059    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 14:06:51.656783 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.651062    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 14:06:51.656783 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.651310    2580 flags.go:64] FLAG: --address="0.0.0.0"
Sep 17 14:06:51.656783 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652288    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 17 14:06:51.656783 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652323    2580 flags.go:64] FLAG: --anonymous-auth="true"
Sep 17 14:06:51.656783 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652334    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 17 14:06:51.656783 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652455    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 17 14:06:51.656783 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652460    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 17 14:06:51.656783 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652464    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 17 14:06:51.656783 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652469    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 17 14:06:51.656783 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652472    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 17 14:06:51.656783 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652476    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 17 14:06:51.656783 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652479    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 17 14:06:51.656783 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652483    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 17 14:06:51.656783 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652486    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 17 14:06:51.656783 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652489    2580 flags.go:64] FLAG: --cgroup-root=""
Sep 17 14:06:51.656783 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652492    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 17 14:06:51.656783 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652495    2580 flags.go:64] FLAG: --client-ca-file=""
Sep 17 14:06:51.656783 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652498    2580 flags.go:64] FLAG: --cloud-provider="external"
Sep 17 14:06:51.656783 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652501    2580 flags.go:64] FLAG: --cluster-dns="[]"
Sep 17 14:06:51.656783 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652506    2580 flags.go:64] FLAG: --cluster-domain=""
Sep 17 14:06:51.656783 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652509    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 17 14:06:51.657406 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652512    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 17 14:06:51.657406 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652516    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 17 14:06:51.657406 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652519    2580 flags.go:64] FLAG: --container-log-max-files="5"
Sep 17 14:06:51.657406 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652523    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 17 14:06:51.657406 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652526    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 17 14:06:51.657406 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652529    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 17 14:06:51.657406 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652533    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 17 14:06:51.657406 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652536    2580 flags.go:64] FLAG: --contention-profiling="false"
Sep 17 14:06:51.657406 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652539    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 17 14:06:51.657406 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652542    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 17 14:06:51.657406 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652546    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 17 14:06:51.657406 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652549    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 17 14:06:51.657406 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652553    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 17 14:06:51.657406 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652556    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 17 14:06:51.657406 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652561    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 17 14:06:51.657406 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652564    2580 flags.go:64] FLAG: --enable-load-reader="false"
Sep 17 14:06:51.657406 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652567    2580 flags.go:64] FLAG: --enable-server="true"
Sep 17 14:06:51.657406 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652570    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 17 14:06:51.657406 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652576    2580 flags.go:64] FLAG: --event-burst="100"
Sep 17 14:06:51.657406 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652580    2580 flags.go:64] FLAG: --event-qps="50"
Sep 17 14:06:51.657406 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652583    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 17 14:06:51.657406 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652586    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 17 14:06:51.657406 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652589    2580 flags.go:64] FLAG: --eviction-hard=""
Sep 17 14:06:51.657406 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652601    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 17 14:06:51.657970 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652604    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 17 14:06:51.657970 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652608    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 17 14:06:51.657970 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652610    2580 flags.go:64] FLAG: --eviction-soft=""
Sep 17 14:06:51.657970 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652614    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 17 14:06:51.657970 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652617    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 17 14:06:51.657970 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652620    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 17 14:06:51.657970 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652623    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 17 14:06:51.657970 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652626    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 17 14:06:51.657970 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652629    2580 flags.go:64] FLAG: --fail-swap-on="true"
Sep 17 14:06:51.657970 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652632    2580 flags.go:64] FLAG: --feature-gates=""
Sep 17 14:06:51.657970 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652635    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 17 14:06:51.657970 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652639    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 17 14:06:51.657970 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652642    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 17 14:06:51.657970 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652645    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 17 14:06:51.657970 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652648    2580 flags.go:64] FLAG: --healthz-port="10248"
Sep 17 14:06:51.657970 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652651    2580 flags.go:64] FLAG: --help="false"
Sep 17 14:06:51.657970 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652654    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-142-22.ec2.internal"
Sep 17 14:06:51.657970 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652657    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 17 14:06:51.657970 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652661    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 17 14:06:51.657970 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652664    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 17 14:06:51.657970 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652668    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 17 14:06:51.657970 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652672    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 17 14:06:51.657970 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652675    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 17 14:06:51.657970 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652678    2580 flags.go:64] FLAG: --image-service-endpoint=""
Sep 17 14:06:51.658590 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652681    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 17 14:06:51.658590 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652684    2580 flags.go:64] FLAG: --kube-api-burst="100"
Sep 17 14:06:51.658590 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652687    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 17 14:06:51.658590 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652690    2580 flags.go:64] FLAG: --kube-api-qps="50"
Sep 17 14:06:51.658590 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652693    2580 flags.go:64] FLAG: --kube-reserved=""
Sep 17 14:06:51.658590 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652696    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 17 14:06:51.658590 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652699    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 17 14:06:51.658590 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652703    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 17 14:06:51.658590 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652706    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 17 14:06:51.658590 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652708    2580 flags.go:64] FLAG: --lock-file=""
Sep 17 14:06:51.658590 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652711    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 17 14:06:51.658590 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652714    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 17 14:06:51.658590 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652717    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 17 14:06:51.658590 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652723    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 17 14:06:51.658590 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652726    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 17 14:06:51.658590 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652729    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 17 14:06:51.658590 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652731    2580 flags.go:64] FLAG: --logging-format="text"
Sep 17 14:06:51.658590 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652734    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 17 14:06:51.658590 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652738    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 17 14:06:51.658590 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652741    2580 flags.go:64] FLAG: --manifest-url=""
Sep 17 14:06:51.658590 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652744    2580 flags.go:64] FLAG: --manifest-url-header=""
Sep 17 14:06:51.658590 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652749    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 17 14:06:51.658590 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652755    2580 flags.go:64] FLAG: --max-open-files="1000000"
Sep 17 14:06:51.658590 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652759    2580 flags.go:64] FLAG: --max-pods="110"
Sep 17 14:06:51.658590 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652762    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 17 14:06:51.659234 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652765    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 17 14:06:51.659234 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652768    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 17 14:06:51.659234 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652771    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 17 14:06:51.659234 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652774    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 17 14:06:51.659234 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652777    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 17 14:06:51.659234 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652781    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 17 14:06:51.659234 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652789    2580 flags.go:64] FLAG: --node-status-max-images="50"
Sep 17 14:06:51.659234 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652792    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 17 14:06:51.659234 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652795    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 17 14:06:51.659234 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652798    2580 flags.go:64] FLAG: --pod-cidr=""
Sep 17 14:06:51.659234 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652801    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 17 14:06:51.659234 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652806    2580 flags.go:64] FLAG: --pod-manifest-path=""
Sep 17 14:06:51.659234 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652809    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 17 14:06:51.659234 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652812    2580 flags.go:64] FLAG: --pods-per-core="0"
Sep 17 14:06:51.659234 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652815    2580 flags.go:64] FLAG: --port="10250"
Sep 17 14:06:51.659234 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652818    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 17 14:06:51.659234 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652821    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0119b5579dadb365d"
Sep 17 14:06:51.659234 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652824    2580 flags.go:64] FLAG: --qos-reserved=""
Sep 17 14:06:51.659234 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652828    2580 flags.go:64] FLAG: --read-only-port="10255"
Sep 17 14:06:51.659234 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652831    2580 flags.go:64] FLAG: --register-node="true"
Sep 17 14:06:51.659234 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652834    2580 flags.go:64] FLAG: --register-with-taints=""
Sep 17 14:06:51.659234 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652837    2580 flags.go:64] FLAG: --registry-burst="10"
Sep 17 14:06:51.659234 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652840    2580 flags.go:64] FLAG: --registry-qps="5"
Sep 17 14:06:51.659234 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652853    2580 flags.go:64] FLAG: --reserved-cpus=""
Sep 17 14:06:51.659823 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652856    2580 flags.go:64] FLAG: --reserved-memory=""
Sep 17 14:06:51.659823 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652861    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 17 14:06:51.659823 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652864    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 17 14:06:51.659823 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652867    2580 flags.go:64] FLAG: --rotate-certificates="false"
Sep 17 14:06:51.659823 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652870    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 17 14:06:51.659823 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652875    2580 flags.go:64] FLAG: --runonce="false"
Sep 17 14:06:51.659823 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652877    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 17 14:06:51.659823 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652881    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 17 14:06:51.659823 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652884    2580 flags.go:64] FLAG: --seccomp-default="false"
Sep 17 14:06:51.659823 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652887    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 17 14:06:51.659823 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652890    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 17 14:06:51.659823 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652894    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 17 14:06:51.659823 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652897    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 17 14:06:51.659823 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652900    2580 flags.go:64] FLAG: --storage-driver-password="root"
Sep 17 14:06:51.659823 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652903    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 17 14:06:51.659823 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652906    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 17 14:06:51.659823 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652909    2580 flags.go:64] FLAG: --storage-driver-user="root"
Sep 17 14:06:51.659823 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652912    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 17 14:06:51.659823 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652915    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 17 14:06:51.659823 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652917    2580 flags.go:64] FLAG: --system-cgroups=""
Sep 17 14:06:51.659823 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652920    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 17 14:06:51.659823 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652927    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 17 14:06:51.659823 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652929    2580 flags.go:64] FLAG: --tls-cert-file=""
Sep 17 14:06:51.659823 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652932    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 17 14:06:51.659823 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652936    2580 flags.go:64] FLAG: --tls-min-version=""
Sep 17 14:06:51.660472 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652939    2580 flags.go:64] FLAG: --tls-private-key-file=""
Sep 17 14:06:51.660472 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652942    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 17 14:06:51.660472 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652945    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 17 14:06:51.660472 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652947    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 17 14:06:51.660472 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652950    2580 flags.go:64] FLAG: --v="2"
Sep 17 14:06:51.660472 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652954    2580 flags.go:64] FLAG: --version="false"
Sep 17 14:06:51.660472 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652958    2580 flags.go:64] FLAG: --vmodule=""
Sep 17 14:06:51.660472 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652962    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 17 14:06:51.660472 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.652966    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 17 14:06:51.660472 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653082    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 14:06:51.660472 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653086    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 14:06:51.660472 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653090    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 14:06:51.660472 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653093    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 14:06:51.660472 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653110    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 14:06:51.660472 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653114    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 14:06:51.660472 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653118    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 14:06:51.660472 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653122    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 14:06:51.660472 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653126    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 14:06:51.660472 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653128    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 14:06:51.660472 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653132    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 14:06:51.660472 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653135    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 14:06:51.660472 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653137    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 14:06:51.661002 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653140    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 14:06:51.661002 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653143    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 14:06:51.661002 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653146    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 14:06:51.661002 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653148    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 14:06:51.661002 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653151    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 14:06:51.661002 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653154    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 14:06:51.661002 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653157    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 14:06:51.661002 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653159    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 14:06:51.661002 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653162    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 14:06:51.661002 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653164    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 14:06:51.661002 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653169    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 14:06:51.661002 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653172    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 14:06:51.661002 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653175    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 14:06:51.661002 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653178    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 14:06:51.661002 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653181    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 14:06:51.661002 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653184    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 14:06:51.661002 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653187    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 14:06:51.661002 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653190    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 14:06:51.661002 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653193    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 14:06:51.661485 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653195    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 14:06:51.661485 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653198    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 14:06:51.661485 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653201    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 14:06:51.661485 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653203    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 14:06:51.661485 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653206    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 14:06:51.661485 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653209    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 14:06:51.661485 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653211    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 14:06:51.661485 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653214    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 14:06:51.661485 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653217    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 14:06:51.661485 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653221    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 14:06:51.661485 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653225    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 14:06:51.661485 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653227    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 14:06:51.661485 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653230    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 14:06:51.661485 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653233    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 14:06:51.661485 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653235    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 14:06:51.661485 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653238    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 14:06:51.661485 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653241    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 14:06:51.661485 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653243    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 14:06:51.661485 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653246    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 14:06:51.661485 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653248    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 14:06:51.661960 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653251    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 14:06:51.661960 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653254    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 14:06:51.661960 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653256    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 14:06:51.661960 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653259    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 14:06:51.661960 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653261    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 14:06:51.661960 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653264    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 14:06:51.661960 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653267    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 14:06:51.661960 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653269    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 14:06:51.661960 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653272    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 14:06:51.661960 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653274    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 14:06:51.661960 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653277    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 14:06:51.661960 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653279    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 14:06:51.661960 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653282    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 14:06:51.661960 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653285    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 14:06:51.661960 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653288    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 14:06:51.661960 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653290    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 14:06:51.661960 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653293    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 14:06:51.661960 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653295    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 14:06:51.661960 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653298    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 14:06:51.661960 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653300    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 14:06:51.662483 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653303    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 14:06:51.662483 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653306    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 14:06:51.662483 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653309    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 14:06:51.662483 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653311    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 14:06:51.662483 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653314    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 14:06:51.662483 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653316    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 14:06:51.662483 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653319    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 14:06:51.662483 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653321    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 14:06:51.662483 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653324    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 14:06:51.662483 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653326    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 14:06:51.662483 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653329    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 14:06:51.662483 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653331    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 14:06:51.662483 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653334    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 14:06:51.662483 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653336    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 14:06:51.662483 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653339    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 14:06:51.662483 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653341    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 14:06:51.662483 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653344    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 14:06:51.662483 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653347    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 14:06:51.662483 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653350    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 14:06:51.662483 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653352    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 14:06:51.662979 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653356    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 14:06:51.662979 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653360    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 14:06:51.662979 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653363    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 14:06:51.662979 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653367    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 14:06:51.662979 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653370    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 14:06:51.662979 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653373    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 14:06:51.662979 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.653378    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 14:06:51.662979 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.653899    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 14:06:51.662979 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.660650    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 17 14:06:51.662979 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.660664    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 17 14:06:51.662979 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.660677    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 17 14:06:51.662979 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.660686    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 17 14:06:51.662979 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660748    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 14:06:51.662979 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660752    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 14:06:51.663338 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660756    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 14:06:51.663338 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660759    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 14:06:51.663338 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660762    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 14:06:51.663338 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660765    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 14:06:51.663338 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660768    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 14:06:51.663338 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660772    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 14:06:51.663338 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660776    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 14:06:51.663338 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660779    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 14:06:51.663338 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660782    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 14:06:51.663338 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660784    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 14:06:51.663338 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660787    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 14:06:51.663338 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660790    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 14:06:51.663338 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660793    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 14:06:51.663338 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660795    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 14:06:51.663338 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660798    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 14:06:51.663338 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660801    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 14:06:51.663338 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660803    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 14:06:51.663338 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660806    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 14:06:51.663338 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660808    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 14:06:51.663338 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660811    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 14:06:51.663855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660814    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 14:06:51.663855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660816    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 14:06:51.663855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660819    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 14:06:51.663855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660822    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 14:06:51.663855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660825    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 14:06:51.663855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660827    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 14:06:51.663855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660830    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 14:06:51.663855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660834    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 14:06:51.663855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660837    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 14:06:51.663855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660839    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 14:06:51.663855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660842    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 14:06:51.663855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660845    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 14:06:51.663855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660847    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 14:06:51.663855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660850    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 14:06:51.663855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660852    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 14:06:51.663855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660855    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 14:06:51.663855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660857    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 14:06:51.663855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660860    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 14:06:51.663855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660863    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 14:06:51.663855 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660865    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 14:06:51.664347 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660868    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 14:06:51.664347 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660870    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 14:06:51.664347 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660873    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 14:06:51.664347 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660876    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 14:06:51.664347 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660878    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 14:06:51.664347 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660881    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 14:06:51.664347 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660883    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 14:06:51.664347 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660886    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 14:06:51.664347 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660888    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 14:06:51.664347 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660891    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 14:06:51.664347 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660894    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 14:06:51.664347 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660896    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 14:06:51.664347 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660899    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 14:06:51.664347 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660902    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 14:06:51.664347 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660905    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 14:06:51.664347 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660907    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 14:06:51.664347 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660910    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 14:06:51.664347 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660913    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 14:06:51.664347 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660915    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 14:06:51.664347 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660918    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 14:06:51.664832 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660921    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 14:06:51.664832 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660924    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 14:06:51.664832 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660926    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 14:06:51.664832 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660929    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 14:06:51.664832 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660932    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 14:06:51.664832 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660937    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 14:06:51.664832 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660941    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 14:06:51.664832 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660944    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 14:06:51.664832 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660947    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 14:06:51.664832 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660950    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 14:06:51.664832 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660953    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 14:06:51.664832 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660956    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 14:06:51.664832 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660959    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 14:06:51.664832 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660962    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 14:06:51.664832 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660965    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 14:06:51.664832 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660967    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 14:06:51.664832 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660970    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 14:06:51.664832 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660973    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 14:06:51.664832 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660975    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 14:06:51.665310 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660978    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 14:06:51.665310 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660980    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 14:06:51.665310 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660983    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 14:06:51.665310 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660986    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 14:06:51.665310 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660988    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 14:06:51.665310 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660991    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 14:06:51.665310 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660994    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 14:06:51.665310 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.660998    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 14:06:51.665310 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661001    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 14:06:51.665310 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661004    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 14:06:51.665310 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661007    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 14:06:51.665310 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661010    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 14:06:51.665310 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661013    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 14:06:51.665310 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661016    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 14:06:51.665310 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661019    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 14:06:51.665310 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661021    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 14:06:51.665310 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661024    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 14:06:51.665310 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661027    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 14:06:51.665744 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.661032    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 14:06:51.665744 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661163    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 14:06:51.665744 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661168    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 14:06:51.665744 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661171    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 14:06:51.665744 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661174    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 14:06:51.665744 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661177    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 14:06:51.665744 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661182    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 14:06:51.665744 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661185    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 14:06:51.665744 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661188    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 14:06:51.665744 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661191    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 14:06:51.665744 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661194    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 14:06:51.665744 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661196    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 14:06:51.665744 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661199    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 14:06:51.665744 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661202    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 14:06:51.665744 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661204    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 14:06:51.666245 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661207    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 14:06:51.666245 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661209    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 14:06:51.666245 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661212    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 14:06:51.666245 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661215    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 14:06:51.666245 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661217    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 14:06:51.666245 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661220    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 14:06:51.666245 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661222    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 14:06:51.666245 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661225    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 14:06:51.666245 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661228    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 14:06:51.666245 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661230    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 14:06:51.666245 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661233    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 14:06:51.666245 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661236    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 14:06:51.666245 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661239    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 14:06:51.666245 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661241    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 14:06:51.666245 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661244    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 14:06:51.666245 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661246    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 14:06:51.666245 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661249    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 14:06:51.666245 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661251    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 14:06:51.666245 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661254    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 14:06:51.666245 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661256    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 14:06:51.666740 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661259    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 14:06:51.666740 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661261    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 14:06:51.666740 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661264    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 14:06:51.666740 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661266    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 14:06:51.666740 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661268    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 14:06:51.666740 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661272    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 14:06:51.666740 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661276    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 14:06:51.666740 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661279    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 14:06:51.666740 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661281    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 14:06:51.666740 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661284    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 14:06:51.666740 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661287    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 14:06:51.666740 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661290    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 14:06:51.666740 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661293    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 14:06:51.666740 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661295    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 14:06:51.666740 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661298    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 14:06:51.666740 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661301    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 14:06:51.666740 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661304    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 14:06:51.666740 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661307    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 14:06:51.666740 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661311    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 14:06:51.667222 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661314    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 14:06:51.667222 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661317    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 14:06:51.667222 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661319    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 14:06:51.667222 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661322    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 14:06:51.667222 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661326    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 14:06:51.667222 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661329    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 14:06:51.667222 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661331    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 14:06:51.667222 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661334    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 14:06:51.667222 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661336    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 14:06:51.667222 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661339    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 14:06:51.667222 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661341    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 14:06:51.667222 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661344    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 14:06:51.667222 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661346    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 14:06:51.667222 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661349    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 14:06:51.667222 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661351    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 14:06:51.667222 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661354    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 14:06:51.667222 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661356    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 14:06:51.667222 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661359    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 14:06:51.667222 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661361    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 14:06:51.667222 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661363    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 14:06:51.667705 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661366    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 14:06:51.667705 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661368    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 14:06:51.667705 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661371    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 14:06:51.667705 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661373    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 14:06:51.667705 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661376    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 14:06:51.667705 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661378    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 14:06:51.667705 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661381    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 14:06:51.667705 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661383    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 14:06:51.667705 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661386    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 14:06:51.667705 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661388    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 14:06:51.667705 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661391    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 14:06:51.667705 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661393    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 14:06:51.667705 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661396    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 14:06:51.667705 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661399    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 14:06:51.667705 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661401    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 14:06:51.667705 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661403    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 14:06:51.667705 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661407    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 14:06:51.667705 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661409    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 14:06:51.667705 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661412    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 14:06:51.667705 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661415    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 14:06:51.668189 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661417    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 14:06:51.668189 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661420    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 14:06:51.668189 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661422    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 14:06:51.668189 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661425    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 14:06:51.668189 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661427    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 14:06:51.668189 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:51.661430    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 14:06:51.668189 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.661435    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 14:06:51.668189 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.661533    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 17 14:06:51.668189 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.663374    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 17 14:06:51.668189 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.664083    2580 server.go:1019] "Starting client certificate rotation"
Sep 17 14:06:51.668189 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.664194    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 14:06:51.668189 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.664234    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 14:06:51.668189 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.666929    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 14:06:51.669796 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.669782    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 14:06:51.684350 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.684329    2580 log.go:25] "Validated CRI v1 runtime API"
Sep 17 14:06:51.688847 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.688825    2580 log.go:25] "Validated CRI v1 image API"
Sep 17 14:06:51.690135 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.690118    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 17 14:06:51.693340 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.693317    2580 fs.go:135] Filesystem UUIDs: map[4842134c-af03-4747-88fb-252db7d803b4:/dev/nvme0n1p3 4fca9e9c-f4d8-49be-ae94-4d718c0c2c1e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Sep 17 14:06:51.693417 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.693339    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 17 14:06:51.699313 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.699199    2580 manager.go:216] Machine: {Timestamp:2026-09-17 14:06:51.697254321 +0000 UTC m=+0.312943829 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098178 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ef7380056e6ec6a177e75fe9c9a5b SystemUUID:ec2ef738-0056-e6ec-6a17-7e75fe9c9a5b BootID:59906319-461e-459f-8471-5c106c9cc13f Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:eb:4f:ba:d1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:eb:4f:ba:d1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:86:b3:0e:fe:06 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 17 14:06:51.699313 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.699312    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 17 14:06:51.699423 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.699392    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 17 14:06:51.702869 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.702844    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 17 14:06:51.703043 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.702871    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-22.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 17 14:06:51.703124 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.703109    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 14:06:51.704393 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.704382    2580 topology_manager.go:138] "Creating topology manager with none policy"
Sep 17 14:06:51.704478 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.704396    2580 container_manager_linux.go:309] "Creating device plugin manager"
Sep 17 14:06:51.704478 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.704404    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 14:06:51.704956 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.704946    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 14:06:51.705691 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.705681    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 17 14:06:51.709634 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.709622    2580 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 14:06:51.709743 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.709734    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 17 14:06:51.709780 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.709764    2580 kubelet.go:486] "Attempting to sync node with API server"
Sep 17 14:06:51.709780 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.709773    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 17 14:06:51.709860 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.709786    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 17 14:06:51.709860 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.709796    2580 kubelet.go:398] "Adding apiserver pod source"
Sep 17 14:06:51.709860 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.709804    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 17 14:06:51.710178 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.710166    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 14:06:51.710218 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.710187    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 14:06:51.712317 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.712300    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 17 14:06:51.714811 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.714797    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 17 14:06:51.714872 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.714827    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 17 14:06:51.716321 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.716307    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 17 14:06:51.716321 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.716324    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 17 14:06:51.716436 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.716332    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 17 14:06:51.716436 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.716337    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 17 14:06:51.716436 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.716347    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 17 14:06:51.716436 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.716353    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 17 14:06:51.716436 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.716366    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 17 14:06:51.716436 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.716371    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 17 14:06:51.716436 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.716377    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 17 14:06:51.716436 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.716383    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 17 14:06:51.716436 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.716401    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 17 14:06:51.716436 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.716406    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 17 14:06:51.717466 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.717456    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 17 14:06:51.717466 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.717464    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 17 14:06:51.721197 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.721184    2580 server.go:1268] "Started kubelet"
Sep 17 14:06:51.721292 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.721261    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 17 14:06:51.721292 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.721277    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 17 14:06:51.721381 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.721332    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 17 14:06:51.722080 ip-10-0-142-22 systemd[1]: Started Kubernetes Kubelet.
Sep 17 14:06:51.722924 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:51.722900    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 17 14:06:51.722987 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.722924    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-22.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 17 14:06:51.722987 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:51.722899    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-22.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 17 14:06:51.727687 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.727667    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 17 14:06:51.728712 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.728476    2580 server.go:310] "Adding debug handlers to kubelet server"
Sep 17 14:06:51.729797 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:51.729775    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 17 14:06:51.732184 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:51.731328    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-22.ec2.internal.18d620d7777e0b82  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-22.ec2.internal,UID:ip-10-0-142-22.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-22.ec2.internal,},FirstTimestamp:2026-09-17 14:06:51.721157506 +0000 UTC m=+0.336847004,LastTimestamp:2026-09-17 14:06:51.721157506 +0000 UTC m=+0.336847004,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-22.ec2.internal,}"
Sep 17 14:06:51.733219 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.733199    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 17 14:06:51.733670 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.733654    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 17 14:06:51.733768 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:51.733748    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-22.ec2.internal\" not found"
Sep 17 14:06:51.734190 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.734173    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 17 14:06:51.734190 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.734176    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 17 14:06:51.734331 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.734200    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 17 14:06:51.734331 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.734278    2580 reconstruct.go:97] "Volume reconstruction finished"
Sep 17 14:06:51.734331 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.734287    2580 reconciler.go:29] "Reconciler: start to sync state"
Sep 17 14:06:51.735162 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.735145    2580 factory.go:55] Registering systemd factory
Sep 17 14:06:51.735162 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.735164    2580 factory.go:223] Registration of the systemd container factory successfully
Sep 17 14:06:51.735398 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.735380    2580 factory.go:153] Registering CRI-O factory
Sep 17 14:06:51.735398 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.735398    2580 factory.go:223] Registration of the crio container factory successfully
Sep 17 14:06:51.735533 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.735441    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 17 14:06:51.735533 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.735455    2580 factory.go:103] Registering Raw factory
Sep 17 14:06:51.735533 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.735469    2580 manager.go:1196] Started watching for new ooms in manager
Sep 17 14:06:51.735815 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.735802    2580 manager.go:349] Starting recovery of all containers
Sep 17 14:06:51.745314 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.745157    2580 manager.go:354] Recovery completed
Sep 17 14:06:51.745580 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:51.745549    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-22.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 17 14:06:51.746063 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:51.746040    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 17 14:06:51.747114 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.747080    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7rvf6"
Sep 17 14:06:51.750506 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.750486    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 14:06:51.760518 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.760500    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 14:06:51.760597 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.760533    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 14:06:51.760597 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.760547    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasSufficientPID"
Sep 17 14:06:51.761147 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.761133    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 17 14:06:51.761194 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.761148    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 17 14:06:51.761194 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.761137    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 14:06:51.761194 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.761166    2580 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 14:06:51.761949 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.761934    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 14:06:51.762002 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.761960    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 14:06:51.762002 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.761972    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasSufficientPID"
Sep 17 14:06:51.762395 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.762382    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7rvf6"
Sep 17 14:06:51.764499 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:51.764418    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-22.ec2.internal.18d620d779d69e33  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-22.ec2.internal,UID:ip-10-0-142-22.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-22.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-22.ec2.internal,},FirstTimestamp:2026-09-17 14:06:51.760516659 +0000 UTC m=+0.376206156,LastTimestamp:2026-09-17 14:06:51.760516659 +0000 UTC m=+0.376206156,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-22.ec2.internal,}"
Sep 17 14:06:51.834370 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:51.834340    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-22.ec2.internal\" not found"
Sep 17 14:06:51.902498 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.902412    2580 policy_none.go:49] "None policy: Start"
Sep 17 14:06:51.902498 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.902440    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 17 14:06:51.902498 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.902452    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 17 14:06:51.903523 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.903510    2580 policy_none.go:47] "Start"
Sep 17 14:06:51.934563 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:51.934539    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-22.ec2.internal\" not found"
Sep 17 14:06:51.934735 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.934720    2580 manager.go:337] "Starting Device Plugin manager"
Sep 17 14:06:51.934803 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:51.934768    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 17 14:06:51.934803 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.934783    2580 server.go:87] "Starting device plugin registration server"
Sep 17 14:06:51.935156 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.935143    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 17 14:06:51.935224 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.935158    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 17 14:06:51.935276 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.935253    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 17 14:06:51.935338 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.935328    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 17 14:06:51.935338 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.935338    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 17 14:06:51.935920 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:51.935898    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 17 14:06:51.935994 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:51.935948    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-22.ec2.internal\" not found"
Sep 17 14:06:51.953711 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:51.953693    2580 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-22.ec2.internal\" not found" node="ip-10-0-142-22.ec2.internal"
Sep 17 14:06:51.997281 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.997255    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 17 14:06:51.998457 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.998440    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 17 14:06:51.998529 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.998497    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 17 14:06:51.998529 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:51.998527    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 17 14:06:51.998639 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:51.998625    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 17 14:06:52.001500 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:52.001479    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 14:06:52.035953 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:52.035934    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 14:06:52.037015 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:52.037000    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 14:06:52.037085 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:52.037029    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 14:06:52.037085 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:52.037042    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasSufficientPID"
Sep 17 14:06:52.037085 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:52.037065    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-22.ec2.internal"
Sep 17 14:06:52.051294 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:52.051273    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-22.ec2.internal"
Sep 17 14:06:52.051377 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:52.051300    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-22.ec2.internal\": node \"ip-10-0-142-22.ec2.internal\" not found"
Sep 17 14:06:52.098897 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:52.098873    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-22.ec2.internal"]
Sep 17 14:06:52.099006 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:52.098941    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 14:06:52.099867 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:52.099845    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 14:06:52.099966 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:52.099879    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 14:06:52.099966 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:52.099894    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasSufficientPID"
Sep 17 14:06:52.101155 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:52.101140    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 14:06:52.101248 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:52.101234    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal"
Sep 17 14:06:52.101295 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:52.101268    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 14:06:52.101839 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:52.101825    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 14:06:52.101891 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:52.101854    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 14:06:52.101891 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:52.101857    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 14:06:52.101891 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:52.101869    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasSufficientPID"
Sep 17 14:06:52.101891 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:52.101877    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 14:06:52.101891 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:52.101889    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasSufficientPID"
Sep 17 14:06:52.103279 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:52.103266    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-22.ec2.internal"
Sep 17 14:06:52.103328 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:52.103290    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 14:06:52.103911 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:52.103899    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 14:06:52.103968 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:52.103916    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 14:06:52.103968 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:52.103926    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasSufficientPID"
Sep 17 14:06:52.128727 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:52.128710    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-22.ec2.internal\" not found" node="ip-10-0-142-22.ec2.internal"
Sep 17 14:06:52.132958 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:52.132942    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-22.ec2.internal\" not found" node="ip-10-0-142-22.ec2.internal"
Sep 17 14:06:52.235888 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:52.235801    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e7dbc191af6a805aa5ecdfa53b74162f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal\" (UID: \"e7dbc191af6a805aa5ecdfa53b74162f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal"
Sep 17 14:06:52.235888 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:52.235835    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7dbc191af6a805aa5ecdfa53b74162f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal\" (UID: \"e7dbc191af6a805aa5ecdfa53b74162f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal"
Sep 17 14:06:52.235888 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:52.235861    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e37420b5f4f2cfdf85c1d60d1139054c-config\") pod \"kube-apiserver-proxy-ip-10-0-142-22.ec2.internal\" (UID: \"e37420b5f4f2cfdf85c1d60d1139054c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-22.ec2.internal"
Sep 17 14:06:52.261639 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:52.261615    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-22.ec2.internal\" not found"
Sep 17 14:06:53.508453 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:53.508430    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7dbc191af6a805aa5ecdfa53b74162f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal\" (UID: \"e7dbc191af6a805aa5ecdfa53b74162f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal"
Sep 17 14:06:53.508453 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:53.508461    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e37420b5f4f2cfdf85c1d60d1139054c-config\") pod \"kube-apiserver-proxy-ip-10-0-142-22.ec2.internal\" (UID: \"e37420b5f4f2cfdf85c1d60d1139054c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-22.ec2.internal"
Sep 17 14:06:53.508628 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:53.508476    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e7dbc191af6a805aa5ecdfa53b74162f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal\" (UID: \"e7dbc191af6a805aa5ecdfa53b74162f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal"
Sep 17 14:06:53.508628 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:53.508515    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e7dbc191af6a805aa5ecdfa53b74162f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal\" (UID: \"e7dbc191af6a805aa5ecdfa53b74162f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal"
Sep 17 14:06:53.508628 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:53.508549    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7dbc191af6a805aa5ecdfa53b74162f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal\" (UID: \"e7dbc191af6a805aa5ecdfa53b74162f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal"
Sep 17 14:06:53.508628 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:53.508553    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e37420b5f4f2cfdf85c1d60d1139054c-config\") pod \"kube-apiserver-proxy-ip-10-0-142-22.ec2.internal\" (UID: \"e37420b5f4f2cfdf85c1d60d1139054c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-22.ec2.internal"
Sep 17 14:06:53.534202 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:53.534160    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-22.ec2.internal\" not found"
Sep 17 14:06:53.602557 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:53.602528    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal"
Sep 17 14:06:53.607673 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:53.607653    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-22.ec2.internal"
Sep 17 14:06:53.634546 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:53.634519    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-22.ec2.internal\" not found"
Sep 17 14:06:53.735457 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:53.735417    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-22.ec2.internal\" not found"
Sep 17 14:06:53.835999 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:53.835968    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 17 14:06:53.836458 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:53.835980    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-22.ec2.internal\" not found"
Sep 17 14:06:53.836458 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:53.836129    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 14:06:53.936126 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:53.936090    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-22.ec2.internal\" not found"
Sep 17 14:06:53.938360 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:53.938324    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 14:01:52 +0000 UTC" deadline="2028-05-07 14:45:27.112676497 +0000 UTC"
Sep 17 14:06:53.938410 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:53.938360    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14352h38m33.17431919s"
Sep 17 14:06:53.966784 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:53.966756    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 14:06:54.007924 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.007859    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 14:06:54.010892 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.010877    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 14:06:54.011820 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.011805    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 14:06:54.011877 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.011835    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 14:06:54.011877 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.011847    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeHasSufficientPID"
Sep 17 14:06:54.036777 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:54.036750    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-22.ec2.internal\" not found"
Sep 17 14:06:54.137492 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:54.137465    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-22.ec2.internal\" not found"
Sep 17 14:06:54.232280 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:54.232243    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode37420b5f4f2cfdf85c1d60d1139054c.slice/crio-e62d368c871ddd3452ebc206b1ba0ae12238b19330c5b4bced6786cb4e15bd9d WatchSource:0}: Error finding container e62d368c871ddd3452ebc206b1ba0ae12238b19330c5b4bced6786cb4e15bd9d: Status 404 returned error can't find the container with id e62d368c871ddd3452ebc206b1ba0ae12238b19330c5b4bced6786cb4e15bd9d
Sep 17 14:06:54.235224 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.235202    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 14:06:54.237972 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:54.237954    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-22.ec2.internal\" not found"
Sep 17 14:06:54.261653 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.261591    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 14:06:54.305533 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.305488    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal"
Sep 17 14:06:54.325690 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.325667    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 14:06:54.326659 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.326645    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-22.ec2.internal"
Sep 17 14:06:54.351404 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.351381    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 14:06:54.811263 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:54.811226    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7dbc191af6a805aa5ecdfa53b74162f.slice/crio-251fa4f7754d8bf96afc9ed7f8e30aba1c3fb16afb14dac0a6c8af99469458f5 WatchSource:0}: Error finding container 251fa4f7754d8bf96afc9ed7f8e30aba1c3fb16afb14dac0a6c8af99469458f5: Status 404 returned error can't find the container with id 251fa4f7754d8bf96afc9ed7f8e30aba1c3fb16afb14dac0a6c8af99469458f5
Sep 17 14:06:54.882423 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.882398    2580 apiserver.go:52] "Watching apiserver"
Sep 17 14:06:54.893567 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.893537    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 17 14:06:54.894999 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.894973    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-22.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx678","openshift-image-registry/node-ca-6cb9l","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal","openshift-multus/multus-additional-cni-plugins-w6p4f","openshift-network-operator/iptables-alerter-czxpz","kube-system/global-pull-secret-syncer-g2wf7","kube-system/konnectivity-agent-j4k9b","openshift-cluster-node-tuning-operator/tuned-9m7cc","openshift-dns/node-resolver-cjdbx","openshift-multus/multus-chbsn","openshift-multus/network-metrics-daemon-pjjpc","openshift-network-diagnostics/network-check-target-wcn9n","openshift-ovn-kubernetes/ovnkube-node-9f67m"]
Sep 17 14:06:54.896467 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.896442    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cjdbx"
Sep 17 14:06:54.897494 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.897468    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcn9n"
Sep 17 14:06:54.897570 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:54.897540    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcn9n" podUID="5b426312-6745-47b1-a19b-4d3ffb91c5af"
Sep 17 14:06:54.898586 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.898564    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6cb9l"
Sep 17 14:06:54.899952 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.899932    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:54.900031 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.900012    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 17 14:06:54.900446 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.900419    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5tcgh\""
Sep 17 14:06:54.900764 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.900746    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 17 14:06:54.901353 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.901331    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w6p4f"
Sep 17 14:06:54.902553 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.902531    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-czxpz"
Sep 17 14:06:54.904347 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.904081    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:54.905310 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.905208    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 17 14:06:54.905310 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.905219    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:06:54.905310 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:54.905274    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wf7" podUID="2da17ddd-8912-4e47-af0f-dc90e7aef2e7"
Sep 17 14:06:54.906479 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.906462    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx678"
Sep 17 14:06:54.907923 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.907905    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j4k9b"
Sep 17 14:06:54.909325 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.909307    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-chbsn"
Sep 17 14:06:54.910032 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.910017    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 17 14:06:54.910169 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.910156    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 17 14:06:54.910777 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.910759    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:06:54.910846 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:54.910830    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjjpc" podUID="59c1fc39-6669-462c-9a66-c97b5357d8ac"
Sep 17 14:06:54.910884 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.910837    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-px4kj\""
Sep 17 14:06:54.911513 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.911496    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 17 14:06:54.912256 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.912228    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bb8x9\""
Sep 17 14:06:54.912256 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.912232    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 17 14:06:54.915104 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.915085    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5nhw\" (UniqueName: \"kubernetes.io/projected/3005c93a-df5e-4bc3-9644-0f24121516bb-kube-api-access-b5nhw\") pod \"iptables-alerter-czxpz\" (UID: \"3005c93a-df5e-4bc3-9644-0f24121516bb\") " pod="openshift-network-operator/iptables-alerter-czxpz"
Sep 17 14:06:54.915210 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.915122    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-etc-sysctl-d\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:54.915210 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.915146    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-sys\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:54.915210 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.915191    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f70452dc-7b40-4964-ba77-7825835571cf-ovnkube-script-lib\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:54.915331 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.915265    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2da17ddd-8912-4e47-af0f-dc90e7aef2e7-original-pull-secret\") pod \"global-pull-secret-syncer-g2wf7\" (UID: \"2da17ddd-8912-4e47-af0f-dc90e7aef2e7\") " pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:06:54.915331 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.915301    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gj79\" (UniqueName: \"kubernetes.io/projected/c8b99574-b747-4489-abb7-560e97784171-kube-api-access-6gj79\") pod \"multus-additional-cni-plugins-w6p4f\" (UID: \"c8b99574-b747-4489-abb7-560e97784171\") " pod="openshift-multus/multus-additional-cni-plugins-w6p4f"
Sep 17 14:06:54.915331 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.915318    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-etc-sysconfig\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:54.915453 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.915334    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-run-systemd\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:54.915453 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.915348    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-host-cni-bin\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:54.915453 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.915363    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c8b99574-b747-4489-abb7-560e97784171-cnibin\") pod \"multus-additional-cni-plugins-w6p4f\" (UID: \"c8b99574-b747-4489-abb7-560e97784171\") " pod="openshift-multus/multus-additional-cni-plugins-w6p4f"
Sep 17 14:06:54.915453 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.915379    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c8b99574-b747-4489-abb7-560e97784171-cni-binary-copy\") pod \"multus-additional-cni-plugins-w6p4f\" (UID: \"c8b99574-b747-4489-abb7-560e97784171\") " pod="openshift-multus/multus-additional-cni-plugins-w6p4f"
Sep 17 14:06:54.915453 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.915397    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3ea6e510-921f-47be-959c-909c700aac5b-socket-dir\") pod \"aws-ebs-csi-driver-node-jx678\" (UID: \"3ea6e510-921f-47be-959c-909c700aac5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx678"
Sep 17 14:06:54.915453 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.915418    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3ea6e510-921f-47be-959c-909c700aac5b-device-dir\") pod \"aws-ebs-csi-driver-node-jx678\" (UID: \"3ea6e510-921f-47be-959c-909c700aac5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx678"
Sep 17 14:06:54.915453 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.915450    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mts5r\" (UniqueName: \"kubernetes.io/projected/f68cb2de-9f71-4ee3-8c37-75f1c2918f66-kube-api-access-mts5r\") pod \"node-ca-6cb9l\" (UID: \"f68cb2de-9f71-4ee3-8c37-75f1c2918f66\") " pod="openshift-image-registry/node-ca-6cb9l"
Sep 17 14:06:54.915761 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.915469    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-host-slash\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:54.915761 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.915499    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-host-cni-netd\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:54.915761 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.915520    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3ea6e510-921f-47be-959c-909c700aac5b-etc-selinux\") pod \"aws-ebs-csi-driver-node-jx678\" (UID: \"3ea6e510-921f-47be-959c-909c700aac5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx678"
Sep 17 14:06:54.915761 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.915548    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f047d12-6bab-4074-8d56-cadba9e9c5dd-etc-tuned\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:54.915761 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.915565    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-host-run-netns\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:54.916064 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.915596    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb7h5\" (UniqueName: \"kubernetes.io/projected/3ea6e510-921f-47be-959c-909c700aac5b-kube-api-access-cb7h5\") pod \"aws-ebs-csi-driver-node-jx678\" (UID: \"3ea6e510-921f-47be-959c-909c700aac5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx678"
Sep 17 14:06:54.916166 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916086    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqdrd\" (UniqueName: \"kubernetes.io/projected/5b426312-6745-47b1-a19b-4d3ffb91c5af-kube-api-access-xqdrd\") pod \"network-check-target-wcn9n\" (UID: \"5b426312-6745-47b1-a19b-4d3ffb91c5af\") " pod="openshift-network-diagnostics/network-check-target-wcn9n"
Sep 17 14:06:54.916166 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916111    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-etc-kubernetes\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:54.916166 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916141    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-etc-systemd\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:54.916166 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916159    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-log-socket\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:54.916412 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916182    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8b99574-b747-4489-abb7-560e97784171-system-cni-dir\") pod \"multus-additional-cni-plugins-w6p4f\" (UID: \"c8b99574-b747-4489-abb7-560e97784171\") " pod="openshift-multus/multus-additional-cni-plugins-w6p4f"
Sep 17 14:06:54.916412 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916204    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2da17ddd-8912-4e47-af0f-dc90e7aef2e7-dbus\") pod \"global-pull-secret-syncer-g2wf7\" (UID: \"2da17ddd-8912-4e47-af0f-dc90e7aef2e7\") " pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:06:54.916412 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916227    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3ea6e510-921f-47be-959c-909c700aac5b-sys-fs\") pod \"aws-ebs-csi-driver-node-jx678\" (UID: \"3ea6e510-921f-47be-959c-909c700aac5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx678"
Sep 17 14:06:54.916412 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916250    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3005c93a-df5e-4bc3-9644-0f24121516bb-iptables-alerter-script\") pod \"iptables-alerter-czxpz\" (UID: \"3005c93a-df5e-4bc3-9644-0f24121516bb\") " pod="openshift-network-operator/iptables-alerter-czxpz"
Sep 17 14:06:54.916412 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916266    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f68cb2de-9f71-4ee3-8c37-75f1c2918f66-host\") pod \"node-ca-6cb9l\" (UID: \"f68cb2de-9f71-4ee3-8c37-75f1c2918f66\") " pod="openshift-image-registry/node-ca-6cb9l"
Sep 17 14:06:54.916412 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916285    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-run\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:54.916412 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916350    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-lib-modules\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:54.916412 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916376    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-var-lib-kubelet\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:54.916412 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916405    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plk6w\" (UniqueName: \"kubernetes.io/projected/1a72aa89-6ca0-47df-9fde-fb8dbc65c79f-kube-api-access-plk6w\") pod \"node-resolver-cjdbx\" (UID: \"1a72aa89-6ca0-47df-9fde-fb8dbc65c79f\") " pod="openshift-dns/node-resolver-cjdbx"
Sep 17 14:06:54.916784 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916422    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-etc-modprobe-d\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:54.916784 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916440    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3ea6e510-921f-47be-959c-909c700aac5b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jx678\" (UID: \"3ea6e510-921f-47be-959c-909c700aac5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx678"
Sep 17 14:06:54.916784 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916454    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-host-kubelet\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:54.916784 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916468    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-host-run-ovn-kubernetes\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:54.916784 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916484    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7gdk\" (UniqueName: \"kubernetes.io/projected/f70452dc-7b40-4964-ba77-7825835571cf-kube-api-access-m7gdk\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:54.916784 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916499    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:54.916784 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916514    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2da17ddd-8912-4e47-af0f-dc90e7aef2e7-kubelet-config\") pod \"global-pull-secret-syncer-g2wf7\" (UID: \"2da17ddd-8912-4e47-af0f-dc90e7aef2e7\") " pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:06:54.916784 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916530    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f68cb2de-9f71-4ee3-8c37-75f1c2918f66-serviceca\") pod \"node-ca-6cb9l\" (UID: \"f68cb2de-9f71-4ee3-8c37-75f1c2918f66\") " pod="openshift-image-registry/node-ca-6cb9l"
Sep 17 14:06:54.916784 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916576    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1a72aa89-6ca0-47df-9fde-fb8dbc65c79f-hosts-file\") pod \"node-resolver-cjdbx\" (UID: \"1a72aa89-6ca0-47df-9fde-fb8dbc65c79f\") " pod="openshift-dns/node-resolver-cjdbx"
Sep 17 14:06:54.916784 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916619    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-var-lib-openvswitch\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:54.916784 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916645    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-etc-openvswitch\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:54.916784 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916668    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3ea6e510-921f-47be-959c-909c700aac5b-registration-dir\") pod \"aws-ebs-csi-driver-node-jx678\" (UID: \"3ea6e510-921f-47be-959c-909c700aac5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx678"
Sep 17 14:06:54.916784 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916697    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-etc-sysctl-conf\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:54.916784 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916734    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f59sl\" (UniqueName: \"kubernetes.io/projected/0f047d12-6bab-4074-8d56-cadba9e9c5dd-kube-api-access-f59sl\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:54.916784 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916753    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f70452dc-7b40-4964-ba77-7825835571cf-env-overrides\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:54.916784 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916768    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c8b99574-b747-4489-abb7-560e97784171-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w6p4f\" (UID: \"c8b99574-b747-4489-abb7-560e97784171\") " pod="openshift-multus/multus-additional-cni-plugins-w6p4f"
Sep 17 14:06:54.917335 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916795    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-host\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:54.917335 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916820    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-node-log\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:54.917335 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916843    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f70452dc-7b40-4964-ba77-7825835571cf-ovnkube-config\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:54.917335 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916871    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c8b99574-b747-4489-abb7-560e97784171-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w6p4f\" (UID: \"c8b99574-b747-4489-abb7-560e97784171\") " pod="openshift-multus/multus-additional-cni-plugins-w6p4f"
Sep 17 14:06:54.917335 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916904    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f047d12-6bab-4074-8d56-cadba9e9c5dd-tmp\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:54.917335 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916917    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a72aa89-6ca0-47df-9fde-fb8dbc65c79f-tmp-dir\") pod \"node-resolver-cjdbx\" (UID: \"1a72aa89-6ca0-47df-9fde-fb8dbc65c79f\") " pod="openshift-dns/node-resolver-cjdbx"
Sep 17 14:06:54.917335 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916933    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-run-openvswitch\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:54.917335 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916969    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-run-ovn\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:54.917335 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.916990    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c8b99574-b747-4489-abb7-560e97784171-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w6p4f\" (UID: \"c8b99574-b747-4489-abb7-560e97784171\") " pod="openshift-multus/multus-additional-cni-plugins-w6p4f"
Sep 17 14:06:54.917335 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.917007    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3005c93a-df5e-4bc3-9644-0f24121516bb-host-slash\") pod \"iptables-alerter-czxpz\" (UID: \"3005c93a-df5e-4bc3-9644-0f24121516bb\") " pod="openshift-network-operator/iptables-alerter-czxpz"
Sep 17 14:06:54.917335 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.917020    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-systemd-units\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:54.917335 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.917038    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f70452dc-7b40-4964-ba77-7825835571cf-ovn-node-metrics-cert\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:54.918443 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.918423    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 17 14:06:54.919703 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.919571    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 17 14:06:54.919703 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.919579    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 17 14:06:54.919840 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.919787    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 17 14:06:54.926308 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.926283    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 17 14:06:54.926733 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.926705    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 17 14:06:54.927012 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.926993    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 17 14:06:54.927065 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.927016    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bnqtd\""
Sep 17 14:06:54.927403 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.927383    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 17 14:06:54.927491 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.927446    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 17 14:06:54.927618 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.927605    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 17 14:06:54.927887 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.927875    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-74rlx\""
Sep 17 14:06:54.928051 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.928028    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 17 14:06:54.928051 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.928047    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ftmvf\""
Sep 17 14:06:54.928217 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.928064    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 17 14:06:54.928217 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.928064    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 17 14:06:54.928217 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.928031    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 17 14:06:54.929878 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.929856    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 17 14:06:54.930128 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.930105    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7zh6m\""
Sep 17 14:06:54.930208 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.930170    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pmzkn\""
Sep 17 14:06:54.930208 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.930176    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 17 14:06:54.930839 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.930820    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bnkqp\""
Sep 17 14:06:54.930839 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.930835    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 17 14:06:54.931215 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.931197    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 17 14:06:54.931272 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.931217    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 17 14:06:54.931766 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.931617    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 17 14:06:54.931766 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.931745    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 17 14:06:54.953951 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.953923    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 14:06:54.987783 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.987757    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-p956w"
Sep 17 14:06:54.997609 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:54.997588    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 14:06:55.006735 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.006696    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 17 14:06:55.014645 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.014625    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-p956w"
Sep 17 14:06:55.017338 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.017316    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c8b99574-b747-4489-abb7-560e97784171-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w6p4f\" (UID: \"c8b99574-b747-4489-abb7-560e97784171\") " pod="openshift-multus/multus-additional-cni-plugins-w6p4f"
Sep 17 14:06:55.017436 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.017350    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-system-cni-dir\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.017436 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.017381    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-multus-daemon-config\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.017436 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.017406    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82gmx\" (UniqueName: \"kubernetes.io/projected/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-kube-api-access-82gmx\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.017436 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.017433    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-host\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:55.017629 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.017461    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-node-log\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.017629 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.017491    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f70452dc-7b40-4964-ba77-7825835571cf-ovnkube-config\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.017629 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.017509    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c8b99574-b747-4489-abb7-560e97784171-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w6p4f\" (UID: \"c8b99574-b747-4489-abb7-560e97784171\") " pod="openshift-multus/multus-additional-cni-plugins-w6p4f"
Sep 17 14:06:55.017629 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.017520    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-host\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:55.017629 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.017555    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c8b99574-b747-4489-abb7-560e97784171-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w6p4f\" (UID: \"c8b99574-b747-4489-abb7-560e97784171\") " pod="openshift-multus/multus-additional-cni-plugins-w6p4f"
Sep 17 14:06:55.017629 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.017562    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-cnibin\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.017629 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.017558    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-node-log\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.017888 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.017733    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f047d12-6bab-4074-8d56-cadba9e9c5dd-tmp\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:55.017888 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.017774    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a72aa89-6ca0-47df-9fde-fb8dbc65c79f-tmp-dir\") pod \"node-resolver-cjdbx\" (UID: \"1a72aa89-6ca0-47df-9fde-fb8dbc65c79f\") " pod="openshift-dns/node-resolver-cjdbx"
Sep 17 14:06:55.017888 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.017803    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-run-openvswitch\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.017888 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.017827    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-run-ovn\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.017888 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.017853    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c8b99574-b747-4489-abb7-560e97784171-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w6p4f\" (UID: \"c8b99574-b747-4489-abb7-560e97784171\") " pod="openshift-multus/multus-additional-cni-plugins-w6p4f"
Sep 17 14:06:55.017888 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.017880    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-host-run-multus-certs\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.018095 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.017910    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3005c93a-df5e-4bc3-9644-0f24121516bb-host-slash\") pod \"iptables-alerter-czxpz\" (UID: \"3005c93a-df5e-4bc3-9644-0f24121516bb\") " pod="openshift-network-operator/iptables-alerter-czxpz"
Sep 17 14:06:55.018095 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.017934    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-systemd-units\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.018095 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.017956    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f70452dc-7b40-4964-ba77-7825835571cf-ovn-node-metrics-cert\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.018095 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.017980    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/50cd5129-5e4f-4063-b789-aa7477a7df41-agent-certs\") pod \"konnectivity-agent-j4k9b\" (UID: \"50cd5129-5e4f-4063-b789-aa7477a7df41\") " pod="kube-system/konnectivity-agent-j4k9b"
Sep 17 14:06:55.018095 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018005    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5nhw\" (UniqueName: \"kubernetes.io/projected/3005c93a-df5e-4bc3-9644-0f24121516bb-kube-api-access-b5nhw\") pod \"iptables-alerter-czxpz\" (UID: \"3005c93a-df5e-4bc3-9644-0f24121516bb\") " pod="openshift-network-operator/iptables-alerter-czxpz"
Sep 17 14:06:55.018095 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018031    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-etc-sysctl-d\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:55.018095 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018052    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a72aa89-6ca0-47df-9fde-fb8dbc65c79f-tmp-dir\") pod \"node-resolver-cjdbx\" (UID: \"1a72aa89-6ca0-47df-9fde-fb8dbc65c79f\") " pod="openshift-dns/node-resolver-cjdbx"
Sep 17 14:06:55.018095 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018062    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-sys\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:55.018095 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018086    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f70452dc-7b40-4964-ba77-7825835571cf-ovnkube-script-lib\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.018458 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018099    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f70452dc-7b40-4964-ba77-7825835571cf-ovnkube-config\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.018458 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018117    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-systemd-units\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.018458 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018111    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2da17ddd-8912-4e47-af0f-dc90e7aef2e7-original-pull-secret\") pod \"global-pull-secret-syncer-g2wf7\" (UID: \"2da17ddd-8912-4e47-af0f-dc90e7aef2e7\") " pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:06:55.018458 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018150    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c8b99574-b747-4489-abb7-560e97784171-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w6p4f\" (UID: \"c8b99574-b747-4489-abb7-560e97784171\") " pod="openshift-multus/multus-additional-cni-plugins-w6p4f"
Sep 17 14:06:55.018458 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018169    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-run-openvswitch\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.018458 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018288    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-etc-sysctl-d\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:55.018458 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018406    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-sys\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:55.018458 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018427    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 17 14:06:55.018752 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:55.018477    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 14:06:55.018752 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018503    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-host-run-netns\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.018752 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018538    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3005c93a-df5e-4bc3-9644-0f24121516bb-host-slash\") pod \"iptables-alerter-czxpz\" (UID: \"3005c93a-df5e-4bc3-9644-0f24121516bb\") " pod="openshift-network-operator/iptables-alerter-czxpz"
Sep 17 14:06:55.018752 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018547    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-run-ovn\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.018752 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018579    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-host-var-lib-cni-bin\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.018752 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018613    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c8b99574-b747-4489-abb7-560e97784171-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w6p4f\" (UID: \"c8b99574-b747-4489-abb7-560e97784171\") " pod="openshift-multus/multus-additional-cni-plugins-w6p4f"
Sep 17 14:06:55.018752 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:55.018648    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2da17ddd-8912-4e47-af0f-dc90e7aef2e7-original-pull-secret podName:2da17ddd-8912-4e47-af0f-dc90e7aef2e7 nodeName:}" failed. No retries permitted until 2026-09-17 14:06:55.518611206 +0000 UTC m=+2.962686788 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2da17ddd-8912-4e47-af0f-dc90e7aef2e7-original-pull-secret") pod "global-pull-secret-syncer-g2wf7" (UID: "2da17ddd-8912-4e47-af0f-dc90e7aef2e7") : object "kube-system"/"original-pull-secret" not registered
Sep 17 14:06:55.018752 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018666    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f70452dc-7b40-4964-ba77-7825835571cf-ovnkube-script-lib\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.018752 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018667    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6djqc\" (UniqueName: \"kubernetes.io/projected/59c1fc39-6669-462c-9a66-c97b5357d8ac-kube-api-access-6djqc\") pod \"network-metrics-daemon-pjjpc\" (UID: \"59c1fc39-6669-462c-9a66-c97b5357d8ac\") " pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:06:55.018752 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018726    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/50cd5129-5e4f-4063-b789-aa7477a7df41-konnectivity-ca\") pod \"konnectivity-agent-j4k9b\" (UID: \"50cd5129-5e4f-4063-b789-aa7477a7df41\") " pod="kube-system/konnectivity-agent-j4k9b"
Sep 17 14:06:55.018752 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018750    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gj79\" (UniqueName: \"kubernetes.io/projected/c8b99574-b747-4489-abb7-560e97784171-kube-api-access-6gj79\") pod \"multus-additional-cni-plugins-w6p4f\" (UID: \"c8b99574-b747-4489-abb7-560e97784171\") " pod="openshift-multus/multus-additional-cni-plugins-w6p4f"
Sep 17 14:06:55.019249 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018765    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-etc-sysconfig\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:55.019249 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018779    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-run-systemd\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.019249 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018796    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-host-cni-bin\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.019249 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018817    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c8b99574-b747-4489-abb7-560e97784171-cnibin\") pod \"multus-additional-cni-plugins-w6p4f\" (UID: \"c8b99574-b747-4489-abb7-560e97784171\") " pod="openshift-multus/multus-additional-cni-plugins-w6p4f"
Sep 17 14:06:55.019249 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018840    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c8b99574-b747-4489-abb7-560e97784171-cni-binary-copy\") pod \"multus-additional-cni-plugins-w6p4f\" (UID: \"c8b99574-b747-4489-abb7-560e97784171\") " pod="openshift-multus/multus-additional-cni-plugins-w6p4f"
Sep 17 14:06:55.019249 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018857    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-etc-sysconfig\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:55.019249 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018864    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3ea6e510-921f-47be-959c-909c700aac5b-socket-dir\") pod \"aws-ebs-csi-driver-node-jx678\" (UID: \"3ea6e510-921f-47be-959c-909c700aac5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx678"
Sep 17 14:06:55.019249 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018875    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-host-cni-bin\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.019249 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018879    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-run-systemd\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.019249 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018889    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3ea6e510-921f-47be-959c-909c700aac5b-device-dir\") pod \"aws-ebs-csi-driver-node-jx678\" (UID: \"3ea6e510-921f-47be-959c-909c700aac5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx678"
Sep 17 14:06:55.019249 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018910    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c8b99574-b747-4489-abb7-560e97784171-cnibin\") pod \"multus-additional-cni-plugins-w6p4f\" (UID: \"c8b99574-b747-4489-abb7-560e97784171\") " pod="openshift-multus/multus-additional-cni-plugins-w6p4f"
Sep 17 14:06:55.019249 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018925    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mts5r\" (UniqueName: \"kubernetes.io/projected/f68cb2de-9f71-4ee3-8c37-75f1c2918f66-kube-api-access-mts5r\") pod \"node-ca-6cb9l\" (UID: \"f68cb2de-9f71-4ee3-8c37-75f1c2918f66\") " pod="openshift-image-registry/node-ca-6cb9l"
Sep 17 14:06:55.019249 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018952    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-host-slash\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.019249 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018978    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-host-cni-netd\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.019249 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.018997    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3ea6e510-921f-47be-959c-909c700aac5b-socket-dir\") pod \"aws-ebs-csi-driver-node-jx678\" (UID: \"3ea6e510-921f-47be-959c-909c700aac5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx678"
Sep 17 14:06:55.019249 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019002    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3ea6e510-921f-47be-959c-909c700aac5b-etc-selinux\") pod \"aws-ebs-csi-driver-node-jx678\" (UID: \"3ea6e510-921f-47be-959c-909c700aac5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx678"
Sep 17 14:06:55.019249 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019017    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-host-slash\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.020006 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019027    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-cni-binary-copy\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.020006 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019054    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3ea6e510-921f-47be-959c-909c700aac5b-etc-selinux\") pod \"aws-ebs-csi-driver-node-jx678\" (UID: \"3ea6e510-921f-47be-959c-909c700aac5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx678"
Sep 17 14:06:55.020006 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019063    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-host-run-k8s-cni-cncf-io\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.020006 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019066    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-host-cni-netd\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.020006 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019097    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3ea6e510-921f-47be-959c-909c700aac5b-device-dir\") pod \"aws-ebs-csi-driver-node-jx678\" (UID: \"3ea6e510-921f-47be-959c-909c700aac5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx678"
Sep 17 14:06:55.020006 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019091    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f047d12-6bab-4074-8d56-cadba9e9c5dd-etc-tuned\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:55.020006 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019176    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-host-run-netns\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.020006 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019222    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb7h5\" (UniqueName: \"kubernetes.io/projected/3ea6e510-921f-47be-959c-909c700aac5b-kube-api-access-cb7h5\") pod \"aws-ebs-csi-driver-node-jx678\" (UID: \"3ea6e510-921f-47be-959c-909c700aac5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx678"
Sep 17 14:06:55.020006 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019249    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-multus-socket-dir-parent\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.020006 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019265    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-host-var-lib-cni-multus\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.020006 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019268    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-host-run-netns\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.020006 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019281    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqdrd\" (UniqueName: \"kubernetes.io/projected/5b426312-6745-47b1-a19b-4d3ffb91c5af-kube-api-access-xqdrd\") pod \"network-check-target-wcn9n\" (UID: \"5b426312-6745-47b1-a19b-4d3ffb91c5af\") " pod="openshift-network-diagnostics/network-check-target-wcn9n"
Sep 17 14:06:55.020006 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019301    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-etc-kubernetes\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:55.020006 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019325    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c8b99574-b747-4489-abb7-560e97784171-cni-binary-copy\") pod \"multus-additional-cni-plugins-w6p4f\" (UID: \"c8b99574-b747-4489-abb7-560e97784171\") " pod="openshift-multus/multus-additional-cni-plugins-w6p4f"
Sep 17 14:06:55.020006 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019398    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-etc-kubernetes\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:55.020006 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019431    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-etc-systemd\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:55.020006 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019460    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-multus-cni-dir\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.020568 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019485    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-hostroot\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.020568 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019509    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-etc-systemd\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:55.020568 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019517    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-multus-conf-dir\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.020568 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019560    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-log-socket\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.020568 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019586    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8b99574-b747-4489-abb7-560e97784171-system-cni-dir\") pod \"multus-additional-cni-plugins-w6p4f\" (UID: \"c8b99574-b747-4489-abb7-560e97784171\") " pod="openshift-multus/multus-additional-cni-plugins-w6p4f"
Sep 17 14:06:55.020568 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019611    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2da17ddd-8912-4e47-af0f-dc90e7aef2e7-dbus\") pod \"global-pull-secret-syncer-g2wf7\" (UID: \"2da17ddd-8912-4e47-af0f-dc90e7aef2e7\") " pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:06:55.020568 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019630    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-log-socket\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.020568 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019636    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3ea6e510-921f-47be-959c-909c700aac5b-sys-fs\") pod \"aws-ebs-csi-driver-node-jx678\" (UID: \"3ea6e510-921f-47be-959c-909c700aac5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx678"
Sep 17 14:06:55.020568 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019663    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59c1fc39-6669-462c-9a66-c97b5357d8ac-metrics-certs\") pod \"network-metrics-daemon-pjjpc\" (UID: \"59c1fc39-6669-462c-9a66-c97b5357d8ac\") " pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:06:55.020568 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019691    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2da17ddd-8912-4e47-af0f-dc90e7aef2e7-dbus\") pod \"global-pull-secret-syncer-g2wf7\" (UID: \"2da17ddd-8912-4e47-af0f-dc90e7aef2e7\") " pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:06:55.020568 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019691    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3ea6e510-921f-47be-959c-909c700aac5b-sys-fs\") pod \"aws-ebs-csi-driver-node-jx678\" (UID: \"3ea6e510-921f-47be-959c-909c700aac5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx678"
Sep 17 14:06:55.020568 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019691    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3005c93a-df5e-4bc3-9644-0f24121516bb-iptables-alerter-script\") pod \"iptables-alerter-czxpz\" (UID: \"3005c93a-df5e-4bc3-9644-0f24121516bb\") " pod="openshift-network-operator/iptables-alerter-czxpz"
Sep 17 14:06:55.020568 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019754    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-etc-kubernetes\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.020568 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019777    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f68cb2de-9f71-4ee3-8c37-75f1c2918f66-host\") pod \"node-ca-6cb9l\" (UID: \"f68cb2de-9f71-4ee3-8c37-75f1c2918f66\") " pod="openshift-image-registry/node-ca-6cb9l"
Sep 17 14:06:55.020568 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019636    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8b99574-b747-4489-abb7-560e97784171-system-cni-dir\") pod \"multus-additional-cni-plugins-w6p4f\" (UID: \"c8b99574-b747-4489-abb7-560e97784171\") " pod="openshift-multus/multus-additional-cni-plugins-w6p4f"
Sep 17 14:06:55.020568 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019796    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-run\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:55.020568 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019827    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-lib-modules\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:55.021228 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019837    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-run\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:55.021228 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019852    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-var-lib-kubelet\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:55.021228 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019875    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f68cb2de-9f71-4ee3-8c37-75f1c2918f66-host\") pod \"node-ca-6cb9l\" (UID: \"f68cb2de-9f71-4ee3-8c37-75f1c2918f66\") " pod="openshift-image-registry/node-ca-6cb9l"
Sep 17 14:06:55.021228 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019877    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plk6w\" (UniqueName: \"kubernetes.io/projected/1a72aa89-6ca0-47df-9fde-fb8dbc65c79f-kube-api-access-plk6w\") pod \"node-resolver-cjdbx\" (UID: \"1a72aa89-6ca0-47df-9fde-fb8dbc65c79f\") " pod="openshift-dns/node-resolver-cjdbx"
Sep 17 14:06:55.021228 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019902    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-etc-modprobe-d\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:55.021228 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019925    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3ea6e510-921f-47be-959c-909c700aac5b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jx678\" (UID: \"3ea6e510-921f-47be-959c-909c700aac5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx678"
Sep 17 14:06:55.021228 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019945    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-host-kubelet\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.021228 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019957    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-lib-modules\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:55.021228 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019968    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-host-run-ovn-kubernetes\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.021228 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.019999    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7gdk\" (UniqueName: \"kubernetes.io/projected/f70452dc-7b40-4964-ba77-7825835571cf-kube-api-access-m7gdk\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.021228 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.020004    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-host-run-ovn-kubernetes\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.021228 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.020022    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-host-var-lib-kubelet\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.021228 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.020045    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.021228 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.020065    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-etc-modprobe-d\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:55.021228 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.020068    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2da17ddd-8912-4e47-af0f-dc90e7aef2e7-kubelet-config\") pod \"global-pull-secret-syncer-g2wf7\" (UID: \"2da17ddd-8912-4e47-af0f-dc90e7aef2e7\") " pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:06:55.021228 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.020093    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f68cb2de-9f71-4ee3-8c37-75f1c2918f66-serviceca\") pod \"node-ca-6cb9l\" (UID: \"f68cb2de-9f71-4ee3-8c37-75f1c2918f66\") " pod="openshift-image-registry/node-ca-6cb9l"
Sep 17 14:06:55.021228 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.020101    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-host-kubelet\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.021915 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.020118    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3ea6e510-921f-47be-959c-909c700aac5b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jx678\" (UID: \"3ea6e510-921f-47be-959c-909c700aac5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx678"
Sep 17 14:06:55.021915 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.020113    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1a72aa89-6ca0-47df-9fde-fb8dbc65c79f-hosts-file\") pod \"node-resolver-cjdbx\" (UID: \"1a72aa89-6ca0-47df-9fde-fb8dbc65c79f\") " pod="openshift-dns/node-resolver-cjdbx"
Sep 17 14:06:55.021915 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.020146    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.021915 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.020153    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-var-lib-openvswitch\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.021915 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.020164    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-var-lib-kubelet\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:55.021915 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.020176    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-etc-openvswitch\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.021915 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.020197    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3ea6e510-921f-47be-959c-909c700aac5b-registration-dir\") pod \"aws-ebs-csi-driver-node-jx678\" (UID: \"3ea6e510-921f-47be-959c-909c700aac5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx678"
Sep 17 14:06:55.021915 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.020222    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-etc-sysctl-conf\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:55.021915 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.020227    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2da17ddd-8912-4e47-af0f-dc90e7aef2e7-kubelet-config\") pod \"global-pull-secret-syncer-g2wf7\" (UID: \"2da17ddd-8912-4e47-af0f-dc90e7aef2e7\") " pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:06:55.021915 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.020242    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f59sl\" (UniqueName: \"kubernetes.io/projected/0f047d12-6bab-4074-8d56-cadba9e9c5dd-kube-api-access-f59sl\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:55.021915 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.020264    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f70452dc-7b40-4964-ba77-7825835571cf-env-overrides\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.021915 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.020357    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3ea6e510-921f-47be-959c-909c700aac5b-registration-dir\") pod \"aws-ebs-csi-driver-node-jx678\" (UID: \"3ea6e510-921f-47be-959c-909c700aac5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx678"
Sep 17 14:06:55.021915 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.020401    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1a72aa89-6ca0-47df-9fde-fb8dbc65c79f-hosts-file\") pod \"node-resolver-cjdbx\" (UID: \"1a72aa89-6ca0-47df-9fde-fb8dbc65c79f\") " pod="openshift-dns/node-resolver-cjdbx"
Sep 17 14:06:55.021915 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.020434    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-var-lib-openvswitch\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.021915 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.020473    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f70452dc-7b40-4964-ba77-7825835571cf-etc-openvswitch\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.021915 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.020513    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3005c93a-df5e-4bc3-9644-0f24121516bb-iptables-alerter-script\") pod \"iptables-alerter-czxpz\" (UID: \"3005c93a-df5e-4bc3-9644-0f24121516bb\") " pod="openshift-network-operator/iptables-alerter-czxpz"
Sep 17 14:06:55.021915 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.020561    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f047d12-6bab-4074-8d56-cadba9e9c5dd-etc-sysctl-conf\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:55.022564 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.020595    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f68cb2de-9f71-4ee3-8c37-75f1c2918f66-serviceca\") pod \"node-ca-6cb9l\" (UID: \"f68cb2de-9f71-4ee3-8c37-75f1c2918f66\") " pod="openshift-image-registry/node-ca-6cb9l"
Sep 17 14:06:55.022564 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.020656    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f70452dc-7b40-4964-ba77-7825835571cf-env-overrides\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.023090 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.022995    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f047d12-6bab-4074-8d56-cadba9e9c5dd-etc-tuned\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:55.023090 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.023057    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f047d12-6bab-4074-8d56-cadba9e9c5dd-tmp\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:55.023220 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.023157    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f70452dc-7b40-4964-ba77-7825835571cf-ovn-node-metrics-cert\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.052247 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.052221    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5nhw\" (UniqueName: \"kubernetes.io/projected/3005c93a-df5e-4bc3-9644-0f24121516bb-kube-api-access-b5nhw\") pod \"iptables-alerter-czxpz\" (UID: \"3005c93a-df5e-4bc3-9644-0f24121516bb\") " pod="openshift-network-operator/iptables-alerter-czxpz"
Sep 17 14:06:55.054192 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.054171    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f59sl\" (UniqueName: \"kubernetes.io/projected/0f047d12-6bab-4074-8d56-cadba9e9c5dd-kube-api-access-f59sl\") pod \"tuned-9m7cc\" (UID: \"0f047d12-6bab-4074-8d56-cadba9e9c5dd\") " pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:55.074704 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:55.074639    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 14:06:55.074704 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:55.074670    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 14:06:55.074704 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:55.074682    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xqdrd for pod openshift-network-diagnostics/network-check-target-wcn9n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 14:06:55.074924 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:55.074754    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b426312-6745-47b1-a19b-4d3ffb91c5af-kube-api-access-xqdrd podName:5b426312-6745-47b1-a19b-4d3ffb91c5af nodeName:}" failed. No retries permitted until 2026-09-17 14:06:55.574736962 +0000 UTC m=+3.018812537 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xqdrd" (UniqueName: "kubernetes.io/projected/5b426312-6745-47b1-a19b-4d3ffb91c5af-kube-api-access-xqdrd") pod "network-check-target-wcn9n" (UID: "5b426312-6745-47b1-a19b-4d3ffb91c5af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 14:06:55.080656 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.080636    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plk6w\" (UniqueName: \"kubernetes.io/projected/1a72aa89-6ca0-47df-9fde-fb8dbc65c79f-kube-api-access-plk6w\") pod \"node-resolver-cjdbx\" (UID: \"1a72aa89-6ca0-47df-9fde-fb8dbc65c79f\") " pod="openshift-dns/node-resolver-cjdbx"
Sep 17 14:06:55.080774 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.080651    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb7h5\" (UniqueName: \"kubernetes.io/projected/3ea6e510-921f-47be-959c-909c700aac5b-kube-api-access-cb7h5\") pod \"aws-ebs-csi-driver-node-jx678\" (UID: \"3ea6e510-921f-47be-959c-909c700aac5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx678"
Sep 17 14:06:55.080946 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.080928    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mts5r\" (UniqueName: \"kubernetes.io/projected/f68cb2de-9f71-4ee3-8c37-75f1c2918f66-kube-api-access-mts5r\") pod \"node-ca-6cb9l\" (UID: \"f68cb2de-9f71-4ee3-8c37-75f1c2918f66\") " pod="openshift-image-registry/node-ca-6cb9l"
Sep 17 14:06:55.087571 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.087551    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7gdk\" (UniqueName: \"kubernetes.io/projected/f70452dc-7b40-4964-ba77-7825835571cf-kube-api-access-m7gdk\") pod \"ovnkube-node-9f67m\" (UID: \"f70452dc-7b40-4964-ba77-7825835571cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.091753 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.091734    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gj79\" (UniqueName: \"kubernetes.io/projected/c8b99574-b747-4489-abb7-560e97784171-kube-api-access-6gj79\") pod \"multus-additional-cni-plugins-w6p4f\" (UID: \"c8b99574-b747-4489-abb7-560e97784171\") " pod="openshift-multus/multus-additional-cni-plugins-w6p4f"
Sep 17 14:06:55.121086 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.121061    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82gmx\" (UniqueName: \"kubernetes.io/projected/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-kube-api-access-82gmx\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.121181 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.121100    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-cnibin\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.121181 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.121148    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-host-run-multus-certs\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.121181 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.121166    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/50cd5129-5e4f-4063-b789-aa7477a7df41-agent-certs\") pod \"konnectivity-agent-j4k9b\" (UID: \"50cd5129-5e4f-4063-b789-aa7477a7df41\") " pod="kube-system/konnectivity-agent-j4k9b"
Sep 17 14:06:55.121298 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.121209    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-host-run-netns\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.121298 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.121229    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-host-var-lib-cni-bin\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.121298 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.121247    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-cnibin\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.121298 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.121252    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6djqc\" (UniqueName: \"kubernetes.io/projected/59c1fc39-6669-462c-9a66-c97b5357d8ac-kube-api-access-6djqc\") pod \"network-metrics-daemon-pjjpc\" (UID: \"59c1fc39-6669-462c-9a66-c97b5357d8ac\") " pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:06:55.121298 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.121296    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/50cd5129-5e4f-4063-b789-aa7477a7df41-konnectivity-ca\") pod \"konnectivity-agent-j4k9b\" (UID: \"50cd5129-5e4f-4063-b789-aa7477a7df41\") " pod="kube-system/konnectivity-agent-j4k9b"
Sep 17 14:06:55.121473 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.121319    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-cni-binary-copy\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.121473 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.121334    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-host-run-k8s-cni-cncf-io\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.121473 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.121367    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-multus-socket-dir-parent\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.121473 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.121392    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-host-var-lib-cni-multus\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.121473 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.121431    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-multus-cni-dir\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.121473 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.121446    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-hostroot\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.121473 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.121459    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-multus-conf-dir\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.121473 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.121471    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-host-run-netns\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.121809 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:55.121540    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 14:06:55.121809 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:55.121590    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59c1fc39-6669-462c-9a66-c97b5357d8ac-metrics-certs podName:59c1fc39-6669-462c-9a66-c97b5357d8ac nodeName:}" failed. No retries permitted until 2026-09-17 14:06:55.621572914 +0000 UTC m=+3.065648483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59c1fc39-6669-462c-9a66-c97b5357d8ac-metrics-certs") pod "network-metrics-daemon-pjjpc" (UID: "59c1fc39-6669-462c-9a66-c97b5357d8ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 14:06:55.121809 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.121663    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-host-run-multus-certs\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.121809 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.121475    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59c1fc39-6669-462c-9a66-c97b5357d8ac-metrics-certs\") pod \"network-metrics-daemon-pjjpc\" (UID: \"59c1fc39-6669-462c-9a66-c97b5357d8ac\") " pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:06:55.121809 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.121725    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-etc-kubernetes\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.121809 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.121741    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-host-var-lib-cni-multus\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.121809 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.121761    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-host-var-lib-kubelet\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.121809 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.121790    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-host-run-k8s-cni-cncf-io\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.121809 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.121800    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-system-cni-dir\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.122229 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.121825    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-multus-daemon-config\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.122229 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.121842    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-multus-socket-dir-parent\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.122229 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.121883    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-hostroot\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.122229 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.121934    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-multus-cni-dir\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.122229 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.121979    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-etc-kubernetes\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.122229 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.122016    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-host-var-lib-cni-bin\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.122229 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.122028    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-cni-binary-copy\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.122229 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.122056    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-host-var-lib-kubelet\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.122229 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.122087    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-multus-conf-dir\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.122229 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.122108    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-system-cni-dir\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.122737 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.122241    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/50cd5129-5e4f-4063-b789-aa7477a7df41-konnectivity-ca\") pod \"konnectivity-agent-j4k9b\" (UID: \"50cd5129-5e4f-4063-b789-aa7477a7df41\") " pod="kube-system/konnectivity-agent-j4k9b"
Sep 17 14:06:55.122737 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.122250    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-multus-daemon-config\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.123934 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.123912    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/50cd5129-5e4f-4063-b789-aa7477a7df41-agent-certs\") pod \"konnectivity-agent-j4k9b\" (UID: \"50cd5129-5e4f-4063-b789-aa7477a7df41\") " pod="kube-system/konnectivity-agent-j4k9b"
Sep 17 14:06:55.148990 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.148967    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82gmx\" (UniqueName: \"kubernetes.io/projected/68c8a1d5-6bb2-4f87-a96d-fca6fc490801-kube-api-access-82gmx\") pod \"multus-chbsn\" (UID: \"68c8a1d5-6bb2-4f87-a96d-fca6fc490801\") " pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.164922 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.164899    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6djqc\" (UniqueName: \"kubernetes.io/projected/59c1fc39-6669-462c-9a66-c97b5357d8ac-kube-api-access-6djqc\") pod \"network-metrics-daemon-pjjpc\" (UID: \"59c1fc39-6669-462c-9a66-c97b5357d8ac\") " pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:06:55.175479 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.175432    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal" event={"ID":"e7dbc191af6a805aa5ecdfa53b74162f","Type":"ContainerStarted","Data":"251fa4f7754d8bf96afc9ed7f8e30aba1c3fb16afb14dac0a6c8af99469458f5"}
Sep 17 14:06:55.176630 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.176605    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-22.ec2.internal" event={"ID":"e37420b5f4f2cfdf85c1d60d1139054c","Type":"ContainerStarted","Data":"e62d368c871ddd3452ebc206b1ba0ae12238b19330c5b4bced6786cb4e15bd9d"}
Sep 17 14:06:55.207840 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.207804    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cjdbx"
Sep 17 14:06:55.215666 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.215645    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6cb9l"
Sep 17 14:06:55.224679 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.224659    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:06:55.229362 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.229346    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w6p4f"
Sep 17 14:06:55.239764 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.239740    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-czxpz"
Sep 17 14:06:55.245926 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.245898    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9m7cc"
Sep 17 14:06:55.250507 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.250490    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx678"
Sep 17 14:06:55.256866 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.256846    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j4k9b"
Sep 17 14:06:55.263050 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.263029    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-chbsn"
Sep 17 14:06:55.524292 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.524259    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2da17ddd-8912-4e47-af0f-dc90e7aef2e7-original-pull-secret\") pod \"global-pull-secret-syncer-g2wf7\" (UID: \"2da17ddd-8912-4e47-af0f-dc90e7aef2e7\") " pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:06:55.524470 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:55.524364    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 14:06:55.524470 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:55.524440    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2da17ddd-8912-4e47-af0f-dc90e7aef2e7-original-pull-secret podName:2da17ddd-8912-4e47-af0f-dc90e7aef2e7 nodeName:}" failed. No retries permitted until 2026-09-17 14:06:56.52441975 +0000 UTC m=+3.968495317 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2da17ddd-8912-4e47-af0f-dc90e7aef2e7-original-pull-secret") pod "global-pull-secret-syncer-g2wf7" (UID: "2da17ddd-8912-4e47-af0f-dc90e7aef2e7") : object "kube-system"/"original-pull-secret" not registered
Sep 17 14:06:55.590195 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:55.590043    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3005c93a_df5e_4bc3_9644_0f24121516bb.slice/crio-bb70feb938954f611026bd8ca4265892a7c7f2ad1ae659a653ca54f946e25aac WatchSource:0}: Error finding container bb70feb938954f611026bd8ca4265892a7c7f2ad1ae659a653ca54f946e25aac: Status 404 returned error can't find the container with id bb70feb938954f611026bd8ca4265892a7c7f2ad1ae659a653ca54f946e25aac
Sep 17 14:06:55.591946 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:55.591924    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf70452dc_7b40_4964_ba77_7825835571cf.slice/crio-bdd26c25966ac785c009d9c2dc4b30e8da04edb93450bdd55304be1e3a19b537 WatchSource:0}: Error finding container bdd26c25966ac785c009d9c2dc4b30e8da04edb93450bdd55304be1e3a19b537: Status 404 returned error can't find the container with id bdd26c25966ac785c009d9c2dc4b30e8da04edb93450bdd55304be1e3a19b537
Sep 17 14:06:55.596098 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:55.596065    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f047d12_6bab_4074_8d56_cadba9e9c5dd.slice/crio-e152cfbd831bae128e725708a80e6d4cd7ede176eca8154aba629b88e49cabfe WatchSource:0}: Error finding container e152cfbd831bae128e725708a80e6d4cd7ede176eca8154aba629b88e49cabfe: Status 404 returned error can't find the container with id e152cfbd831bae128e725708a80e6d4cd7ede176eca8154aba629b88e49cabfe
Sep 17 14:06:55.598386 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:55.598363    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a72aa89_6ca0_47df_9fde_fb8dbc65c79f.slice/crio-f327a53e9909be11cc8ce49e8beeb0c75ce47d1d8c89577f19556abd0d35b409 WatchSource:0}: Error finding container f327a53e9909be11cc8ce49e8beeb0c75ce47d1d8c89577f19556abd0d35b409: Status 404 returned error can't find the container with id f327a53e9909be11cc8ce49e8beeb0c75ce47d1d8c89577f19556abd0d35b409
Sep 17 14:06:55.599178 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:55.599150    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ea6e510_921f_47be_959c_909c700aac5b.slice/crio-bb49067a9e8efce66dde2ba294189234b2cc292c46b2922094c11e22daeae355 WatchSource:0}: Error finding container bb49067a9e8efce66dde2ba294189234b2cc292c46b2922094c11e22daeae355: Status 404 returned error can't find the container with id bb49067a9e8efce66dde2ba294189234b2cc292c46b2922094c11e22daeae355
Sep 17 14:06:55.599978 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:55.599859    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf68cb2de_9f71_4ee3_8c37_75f1c2918f66.slice/crio-28751f84d1f1d73093a1a2cd0cf0cf47a29a38a120d12f4820bcee4bbd7713d3 WatchSource:0}: Error finding container 28751f84d1f1d73093a1a2cd0cf0cf47a29a38a120d12f4820bcee4bbd7713d3: Status 404 returned error can't find the container with id 28751f84d1f1d73093a1a2cd0cf0cf47a29a38a120d12f4820bcee4bbd7713d3
Sep 17 14:06:55.601686 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:55.601663    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8b99574_b747_4489_abb7_560e97784171.slice/crio-a8d914d37705b6a8f1d6d4cc99960c97c30e17a5b87c679171f5831a41f9e6fd WatchSource:0}: Error finding container a8d914d37705b6a8f1d6d4cc99960c97c30e17a5b87c679171f5831a41f9e6fd: Status 404 returned error can't find the container with id a8d914d37705b6a8f1d6d4cc99960c97c30e17a5b87c679171f5831a41f9e6fd
Sep 17 14:06:55.602601 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:55.602577    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68c8a1d5_6bb2_4f87_a96d_fca6fc490801.slice/crio-f3c1113d04b7b6e4ff24c29aa587a4915530a29c857c0ab24386ba17ff330868 WatchSource:0}: Error finding container f3c1113d04b7b6e4ff24c29aa587a4915530a29c857c0ab24386ba17ff330868: Status 404 returned error can't find the container with id f3c1113d04b7b6e4ff24c29aa587a4915530a29c857c0ab24386ba17ff330868
Sep 17 14:06:55.603814 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:06:55.603784    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50cd5129_5e4f_4063_b789_aa7477a7df41.slice/crio-cba1e8cd928ad084138a130bacd9efa4f5e73328b40c97d370c70010447feaf9 WatchSource:0}: Error finding container cba1e8cd928ad084138a130bacd9efa4f5e73328b40c97d370c70010447feaf9: Status 404 returned error can't find the container with id cba1e8cd928ad084138a130bacd9efa4f5e73328b40c97d370c70010447feaf9
Sep 17 14:06:55.625461 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.625437    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqdrd\" (UniqueName: \"kubernetes.io/projected/5b426312-6745-47b1-a19b-4d3ffb91c5af-kube-api-access-xqdrd\") pod \"network-check-target-wcn9n\" (UID: \"5b426312-6745-47b1-a19b-4d3ffb91c5af\") " pod="openshift-network-diagnostics/network-check-target-wcn9n"
Sep 17 14:06:55.625533 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:55.625475    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59c1fc39-6669-462c-9a66-c97b5357d8ac-metrics-certs\") pod \"network-metrics-daemon-pjjpc\" (UID: \"59c1fc39-6669-462c-9a66-c97b5357d8ac\") " pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:06:55.625618 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:55.625602    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 14:06:55.625656 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:55.625627    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 14:06:55.625656 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:55.625637    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xqdrd for pod openshift-network-diagnostics/network-check-target-wcn9n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 14:06:55.625729 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:55.625680    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b426312-6745-47b1-a19b-4d3ffb91c5af-kube-api-access-xqdrd podName:5b426312-6745-47b1-a19b-4d3ffb91c5af nodeName:}" failed. No retries permitted until 2026-09-17 14:06:56.625663001 +0000 UTC m=+4.069738582 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xqdrd" (UniqueName: "kubernetes.io/projected/5b426312-6745-47b1-a19b-4d3ffb91c5af-kube-api-access-xqdrd") pod "network-check-target-wcn9n" (UID: "5b426312-6745-47b1-a19b-4d3ffb91c5af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 14:06:55.625729 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:55.625603    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 14:06:55.625802 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:55.625731    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59c1fc39-6669-462c-9a66-c97b5357d8ac-metrics-certs podName:59c1fc39-6669-462c-9a66-c97b5357d8ac nodeName:}" failed. No retries permitted until 2026-09-17 14:06:56.625722314 +0000 UTC m=+4.069797899 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59c1fc39-6669-462c-9a66-c97b5357d8ac-metrics-certs") pod "network-metrics-daemon-pjjpc" (UID: "59c1fc39-6669-462c-9a66-c97b5357d8ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 14:06:56.017424 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:56.017382    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 14:01:54 +0000 UTC" deadline="2028-04-02 06:48:11.895329648 +0000 UTC"
Sep 17 14:06:56.017424 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:56.017422    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13504h41m15.877912625s"
Sep 17 14:06:56.171162 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:56.170487    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:06:56.171162 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:56.170605    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wf7" podUID="2da17ddd-8912-4e47-af0f-dc90e7aef2e7"
Sep 17 14:06:56.171162 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:56.171006    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:06:56.171162 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:56.171118    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjjpc" podUID="59c1fc39-6669-462c-9a66-c97b5357d8ac"
Sep 17 14:06:56.184017 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:56.183938    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9m7cc" event={"ID":"0f047d12-6bab-4074-8d56-cadba9e9c5dd","Type":"ContainerStarted","Data":"e152cfbd831bae128e725708a80e6d4cd7ede176eca8154aba629b88e49cabfe"}
Sep 17 14:06:56.192776 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:56.192182    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-22.ec2.internal" event={"ID":"e37420b5f4f2cfdf85c1d60d1139054c","Type":"ContainerStarted","Data":"1c8ae944266a20b234f4a4bbb8c50ff0ac00ce9beff71a2e862a6c6f4b5dbc3f"}
Sep 17 14:06:56.194800 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:56.194726    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w6p4f" event={"ID":"c8b99574-b747-4489-abb7-560e97784171","Type":"ContainerStarted","Data":"a8d914d37705b6a8f1d6d4cc99960c97c30e17a5b87c679171f5831a41f9e6fd"}
Sep 17 14:06:56.198755 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:56.198728    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cjdbx" event={"ID":"1a72aa89-6ca0-47df-9fde-fb8dbc65c79f","Type":"ContainerStarted","Data":"f327a53e9909be11cc8ce49e8beeb0c75ce47d1d8c89577f19556abd0d35b409"}
Sep 17 14:06:56.201442 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:56.201344    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9f67m" event={"ID":"f70452dc-7b40-4964-ba77-7825835571cf","Type":"ContainerStarted","Data":"bdd26c25966ac785c009d9c2dc4b30e8da04edb93450bdd55304be1e3a19b537"}
Sep 17 14:06:56.203248 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:56.203192    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-czxpz" event={"ID":"3005c93a-df5e-4bc3-9644-0f24121516bb","Type":"ContainerStarted","Data":"bb70feb938954f611026bd8ca4265892a7c7f2ad1ae659a653ca54f946e25aac"}
Sep 17 14:06:56.213772 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:56.213748    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j4k9b" event={"ID":"50cd5129-5e4f-4063-b789-aa7477a7df41","Type":"ContainerStarted","Data":"cba1e8cd928ad084138a130bacd9efa4f5e73328b40c97d370c70010447feaf9"}
Sep 17 14:06:56.219701 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:56.219670    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-chbsn" event={"ID":"68c8a1d5-6bb2-4f87-a96d-fca6fc490801","Type":"ContainerStarted","Data":"f3c1113d04b7b6e4ff24c29aa587a4915530a29c857c0ab24386ba17ff330868"}
Sep 17 14:06:56.221688 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:56.221660    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6cb9l" event={"ID":"f68cb2de-9f71-4ee3-8c37-75f1c2918f66","Type":"ContainerStarted","Data":"28751f84d1f1d73093a1a2cd0cf0cf47a29a38a120d12f4820bcee4bbd7713d3"}
Sep 17 14:06:56.224672 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:56.224647    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx678" event={"ID":"3ea6e510-921f-47be-959c-909c700aac5b","Type":"ContainerStarted","Data":"bb49067a9e8efce66dde2ba294189234b2cc292c46b2922094c11e22daeae355"}
Sep 17 14:06:56.531619 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:56.531578    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2da17ddd-8912-4e47-af0f-dc90e7aef2e7-original-pull-secret\") pod \"global-pull-secret-syncer-g2wf7\" (UID: \"2da17ddd-8912-4e47-af0f-dc90e7aef2e7\") " pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:06:56.531830 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:56.531757    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 14:06:56.531830 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:56.531819    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2da17ddd-8912-4e47-af0f-dc90e7aef2e7-original-pull-secret podName:2da17ddd-8912-4e47-af0f-dc90e7aef2e7 nodeName:}" failed. No retries permitted until 2026-09-17 14:06:58.531801965 +0000 UTC m=+5.975877536 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2da17ddd-8912-4e47-af0f-dc90e7aef2e7-original-pull-secret") pod "global-pull-secret-syncer-g2wf7" (UID: "2da17ddd-8912-4e47-af0f-dc90e7aef2e7") : object "kube-system"/"original-pull-secret" not registered
Sep 17 14:06:56.632159 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:56.632120    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqdrd\" (UniqueName: \"kubernetes.io/projected/5b426312-6745-47b1-a19b-4d3ffb91c5af-kube-api-access-xqdrd\") pod \"network-check-target-wcn9n\" (UID: \"5b426312-6745-47b1-a19b-4d3ffb91c5af\") " pod="openshift-network-diagnostics/network-check-target-wcn9n"
Sep 17 14:06:56.632348 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:56.632179    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59c1fc39-6669-462c-9a66-c97b5357d8ac-metrics-certs\") pod \"network-metrics-daemon-pjjpc\" (UID: \"59c1fc39-6669-462c-9a66-c97b5357d8ac\") " pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:06:56.632348 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:56.632299    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 14:06:56.632454 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:56.632362    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59c1fc39-6669-462c-9a66-c97b5357d8ac-metrics-certs podName:59c1fc39-6669-462c-9a66-c97b5357d8ac nodeName:}" failed. No retries permitted until 2026-09-17 14:06:58.63234278 +0000 UTC m=+6.076418350 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59c1fc39-6669-462c-9a66-c97b5357d8ac-metrics-certs") pod "network-metrics-daemon-pjjpc" (UID: "59c1fc39-6669-462c-9a66-c97b5357d8ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 14:06:56.632454 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:56.632396    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 14:06:56.632454 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:56.632421    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 14:06:56.632454 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:56.632434    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xqdrd for pod openshift-network-diagnostics/network-check-target-wcn9n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 14:06:56.632652 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:56.632484    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b426312-6745-47b1-a19b-4d3ffb91c5af-kube-api-access-xqdrd podName:5b426312-6745-47b1-a19b-4d3ffb91c5af nodeName:}" failed. No retries permitted until 2026-09-17 14:06:58.632468038 +0000 UTC m=+6.076543605 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xqdrd" (UniqueName: "kubernetes.io/projected/5b426312-6745-47b1-a19b-4d3ffb91c5af-kube-api-access-xqdrd") pod "network-check-target-wcn9n" (UID: "5b426312-6745-47b1-a19b-4d3ffb91c5af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 14:06:57.017945 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:57.017863    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 14:01:54 +0000 UTC" deadline="2028-05-11 09:13:28.906927239 +0000 UTC"
Sep 17 14:06:57.017945 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:57.017930    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14443h6m31.889001645s"
Sep 17 14:06:57.174259 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:57.173685    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcn9n"
Sep 17 14:06:57.174259 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:57.173819    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcn9n" podUID="5b426312-6745-47b1-a19b-4d3ffb91c5af"
Sep 17 14:06:58.171588 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:58.170864    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:06:58.171588 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:58.170986    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wf7" podUID="2da17ddd-8912-4e47-af0f-dc90e7aef2e7"
Sep 17 14:06:58.171588 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:58.171380    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:06:58.171588 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:58.171488    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjjpc" podUID="59c1fc39-6669-462c-9a66-c97b5357d8ac"
Sep 17 14:06:58.242972 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:58.242934    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal" event={"ID":"e7dbc191af6a805aa5ecdfa53b74162f","Type":"ContainerStarted","Data":"47a8f285ff4c48834bebb6675a26b7b8dd61e6f6121e487f43a91d5915568ff7"}
Sep 17 14:06:58.288828 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:58.287609    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-22.ec2.internal" podStartSLOduration=4.287584919 podStartE2EDuration="4.287584919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:06:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:06:56.243999493 +0000 UTC m=+3.688075102" watchObservedRunningTime="2026-09-17 14:06:58.287584919 +0000 UTC m=+5.731660482"
Sep 17 14:06:58.546894 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:58.546331    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2da17ddd-8912-4e47-af0f-dc90e7aef2e7-original-pull-secret\") pod \"global-pull-secret-syncer-g2wf7\" (UID: \"2da17ddd-8912-4e47-af0f-dc90e7aef2e7\") " pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:06:58.546894 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:58.546472    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 14:06:58.546894 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:58.546538    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2da17ddd-8912-4e47-af0f-dc90e7aef2e7-original-pull-secret podName:2da17ddd-8912-4e47-af0f-dc90e7aef2e7 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:02.546519216 +0000 UTC m=+9.990594783 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2da17ddd-8912-4e47-af0f-dc90e7aef2e7-original-pull-secret") pod "global-pull-secret-syncer-g2wf7" (UID: "2da17ddd-8912-4e47-af0f-dc90e7aef2e7") : object "kube-system"/"original-pull-secret" not registered
Sep 17 14:06:58.647161 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:58.647117    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqdrd\" (UniqueName: \"kubernetes.io/projected/5b426312-6745-47b1-a19b-4d3ffb91c5af-kube-api-access-xqdrd\") pod \"network-check-target-wcn9n\" (UID: \"5b426312-6745-47b1-a19b-4d3ffb91c5af\") " pod="openshift-network-diagnostics/network-check-target-wcn9n"
Sep 17 14:06:58.647345 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:58.647179    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59c1fc39-6669-462c-9a66-c97b5357d8ac-metrics-certs\") pod \"network-metrics-daemon-pjjpc\" (UID: \"59c1fc39-6669-462c-9a66-c97b5357d8ac\") " pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:06:58.647407 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:58.647356    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 14:06:58.647458 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:58.647420    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59c1fc39-6669-462c-9a66-c97b5357d8ac-metrics-certs podName:59c1fc39-6669-462c-9a66-c97b5357d8ac nodeName:}" failed. No retries permitted until 2026-09-17 14:07:02.647401173 +0000 UTC m=+10.091476742 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59c1fc39-6669-462c-9a66-c97b5357d8ac-metrics-certs") pod "network-metrics-daemon-pjjpc" (UID: "59c1fc39-6669-462c-9a66-c97b5357d8ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 14:06:58.647524 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:58.647516    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 14:06:58.647577 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:58.647531    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 14:06:58.647577 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:58.647543    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xqdrd for pod openshift-network-diagnostics/network-check-target-wcn9n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 14:06:58.647679 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:58.647584    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b426312-6745-47b1-a19b-4d3ffb91c5af-kube-api-access-xqdrd podName:5b426312-6745-47b1-a19b-4d3ffb91c5af nodeName:}" failed. No retries permitted until 2026-09-17 14:07:02.647570488 +0000 UTC m=+10.091646055 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xqdrd" (UniqueName: "kubernetes.io/projected/5b426312-6745-47b1-a19b-4d3ffb91c5af-kube-api-access-xqdrd") pod "network-check-target-wcn9n" (UID: "5b426312-6745-47b1-a19b-4d3ffb91c5af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 14:06:59.171000 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:06:59.170801    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcn9n"
Sep 17 14:06:59.171000 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:06:59.170942    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcn9n" podUID="5b426312-6745-47b1-a19b-4d3ffb91c5af"
Sep 17 14:07:00.171046 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:00.171012    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:07:00.171481 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:00.171139    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wf7" podUID="2da17ddd-8912-4e47-af0f-dc90e7aef2e7"
Sep 17 14:07:00.171563 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:00.171516    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:07:00.171645 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:00.171626    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjjpc" podUID="59c1fc39-6669-462c-9a66-c97b5357d8ac"
Sep 17 14:07:01.170497 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:01.170461    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcn9n"
Sep 17 14:07:01.170668 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:01.170594    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcn9n" podUID="5b426312-6745-47b1-a19b-4d3ffb91c5af"
Sep 17 14:07:02.171253 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:02.171057    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:07:02.171253 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:02.171200    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wf7" podUID="2da17ddd-8912-4e47-af0f-dc90e7aef2e7"
Sep 17 14:07:02.171253 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:02.171251    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:07:02.171872 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:02.171378    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjjpc" podUID="59c1fc39-6669-462c-9a66-c97b5357d8ac"
Sep 17 14:07:02.580862 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:02.580818    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2da17ddd-8912-4e47-af0f-dc90e7aef2e7-original-pull-secret\") pod \"global-pull-secret-syncer-g2wf7\" (UID: \"2da17ddd-8912-4e47-af0f-dc90e7aef2e7\") " pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:07:02.581045 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:02.580962    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 14:07:02.581045 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:02.581020    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2da17ddd-8912-4e47-af0f-dc90e7aef2e7-original-pull-secret podName:2da17ddd-8912-4e47-af0f-dc90e7aef2e7 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:10.581001676 +0000 UTC m=+18.025077248 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2da17ddd-8912-4e47-af0f-dc90e7aef2e7-original-pull-secret") pod "global-pull-secret-syncer-g2wf7" (UID: "2da17ddd-8912-4e47-af0f-dc90e7aef2e7") : object "kube-system"/"original-pull-secret" not registered
Sep 17 14:07:02.682137 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:02.682055    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqdrd\" (UniqueName: \"kubernetes.io/projected/5b426312-6745-47b1-a19b-4d3ffb91c5af-kube-api-access-xqdrd\") pod \"network-check-target-wcn9n\" (UID: \"5b426312-6745-47b1-a19b-4d3ffb91c5af\") " pod="openshift-network-diagnostics/network-check-target-wcn9n"
Sep 17 14:07:02.682137 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:02.682111    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59c1fc39-6669-462c-9a66-c97b5357d8ac-metrics-certs\") pod \"network-metrics-daemon-pjjpc\" (UID: \"59c1fc39-6669-462c-9a66-c97b5357d8ac\") " pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:07:02.682401 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:02.682238    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 14:07:02.682401 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:02.682264    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 14:07:02.682401 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:02.682277    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xqdrd for pod openshift-network-diagnostics/network-check-target-wcn9n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 14:07:02.682401 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:02.682319    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 14:07:02.682401 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:02.682342    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b426312-6745-47b1-a19b-4d3ffb91c5af-kube-api-access-xqdrd podName:5b426312-6745-47b1-a19b-4d3ffb91c5af nodeName:}" failed. No retries permitted until 2026-09-17 14:07:10.682323204 +0000 UTC m=+18.126398774 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xqdrd" (UniqueName: "kubernetes.io/projected/5b426312-6745-47b1-a19b-4d3ffb91c5af-kube-api-access-xqdrd") pod "network-check-target-wcn9n" (UID: "5b426312-6745-47b1-a19b-4d3ffb91c5af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 14:07:02.682401 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:02.682371    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59c1fc39-6669-462c-9a66-c97b5357d8ac-metrics-certs podName:59c1fc39-6669-462c-9a66-c97b5357d8ac nodeName:}" failed. No retries permitted until 2026-09-17 14:07:10.682354901 +0000 UTC m=+18.126430464 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59c1fc39-6669-462c-9a66-c97b5357d8ac-metrics-certs") pod "network-metrics-daemon-pjjpc" (UID: "59c1fc39-6669-462c-9a66-c97b5357d8ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 14:07:03.171821 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:03.171785    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcn9n"
Sep 17 14:07:03.172308 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:03.171908    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcn9n" podUID="5b426312-6745-47b1-a19b-4d3ffb91c5af"
Sep 17 14:07:04.171157 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:04.171119    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:07:04.171332 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:04.171169    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:07:04.171332 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:04.171235    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjjpc" podUID="59c1fc39-6669-462c-9a66-c97b5357d8ac"
Sep 17 14:07:04.171332 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:04.171312    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wf7" podUID="2da17ddd-8912-4e47-af0f-dc90e7aef2e7"
Sep 17 14:07:04.257593 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:04.257559    2580 generic.go:356] "Generic (PLEG): container finished" podID="e7dbc191af6a805aa5ecdfa53b74162f" containerID="47a8f285ff4c48834bebb6675a26b7b8dd61e6f6121e487f43a91d5915568ff7" exitCode=0
Sep 17 14:07:04.258045 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:04.257617    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal" event={"ID":"e7dbc191af6a805aa5ecdfa53b74162f","Type":"ContainerDied","Data":"47a8f285ff4c48834bebb6675a26b7b8dd61e6f6121e487f43a91d5915568ff7"}
Sep 17 14:07:05.171386 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:05.171352    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcn9n"
Sep 17 14:07:05.171545 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:05.171473    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcn9n" podUID="5b426312-6745-47b1-a19b-4d3ffb91c5af"
Sep 17 14:07:06.171233 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:06.171198    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:07:06.171233 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:06.171222    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:07:06.171623 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:06.171317    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjjpc" podUID="59c1fc39-6669-462c-9a66-c97b5357d8ac"
Sep 17 14:07:06.171623 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:06.171421    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wf7" podUID="2da17ddd-8912-4e47-af0f-dc90e7aef2e7"
Sep 17 14:07:07.171412 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:07.171382    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcn9n"
Sep 17 14:07:07.171857 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:07.171524    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcn9n" podUID="5b426312-6745-47b1-a19b-4d3ffb91c5af"
Sep 17 14:07:08.171223 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:08.171185    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:07:08.171389 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:08.171314    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjjpc" podUID="59c1fc39-6669-462c-9a66-c97b5357d8ac"
Sep 17 14:07:08.171451 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:08.171381    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:07:08.171797 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:08.171502    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wf7" podUID="2da17ddd-8912-4e47-af0f-dc90e7aef2e7"
Sep 17 14:07:09.170912 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:09.170876    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcn9n"
Sep 17 14:07:09.171080 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:09.171006    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcn9n" podUID="5b426312-6745-47b1-a19b-4d3ffb91c5af"
Sep 17 14:07:10.170989 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:10.170958    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:07:10.171521 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:10.171003    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:07:10.171521 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:10.171087    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjjpc" podUID="59c1fc39-6669-462c-9a66-c97b5357d8ac"
Sep 17 14:07:10.171521 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:10.171200    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wf7" podUID="2da17ddd-8912-4e47-af0f-dc90e7aef2e7"
Sep 17 14:07:10.640297 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:10.640259    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2da17ddd-8912-4e47-af0f-dc90e7aef2e7-original-pull-secret\") pod \"global-pull-secret-syncer-g2wf7\" (UID: \"2da17ddd-8912-4e47-af0f-dc90e7aef2e7\") " pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:07:10.640461 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:10.640431    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 14:07:10.640527 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:10.640509    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2da17ddd-8912-4e47-af0f-dc90e7aef2e7-original-pull-secret podName:2da17ddd-8912-4e47-af0f-dc90e7aef2e7 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:26.640487195 +0000 UTC m=+34.084562773 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2da17ddd-8912-4e47-af0f-dc90e7aef2e7-original-pull-secret") pod "global-pull-secret-syncer-g2wf7" (UID: "2da17ddd-8912-4e47-af0f-dc90e7aef2e7") : object "kube-system"/"original-pull-secret" not registered
Sep 17 14:07:10.741095 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:10.741059    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqdrd\" (UniqueName: \"kubernetes.io/projected/5b426312-6745-47b1-a19b-4d3ffb91c5af-kube-api-access-xqdrd\") pod \"network-check-target-wcn9n\" (UID: \"5b426312-6745-47b1-a19b-4d3ffb91c5af\") " pod="openshift-network-diagnostics/network-check-target-wcn9n"
Sep 17 14:07:10.741274 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:10.741103    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59c1fc39-6669-462c-9a66-c97b5357d8ac-metrics-certs\") pod \"network-metrics-daemon-pjjpc\" (UID: \"59c1fc39-6669-462c-9a66-c97b5357d8ac\") " pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:07:10.741274 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:10.741254    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 14:07:10.741382 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:10.741282    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 14:07:10.741382 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:10.741296    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xqdrd for pod openshift-network-diagnostics/network-check-target-wcn9n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 14:07:10.741382 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:10.741296    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 14:07:10.741382 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:10.741362    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b426312-6745-47b1-a19b-4d3ffb91c5af-kube-api-access-xqdrd podName:5b426312-6745-47b1-a19b-4d3ffb91c5af nodeName:}" failed. No retries permitted until 2026-09-17 14:07:26.741342329 +0000 UTC m=+34.185417907 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xqdrd" (UniqueName: "kubernetes.io/projected/5b426312-6745-47b1-a19b-4d3ffb91c5af-kube-api-access-xqdrd") pod "network-check-target-wcn9n" (UID: "5b426312-6745-47b1-a19b-4d3ffb91c5af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 14:07:10.741382 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:10.741382    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59c1fc39-6669-462c-9a66-c97b5357d8ac-metrics-certs podName:59c1fc39-6669-462c-9a66-c97b5357d8ac nodeName:}" failed. No retries permitted until 2026-09-17 14:07:26.741371398 +0000 UTC m=+34.185446966 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59c1fc39-6669-462c-9a66-c97b5357d8ac-metrics-certs") pod "network-metrics-daemon-pjjpc" (UID: "59c1fc39-6669-462c-9a66-c97b5357d8ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 14:07:11.170911 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:11.170863    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcn9n"
Sep 17 14:07:11.171104 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:11.171012    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcn9n" podUID="5b426312-6745-47b1-a19b-4d3ffb91c5af"
Sep 17 14:07:12.171133 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:12.171098    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:07:12.171133 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:12.171135    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:07:12.171606 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:12.171216    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wf7" podUID="2da17ddd-8912-4e47-af0f-dc90e7aef2e7"
Sep 17 14:07:12.171606 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:12.171338    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjjpc" podUID="59c1fc39-6669-462c-9a66-c97b5357d8ac"
Sep 17 14:07:13.171367 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:13.171338    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcn9n"
Sep 17 14:07:13.171734 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:13.171416    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcn9n" podUID="5b426312-6745-47b1-a19b-4d3ffb91c5af"
Sep 17 14:07:14.170697 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:14.170505    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:07:14.170857 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:14.170541    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:07:14.170912 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:14.170876    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wf7" podUID="2da17ddd-8912-4e47-af0f-dc90e7aef2e7"
Sep 17 14:07:14.171066 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:14.171039    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjjpc" podUID="59c1fc39-6669-462c-9a66-c97b5357d8ac"
Sep 17 14:07:14.277188 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:14.277120    2580 generic.go:356] "Generic (PLEG): container finished" podID="c8b99574-b747-4489-abb7-560e97784171" containerID="8b9aa9ec581906b71009dd501ae7de69e2fc9c998bcbb40334a427149d91c3b8" exitCode=0
Sep 17 14:07:14.277939 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:14.277194    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w6p4f" event={"ID":"c8b99574-b747-4489-abb7-560e97784171","Type":"ContainerDied","Data":"8b9aa9ec581906b71009dd501ae7de69e2fc9c998bcbb40334a427149d91c3b8"}
Sep 17 14:07:14.278772 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:14.278751    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cjdbx" event={"ID":"1a72aa89-6ca0-47df-9fde-fb8dbc65c79f","Type":"ContainerStarted","Data":"5c8f1716d7ac0ae7c9b4c4422bb13dcaf6582a23ab5c2438076e5e1b24d6d41b"}
Sep 17 14:07:14.281921 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:14.281894    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9f67m" event={"ID":"f70452dc-7b40-4964-ba77-7825835571cf","Type":"ContainerStarted","Data":"2c3ec7db96953d869c05e4c6b458a69ca516bad02180f2f2206f2c00e74f8eac"}
Sep 17 14:07:14.282018 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:14.281975    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9f67m" event={"ID":"f70452dc-7b40-4964-ba77-7825835571cf","Type":"ContainerStarted","Data":"6d934041c779ce121ba4b120a2b52ab8b36cb4371024c8a96470e0ef43636b02"}
Sep 17 14:07:14.282066 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:14.282026    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9f67m" event={"ID":"f70452dc-7b40-4964-ba77-7825835571cf","Type":"ContainerStarted","Data":"704795a6f0b343dd6cc7e2f089b8abf98e7e69534b30e64d811cea6742ef8361"}
Sep 17 14:07:14.282101 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:14.282074    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9f67m" event={"ID":"f70452dc-7b40-4964-ba77-7825835571cf","Type":"ContainerStarted","Data":"04b59272f453979bed77598d778e68e5e872a436e9453c2b1cdb8684608598bc"}
Sep 17 14:07:14.282142 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:14.282107    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9f67m" event={"ID":"f70452dc-7b40-4964-ba77-7825835571cf","Type":"ContainerStarted","Data":"1a5eac9294181b4fd6c1ae10f42508d701036942f1b25b693340675645f62bd4"}
Sep 17 14:07:14.282179 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:14.282142    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9f67m" event={"ID":"f70452dc-7b40-4964-ba77-7825835571cf","Type":"ContainerStarted","Data":"95a39f0b0390b1c7faad7bcdadc143f001f9b49215983824cd2cd35b2ccb41f6"}
Sep 17 14:07:14.283764 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:14.283742    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal" event={"ID":"e7dbc191af6a805aa5ecdfa53b74162f","Type":"ContainerStarted","Data":"62719d723e97920967fbb15176ff91aeede920aafc128ad0b4ddc9d9af4a74f3"}
Sep 17 14:07:14.285107 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:14.285084    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j4k9b" event={"ID":"50cd5129-5e4f-4063-b789-aa7477a7df41","Type":"ContainerStarted","Data":"629df742f28aa60651069a9ba8c163d802eeb90d95ccc89edc714f4f503a3d73"}
Sep 17 14:07:14.286526 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:14.286505    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-chbsn" event={"ID":"68c8a1d5-6bb2-4f87-a96d-fca6fc490801","Type":"ContainerStarted","Data":"79af7fd970daf50e143022ef9afb98106695d839faa43f885c6066e2d4801b7f"}
Sep 17 14:07:14.287850 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:14.287826    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6cb9l" event={"ID":"f68cb2de-9f71-4ee3-8c37-75f1c2918f66","Type":"ContainerStarted","Data":"185ec4e5d8caaa06afc6d2fc0e560774dd2e96ef5e82415e2f28fcb950dfe855"}
Sep 17 14:07:14.289170 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:14.289152    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx678" event={"ID":"3ea6e510-921f-47be-959c-909c700aac5b","Type":"ContainerStarted","Data":"bb73ca2fed16b4e72d159aab34ccc5cf6c2ebdacf79be724a96a3e14739886cc"}
Sep 17 14:07:14.290399 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:14.290383    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9m7cc" event={"ID":"0f047d12-6bab-4074-8d56-cadba9e9c5dd","Type":"ContainerStarted","Data":"4a48b72956c332ee16908d5c64edaa8c2c69b4ed88a55e757a105fe7473b1a6d"}
Sep 17 14:07:14.345854 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:14.345803    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-j4k9b" podStartSLOduration=3.597120662 podStartE2EDuration="21.345787539s" totalImagesPullingTime="17.748666877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:14.345541133 +0000 UTC m=+21.789616720" watchObservedRunningTime="2026-09-17 14:07:14.345787539 +0000 UTC m=+21.789863125"
Sep 17 14:07:14.346037 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:14.345897    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9m7cc" podStartSLOduration=3.6046432299999998 podStartE2EDuration="21.345890339s" totalImagesPullingTime="17.741247109s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:14.32936666 +0000 UTC m=+21.773442272" watchObservedRunningTime="2026-09-17 14:07:14.345890339 +0000 UTC m=+21.789965925"
Sep 17 14:07:14.390512 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:14.390461    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-chbsn" podStartSLOduration=3.589547486 podStartE2EDuration="21.390444208s" totalImagesPullingTime="17.800896722s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:14.371258609 +0000 UTC m=+21.815334196" watchObservedRunningTime="2026-09-17 14:07:14.390444208 +0000 UTC m=+21.834519787"
Sep 17 14:07:14.391550 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:14.391497    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-22.ec2.internal" podStartSLOduration=20.391478939 podStartE2EDuration="20.391478939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:06:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:14.391116105 +0000 UTC m=+21.835191686" watchObservedRunningTime="2026-09-17 14:07:14.391478939 +0000 UTC m=+21.835554527"
Sep 17 14:07:14.410144 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:14.410100    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cjdbx" podStartSLOduration=3.640527392 podStartE2EDuration="21.410087471s" totalImagesPullingTime="17.769560079s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:14.409923637 +0000 UTC m=+21.853999242" watchObservedRunningTime="2026-09-17 14:07:14.410087471 +0000 UTC m=+21.854163056"
Sep 17 14:07:14.793857 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:14.793683    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 17 14:07:15.120692 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:15.120572    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T14:07:14.793852184Z","UUID":"98df2d82-1424-42e3-8a73-b05ee7334da4","Handler":null,"Name":"","Endpoint":""}
Sep 17 14:07:15.122177 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:15.122156    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 17 14:07:15.122299 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:15.122192    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 17 14:07:15.171280 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:15.171255    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcn9n"
Sep 17 14:07:15.171427 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:15.171376    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcn9n" podUID="5b426312-6745-47b1-a19b-4d3ffb91c5af"
Sep 17 14:07:15.294135 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:15.294098    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-czxpz" event={"ID":"3005c93a-df5e-4bc3-9644-0f24121516bb","Type":"ContainerStarted","Data":"14cefd4d2c4df20383bcd7fb672d6215d2be84b3663a6ba63ca5a06d03a5a65b"}
Sep 17 14:07:15.295976 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:15.295944    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx678" event={"ID":"3ea6e510-921f-47be-959c-909c700aac5b","Type":"ContainerStarted","Data":"7358ff5dbb24e1e8119ea95ec33e49aac019d9290b1cb8471a3f37fe343bb50d"}
Sep 17 14:07:15.312403 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:15.312360    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6cb9l" podStartSLOduration=4.550395745 podStartE2EDuration="22.312343997s" totalImagesPullingTime="17.761948252s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:14.42666722 +0000 UTC m=+21.870742824" watchObservedRunningTime="2026-09-17 14:07:15.312343997 +0000 UTC m=+22.756419598"
Sep 17 14:07:15.312561 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:15.312542    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-czxpz" podStartSLOduration=4.565296241 podStartE2EDuration="22.312534469s" totalImagesPullingTime="17.747238228s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:15.311967846 +0000 UTC m=+22.756043475" watchObservedRunningTime="2026-09-17 14:07:15.312534469 +0000 UTC m=+22.756610056"
Sep 17 14:07:16.171335 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:16.170877    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:07:16.171335 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:16.170919    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:07:16.171335 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:16.171041    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjjpc" podUID="59c1fc39-6669-462c-9a66-c97b5357d8ac"
Sep 17 14:07:16.171335 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:16.171144    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wf7" podUID="2da17ddd-8912-4e47-af0f-dc90e7aef2e7"
Sep 17 14:07:16.300320 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:16.300286    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx678" event={"ID":"3ea6e510-921f-47be-959c-909c700aac5b","Type":"ContainerStarted","Data":"8fcecb759c41056ad83b1f4110b622ad19357b5c1fd7f18e99fd34794a3f15aa"}
Sep 17 14:07:16.303656 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:16.303633    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9f67m" event={"ID":"f70452dc-7b40-4964-ba77-7825835571cf","Type":"ContainerStarted","Data":"ffdaf6391a033f2ddc6090007f66e3167f360be72572657cec14554814da6fcd"}
Sep 17 14:07:17.171509 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:17.171475    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcn9n"
Sep 17 14:07:17.171777 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:17.171584    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcn9n" podUID="5b426312-6745-47b1-a19b-4d3ffb91c5af"
Sep 17 14:07:18.171409 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:18.171379    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:07:18.171934 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:18.171505    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wf7" podUID="2da17ddd-8912-4e47-af0f-dc90e7aef2e7"
Sep 17 14:07:18.171934 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:18.171560    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:07:18.171934 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:18.171653    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjjpc" podUID="59c1fc39-6669-462c-9a66-c97b5357d8ac"
Sep 17 14:07:19.171247 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:19.171105    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcn9n"
Sep 17 14:07:19.171348 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:19.171321    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcn9n" podUID="5b426312-6745-47b1-a19b-4d3ffb91c5af"
Sep 17 14:07:19.186610 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:19.186580    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-j4k9b"
Sep 17 14:07:19.187106 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:19.187089    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-j4k9b"
Sep 17 14:07:19.207826 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:19.207767    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx678" podStartSLOduration=6.310087342 podStartE2EDuration="26.207749977s" totalImagesPullingTime="19.897662635s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:06:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:16.331580014 +0000 UTC m=+23.775655601" watchObservedRunningTime="2026-09-17 14:07:19.207749977 +0000 UTC m=+26.651825562"
Sep 17 14:07:19.312793 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:19.312761    2580 generic.go:356] "Generic (PLEG): container finished" podID="c8b99574-b747-4489-abb7-560e97784171" containerID="d6559d9cea5b7e44f0f463c775bd4764a5ceb7646ddc8508138d5bfb2e276308" exitCode=0
Sep 17 14:07:19.312904 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:19.312847    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w6p4f" event={"ID":"c8b99574-b747-4489-abb7-560e97784171","Type":"ContainerDied","Data":"d6559d9cea5b7e44f0f463c775bd4764a5ceb7646ddc8508138d5bfb2e276308"}
Sep 17 14:07:19.316985 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:19.316963    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9f67m" event={"ID":"f70452dc-7b40-4964-ba77-7825835571cf","Type":"ContainerStarted","Data":"dbcde90b661777a0ea3f511df58f8f71ed02cbe585dc037dc0e38e93d7191d9c"}
Sep 17 14:07:19.369801 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:19.369748    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9f67m" podStartSLOduration=8.560823715 podStartE2EDuration="26.369727848s" totalImagesPullingTime="17.808904133s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:19.367355486 +0000 UTC m=+26.811431072" watchObservedRunningTime="2026-09-17 14:07:19.369727848 +0000 UTC m=+26.813803444"
Sep 17 14:07:20.086396 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:20.086362    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-j4k9b"
Sep 17 14:07:20.087058 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:20.087031    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-j4k9b"
Sep 17 14:07:20.171271 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:20.171232    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:07:20.171271 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:20.171251    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:07:20.171470 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:20.171374    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wf7" podUID="2da17ddd-8912-4e47-af0f-dc90e7aef2e7"
Sep 17 14:07:20.171540 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:20.171496    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjjpc" podUID="59c1fc39-6669-462c-9a66-c97b5357d8ac"
Sep 17 14:07:20.319614 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:20.319578    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:07:20.320083 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:20.319655    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:07:20.320083 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:20.319701    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:07:20.335125 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:20.335098    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:07:20.335278 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:20.335258    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:07:20.880458 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:20.880416    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g2wf7"]
Sep 17 14:07:20.880655 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:20.880536    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:07:20.880757 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:20.880649    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wf7" podUID="2da17ddd-8912-4e47-af0f-dc90e7aef2e7"
Sep 17 14:07:20.890662 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:20.890571    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pjjpc"]
Sep 17 14:07:20.890841 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:20.890671    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:07:20.890841 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:20.890809    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjjpc" podUID="59c1fc39-6669-462c-9a66-c97b5357d8ac"
Sep 17 14:07:20.891228 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:20.891208    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wcn9n"]
Sep 17 14:07:20.891319 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:20.891295    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcn9n"
Sep 17 14:07:20.891428 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:20.891386    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcn9n" podUID="5b426312-6745-47b1-a19b-4d3ffb91c5af"
Sep 17 14:07:22.171293 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:22.171120    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:07:22.171847 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:22.171126    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcn9n"
Sep 17 14:07:22.171847 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:22.171387    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjjpc" podUID="59c1fc39-6669-462c-9a66-c97b5357d8ac"
Sep 17 14:07:22.171847 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:22.171430    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcn9n" podUID="5b426312-6745-47b1-a19b-4d3ffb91c5af"
Sep 17 14:07:22.326024 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:22.325990    2580 generic.go:356] "Generic (PLEG): container finished" podID="c8b99574-b747-4489-abb7-560e97784171" containerID="44f698fef91f00a5d6178494f6849e487f04e6d4827f4da10836d14d69d4cf8d" exitCode=0
Sep 17 14:07:22.326182 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:22.326068    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w6p4f" event={"ID":"c8b99574-b747-4489-abb7-560e97784171","Type":"ContainerDied","Data":"44f698fef91f00a5d6178494f6849e487f04e6d4827f4da10836d14d69d4cf8d"}
Sep 17 14:07:23.172561 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:23.172533    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:07:23.172896 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:23.172644    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wf7" podUID="2da17ddd-8912-4e47-af0f-dc90e7aef2e7"
Sep 17 14:07:24.171275 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:24.171240    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:07:24.171464 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:24.171240    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcn9n"
Sep 17 14:07:24.171464 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:24.171352    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjjpc" podUID="59c1fc39-6669-462c-9a66-c97b5357d8ac"
Sep 17 14:07:24.171464 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:24.171425    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcn9n" podUID="5b426312-6745-47b1-a19b-4d3ffb91c5af"
Sep 17 14:07:24.332368 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:24.332335    2580 generic.go:356] "Generic (PLEG): container finished" podID="c8b99574-b747-4489-abb7-560e97784171" containerID="60942bc7754dc44058f83147ba37dfcea576e4da8bec9b03cbbea8e8b03567e1" exitCode=0
Sep 17 14:07:24.332783 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:24.332396    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w6p4f" event={"ID":"c8b99574-b747-4489-abb7-560e97784171","Type":"ContainerDied","Data":"60942bc7754dc44058f83147ba37dfcea576e4da8bec9b03cbbea8e8b03567e1"}
Sep 17 14:07:25.171074 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:25.171037    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:07:25.171273 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:25.171180    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wf7" podUID="2da17ddd-8912-4e47-af0f-dc90e7aef2e7"
Sep 17 14:07:26.170889 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:26.170856    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcn9n"
Sep 17 14:07:26.171348 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:26.170861    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:07:26.171348 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:26.170976    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcn9n" podUID="5b426312-6745-47b1-a19b-4d3ffb91c5af"
Sep 17 14:07:26.171348 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:26.171061    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjjpc" podUID="59c1fc39-6669-462c-9a66-c97b5357d8ac"
Sep 17 14:07:26.659459 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:26.659418    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2da17ddd-8912-4e47-af0f-dc90e7aef2e7-original-pull-secret\") pod \"global-pull-secret-syncer-g2wf7\" (UID: \"2da17ddd-8912-4e47-af0f-dc90e7aef2e7\") " pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:07:26.659634 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:26.659565    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 14:07:26.659634 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:26.659627    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2da17ddd-8912-4e47-af0f-dc90e7aef2e7-original-pull-secret podName:2da17ddd-8912-4e47-af0f-dc90e7aef2e7 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:58.659611545 +0000 UTC m=+66.103687113 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2da17ddd-8912-4e47-af0f-dc90e7aef2e7-original-pull-secret") pod "global-pull-secret-syncer-g2wf7" (UID: "2da17ddd-8912-4e47-af0f-dc90e7aef2e7") : object "kube-system"/"original-pull-secret" not registered
Sep 17 14:07:26.760364 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:26.760320    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqdrd\" (UniqueName: \"kubernetes.io/projected/5b426312-6745-47b1-a19b-4d3ffb91c5af-kube-api-access-xqdrd\") pod \"network-check-target-wcn9n\" (UID: \"5b426312-6745-47b1-a19b-4d3ffb91c5af\") " pod="openshift-network-diagnostics/network-check-target-wcn9n"
Sep 17 14:07:26.760364 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:26.760369    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59c1fc39-6669-462c-9a66-c97b5357d8ac-metrics-certs\") pod \"network-metrics-daemon-pjjpc\" (UID: \"59c1fc39-6669-462c-9a66-c97b5357d8ac\") " pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:07:26.760569 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:26.760462    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 14:07:26.760569 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:26.760479    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 14:07:26.760569 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:26.760503    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 14:07:26.760569 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:26.760514    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59c1fc39-6669-462c-9a66-c97b5357d8ac-metrics-certs podName:59c1fc39-6669-462c-9a66-c97b5357d8ac nodeName:}" failed. No retries permitted until 2026-09-17 14:07:58.760500105 +0000 UTC m=+66.204575670 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59c1fc39-6669-462c-9a66-c97b5357d8ac-metrics-certs") pod "network-metrics-daemon-pjjpc" (UID: "59c1fc39-6669-462c-9a66-c97b5357d8ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 14:07:26.760569 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:26.760517    2580 projected.go:196] Error preparing data for projected volume kube-api-access-xqdrd for pod openshift-network-diagnostics/network-check-target-wcn9n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 14:07:26.760569 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:26.760571    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b426312-6745-47b1-a19b-4d3ffb91c5af-kube-api-access-xqdrd podName:5b426312-6745-47b1-a19b-4d3ffb91c5af nodeName:}" failed. No retries permitted until 2026-09-17 14:07:58.760555787 +0000 UTC m=+66.204631351 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xqdrd" (UniqueName: "kubernetes.io/projected/5b426312-6745-47b1-a19b-4d3ffb91c5af-kube-api-access-xqdrd") pod "network-check-target-wcn9n" (UID: "5b426312-6745-47b1-a19b-4d3ffb91c5af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 14:07:27.170463 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.170381    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:07:27.170618 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:27.170513    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g2wf7" podUID="2da17ddd-8912-4e47-af0f-dc90e7aef2e7"
Sep 17 14:07:27.288382 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.288357    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-22.ec2.internal" event="NodeReady"
Sep 17 14:07:27.288844 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.288474    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 17 14:07:27.370996 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.370963    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6nv9q"]
Sep 17 14:07:27.374930 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.374907    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mhzr8"]
Sep 17 14:07:27.375118 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.375056    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6nv9q"
Sep 17 14:07:27.378121 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.378099    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mhzr8"
Sep 17 14:07:27.380315 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.380224    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 17 14:07:27.380315 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.380301    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 17 14:07:27.380756 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.380737    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jdh9k\""
Sep 17 14:07:27.382847 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.382828    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 17 14:07:27.383258 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.383237    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jltzw\""
Sep 17 14:07:27.383369 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.383323    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 17 14:07:27.383580 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.383561    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 17 14:07:27.392536 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.392514    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6nv9q"]
Sep 17 14:07:27.439303 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.439229    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mhzr8"]
Sep 17 14:07:27.465532 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.465495    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfjxd\" (UniqueName: \"kubernetes.io/projected/b69e72f2-4449-4197-ac80-a0284247ac28-kube-api-access-qfjxd\") pod \"dns-default-6nv9q\" (UID: \"b69e72f2-4449-4197-ac80-a0284247ac28\") " pod="openshift-dns/dns-default-6nv9q"
Sep 17 14:07:27.465707 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.465547    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b69e72f2-4449-4197-ac80-a0284247ac28-config-volume\") pod \"dns-default-6nv9q\" (UID: \"b69e72f2-4449-4197-ac80-a0284247ac28\") " pod="openshift-dns/dns-default-6nv9q"
Sep 17 14:07:27.465707 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.465606    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b69e72f2-4449-4197-ac80-a0284247ac28-metrics-tls\") pod \"dns-default-6nv9q\" (UID: \"b69e72f2-4449-4197-ac80-a0284247ac28\") " pod="openshift-dns/dns-default-6nv9q"
Sep 17 14:07:27.465707 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.465680    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b69e72f2-4449-4197-ac80-a0284247ac28-tmp-dir\") pod \"dns-default-6nv9q\" (UID: \"b69e72f2-4449-4197-ac80-a0284247ac28\") " pod="openshift-dns/dns-default-6nv9q"
Sep 17 14:07:27.465889 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.465783    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssctb\" (UniqueName: \"kubernetes.io/projected/85268ab9-968c-4231-85c2-e4bd619a31c5-kube-api-access-ssctb\") pod \"ingress-canary-mhzr8\" (UID: \"85268ab9-968c-4231-85c2-e4bd619a31c5\") " pod="openshift-ingress-canary/ingress-canary-mhzr8"
Sep 17 14:07:27.465889 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.465818    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85268ab9-968c-4231-85c2-e4bd619a31c5-cert\") pod \"ingress-canary-mhzr8\" (UID: \"85268ab9-968c-4231-85c2-e4bd619a31c5\") " pod="openshift-ingress-canary/ingress-canary-mhzr8"
Sep 17 14:07:27.566960 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.566912    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b69e72f2-4449-4197-ac80-a0284247ac28-config-volume\") pod \"dns-default-6nv9q\" (UID: \"b69e72f2-4449-4197-ac80-a0284247ac28\") " pod="openshift-dns/dns-default-6nv9q"
Sep 17 14:07:27.566960 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.566966    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b69e72f2-4449-4197-ac80-a0284247ac28-metrics-tls\") pod \"dns-default-6nv9q\" (UID: \"b69e72f2-4449-4197-ac80-a0284247ac28\") " pod="openshift-dns/dns-default-6nv9q"
Sep 17 14:07:27.567199 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.567032    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b69e72f2-4449-4197-ac80-a0284247ac28-tmp-dir\") pod \"dns-default-6nv9q\" (UID: \"b69e72f2-4449-4197-ac80-a0284247ac28\") " pod="openshift-dns/dns-default-6nv9q"
Sep 17 14:07:27.567199 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.567078    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssctb\" (UniqueName: \"kubernetes.io/projected/85268ab9-968c-4231-85c2-e4bd619a31c5-kube-api-access-ssctb\") pod \"ingress-canary-mhzr8\" (UID: \"85268ab9-968c-4231-85c2-e4bd619a31c5\") " pod="openshift-ingress-canary/ingress-canary-mhzr8"
Sep 17 14:07:27.567199 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.567096    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85268ab9-968c-4231-85c2-e4bd619a31c5-cert\") pod \"ingress-canary-mhzr8\" (UID: \"85268ab9-968c-4231-85c2-e4bd619a31c5\") " pod="openshift-ingress-canary/ingress-canary-mhzr8"
Sep 17 14:07:27.567199 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.567127    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfjxd\" (UniqueName: \"kubernetes.io/projected/b69e72f2-4449-4197-ac80-a0284247ac28-kube-api-access-qfjxd\") pod \"dns-default-6nv9q\" (UID: \"b69e72f2-4449-4197-ac80-a0284247ac28\") " pod="openshift-dns/dns-default-6nv9q"
Sep 17 14:07:27.567199 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:27.567171    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 14:07:27.567423 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:27.567249    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b69e72f2-4449-4197-ac80-a0284247ac28-metrics-tls podName:b69e72f2-4449-4197-ac80-a0284247ac28 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:28.06722743 +0000 UTC m=+35.511303006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b69e72f2-4449-4197-ac80-a0284247ac28-metrics-tls") pod "dns-default-6nv9q" (UID: "b69e72f2-4449-4197-ac80-a0284247ac28") : secret "dns-default-metrics-tls" not found
Sep 17 14:07:27.567472 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.567418    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b69e72f2-4449-4197-ac80-a0284247ac28-tmp-dir\") pod \"dns-default-6nv9q\" (UID: \"b69e72f2-4449-4197-ac80-a0284247ac28\") " pod="openshift-dns/dns-default-6nv9q"
Sep 17 14:07:27.567526 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.567506    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b69e72f2-4449-4197-ac80-a0284247ac28-config-volume\") pod \"dns-default-6nv9q\" (UID: \"b69e72f2-4449-4197-ac80-a0284247ac28\") " pod="openshift-dns/dns-default-6nv9q"
Sep 17 14:07:27.572346 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.572187    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85268ab9-968c-4231-85c2-e4bd619a31c5-cert\") pod \"ingress-canary-mhzr8\" (UID: \"85268ab9-968c-4231-85c2-e4bd619a31c5\") " pod="openshift-ingress-canary/ingress-canary-mhzr8"
Sep 17 14:07:27.593531 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.593503    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfjxd\" (UniqueName: \"kubernetes.io/projected/b69e72f2-4449-4197-ac80-a0284247ac28-kube-api-access-qfjxd\") pod \"dns-default-6nv9q\" (UID: \"b69e72f2-4449-4197-ac80-a0284247ac28\") " pod="openshift-dns/dns-default-6nv9q"
Sep 17 14:07:27.597698 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.597676    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssctb\" (UniqueName: \"kubernetes.io/projected/85268ab9-968c-4231-85c2-e4bd619a31c5-kube-api-access-ssctb\") pod \"ingress-canary-mhzr8\" (UID: \"85268ab9-968c-4231-85c2-e4bd619a31c5\") " pod="openshift-ingress-canary/ingress-canary-mhzr8"
Sep 17 14:07:27.694389 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:27.694311    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mhzr8"
Sep 17 14:07:28.070610 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:28.070575    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b69e72f2-4449-4197-ac80-a0284247ac28-metrics-tls\") pod \"dns-default-6nv9q\" (UID: \"b69e72f2-4449-4197-ac80-a0284247ac28\") " pod="openshift-dns/dns-default-6nv9q"
Sep 17 14:07:28.070815 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:28.070771    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 14:07:28.070868 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:28.070849    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b69e72f2-4449-4197-ac80-a0284247ac28-metrics-tls podName:b69e72f2-4449-4197-ac80-a0284247ac28 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:29.070828495 +0000 UTC m=+36.514904072 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b69e72f2-4449-4197-ac80-a0284247ac28-metrics-tls") pod "dns-default-6nv9q" (UID: "b69e72f2-4449-4197-ac80-a0284247ac28") : secret "dns-default-metrics-tls" not found
Sep 17 14:07:28.170390 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:28.170352    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:07:28.170554 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:28.170369    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcn9n"
Sep 17 14:07:28.173599 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:28.173562    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 14:07:28.173599 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:28.173564    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ck6nq\""
Sep 17 14:07:28.173790 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:28.173602    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 14:07:28.174724 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:28.174692    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 14:07:28.174847 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:28.174833    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c2694\""
Sep 17 14:07:29.045596 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:29.045492    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mhzr8"]
Sep 17 14:07:29.051916 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:07:29.051890    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85268ab9_968c_4231_85c2_e4bd619a31c5.slice/crio-8cd98618ea2139732e671471fe1fb9a75204f6c7818599e45330229858ec60cd WatchSource:0}: Error finding container 8cd98618ea2139732e671471fe1fb9a75204f6c7818599e45330229858ec60cd: Status 404 returned error can't find the container with id 8cd98618ea2139732e671471fe1fb9a75204f6c7818599e45330229858ec60cd
Sep 17 14:07:29.078760 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:29.078735    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b69e72f2-4449-4197-ac80-a0284247ac28-metrics-tls\") pod \"dns-default-6nv9q\" (UID: \"b69e72f2-4449-4197-ac80-a0284247ac28\") " pod="openshift-dns/dns-default-6nv9q"
Sep 17 14:07:29.078924 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:29.078902    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 14:07:29.078999 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:29.078982    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b69e72f2-4449-4197-ac80-a0284247ac28-metrics-tls podName:b69e72f2-4449-4197-ac80-a0284247ac28 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:31.078961452 +0000 UTC m=+38.523037031 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b69e72f2-4449-4197-ac80-a0284247ac28-metrics-tls") pod "dns-default-6nv9q" (UID: "b69e72f2-4449-4197-ac80-a0284247ac28") : secret "dns-default-metrics-tls" not found
Sep 17 14:07:29.170648 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:29.170613    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:07:29.174158 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:29.174136    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 14:07:29.347832 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:29.347755    2580 generic.go:356] "Generic (PLEG): container finished" podID="c8b99574-b747-4489-abb7-560e97784171" containerID="6ca72684b62eb40725473f607b5a5be4be2842f6c8aeb27160ae929122fefbc0" exitCode=0
Sep 17 14:07:29.347956 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:29.347831    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w6p4f" event={"ID":"c8b99574-b747-4489-abb7-560e97784171","Type":"ContainerDied","Data":"6ca72684b62eb40725473f607b5a5be4be2842f6c8aeb27160ae929122fefbc0"}
Sep 17 14:07:29.349068 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:29.349048    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mhzr8" event={"ID":"85268ab9-968c-4231-85c2-e4bd619a31c5","Type":"ContainerStarted","Data":"8cd98618ea2139732e671471fe1fb9a75204f6c7818599e45330229858ec60cd"}
Sep 17 14:07:30.355063 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:30.355034    2580 generic.go:356] "Generic (PLEG): container finished" podID="c8b99574-b747-4489-abb7-560e97784171" containerID="008aa927c4baba4227d960c85d3adacd244b77f547bb992d0ea379c7e27ae578" exitCode=0
Sep 17 14:07:30.355506 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:30.355088    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w6p4f" event={"ID":"c8b99574-b747-4489-abb7-560e97784171","Type":"ContainerDied","Data":"008aa927c4baba4227d960c85d3adacd244b77f547bb992d0ea379c7e27ae578"}
Sep 17 14:07:31.091954 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:31.091734    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b69e72f2-4449-4197-ac80-a0284247ac28-metrics-tls\") pod \"dns-default-6nv9q\" (UID: \"b69e72f2-4449-4197-ac80-a0284247ac28\") " pod="openshift-dns/dns-default-6nv9q"
Sep 17 14:07:31.092132 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:31.091892    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 14:07:31.092132 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:31.092080    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b69e72f2-4449-4197-ac80-a0284247ac28-metrics-tls podName:b69e72f2-4449-4197-ac80-a0284247ac28 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:35.092061089 +0000 UTC m=+42.536136653 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b69e72f2-4449-4197-ac80-a0284247ac28-metrics-tls") pod "dns-default-6nv9q" (UID: "b69e72f2-4449-4197-ac80-a0284247ac28") : secret "dns-default-metrics-tls" not found
Sep 17 14:07:31.360249 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:31.360176    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w6p4f" event={"ID":"c8b99574-b747-4489-abb7-560e97784171","Type":"ContainerStarted","Data":"0848d14b9c698d64fe06d543a628f09c7b84fd4bb0e4f73e3f323eb8b8f4c461"}
Sep 17 14:07:31.387336 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:31.387294    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-w6p4f" podStartSLOduration=8.29406827 podStartE2EDuration="38.387277539s" totalImagesPullingTime="30.093209269s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:06:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:31.387250593 +0000 UTC m=+38.831326205" watchObservedRunningTime="2026-09-17 14:07:31.387277539 +0000 UTC m=+38.831353141"
Sep 17 14:07:32.364484 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:32.364447    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mhzr8" event={"ID":"85268ab9-968c-4231-85c2-e4bd619a31c5","Type":"ContainerStarted","Data":"020ea8dae7d5d1b9715935b46c186e383046f18312b89dd14655b68cb0346e04"}
Sep 17 14:07:32.393026 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:32.392980    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mhzr8" podStartSLOduration=2.895195299 podStartE2EDuration="5.392962737s" totalImagesPullingTime="2.497767438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:07:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:07:32.391982588 +0000 UTC m=+39.836058173" watchObservedRunningTime="2026-09-17 14:07:32.392962737 +0000 UTC m=+39.837038326"
Sep 17 14:07:35.121455 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:35.121417    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b69e72f2-4449-4197-ac80-a0284247ac28-metrics-tls\") pod \"dns-default-6nv9q\" (UID: \"b69e72f2-4449-4197-ac80-a0284247ac28\") " pod="openshift-dns/dns-default-6nv9q"
Sep 17 14:07:35.121857 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:35.121534    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 14:07:35.121857 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:35.121586    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b69e72f2-4449-4197-ac80-a0284247ac28-metrics-tls podName:b69e72f2-4449-4197-ac80-a0284247ac28 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:43.121572301 +0000 UTC m=+50.565647864 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b69e72f2-4449-4197-ac80-a0284247ac28-metrics-tls") pod "dns-default-6nv9q" (UID: "b69e72f2-4449-4197-ac80-a0284247ac28") : secret "dns-default-metrics-tls" not found
Sep 17 14:07:43.177866 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:43.177832    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b69e72f2-4449-4197-ac80-a0284247ac28-metrics-tls\") pod \"dns-default-6nv9q\" (UID: \"b69e72f2-4449-4197-ac80-a0284247ac28\") " pod="openshift-dns/dns-default-6nv9q"
Sep 17 14:07:43.178336 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:43.177972    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 14:07:43.178336 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:43.178031    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b69e72f2-4449-4197-ac80-a0284247ac28-metrics-tls podName:b69e72f2-4449-4197-ac80-a0284247ac28 nodeName:}" failed. No retries permitted until 2026-09-17 14:07:59.178015934 +0000 UTC m=+66.622091498 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b69e72f2-4449-4197-ac80-a0284247ac28-metrics-tls") pod "dns-default-6nv9q" (UID: "b69e72f2-4449-4197-ac80-a0284247ac28") : secret "dns-default-metrics-tls" not found
Sep 17 14:07:52.336438 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:52.336410    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9f67m"
Sep 17 14:07:58.691056 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:58.691017    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2da17ddd-8912-4e47-af0f-dc90e7aef2e7-original-pull-secret\") pod \"global-pull-secret-syncer-g2wf7\" (UID: \"2da17ddd-8912-4e47-af0f-dc90e7aef2e7\") " pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:07:58.698753 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:58.698732    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 14:07:58.704496 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:58.704475    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2da17ddd-8912-4e47-af0f-dc90e7aef2e7-original-pull-secret\") pod \"global-pull-secret-syncer-g2wf7\" (UID: \"2da17ddd-8912-4e47-af0f-dc90e7aef2e7\") " pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:07:58.791937 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:58.791905    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqdrd\" (UniqueName: \"kubernetes.io/projected/5b426312-6745-47b1-a19b-4d3ffb91c5af-kube-api-access-xqdrd\") pod \"network-check-target-wcn9n\" (UID: \"5b426312-6745-47b1-a19b-4d3ffb91c5af\") " pod="openshift-network-diagnostics/network-check-target-wcn9n"
Sep 17 14:07:58.792108 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:58.791945    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59c1fc39-6669-462c-9a66-c97b5357d8ac-metrics-certs\") pod \"network-metrics-daemon-pjjpc\" (UID: \"59c1fc39-6669-462c-9a66-c97b5357d8ac\") " pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:07:58.795795 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:58.795774    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 14:07:58.795875 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:58.795802    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 14:07:58.803040 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:58.803021    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 17 14:07:58.803127 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:58.803086    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59c1fc39-6669-462c-9a66-c97b5357d8ac-metrics-certs podName:59c1fc39-6669-462c-9a66-c97b5357d8ac nodeName:}" failed. No retries permitted until 2026-09-17 14:09:02.803069905 +0000 UTC m=+130.247145469 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59c1fc39-6669-462c-9a66-c97b5357d8ac-metrics-certs") pod "network-metrics-daemon-pjjpc" (UID: "59c1fc39-6669-462c-9a66-c97b5357d8ac") : secret "metrics-daemon-secret" not found
Sep 17 14:07:58.805858 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:58.805844    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 14:07:58.816031 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:58.816004    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqdrd\" (UniqueName: \"kubernetes.io/projected/5b426312-6745-47b1-a19b-4d3ffb91c5af-kube-api-access-xqdrd\") pod \"network-check-target-wcn9n\" (UID: \"5b426312-6745-47b1-a19b-4d3ffb91c5af\") " pod="openshift-network-diagnostics/network-check-target-wcn9n"
Sep 17 14:07:58.880127 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:58.880094    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g2wf7"
Sep 17 14:07:59.092398 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:59.092368    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c2694\""
Sep 17 14:07:59.099339 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:59.099323    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcn9n"
Sep 17 14:07:59.174820 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:59.174794    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g2wf7"]
Sep 17 14:07:59.175370 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:07:59.175345    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2da17ddd_8912_4e47_af0f_dc90e7aef2e7.slice/crio-b30a99d3af8d32c1113ddf185730dfcd55e9899a0288cd993842e648f01393e3 WatchSource:0}: Error finding container b30a99d3af8d32c1113ddf185730dfcd55e9899a0288cd993842e648f01393e3: Status 404 returned error can't find the container with id b30a99d3af8d32c1113ddf185730dfcd55e9899a0288cd993842e648f01393e3
Sep 17 14:07:59.195500 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:59.195476    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b69e72f2-4449-4197-ac80-a0284247ac28-metrics-tls\") pod \"dns-default-6nv9q\" (UID: \"b69e72f2-4449-4197-ac80-a0284247ac28\") " pod="openshift-dns/dns-default-6nv9q"
Sep 17 14:07:59.195595 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:59.195585    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 14:07:59.195652 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:07:59.195643    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b69e72f2-4449-4197-ac80-a0284247ac28-metrics-tls podName:b69e72f2-4449-4197-ac80-a0284247ac28 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:31.195629876 +0000 UTC m=+98.639705440 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b69e72f2-4449-4197-ac80-a0284247ac28-metrics-tls") pod "dns-default-6nv9q" (UID: "b69e72f2-4449-4197-ac80-a0284247ac28") : secret "dns-default-metrics-tls" not found
Sep 17 14:07:59.381329 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:59.381304    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wcn9n"]
Sep 17 14:07:59.383577 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:07:59.383552    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b426312_6745_47b1_a19b_4d3ffb91c5af.slice/crio-33b86229525610ce1179fddec3da2bb47e1242b7f77c8e294af902f7b56eb84b WatchSource:0}: Error finding container 33b86229525610ce1179fddec3da2bb47e1242b7f77c8e294af902f7b56eb84b: Status 404 returned error can't find the container with id 33b86229525610ce1179fddec3da2bb47e1242b7f77c8e294af902f7b56eb84b
Sep 17 14:07:59.425392 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:59.425360    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wcn9n" event={"ID":"5b426312-6745-47b1-a19b-4d3ffb91c5af","Type":"ContainerStarted","Data":"33b86229525610ce1179fddec3da2bb47e1242b7f77c8e294af902f7b56eb84b"}
Sep 17 14:07:59.426455 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:07:59.426437    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g2wf7" event={"ID":"2da17ddd-8912-4e47-af0f-dc90e7aef2e7","Type":"ContainerStarted","Data":"b30a99d3af8d32c1113ddf185730dfcd55e9899a0288cd993842e648f01393e3"}
Sep 17 14:08:04.442105 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:04.442001    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wcn9n" event={"ID":"5b426312-6745-47b1-a19b-4d3ffb91c5af","Type":"ContainerStarted","Data":"040139af9382ba185192fe550eab5fa97adb7d99c5f47d3f88364e75e12dc6e8"}
Sep 17 14:08:04.442105 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:04.442069    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wcn9n"
Sep 17 14:08:04.443547 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:04.443523    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g2wf7" event={"ID":"2da17ddd-8912-4e47-af0f-dc90e7aef2e7","Type":"ContainerStarted","Data":"211bbbe324a64b6a29ff3f0dc7a7fc28865bb3a8b93981f5735950ba5561850b"}
Sep 17 14:08:04.487341 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:04.487284    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wcn9n" podStartSLOduration=66.836631084 podStartE2EDuration="1m11.487267216s" totalImagesPullingTime="4.650636132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:04.469241461 +0000 UTC m=+71.913317046" watchObservedRunningTime="2026-09-17 14:08:04.487267216 +0000 UTC m=+71.931342814"
Sep 17 14:08:04.487673 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:04.487654    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-g2wf7" podStartSLOduration=66.61733982 podStartE2EDuration="1m11.487646039s" totalImagesPullingTime="4.870306219s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:04.487399537 +0000 UTC m=+71.931475102" watchObservedRunningTime="2026-09-17 14:08:04.487646039 +0000 UTC m=+71.931721625"
Sep 17 14:08:31.209216 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:31.209158    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b69e72f2-4449-4197-ac80-a0284247ac28-metrics-tls\") pod \"dns-default-6nv9q\" (UID: \"b69e72f2-4449-4197-ac80-a0284247ac28\") " pod="openshift-dns/dns-default-6nv9q"
Sep 17 14:08:31.209647 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:31.209311    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 14:08:31.209647 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:31.209372    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b69e72f2-4449-4197-ac80-a0284247ac28-metrics-tls podName:b69e72f2-4449-4197-ac80-a0284247ac28 nodeName:}" failed. No retries permitted until 2026-09-17 14:09:35.209357006 +0000 UTC m=+162.653432570 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b69e72f2-4449-4197-ac80-a0284247ac28-metrics-tls") pod "dns-default-6nv9q" (UID: "b69e72f2-4449-4197-ac80-a0284247ac28") : secret "dns-default-metrics-tls" not found
Sep 17 14:08:35.448093 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:35.448059    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wcn9n"
Sep 17 14:08:44.211781 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.211739    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-krk4h"]
Sep 17 14:08:44.213467 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.213452    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-v76ts"]
Sep 17 14:08:44.213610 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.213589    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-krk4h"
Sep 17 14:08:44.215170 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.215148    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-v76ts"
Sep 17 14:08:44.215965 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.215945    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-vdxdz"]
Sep 17 14:08:44.217376 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.217362    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vdxdz"
Sep 17 14:08:44.217788 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.217772    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 17 14:08:44.217886 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.217868    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-kdnbh\""
Sep 17 14:08:44.220822 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.220800    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 17 14:08:44.220913 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.220818    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 17 14:08:44.220913 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.220823    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 17 14:08:44.220913 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.220846    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-k8ttw\""
Sep 17 14:08:44.224218 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.224179    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 17 14:08:44.224302 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.224226    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-hqppm\""
Sep 17 14:08:44.224835 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.224625    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 17 14:08:44.224835 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.224694    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 17 14:08:44.241977 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.241937    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-krk4h"]
Sep 17 14:08:44.242653 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.242634    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-vdxdz"]
Sep 17 14:08:44.243233 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.243217    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-v76ts"]
Sep 17 14:08:44.243520 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.243503    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 17 14:08:44.295755 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.295705    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4a99568-1175-40ac-ad56-24b4b507884c-config\") pod \"service-ca-operator-cf7c776b7-vdxdz\" (UID: \"f4a99568-1175-40ac-ad56-24b4b507884c\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vdxdz"
Sep 17 14:08:44.295904 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.295757    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jhk5\" (UniqueName: \"kubernetes.io/projected/f4a99568-1175-40ac-ad56-24b4b507884c-kube-api-access-5jhk5\") pod \"service-ca-operator-cf7c776b7-vdxdz\" (UID: \"f4a99568-1175-40ac-ad56-24b4b507884c\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vdxdz"
Sep 17 14:08:44.295904 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.295803    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pxpn\" (UniqueName: \"kubernetes.io/projected/92f8530c-23cc-4d9c-9d4b-564058a9b840-kube-api-access-2pxpn\") pod \"cluster-monitoring-operator-6cd954b897-krk4h\" (UID: \"92f8530c-23cc-4d9c-9d4b-564058a9b840\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-krk4h"
Sep 17 14:08:44.295904 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.295839    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/92f8530c-23cc-4d9c-9d4b-564058a9b840-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-krk4h\" (UID: \"92f8530c-23cc-4d9c-9d4b-564058a9b840\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-krk4h"
Sep 17 14:08:44.295904 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.295862    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92f8530c-23cc-4d9c-9d4b-564058a9b840-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-krk4h\" (UID: \"92f8530c-23cc-4d9c-9d4b-564058a9b840\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-krk4h"
Sep 17 14:08:44.295904 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.295889    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f4a99568-1175-40ac-ad56-24b4b507884c-serving-cert\") pod \"service-ca-operator-cf7c776b7-vdxdz\" (UID: \"f4a99568-1175-40ac-ad56-24b4b507884c\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vdxdz"
Sep 17 14:08:44.296083 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.295908    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ql8x\" (UniqueName: \"kubernetes.io/projected/6a8b5b60-30fa-43c0-a351-67a3e202e3e2-kube-api-access-6ql8x\") pod \"network-check-source-6f8b768455-v76ts\" (UID: \"6a8b5b60-30fa-43c0-a351-67a3e202e3e2\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-v76ts"
Sep 17 14:08:44.328657 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.328621    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-679df86f77-4lwpc"]
Sep 17 14:08:44.330733 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.330700    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:08:44.339725 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.339685    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 17 14:08:44.339833 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.339692    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2g4kt\""
Sep 17 14:08:44.340453 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.340427    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 17 14:08:44.340533 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.340429    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 17 14:08:44.340533 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.340467    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t4ngb"]
Sep 17 14:08:44.342285 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.342267    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t4ngb"
Sep 17 14:08:44.347161 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.347140    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 17 14:08:44.347396 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.347370    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 17 14:08:44.347495 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.347451    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 17 14:08:44.347795 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.347779    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-j4pjn\""
Sep 17 14:08:44.349345 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.349328    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 17 14:08:44.359605 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.359586    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-679df86f77-4lwpc"]
Sep 17 14:08:44.370958 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.370935    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t4ngb"]
Sep 17 14:08:44.396527 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.396499    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/92f8530c-23cc-4d9c-9d4b-564058a9b840-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-krk4h\" (UID: \"92f8530c-23cc-4d9c-9d4b-564058a9b840\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-krk4h"
Sep 17 14:08:44.396657 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.396534    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92f8530c-23cc-4d9c-9d4b-564058a9b840-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-krk4h\" (UID: \"92f8530c-23cc-4d9c-9d4b-564058a9b840\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-krk4h"
Sep 17 14:08:44.396657 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.396580    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f4a99568-1175-40ac-ad56-24b4b507884c-serving-cert\") pod \"service-ca-operator-cf7c776b7-vdxdz\" (UID: \"f4a99568-1175-40ac-ad56-24b4b507884c\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vdxdz"
Sep 17 14:08:44.396657 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.396608    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-registry-tls\") pod \"image-registry-679df86f77-4lwpc\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") " pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:08:44.396657 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.396633    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-registry-certificates\") pod \"image-registry-679df86f77-4lwpc\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") " pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:08:44.396894 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:44.396653    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 14:08:44.396894 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.396660    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ql8x\" (UniqueName: \"kubernetes.io/projected/6a8b5b60-30fa-43c0-a351-67a3e202e3e2-kube-api-access-6ql8x\") pod \"network-check-source-6f8b768455-v76ts\" (UID: \"6a8b5b60-30fa-43c0-a351-67a3e202e3e2\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-v76ts"
Sep 17 14:08:44.396894 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.396684    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-ca-trust-extracted\") pod \"image-registry-679df86f77-4lwpc\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") " pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:08:44.396894 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:44.396744    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92f8530c-23cc-4d9c-9d4b-564058a9b840-cluster-monitoring-operator-tls podName:92f8530c-23cc-4d9c-9d4b-564058a9b840 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:44.8967055 +0000 UTC m=+112.340781071 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92f8530c-23cc-4d9c-9d4b-564058a9b840-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-krk4h" (UID: "92f8530c-23cc-4d9c-9d4b-564058a9b840") : secret "cluster-monitoring-operator-tls" not found
Sep 17 14:08:44.396894 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.396764    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-image-registry-private-configuration\") pod \"image-registry-679df86f77-4lwpc\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") " pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:08:44.396894 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.396832    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc41a52d-5543-4bec-8e90-06bd5f78313a-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-t4ngb\" (UID: \"bc41a52d-5543-4bec-8e90-06bd5f78313a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t4ngb"
Sep 17 14:08:44.396894 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.396868    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9f7q\" (UniqueName: \"kubernetes.io/projected/bc41a52d-5543-4bec-8e90-06bd5f78313a-kube-api-access-z9f7q\") pod \"cluster-samples-operator-86499c89c4-t4ngb\" (UID: \"bc41a52d-5543-4bec-8e90-06bd5f78313a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t4ngb"
Sep 17 14:08:44.397175 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.396904    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-installation-pull-secrets\") pod \"image-registry-679df86f77-4lwpc\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") " pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:08:44.397175 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.396929    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-trusted-ca\") pod \"image-registry-679df86f77-4lwpc\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") " pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:08:44.397175 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.396946    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv8hd\" (UniqueName: \"kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-kube-api-access-vv8hd\") pod \"image-registry-679df86f77-4lwpc\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") " pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:08:44.397175 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.396965    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-bound-sa-token\") pod \"image-registry-679df86f77-4lwpc\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") " pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:08:44.397175 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.397031    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4a99568-1175-40ac-ad56-24b4b507884c-config\") pod \"service-ca-operator-cf7c776b7-vdxdz\" (UID: \"f4a99568-1175-40ac-ad56-24b4b507884c\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vdxdz"
Sep 17 14:08:44.397175 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.397064    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jhk5\" (UniqueName: \"kubernetes.io/projected/f4a99568-1175-40ac-ad56-24b4b507884c-kube-api-access-5jhk5\") pod \"service-ca-operator-cf7c776b7-vdxdz\" (UID: \"f4a99568-1175-40ac-ad56-24b4b507884c\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vdxdz"
Sep 17 14:08:44.397175 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.397085    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pxpn\" (UniqueName: \"kubernetes.io/projected/92f8530c-23cc-4d9c-9d4b-564058a9b840-kube-api-access-2pxpn\") pod \"cluster-monitoring-operator-6cd954b897-krk4h\" (UID: \"92f8530c-23cc-4d9c-9d4b-564058a9b840\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-krk4h"
Sep 17 14:08:44.397418 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.397269    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/92f8530c-23cc-4d9c-9d4b-564058a9b840-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-krk4h\" (UID: \"92f8530c-23cc-4d9c-9d4b-564058a9b840\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-krk4h"
Sep 17 14:08:44.397473 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.397455    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4a99568-1175-40ac-ad56-24b4b507884c-config\") pod \"service-ca-operator-cf7c776b7-vdxdz\" (UID: \"f4a99568-1175-40ac-ad56-24b4b507884c\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vdxdz"
Sep 17 14:08:44.398931 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.398910    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f4a99568-1175-40ac-ad56-24b4b507884c-serving-cert\") pod \"service-ca-operator-cf7c776b7-vdxdz\" (UID: \"f4a99568-1175-40ac-ad56-24b4b507884c\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vdxdz"
Sep 17 14:08:44.408867 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.408841    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ql8x\" (UniqueName: \"kubernetes.io/projected/6a8b5b60-30fa-43c0-a351-67a3e202e3e2-kube-api-access-6ql8x\") pod \"network-check-source-6f8b768455-v76ts\" (UID: \"6a8b5b60-30fa-43c0-a351-67a3e202e3e2\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-v76ts"
Sep 17 14:08:44.409765 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.409732    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jhk5\" (UniqueName: \"kubernetes.io/projected/f4a99568-1175-40ac-ad56-24b4b507884c-kube-api-access-5jhk5\") pod \"service-ca-operator-cf7c776b7-vdxdz\" (UID: \"f4a99568-1175-40ac-ad56-24b4b507884c\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vdxdz"
Sep 17 14:08:44.410436 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.410416    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pxpn\" (UniqueName: \"kubernetes.io/projected/92f8530c-23cc-4d9c-9d4b-564058a9b840-kube-api-access-2pxpn\") pod \"cluster-monitoring-operator-6cd954b897-krk4h\" (UID: \"92f8530c-23cc-4d9c-9d4b-564058a9b840\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-krk4h"
Sep 17 14:08:44.498153 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.498053    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-installation-pull-secrets\") pod \"image-registry-679df86f77-4lwpc\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") " pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:08:44.498153 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.498105    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-trusted-ca\") pod \"image-registry-679df86f77-4lwpc\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") " pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:08:44.498153 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.498121    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv8hd\" (UniqueName: \"kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-kube-api-access-vv8hd\") pod \"image-registry-679df86f77-4lwpc\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") " pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:08:44.498153 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.498139    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-bound-sa-token\") pod \"image-registry-679df86f77-4lwpc\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") " pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:08:44.498493 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.498310    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-registry-tls\") pod \"image-registry-679df86f77-4lwpc\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") " pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:08:44.498493 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.498350    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-registry-certificates\") pod \"image-registry-679df86f77-4lwpc\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") " pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:08:44.498493 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.498388    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-ca-trust-extracted\") pod \"image-registry-679df86f77-4lwpc\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") " pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:08:44.498493 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:44.498400    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 14:08:44.498493 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:44.498417    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-679df86f77-4lwpc: secret "image-registry-tls" not found
Sep 17 14:08:44.498493 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.498419    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-image-registry-private-configuration\") pod \"image-registry-679df86f77-4lwpc\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") " pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:08:44.498493 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.498448    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc41a52d-5543-4bec-8e90-06bd5f78313a-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-t4ngb\" (UID: \"bc41a52d-5543-4bec-8e90-06bd5f78313a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t4ngb"
Sep 17 14:08:44.498493 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:44.498474    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-registry-tls podName:dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:44.998455704 +0000 UTC m=+112.442531269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-registry-tls") pod "image-registry-679df86f77-4lwpc" (UID: "dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4") : secret "image-registry-tls" not found
Sep 17 14:08:44.498883 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.498505    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9f7q\" (UniqueName: \"kubernetes.io/projected/bc41a52d-5543-4bec-8e90-06bd5f78313a-kube-api-access-z9f7q\") pod \"cluster-samples-operator-86499c89c4-t4ngb\" (UID: \"bc41a52d-5543-4bec-8e90-06bd5f78313a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t4ngb"
Sep 17 14:08:44.498883 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:44.498579    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 14:08:44.498883 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:44.498636    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc41a52d-5543-4bec-8e90-06bd5f78313a-samples-operator-tls podName:bc41a52d-5543-4bec-8e90-06bd5f78313a nodeName:}" failed. No retries permitted until 2026-09-17 14:08:44.998620776 +0000 UTC m=+112.442696354 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bc41a52d-5543-4bec-8e90-06bd5f78313a-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-t4ngb" (UID: "bc41a52d-5543-4bec-8e90-06bd5f78313a") : secret "samples-operator-tls" not found
Sep 17 14:08:44.498883 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.498810    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-ca-trust-extracted\") pod \"image-registry-679df86f77-4lwpc\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") " pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:08:44.499029 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.498980    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-registry-certificates\") pod \"image-registry-679df86f77-4lwpc\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") " pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:08:44.499360 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.499342    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-trusted-ca\") pod \"image-registry-679df86f77-4lwpc\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") " pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:08:44.500658 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.500637    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-image-registry-private-configuration\") pod \"image-registry-679df86f77-4lwpc\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") " pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:08:44.500764 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.500667    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-installation-pull-secrets\") pod \"image-registry-679df86f77-4lwpc\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") " pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:08:44.515590 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.515571    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-bound-sa-token\") pod \"image-registry-679df86f77-4lwpc\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") " pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:08:44.515996 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.515977    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv8hd\" (UniqueName: \"kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-kube-api-access-vv8hd\") pod \"image-registry-679df86f77-4lwpc\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") " pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:08:44.516040 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.515987    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9f7q\" (UniqueName: \"kubernetes.io/projected/bc41a52d-5543-4bec-8e90-06bd5f78313a-kube-api-access-z9f7q\") pod \"cluster-samples-operator-86499c89c4-t4ngb\" (UID: \"bc41a52d-5543-4bec-8e90-06bd5f78313a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t4ngb"
Sep 17 14:08:44.530446 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.530419    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-v76ts"
Sep 17 14:08:44.536232 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.536215    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vdxdz"
Sep 17 14:08:44.813269 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.813243    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-v76ts"]
Sep 17 14:08:44.815462 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:08:44.815436    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a8b5b60_30fa_43c0_a351_67a3e202e3e2.slice/crio-24fb7e0e726158ae56cab19e7347142cb1c231bf6ddc8ff340fa0347eeb35cca WatchSource:0}: Error finding container 24fb7e0e726158ae56cab19e7347142cb1c231bf6ddc8ff340fa0347eeb35cca: Status 404 returned error can't find the container with id 24fb7e0e726158ae56cab19e7347142cb1c231bf6ddc8ff340fa0347eeb35cca
Sep 17 14:08:44.819476 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.819353    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-vdxdz"]
Sep 17 14:08:44.821622 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:08:44.821600    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4a99568_1175_40ac_ad56_24b4b507884c.slice/crio-c61442cf81c29644e8fc51dd49aa74ade2027fe308057f846acbdf3d107bbd19 WatchSource:0}: Error finding container c61442cf81c29644e8fc51dd49aa74ade2027fe308057f846acbdf3d107bbd19: Status 404 returned error can't find the container with id c61442cf81c29644e8fc51dd49aa74ade2027fe308057f846acbdf3d107bbd19
Sep 17 14:08:44.901500 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:44.901463    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92f8530c-23cc-4d9c-9d4b-564058a9b840-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-krk4h\" (UID: \"92f8530c-23cc-4d9c-9d4b-564058a9b840\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-krk4h"
Sep 17 14:08:44.901662 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:44.901574    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 14:08:44.901662 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:44.901637    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92f8530c-23cc-4d9c-9d4b-564058a9b840-cluster-monitoring-operator-tls podName:92f8530c-23cc-4d9c-9d4b-564058a9b840 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:45.901622993 +0000 UTC m=+113.345698556 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92f8530c-23cc-4d9c-9d4b-564058a9b840-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-krk4h" (UID: "92f8530c-23cc-4d9c-9d4b-564058a9b840") : secret "cluster-monitoring-operator-tls" not found
Sep 17 14:08:45.002644 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:45.002597    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-registry-tls\") pod \"image-registry-679df86f77-4lwpc\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") " pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:08:45.002831 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:45.002653    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc41a52d-5543-4bec-8e90-06bd5f78313a-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-t4ngb\" (UID: \"bc41a52d-5543-4bec-8e90-06bd5f78313a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t4ngb"
Sep 17 14:08:45.002831 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:45.002779    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 14:08:45.002831 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:45.002795    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 14:08:45.002831 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:45.002805    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-679df86f77-4lwpc: secret "image-registry-tls" not found
Sep 17 14:08:45.002966 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:45.002863    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc41a52d-5543-4bec-8e90-06bd5f78313a-samples-operator-tls podName:bc41a52d-5543-4bec-8e90-06bd5f78313a nodeName:}" failed. No retries permitted until 2026-09-17 14:08:46.002845774 +0000 UTC m=+113.446921346 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bc41a52d-5543-4bec-8e90-06bd5f78313a-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-t4ngb" (UID: "bc41a52d-5543-4bec-8e90-06bd5f78313a") : secret "samples-operator-tls" not found
Sep 17 14:08:45.002966 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:45.002878    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-registry-tls podName:dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:46.002872424 +0000 UTC m=+113.446947987 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-registry-tls") pod "image-registry-679df86f77-4lwpc" (UID: "dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4") : secret "image-registry-tls" not found
Sep 17 14:08:45.544498 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:45.544456    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vdxdz" event={"ID":"f4a99568-1175-40ac-ad56-24b4b507884c","Type":"ContainerStarted","Data":"c61442cf81c29644e8fc51dd49aa74ade2027fe308057f846acbdf3d107bbd19"}
Sep 17 14:08:45.546221 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:45.546176    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-v76ts" event={"ID":"6a8b5b60-30fa-43c0-a351-67a3e202e3e2","Type":"ContainerStarted","Data":"7babf795b68fa778851f271d87e094bed2fc4b7eac27d75bcc5844d45c91c1ef"}
Sep 17 14:08:45.546328 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:45.546226    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-v76ts" event={"ID":"6a8b5b60-30fa-43c0-a351-67a3e202e3e2","Type":"ContainerStarted","Data":"24fb7e0e726158ae56cab19e7347142cb1c231bf6ddc8ff340fa0347eeb35cca"}
Sep 17 14:08:45.574825 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:45.574779    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-v76ts" podStartSLOduration=1.574764267 podStartE2EDuration="1.574764267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:08:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:45.57432249 +0000 UTC m=+113.018398096" watchObservedRunningTime="2026-09-17 14:08:45.574764267 +0000 UTC m=+113.018839852"
Sep 17 14:08:45.910218 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:45.910127    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92f8530c-23cc-4d9c-9d4b-564058a9b840-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-krk4h\" (UID: \"92f8530c-23cc-4d9c-9d4b-564058a9b840\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-krk4h"
Sep 17 14:08:45.910400 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:45.910286    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 14:08:45.910400 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:45.910366    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92f8530c-23cc-4d9c-9d4b-564058a9b840-cluster-monitoring-operator-tls podName:92f8530c-23cc-4d9c-9d4b-564058a9b840 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:47.910340532 +0000 UTC m=+115.354416116 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92f8530c-23cc-4d9c-9d4b-564058a9b840-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-krk4h" (UID: "92f8530c-23cc-4d9c-9d4b-564058a9b840") : secret "cluster-monitoring-operator-tls" not found
Sep 17 14:08:46.011648 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:46.011607    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-registry-tls\") pod \"image-registry-679df86f77-4lwpc\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") " pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:08:46.011837 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:46.011666    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc41a52d-5543-4bec-8e90-06bd5f78313a-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-t4ngb\" (UID: \"bc41a52d-5543-4bec-8e90-06bd5f78313a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t4ngb"
Sep 17 14:08:46.011837 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:46.011804    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 14:08:46.011837 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:46.011818    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 14:08:46.011984 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:46.011898    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc41a52d-5543-4bec-8e90-06bd5f78313a-samples-operator-tls podName:bc41a52d-5543-4bec-8e90-06bd5f78313a nodeName:}" failed. No retries permitted until 2026-09-17 14:08:48.011877809 +0000 UTC m=+115.455953379 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bc41a52d-5543-4bec-8e90-06bd5f78313a-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-t4ngb" (UID: "bc41a52d-5543-4bec-8e90-06bd5f78313a") : secret "samples-operator-tls" not found
Sep 17 14:08:46.011984 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:46.011827    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-679df86f77-4lwpc: secret "image-registry-tls" not found
Sep 17 14:08:46.011984 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:46.011975    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-registry-tls podName:dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:48.011957799 +0000 UTC m=+115.456033377 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-registry-tls") pod "image-registry-679df86f77-4lwpc" (UID: "dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4") : secret "image-registry-tls" not found
Sep 17 14:08:47.552720 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:47.552669    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vdxdz" event={"ID":"f4a99568-1175-40ac-ad56-24b4b507884c","Type":"ContainerStarted","Data":"19d1409bd61023b5d1f0955439bc7aac49ab38703c6f3630a20194ebab2d49a2"}
Sep 17 14:08:47.925292 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:47.925193    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92f8530c-23cc-4d9c-9d4b-564058a9b840-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-krk4h\" (UID: \"92f8530c-23cc-4d9c-9d4b-564058a9b840\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-krk4h"
Sep 17 14:08:47.925437 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:47.925339    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 14:08:47.925437 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:47.925406    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92f8530c-23cc-4d9c-9d4b-564058a9b840-cluster-monitoring-operator-tls podName:92f8530c-23cc-4d9c-9d4b-564058a9b840 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:51.925391161 +0000 UTC m=+119.369466725 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92f8530c-23cc-4d9c-9d4b-564058a9b840-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-krk4h" (UID: "92f8530c-23cc-4d9c-9d4b-564058a9b840") : secret "cluster-monitoring-operator-tls" not found
Sep 17 14:08:48.026520 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:48.026482    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-registry-tls\") pod \"image-registry-679df86f77-4lwpc\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") " pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:08:48.026520 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:48.026525    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc41a52d-5543-4bec-8e90-06bd5f78313a-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-t4ngb\" (UID: \"bc41a52d-5543-4bec-8e90-06bd5f78313a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t4ngb"
Sep 17 14:08:48.026786 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:48.026641    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 14:08:48.026786 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:48.026653    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 14:08:48.026786 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:48.026679    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-679df86f77-4lwpc: secret "image-registry-tls" not found
Sep 17 14:08:48.026786 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:48.026692    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc41a52d-5543-4bec-8e90-06bd5f78313a-samples-operator-tls podName:bc41a52d-5543-4bec-8e90-06bd5f78313a nodeName:}" failed. No retries permitted until 2026-09-17 14:08:52.026679818 +0000 UTC m=+119.470755382 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bc41a52d-5543-4bec-8e90-06bd5f78313a-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-t4ngb" (UID: "bc41a52d-5543-4bec-8e90-06bd5f78313a") : secret "samples-operator-tls" not found
Sep 17 14:08:48.026786 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:48.026751    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-registry-tls podName:dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:52.026734752 +0000 UTC m=+119.470810344 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-registry-tls") pod "image-registry-679df86f77-4lwpc" (UID: "dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4") : secret "image-registry-tls" not found
Sep 17 14:08:49.345196 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:49.345144    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vdxdz" podStartSLOduration=3.167172969 podStartE2EDuration="5.345125752s" totalImagesPullingTime="2.177952783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:08:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:47.574487682 +0000 UTC m=+115.018563267" watchObservedRunningTime="2026-09-17 14:08:49.345125752 +0000 UTC m=+116.789201337"
Sep 17 14:08:49.345852 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:49.345835    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8br75"]
Sep 17 14:08:49.348161 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:49.348146    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8br75"
Sep 17 14:08:49.352640 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:49.352599    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 17 14:08:49.353936 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:49.353913    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tmmrx\""
Sep 17 14:08:49.354063 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:49.353982    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 17 14:08:49.354063 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:49.353982    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 17 14:08:49.354063 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:49.353985    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 17 14:08:49.424301 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:49.424268    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8br75"]
Sep 17 14:08:49.437480 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:49.437453    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e34585f-eabb-49bc-ae58-5432490909e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8br75\" (UID: \"5e34585f-eabb-49bc-ae58-5432490909e0\") " pod="openshift-insights/insights-runtime-extractor-8br75"
Sep 17 14:08:49.437597 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:49.437485    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv4vr\" (UniqueName: \"kubernetes.io/projected/5e34585f-eabb-49bc-ae58-5432490909e0-kube-api-access-lv4vr\") pod \"insights-runtime-extractor-8br75\" (UID: \"5e34585f-eabb-49bc-ae58-5432490909e0\") " pod="openshift-insights/insights-runtime-extractor-8br75"
Sep 17 14:08:49.437597 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:49.437517    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e34585f-eabb-49bc-ae58-5432490909e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8br75\" (UID: \"5e34585f-eabb-49bc-ae58-5432490909e0\") " pod="openshift-insights/insights-runtime-extractor-8br75"
Sep 17 14:08:49.437597 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:49.437537    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e34585f-eabb-49bc-ae58-5432490909e0-data-volume\") pod \"insights-runtime-extractor-8br75\" (UID: \"5e34585f-eabb-49bc-ae58-5432490909e0\") " pod="openshift-insights/insights-runtime-extractor-8br75"
Sep 17 14:08:49.437698 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:49.437668    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5e34585f-eabb-49bc-ae58-5432490909e0-crio-socket\") pod \"insights-runtime-extractor-8br75\" (UID: \"5e34585f-eabb-49bc-ae58-5432490909e0\") " pod="openshift-insights/insights-runtime-extractor-8br75"
Sep 17 14:08:49.538576 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:49.538543    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5e34585f-eabb-49bc-ae58-5432490909e0-crio-socket\") pod \"insights-runtime-extractor-8br75\" (UID: \"5e34585f-eabb-49bc-ae58-5432490909e0\") " pod="openshift-insights/insights-runtime-extractor-8br75"
Sep 17 14:08:49.538749 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:49.538582    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e34585f-eabb-49bc-ae58-5432490909e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8br75\" (UID: \"5e34585f-eabb-49bc-ae58-5432490909e0\") " pod="openshift-insights/insights-runtime-extractor-8br75"
Sep 17 14:08:49.538749 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:49.538609    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv4vr\" (UniqueName: \"kubernetes.io/projected/5e34585f-eabb-49bc-ae58-5432490909e0-kube-api-access-lv4vr\") pod \"insights-runtime-extractor-8br75\" (UID: \"5e34585f-eabb-49bc-ae58-5432490909e0\") " pod="openshift-insights/insights-runtime-extractor-8br75"
Sep 17 14:08:49.538749 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:49.538654    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e34585f-eabb-49bc-ae58-5432490909e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8br75\" (UID: \"5e34585f-eabb-49bc-ae58-5432490909e0\") " pod="openshift-insights/insights-runtime-extractor-8br75"
Sep 17 14:08:49.538749 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:49.538678    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e34585f-eabb-49bc-ae58-5432490909e0-data-volume\") pod \"insights-runtime-extractor-8br75\" (UID: \"5e34585f-eabb-49bc-ae58-5432490909e0\") " pod="openshift-insights/insights-runtime-extractor-8br75"
Sep 17 14:08:49.538749 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:49.538686    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 14:08:49.538990 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:49.538789    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e34585f-eabb-49bc-ae58-5432490909e0-kube-rbac-proxy-cm podName:5e34585f-eabb-49bc-ae58-5432490909e0 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:50.03876648 +0000 UTC m=+117.482842047 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5e34585f-eabb-49bc-ae58-5432490909e0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8br75" (UID: "5e34585f-eabb-49bc-ae58-5432490909e0") : configmap "kube-rbac-proxy" not found
Sep 17 14:08:49.538990 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:49.538687    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5e34585f-eabb-49bc-ae58-5432490909e0-crio-socket\") pod \"insights-runtime-extractor-8br75\" (UID: \"5e34585f-eabb-49bc-ae58-5432490909e0\") " pod="openshift-insights/insights-runtime-extractor-8br75"
Sep 17 14:08:49.538990 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:49.538823    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 14:08:49.538990 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:49.538899    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e34585f-eabb-49bc-ae58-5432490909e0-insights-runtime-extractor-tls podName:5e34585f-eabb-49bc-ae58-5432490909e0 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:50.038880901 +0000 UTC m=+117.482956470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5e34585f-eabb-49bc-ae58-5432490909e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8br75" (UID: "5e34585f-eabb-49bc-ae58-5432490909e0") : secret "insights-runtime-extractor-tls" not found
Sep 17 14:08:49.539119 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:49.539090    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e34585f-eabb-49bc-ae58-5432490909e0-data-volume\") pod \"insights-runtime-extractor-8br75\" (UID: \"5e34585f-eabb-49bc-ae58-5432490909e0\") " pod="openshift-insights/insights-runtime-extractor-8br75"
Sep 17 14:08:49.566977 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:49.566952    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv4vr\" (UniqueName: \"kubernetes.io/projected/5e34585f-eabb-49bc-ae58-5432490909e0-kube-api-access-lv4vr\") pod \"insights-runtime-extractor-8br75\" (UID: \"5e34585f-eabb-49bc-ae58-5432490909e0\") " pod="openshift-insights/insights-runtime-extractor-8br75"
Sep 17 14:08:49.920726 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:49.919259    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-hmpxg"]
Sep 17 14:08:49.922856 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:49.922837    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hmpxg"
Sep 17 14:08:49.930400 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:49.930378    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 17 14:08:49.931698 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:49.931682    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-dr9l8\""
Sep 17 14:08:49.931772 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:49.931683    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 17 14:08:49.948926 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:49.948898    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-hmpxg"]
Sep 17 14:08:50.042946 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:50.042910    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e34585f-eabb-49bc-ae58-5432490909e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8br75\" (UID: \"5e34585f-eabb-49bc-ae58-5432490909e0\") " pod="openshift-insights/insights-runtime-extractor-8br75"
Sep 17 14:08:50.043154 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:50.042971    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e34585f-eabb-49bc-ae58-5432490909e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8br75\" (UID: \"5e34585f-eabb-49bc-ae58-5432490909e0\") " pod="openshift-insights/insights-runtime-extractor-8br75"
Sep 17 14:08:50.043154 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:50.043006    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c29p\" (UniqueName: \"kubernetes.io/projected/34962ee4-4405-4b0a-b926-bc17926da9cd-kube-api-access-9c29p\") pod \"migrator-8b4d697c5-hmpxg\" (UID: \"34962ee4-4405-4b0a-b926-bc17926da9cd\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hmpxg"
Sep 17 14:08:50.043154 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:50.043031    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 14:08:50.043154 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:50.043093    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e34585f-eabb-49bc-ae58-5432490909e0-kube-rbac-proxy-cm podName:5e34585f-eabb-49bc-ae58-5432490909e0 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:51.043077143 +0000 UTC m=+118.487152725 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5e34585f-eabb-49bc-ae58-5432490909e0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8br75" (UID: "5e34585f-eabb-49bc-ae58-5432490909e0") : configmap "kube-rbac-proxy" not found
Sep 17 14:08:50.043154 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:50.043142    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 14:08:50.043355 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:50.043205    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e34585f-eabb-49bc-ae58-5432490909e0-insights-runtime-extractor-tls podName:5e34585f-eabb-49bc-ae58-5432490909e0 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:51.043188307 +0000 UTC m=+118.487263888 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5e34585f-eabb-49bc-ae58-5432490909e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8br75" (UID: "5e34585f-eabb-49bc-ae58-5432490909e0") : secret "insights-runtime-extractor-tls" not found
Sep 17 14:08:50.143619 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:50.143580    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c29p\" (UniqueName: \"kubernetes.io/projected/34962ee4-4405-4b0a-b926-bc17926da9cd-kube-api-access-9c29p\") pod \"migrator-8b4d697c5-hmpxg\" (UID: \"34962ee4-4405-4b0a-b926-bc17926da9cd\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hmpxg"
Sep 17 14:08:50.158837 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:50.158813    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c29p\" (UniqueName: \"kubernetes.io/projected/34962ee4-4405-4b0a-b926-bc17926da9cd-kube-api-access-9c29p\") pod \"migrator-8b4d697c5-hmpxg\" (UID: \"34962ee4-4405-4b0a-b926-bc17926da9cd\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hmpxg"
Sep 17 14:08:50.231321 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:50.231293    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hmpxg"
Sep 17 14:08:50.511318 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:50.511265    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-hmpxg"]
Sep 17 14:08:50.513173 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:08:50.513150    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34962ee4_4405_4b0a_b926_bc17926da9cd.slice/crio-074bea412acc4a293620d98c3f3be95abb7d93bc73235aa693fed22462cb61fb WatchSource:0}: Error finding container 074bea412acc4a293620d98c3f3be95abb7d93bc73235aa693fed22462cb61fb: Status 404 returned error can't find the container with id 074bea412acc4a293620d98c3f3be95abb7d93bc73235aa693fed22462cb61fb
Sep 17 14:08:50.561214 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:50.561177    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hmpxg" event={"ID":"34962ee4-4405-4b0a-b926-bc17926da9cd","Type":"ContainerStarted","Data":"074bea412acc4a293620d98c3f3be95abb7d93bc73235aa693fed22462cb61fb"}
Sep 17 14:08:50.785167 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:50.785080    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-qgdfj"]
Sep 17 14:08:50.787755 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:50.787734    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-qgdfj"
Sep 17 14:08:50.791637 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:50.791619    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-pxjkn\""
Sep 17 14:08:50.792772 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:50.792757    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 17 14:08:50.793076 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:50.793057    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 17 14:08:50.793076 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:50.793071    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 17 14:08:50.793208 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:50.793126    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 17 14:08:50.807872 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:50.807847    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-qgdfj"]
Sep 17 14:08:50.847876 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:50.847848    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/59af9218-c4da-4e62-bdb2-8bf7e1504f2f-signing-key\") pod \"service-ca-568869fdc5-qgdfj\" (UID: \"59af9218-c4da-4e62-bdb2-8bf7e1504f2f\") " pod="openshift-service-ca/service-ca-568869fdc5-qgdfj"
Sep 17 14:08:50.848037 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:50.847900    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvjwb\" (UniqueName: \"kubernetes.io/projected/59af9218-c4da-4e62-bdb2-8bf7e1504f2f-kube-api-access-dvjwb\") pod \"service-ca-568869fdc5-qgdfj\" (UID: \"59af9218-c4da-4e62-bdb2-8bf7e1504f2f\") " pod="openshift-service-ca/service-ca-568869fdc5-qgdfj"
Sep 17 14:08:50.848037 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:50.847983    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/59af9218-c4da-4e62-bdb2-8bf7e1504f2f-signing-cabundle\") pod \"service-ca-568869fdc5-qgdfj\" (UID: \"59af9218-c4da-4e62-bdb2-8bf7e1504f2f\") " pod="openshift-service-ca/service-ca-568869fdc5-qgdfj"
Sep 17 14:08:50.948617 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:50.948578    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/59af9218-c4da-4e62-bdb2-8bf7e1504f2f-signing-cabundle\") pod \"service-ca-568869fdc5-qgdfj\" (UID: \"59af9218-c4da-4e62-bdb2-8bf7e1504f2f\") " pod="openshift-service-ca/service-ca-568869fdc5-qgdfj"
Sep 17 14:08:50.948789 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:50.948638    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/59af9218-c4da-4e62-bdb2-8bf7e1504f2f-signing-key\") pod \"service-ca-568869fdc5-qgdfj\" (UID: \"59af9218-c4da-4e62-bdb2-8bf7e1504f2f\") " pod="openshift-service-ca/service-ca-568869fdc5-qgdfj"
Sep 17 14:08:50.948789 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:50.948681    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvjwb\" (UniqueName: \"kubernetes.io/projected/59af9218-c4da-4e62-bdb2-8bf7e1504f2f-kube-api-access-dvjwb\") pod \"service-ca-568869fdc5-qgdfj\" (UID: \"59af9218-c4da-4e62-bdb2-8bf7e1504f2f\") " pod="openshift-service-ca/service-ca-568869fdc5-qgdfj"
Sep 17 14:08:50.949281 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:50.949260    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/59af9218-c4da-4e62-bdb2-8bf7e1504f2f-signing-cabundle\") pod \"service-ca-568869fdc5-qgdfj\" (UID: \"59af9218-c4da-4e62-bdb2-8bf7e1504f2f\") " pod="openshift-service-ca/service-ca-568869fdc5-qgdfj"
Sep 17 14:08:50.951260 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:50.951237    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/59af9218-c4da-4e62-bdb2-8bf7e1504f2f-signing-key\") pod \"service-ca-568869fdc5-qgdfj\" (UID: \"59af9218-c4da-4e62-bdb2-8bf7e1504f2f\") " pod="openshift-service-ca/service-ca-568869fdc5-qgdfj"
Sep 17 14:08:50.957647 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:50.957617    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvjwb\" (UniqueName: \"kubernetes.io/projected/59af9218-c4da-4e62-bdb2-8bf7e1504f2f-kube-api-access-dvjwb\") pod \"service-ca-568869fdc5-qgdfj\" (UID: \"59af9218-c4da-4e62-bdb2-8bf7e1504f2f\") " pod="openshift-service-ca/service-ca-568869fdc5-qgdfj"
Sep 17 14:08:51.050073 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:51.049981    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e34585f-eabb-49bc-ae58-5432490909e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8br75\" (UID: \"5e34585f-eabb-49bc-ae58-5432490909e0\") " pod="openshift-insights/insights-runtime-extractor-8br75"
Sep 17 14:08:51.050073 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:51.050059    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e34585f-eabb-49bc-ae58-5432490909e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8br75\" (UID: \"5e34585f-eabb-49bc-ae58-5432490909e0\") " pod="openshift-insights/insights-runtime-extractor-8br75"
Sep 17 14:08:51.050261 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:51.050112    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 14:08:51.050261 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:51.050169    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 14:08:51.050261 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:51.050176    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e34585f-eabb-49bc-ae58-5432490909e0-kube-rbac-proxy-cm podName:5e34585f-eabb-49bc-ae58-5432490909e0 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:53.050161561 +0000 UTC m=+120.494237126 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5e34585f-eabb-49bc-ae58-5432490909e0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8br75" (UID: "5e34585f-eabb-49bc-ae58-5432490909e0") : configmap "kube-rbac-proxy" not found
Sep 17 14:08:51.050261 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:51.050219    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e34585f-eabb-49bc-ae58-5432490909e0-insights-runtime-extractor-tls podName:5e34585f-eabb-49bc-ae58-5432490909e0 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:53.050207537 +0000 UTC m=+120.494283102 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5e34585f-eabb-49bc-ae58-5432490909e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8br75" (UID: "5e34585f-eabb-49bc-ae58-5432490909e0") : secret "insights-runtime-extractor-tls" not found
Sep 17 14:08:51.097244 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:51.097214    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-qgdfj"
Sep 17 14:08:51.232026 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:51.231994    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cjdbx_1a72aa89-6ca0-47df-9fde-fb8dbc65c79f/dns-node-resolver/0.log"
Sep 17 14:08:51.369972 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:51.369841    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-qgdfj"]
Sep 17 14:08:51.372067 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:08:51.372040    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59af9218_c4da_4e62_bdb2_8bf7e1504f2f.slice/crio-c89e16cc994589630c8852d089e0ecd9ce9a4c743882e6529ccc1a40cd3cc385 WatchSource:0}: Error finding container c89e16cc994589630c8852d089e0ecd9ce9a4c743882e6529ccc1a40cd3cc385: Status 404 returned error can't find the container with id c89e16cc994589630c8852d089e0ecd9ce9a4c743882e6529ccc1a40cd3cc385
Sep 17 14:08:51.566174 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:51.566134    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-qgdfj" event={"ID":"59af9218-c4da-4e62-bdb2-8bf7e1504f2f","Type":"ContainerStarted","Data":"0c40e2c71f0ee43cd20bcf220c3fdca645de31cffcaec554f190159d7a4d6d75"}
Sep 17 14:08:51.566517 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:51.566194    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-qgdfj" event={"ID":"59af9218-c4da-4e62-bdb2-8bf7e1504f2f","Type":"ContainerStarted","Data":"c89e16cc994589630c8852d089e0ecd9ce9a4c743882e6529ccc1a40cd3cc385"}
Sep 17 14:08:51.589611 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:51.589564    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-qgdfj" podStartSLOduration=1.58954855 podStartE2EDuration="1.58954855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:08:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:51.587558792 +0000 UTC m=+119.031634377" watchObservedRunningTime="2026-09-17 14:08:51.58954855 +0000 UTC m=+119.033624136"
Sep 17 14:08:51.958873 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:51.958836    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92f8530c-23cc-4d9c-9d4b-564058a9b840-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-krk4h\" (UID: \"92f8530c-23cc-4d9c-9d4b-564058a9b840\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-krk4h"
Sep 17 14:08:51.959058 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:51.958946    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 14:08:51.959058 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:51.959006    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92f8530c-23cc-4d9c-9d4b-564058a9b840-cluster-monitoring-operator-tls podName:92f8530c-23cc-4d9c-9d4b-564058a9b840 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:59.958990511 +0000 UTC m=+127.403066094 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92f8530c-23cc-4d9c-9d4b-564058a9b840-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-krk4h" (UID: "92f8530c-23cc-4d9c-9d4b-564058a9b840") : secret "cluster-monitoring-operator-tls" not found
Sep 17 14:08:52.036891 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:52.036859    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6cb9l_f68cb2de-9f71-4ee3-8c37-75f1c2918f66/node-ca/0.log"
Sep 17 14:08:52.059291 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:52.059255    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-registry-tls\") pod \"image-registry-679df86f77-4lwpc\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") " pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:08:52.059420 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:52.059315    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc41a52d-5543-4bec-8e90-06bd5f78313a-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-t4ngb\" (UID: \"bc41a52d-5543-4bec-8e90-06bd5f78313a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t4ngb"
Sep 17 14:08:52.059420 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:52.059398    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 14:08:52.059420 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:52.059413    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-679df86f77-4lwpc: secret "image-registry-tls" not found
Sep 17 14:08:52.059567 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:52.059461    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-registry-tls podName:dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4 nodeName:}" failed. No retries permitted until 2026-09-17 14:09:00.059448113 +0000 UTC m=+127.503523682 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-registry-tls") pod "image-registry-679df86f77-4lwpc" (UID: "dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4") : secret "image-registry-tls" not found
Sep 17 14:08:52.059567 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:52.059467    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 14:08:52.059567 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:52.059508    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc41a52d-5543-4bec-8e90-06bd5f78313a-samples-operator-tls podName:bc41a52d-5543-4bec-8e90-06bd5f78313a nodeName:}" failed. No retries permitted until 2026-09-17 14:09:00.059496903 +0000 UTC m=+127.503572472 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bc41a52d-5543-4bec-8e90-06bd5f78313a-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-t4ngb" (UID: "bc41a52d-5543-4bec-8e90-06bd5f78313a") : secret "samples-operator-tls" not found
Sep 17 14:08:53.035860 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:53.035827    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mhzr8_85268ab9-968c-4231-85c2-e4bd619a31c5/serve-healthcheck-canary/0.log"
Sep 17 14:08:53.069326 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:53.069292    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e34585f-eabb-49bc-ae58-5432490909e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8br75\" (UID: \"5e34585f-eabb-49bc-ae58-5432490909e0\") " pod="openshift-insights/insights-runtime-extractor-8br75"
Sep 17 14:08:53.069588 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:53.069463    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 14:08:53.069654 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:53.069639    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e34585f-eabb-49bc-ae58-5432490909e0-insights-runtime-extractor-tls podName:5e34585f-eabb-49bc-ae58-5432490909e0 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:57.069620119 +0000 UTC m=+124.513695688 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5e34585f-eabb-49bc-ae58-5432490909e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8br75" (UID: "5e34585f-eabb-49bc-ae58-5432490909e0") : secret "insights-runtime-extractor-tls" not found
Sep 17 14:08:53.069753 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:53.069734    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 14:08:53.069809 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:53.069792    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e34585f-eabb-49bc-ae58-5432490909e0-kube-rbac-proxy-cm podName:5e34585f-eabb-49bc-ae58-5432490909e0 nodeName:}" failed. No retries permitted until 2026-09-17 14:08:57.069777916 +0000 UTC m=+124.513853496 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5e34585f-eabb-49bc-ae58-5432490909e0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8br75" (UID: "5e34585f-eabb-49bc-ae58-5432490909e0") : configmap "kube-rbac-proxy" not found
Sep 17 14:08:53.069891 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:53.069743    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e34585f-eabb-49bc-ae58-5432490909e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8br75\" (UID: \"5e34585f-eabb-49bc-ae58-5432490909e0\") " pod="openshift-insights/insights-runtime-extractor-8br75"
Sep 17 14:08:54.579769 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:54.579733    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hmpxg" event={"ID":"34962ee4-4405-4b0a-b926-bc17926da9cd","Type":"ContainerStarted","Data":"980b6f49758b09a5497780d334071e6db367658437c2ba6dbec1c1831d469c4a"}
Sep 17 14:08:54.580182 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:54.579797    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hmpxg" event={"ID":"34962ee4-4405-4b0a-b926-bc17926da9cd","Type":"ContainerStarted","Data":"2d35892b49efbd83dfe43856354f1f4db3375d1bee6667a4e0a6967eea16026f"}
Sep 17 14:08:54.603099 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:54.603047    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hmpxg" podStartSLOduration=2.479422991 podStartE2EDuration="5.603031531s" totalImagesPullingTime="3.12360854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:08:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:08:54.601896538 +0000 UTC m=+122.045972148" watchObservedRunningTime="2026-09-17 14:08:54.603031531 +0000 UTC m=+122.047107117"
Sep 17 14:08:57.105019 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:57.104987    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e34585f-eabb-49bc-ae58-5432490909e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8br75\" (UID: \"5e34585f-eabb-49bc-ae58-5432490909e0\") " pod="openshift-insights/insights-runtime-extractor-8br75"
Sep 17 14:08:57.105418 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:08:57.105081    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e34585f-eabb-49bc-ae58-5432490909e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8br75\" (UID: \"5e34585f-eabb-49bc-ae58-5432490909e0\") " pod="openshift-insights/insights-runtime-extractor-8br75"
Sep 17 14:08:57.105418 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:57.105147    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 14:08:57.105418 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:57.105208    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e34585f-eabb-49bc-ae58-5432490909e0-insights-runtime-extractor-tls podName:5e34585f-eabb-49bc-ae58-5432490909e0 nodeName:}" failed. No retries permitted until 2026-09-17 14:09:05.105194795 +0000 UTC m=+132.549270364 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5e34585f-eabb-49bc-ae58-5432490909e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8br75" (UID: "5e34585f-eabb-49bc-ae58-5432490909e0") : secret "insights-runtime-extractor-tls" not found
Sep 17 14:08:57.105418 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:57.105152    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 14:08:57.105418 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:08:57.105249    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e34585f-eabb-49bc-ae58-5432490909e0-kube-rbac-proxy-cm podName:5e34585f-eabb-49bc-ae58-5432490909e0 nodeName:}" failed. No retries permitted until 2026-09-17 14:09:05.105240003 +0000 UTC m=+132.549315569 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5e34585f-eabb-49bc-ae58-5432490909e0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8br75" (UID: "5e34585f-eabb-49bc-ae58-5432490909e0") : configmap "kube-rbac-proxy" not found
Sep 17 14:09:00.031531 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:00.031486    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92f8530c-23cc-4d9c-9d4b-564058a9b840-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-krk4h\" (UID: \"92f8530c-23cc-4d9c-9d4b-564058a9b840\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-krk4h"
Sep 17 14:09:00.033889 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:00.033865    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92f8530c-23cc-4d9c-9d4b-564058a9b840-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-krk4h\" (UID: \"92f8530c-23cc-4d9c-9d4b-564058a9b840\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-krk4h"
Sep 17 14:09:00.126240 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:00.126207    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-kdnbh\""
Sep 17 14:09:00.132827 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:00.132802    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc41a52d-5543-4bec-8e90-06bd5f78313a-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-t4ngb\" (UID: \"bc41a52d-5543-4bec-8e90-06bd5f78313a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t4ngb"
Sep 17 14:09:00.132899 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:00.132872    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-registry-tls\") pod \"image-registry-679df86f77-4lwpc\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") " pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:09:00.133204 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:00.133185    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-krk4h"
Sep 17 14:09:00.135452 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:00.135339    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-registry-tls\") pod \"image-registry-679df86f77-4lwpc\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") " pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:09:00.135452 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:00.135399    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc41a52d-5543-4bec-8e90-06bd5f78313a-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-t4ngb\" (UID: \"bc41a52d-5543-4bec-8e90-06bd5f78313a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t4ngb"
Sep 17 14:09:00.242454 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:00.242424    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2g4kt\""
Sep 17 14:09:00.249356 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:00.249337    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:09:00.255576 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:00.255556    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-j4pjn\""
Sep 17 14:09:00.261297 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:00.261271    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t4ngb"
Sep 17 14:09:00.401982 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:00.401960    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-krk4h"]
Sep 17 14:09:00.404539 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:09:00.404508    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92f8530c_23cc_4d9c_9d4b_564058a9b840.slice/crio-f37f7ef2b50e97354b3d210e346fd951add5f80dcc34c3493c501bb5340d3458 WatchSource:0}: Error finding container f37f7ef2b50e97354b3d210e346fd951add5f80dcc34c3493c501bb5340d3458: Status 404 returned error can't find the container with id f37f7ef2b50e97354b3d210e346fd951add5f80dcc34c3493c501bb5340d3458
Sep 17 14:09:00.545679 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:00.545647    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-679df86f77-4lwpc"]
Sep 17 14:09:00.549360 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:09:00.549332    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc7a2273_eab1_4cae_b6d4_31c2a2db8ac4.slice/crio-4dd996931924c36839bb390dc47f44428d81df2ab320a89e4c200236e51d3879 WatchSource:0}: Error finding container 4dd996931924c36839bb390dc47f44428d81df2ab320a89e4c200236e51d3879: Status 404 returned error can't find the container with id 4dd996931924c36839bb390dc47f44428d81df2ab320a89e4c200236e51d3879
Sep 17 14:09:00.563878 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:00.563851    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t4ngb"]
Sep 17 14:09:00.600589 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:00.600563    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-679df86f77-4lwpc" event={"ID":"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4","Type":"ContainerStarted","Data":"4dd996931924c36839bb390dc47f44428d81df2ab320a89e4c200236e51d3879"}
Sep 17 14:09:00.601861 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:00.601820    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-krk4h" event={"ID":"92f8530c-23cc-4d9c-9d4b-564058a9b840","Type":"ContainerStarted","Data":"f37f7ef2b50e97354b3d210e346fd951add5f80dcc34c3493c501bb5340d3458"}
Sep 17 14:09:01.606965 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:01.606929    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-679df86f77-4lwpc" event={"ID":"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4","Type":"ContainerStarted","Data":"f2dc1e3d164eb143f68811657a53b76630b039e0c2f9c5572f702765fe3e054d"}
Sep 17 14:09:01.607428 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:01.607050    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:09:01.608144 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:01.608120    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t4ngb" event={"ID":"bc41a52d-5543-4bec-8e90-06bd5f78313a","Type":"ContainerStarted","Data":"c7718cccfe60d74f8c8a3b4d76c5b237a719632bbaeb2664a271dfeffedba422"}
Sep 17 14:09:01.630808 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:01.630695    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-679df86f77-4lwpc" podStartSLOduration=17.630677715 podStartE2EDuration="17.630677715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:08:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:09:01.62974362 +0000 UTC m=+129.073819232" watchObservedRunningTime="2026-09-17 14:09:01.630677715 +0000 UTC m=+129.074753302"
Sep 17 14:09:02.613922 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:02.613871    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t4ngb" event={"ID":"bc41a52d-5543-4bec-8e90-06bd5f78313a","Type":"ContainerStarted","Data":"06ef2301d1be88cededbe2dcc8e89b9dfb7e2cde404f41d3355fd06b2f627f11"}
Sep 17 14:09:02.614367 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:02.613937    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t4ngb" event={"ID":"bc41a52d-5543-4bec-8e90-06bd5f78313a","Type":"ContainerStarted","Data":"50c6f5195a50f3f9dab8b4cd07450f1348a9456c4a59237430771e87468d75ea"}
Sep 17 14:09:02.637615 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:02.637449    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t4ngb" podStartSLOduration=17.172108272 podStartE2EDuration="18.637429701s" totalImagesPullingTime="1.465321429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:08:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:09:02.637311329 +0000 UTC m=+130.081386937" watchObservedRunningTime="2026-09-17 14:09:02.637429701 +0000 UTC m=+130.081505289"
Sep 17 14:09:02.857957 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:02.857921    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59c1fc39-6669-462c-9a66-c97b5357d8ac-metrics-certs\") pod \"network-metrics-daemon-pjjpc\" (UID: \"59c1fc39-6669-462c-9a66-c97b5357d8ac\") " pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:09:02.860776 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:02.860742    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59c1fc39-6669-462c-9a66-c97b5357d8ac-metrics-certs\") pod \"network-metrics-daemon-pjjpc\" (UID: \"59c1fc39-6669-462c-9a66-c97b5357d8ac\") " pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:09:02.986362 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:02.986330    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ck6nq\""
Sep 17 14:09:02.994125 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:02.994097    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjjpc"
Sep 17 14:09:03.270977 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:03.270833    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pjjpc"]
Sep 17 14:09:03.275106 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:09:03.275064    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59c1fc39_6669_462c_9a66_c97b5357d8ac.slice/crio-857e156a285668ae5e09ec2f19cd8da40e015529bdd835ae532e063815844997 WatchSource:0}: Error finding container 857e156a285668ae5e09ec2f19cd8da40e015529bdd835ae532e063815844997: Status 404 returned error can't find the container with id 857e156a285668ae5e09ec2f19cd8da40e015529bdd835ae532e063815844997
Sep 17 14:09:03.619038 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:03.618944    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pjjpc" event={"ID":"59c1fc39-6669-462c-9a66-c97b5357d8ac","Type":"ContainerStarted","Data":"857e156a285668ae5e09ec2f19cd8da40e015529bdd835ae532e063815844997"}
Sep 17 14:09:04.624596 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:04.624554    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-krk4h" event={"ID":"92f8530c-23cc-4d9c-9d4b-564058a9b840","Type":"ContainerStarted","Data":"bf3b7607934992adc7e288fcfca566a0acb8cccce2d0add1289c623f49bf13fd"}
Sep 17 14:09:04.645554 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:04.645494    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-krk4h" podStartSLOduration=17.08806647 podStartE2EDuration="20.64547279s" totalImagesPullingTime="3.55740632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:08:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:09:04.643826588 +0000 UTC m=+132.087902196" watchObservedRunningTime="2026-09-17 14:09:04.64547279 +0000 UTC m=+132.089548377"
Sep 17 14:09:05.176722 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:05.176683    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e34585f-eabb-49bc-ae58-5432490909e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8br75\" (UID: \"5e34585f-eabb-49bc-ae58-5432490909e0\") " pod="openshift-insights/insights-runtime-extractor-8br75"
Sep 17 14:09:05.176880 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:05.176764    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e34585f-eabb-49bc-ae58-5432490909e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8br75\" (UID: \"5e34585f-eabb-49bc-ae58-5432490909e0\") " pod="openshift-insights/insights-runtime-extractor-8br75"
Sep 17 14:09:05.177193 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:05.177172    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e34585f-eabb-49bc-ae58-5432490909e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8br75\" (UID: \"5e34585f-eabb-49bc-ae58-5432490909e0\") " pod="openshift-insights/insights-runtime-extractor-8br75"
Sep 17 14:09:05.178988 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:05.178962    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e34585f-eabb-49bc-ae58-5432490909e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8br75\" (UID: \"5e34585f-eabb-49bc-ae58-5432490909e0\") " pod="openshift-insights/insights-runtime-extractor-8br75"
Sep 17 14:09:05.259166 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:05.259134    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tmmrx\""
Sep 17 14:09:05.266627 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:05.266605    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8br75"
Sep 17 14:09:05.540888 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:05.540829    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8br75"]
Sep 17 14:09:05.543389 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:09:05.543354    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e34585f_eabb_49bc_ae58_5432490909e0.slice/crio-f3f27af1f54295508d1eecb1971774019c34c76b6d6457f901ac8838050413de WatchSource:0}: Error finding container f3f27af1f54295508d1eecb1971774019c34c76b6d6457f901ac8838050413de: Status 404 returned error can't find the container with id f3f27af1f54295508d1eecb1971774019c34c76b6d6457f901ac8838050413de
Sep 17 14:09:05.629785 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:05.629754    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8br75" event={"ID":"5e34585f-eabb-49bc-ae58-5432490909e0","Type":"ContainerStarted","Data":"bfe385bc9bbc510a538f492754187b4b65e4c0c99796004187330bec7b2f1c90"}
Sep 17 14:09:05.630127 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:05.629810    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8br75" event={"ID":"5e34585f-eabb-49bc-ae58-5432490909e0","Type":"ContainerStarted","Data":"f3f27af1f54295508d1eecb1971774019c34c76b6d6457f901ac8838050413de"}
Sep 17 14:09:06.634311 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:06.634281    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8br75" event={"ID":"5e34585f-eabb-49bc-ae58-5432490909e0","Type":"ContainerStarted","Data":"28bb9c63faab2ee7dd757c918053e57ffeea10112c62d74f202f04a9359bd6af"}
Sep 17 14:09:06.635942 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:06.635918    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pjjpc" event={"ID":"59c1fc39-6669-462c-9a66-c97b5357d8ac","Type":"ContainerStarted","Data":"bbe5ebbf7e614487c86b59a14a36044c259beb2124cc7cacc59fb7821e071c88"}
Sep 17 14:09:06.636060 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:06.635968    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pjjpc" event={"ID":"59c1fc39-6669-462c-9a66-c97b5357d8ac","Type":"ContainerStarted","Data":"62a42323ad6d8e9b7ab8a329c4c0dcaa88eecb59edcd76cb7bceac64bddfc12d"}
Sep 17 14:09:06.657548 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:06.657449    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pjjpc" podStartSLOduration=130.790898499 podStartE2EDuration="2m13.657432952s" totalImagesPullingTime="2.866534453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:09:06.656663338 +0000 UTC m=+134.100738947" watchObservedRunningTime="2026-09-17 14:09:06.657432952 +0000 UTC m=+134.101508538"
Sep 17 14:09:08.644322 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:08.644282    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8br75" event={"ID":"5e34585f-eabb-49bc-ae58-5432490909e0","Type":"ContainerStarted","Data":"5a9cefe4b1c523cde3a2d0052717ce1078091b24f441d045a53dda2c82302314"}
Sep 17 14:09:08.681596 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:08.681547    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8br75" podStartSLOduration=16.844073971 podStartE2EDuration="19.681530706s" totalImagesPullingTime="2.837456735s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:08:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:09:08.681503503 +0000 UTC m=+136.125579088" watchObservedRunningTime="2026-09-17 14:09:08.681530706 +0000 UTC m=+136.125606283"
Sep 17 14:09:15.679446 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:15.679415    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-679df86f77-4lwpc"]
Sep 17 14:09:15.683744 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:15.683699    2580 patch_prober.go:28] interesting pod/image-registry-679df86f77-4lwpc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 17 14:09:15.683867 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:15.683773    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-679df86f77-4lwpc" podUID="dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 14:09:15.729028 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:15.728992    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-qq8f6"]
Sep 17 14:09:15.731951 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:15.731933    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-qq8f6"
Sep 17 14:09:15.735834 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:15.735810    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 17 14:09:15.736171 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:15.736157    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 17 14:09:15.740394 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:15.740378    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-zmrvg\""
Sep 17 14:09:15.770833 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:15.770799    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-qq8f6"]
Sep 17 14:09:15.859370 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:15.859334    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmbmb\" (UniqueName: \"kubernetes.io/projected/f32a3a50-14cd-4c4d-9c76-0b5513397f7a-kube-api-access-zmbmb\") pod \"downloads-76f99584f4-qq8f6\" (UID: \"f32a3a50-14cd-4c4d-9c76-0b5513397f7a\") " pod="openshift-console/downloads-76f99584f4-qq8f6"
Sep 17 14:09:15.960655 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:15.960622    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmbmb\" (UniqueName: \"kubernetes.io/projected/f32a3a50-14cd-4c4d-9c76-0b5513397f7a-kube-api-access-zmbmb\") pod \"downloads-76f99584f4-qq8f6\" (UID: \"f32a3a50-14cd-4c4d-9c76-0b5513397f7a\") " pod="openshift-console/downloads-76f99584f4-qq8f6"
Sep 17 14:09:15.970553 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:15.970529    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmbmb\" (UniqueName: \"kubernetes.io/projected/f32a3a50-14cd-4c4d-9c76-0b5513397f7a-kube-api-access-zmbmb\") pod \"downloads-76f99584f4-qq8f6\" (UID: \"f32a3a50-14cd-4c4d-9c76-0b5513397f7a\") " pod="openshift-console/downloads-76f99584f4-qq8f6"
Sep 17 14:09:16.040027 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:16.039994    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-qq8f6"
Sep 17 14:09:16.310849 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:16.310827    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-qq8f6"]
Sep 17 14:09:16.313100 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:09:16.313070    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf32a3a50_14cd_4c4d_9c76_0b5513397f7a.slice/crio-65ccbe53a15480f2779f73d93c9c2530abd8fdd94e6a037e7e6ea5dac3b4c1bb WatchSource:0}: Error finding container 65ccbe53a15480f2779f73d93c9c2530abd8fdd94e6a037e7e6ea5dac3b4c1bb: Status 404 returned error can't find the container with id 65ccbe53a15480f2779f73d93c9c2530abd8fdd94e6a037e7e6ea5dac3b4c1bb
Sep 17 14:09:16.670171 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:16.670079    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-qq8f6" event={"ID":"f32a3a50-14cd-4c4d-9c76-0b5513397f7a","Type":"ContainerStarted","Data":"65ccbe53a15480f2779f73d93c9c2530abd8fdd94e6a037e7e6ea5dac3b4c1bb"}
Sep 17 14:09:18.612760 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:18.612722    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-rt8f6"]
Sep 17 14:09:18.617217 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:18.617197    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-rt8f6"
Sep 17 14:09:18.624282 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:18.624252    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 17 14:09:18.625440 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:18.625417    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 17 14:09:18.625689 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:18.625666    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-2qqg2\""
Sep 17 14:09:18.626524 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:18.626503    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 17 14:09:18.637905 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:18.637881    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-rt8f6"]
Sep 17 14:09:18.781568 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:18.781535    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlsb6\" (UniqueName: \"kubernetes.io/projected/e422892e-ae98-49b6-9faa-a7baf4b61fe1-kube-api-access-nlsb6\") pod \"prometheus-operator-68bcd7f987-rt8f6\" (UID: \"e422892e-ae98-49b6-9faa-a7baf4b61fe1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rt8f6"
Sep 17 14:09:18.781760 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:18.781597    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e422892e-ae98-49b6-9faa-a7baf4b61fe1-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-rt8f6\" (UID: \"e422892e-ae98-49b6-9faa-a7baf4b61fe1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rt8f6"
Sep 17 14:09:18.781760 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:18.781731    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e422892e-ae98-49b6-9faa-a7baf4b61fe1-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-rt8f6\" (UID: \"e422892e-ae98-49b6-9faa-a7baf4b61fe1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rt8f6"
Sep 17 14:09:18.781858 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:18.781779    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e422892e-ae98-49b6-9faa-a7baf4b61fe1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-rt8f6\" (UID: \"e422892e-ae98-49b6-9faa-a7baf4b61fe1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rt8f6"
Sep 17 14:09:18.883029 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:18.882941    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e422892e-ae98-49b6-9faa-a7baf4b61fe1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-rt8f6\" (UID: \"e422892e-ae98-49b6-9faa-a7baf4b61fe1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rt8f6"
Sep 17 14:09:18.883029 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:18.883002    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlsb6\" (UniqueName: \"kubernetes.io/projected/e422892e-ae98-49b6-9faa-a7baf4b61fe1-kube-api-access-nlsb6\") pod \"prometheus-operator-68bcd7f987-rt8f6\" (UID: \"e422892e-ae98-49b6-9faa-a7baf4b61fe1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rt8f6"
Sep 17 14:09:18.883250 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:18.883066    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e422892e-ae98-49b6-9faa-a7baf4b61fe1-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-rt8f6\" (UID: \"e422892e-ae98-49b6-9faa-a7baf4b61fe1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rt8f6"
Sep 17 14:09:18.883250 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:18.883120    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e422892e-ae98-49b6-9faa-a7baf4b61fe1-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-rt8f6\" (UID: \"e422892e-ae98-49b6-9faa-a7baf4b61fe1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rt8f6"
Sep 17 14:09:18.883784 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:18.883757    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e422892e-ae98-49b6-9faa-a7baf4b61fe1-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-rt8f6\" (UID: \"e422892e-ae98-49b6-9faa-a7baf4b61fe1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rt8f6"
Sep 17 14:09:18.885694 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:18.885667    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e422892e-ae98-49b6-9faa-a7baf4b61fe1-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-rt8f6\" (UID: \"e422892e-ae98-49b6-9faa-a7baf4b61fe1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rt8f6"
Sep 17 14:09:18.885819 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:18.885667    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e422892e-ae98-49b6-9faa-a7baf4b61fe1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-rt8f6\" (UID: \"e422892e-ae98-49b6-9faa-a7baf4b61fe1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rt8f6"
Sep 17 14:09:18.896260 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:18.896235    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlsb6\" (UniqueName: \"kubernetes.io/projected/e422892e-ae98-49b6-9faa-a7baf4b61fe1-kube-api-access-nlsb6\") pod \"prometheus-operator-68bcd7f987-rt8f6\" (UID: \"e422892e-ae98-49b6-9faa-a7baf4b61fe1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-rt8f6"
Sep 17 14:09:18.928866 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:18.928836    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-rt8f6"
Sep 17 14:09:19.212503 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:19.212308    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-rt8f6"]
Sep 17 14:09:19.215125 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:09:19.215084    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode422892e_ae98_49b6_9faa_a7baf4b61fe1.slice/crio-b3278edb0f4b9477a01c57c2c37a8d4572d64b7438f3d9c778402445bcffc670 WatchSource:0}: Error finding container b3278edb0f4b9477a01c57c2c37a8d4572d64b7438f3d9c778402445bcffc670: Status 404 returned error can't find the container with id b3278edb0f4b9477a01c57c2c37a8d4572d64b7438f3d9c778402445bcffc670
Sep 17 14:09:19.684296 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:19.684206    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-rt8f6" event={"ID":"e422892e-ae98-49b6-9faa-a7baf4b61fe1","Type":"ContainerStarted","Data":"b3278edb0f4b9477a01c57c2c37a8d4572d64b7438f3d9c778402445bcffc670"}
Sep 17 14:09:20.692974 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:20.692940    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-rt8f6" event={"ID":"e422892e-ae98-49b6-9faa-a7baf4b61fe1","Type":"ContainerStarted","Data":"010cad841d530ae05a51790f94f2604081e1ac7f11bc34ea026a9244e981789e"}
Sep 17 14:09:21.698436 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:21.698400    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-rt8f6" event={"ID":"e422892e-ae98-49b6-9faa-a7baf4b61fe1","Type":"ContainerStarted","Data":"57d556b38585f402597b62e1b9da4ef51fba22f11b8e70b4a4ac270a642b181c"}
Sep 17 14:09:21.718920 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:21.718856    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-rt8f6" podStartSLOduration=2.389472564 podStartE2EDuration="3.718832705s" totalImagesPullingTime="1.329360141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:09:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:09:21.716789826 +0000 UTC m=+149.160865404" watchObservedRunningTime="2026-09-17 14:09:21.718832705 +0000 UTC m=+149.162908292"
Sep 17 14:09:23.979891 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:23.979742    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-stfjc"]
Sep 17 14:09:23.985879 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:23.984981    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-stfjc"
Sep 17 14:09:23.989158 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:23.988951    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-7g895\""
Sep 17 14:09:23.990289 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:23.990097    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 17 14:09:23.997770 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:23.994693    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 17 14:09:24.005666 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.005581    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-stfjc"]
Sep 17 14:09:24.019600 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.019577    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57e11ae8-25af-4625-8ce8-f36875e393a2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-stfjc\" (UID: \"57e11ae8-25af-4625-8ce8-f36875e393a2\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-stfjc"
Sep 17 14:09:24.019805 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.019768    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrxh4\" (UniqueName: \"kubernetes.io/projected/57e11ae8-25af-4625-8ce8-f36875e393a2-kube-api-access-zrxh4\") pod \"openshift-state-metrics-67dcf8c979-stfjc\" (UID: \"57e11ae8-25af-4625-8ce8-f36875e393a2\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-stfjc"
Sep 17 14:09:24.019907 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.019887    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/57e11ae8-25af-4625-8ce8-f36875e393a2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-stfjc\" (UID: \"57e11ae8-25af-4625-8ce8-f36875e393a2\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-stfjc"
Sep 17 14:09:24.019972 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.019926    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57e11ae8-25af-4625-8ce8-f36875e393a2-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-stfjc\" (UID: \"57e11ae8-25af-4625-8ce8-f36875e393a2\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-stfjc"
Sep 17 14:09:24.021214 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.021190    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qf9s8"]
Sep 17 14:09:24.025452 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.025433    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qf9s8"
Sep 17 14:09:24.028778 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.028239    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rvp8v\""
Sep 17 14:09:24.028778 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.028581    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 17 14:09:24.028778 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.028649    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 17 14:09:24.028778 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.028773    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 17 14:09:24.121112 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.121074    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59d983dc-3c76-4025-9cf6-9085f232616c-metrics-client-ca\") pod \"node-exporter-qf9s8\" (UID: \"59d983dc-3c76-4025-9cf6-9085f232616c\") " pod="openshift-monitoring/node-exporter-qf9s8"
Sep 17 14:09:24.121271 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.121131    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/59d983dc-3c76-4025-9cf6-9085f232616c-node-exporter-accelerators-collector-config\") pod \"node-exporter-qf9s8\" (UID: \"59d983dc-3c76-4025-9cf6-9085f232616c\") " pod="openshift-monitoring/node-exporter-qf9s8"
Sep 17 14:09:24.121271 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.121162    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59d983dc-3c76-4025-9cf6-9085f232616c-node-exporter-tls\") pod \"node-exporter-qf9s8\" (UID: \"59d983dc-3c76-4025-9cf6-9085f232616c\") " pod="openshift-monitoring/node-exporter-qf9s8"
Sep 17 14:09:24.121271 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.121192    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/59d983dc-3c76-4025-9cf6-9085f232616c-node-exporter-wtmp\") pod \"node-exporter-qf9s8\" (UID: \"59d983dc-3c76-4025-9cf6-9085f232616c\") " pod="openshift-monitoring/node-exporter-qf9s8"
Sep 17 14:09:24.121271 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.121224    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/57e11ae8-25af-4625-8ce8-f36875e393a2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-stfjc\" (UID: \"57e11ae8-25af-4625-8ce8-f36875e393a2\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-stfjc"
Sep 17 14:09:24.121271 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.121248    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd5rk\" (UniqueName: \"kubernetes.io/projected/59d983dc-3c76-4025-9cf6-9085f232616c-kube-api-access-fd5rk\") pod \"node-exporter-qf9s8\" (UID: \"59d983dc-3c76-4025-9cf6-9085f232616c\") " pod="openshift-monitoring/node-exporter-qf9s8"
Sep 17 14:09:24.121427 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.121275    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57e11ae8-25af-4625-8ce8-f36875e393a2-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-stfjc\" (UID: \"57e11ae8-25af-4625-8ce8-f36875e393a2\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-stfjc"
Sep 17 14:09:24.121427 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.121311    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/59d983dc-3c76-4025-9cf6-9085f232616c-root\") pod \"node-exporter-qf9s8\" (UID: \"59d983dc-3c76-4025-9cf6-9085f232616c\") " pod="openshift-monitoring/node-exporter-qf9s8"
Sep 17 14:09:24.121427 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.121339    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57e11ae8-25af-4625-8ce8-f36875e393a2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-stfjc\" (UID: \"57e11ae8-25af-4625-8ce8-f36875e393a2\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-stfjc"
Sep 17 14:09:24.121427 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.121393    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/59d983dc-3c76-4025-9cf6-9085f232616c-node-exporter-textfile\") pod \"node-exporter-qf9s8\" (UID: \"59d983dc-3c76-4025-9cf6-9085f232616c\") " pod="openshift-monitoring/node-exporter-qf9s8"
Sep 17 14:09:24.121545 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.121435    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59d983dc-3c76-4025-9cf6-9085f232616c-sys\") pod \"node-exporter-qf9s8\" (UID: \"59d983dc-3c76-4025-9cf6-9085f232616c\") " pod="openshift-monitoring/node-exporter-qf9s8"
Sep 17 14:09:24.121545 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.121476    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrxh4\" (UniqueName: \"kubernetes.io/projected/57e11ae8-25af-4625-8ce8-f36875e393a2-kube-api-access-zrxh4\") pod \"openshift-state-metrics-67dcf8c979-stfjc\" (UID: \"57e11ae8-25af-4625-8ce8-f36875e393a2\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-stfjc"
Sep 17 14:09:24.121545 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.121499    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59d983dc-3c76-4025-9cf6-9085f232616c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qf9s8\" (UID: \"59d983dc-3c76-4025-9cf6-9085f232616c\") " pod="openshift-monitoring/node-exporter-qf9s8"
Sep 17 14:09:24.121742 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:09:24.121674    2580 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 17 14:09:24.121844 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:09:24.121787    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57e11ae8-25af-4625-8ce8-f36875e393a2-openshift-state-metrics-tls podName:57e11ae8-25af-4625-8ce8-f36875e393a2 nodeName:}" failed. No retries permitted until 2026-09-17 14:09:24.621766489 +0000 UTC m=+152.065842066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/57e11ae8-25af-4625-8ce8-f36875e393a2-openshift-state-metrics-tls") pod "openshift-state-metrics-67dcf8c979-stfjc" (UID: "57e11ae8-25af-4625-8ce8-f36875e393a2") : secret "openshift-state-metrics-tls" not found
Sep 17 14:09:24.122737 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.122693    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57e11ae8-25af-4625-8ce8-f36875e393a2-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-stfjc\" (UID: \"57e11ae8-25af-4625-8ce8-f36875e393a2\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-stfjc"
Sep 17 14:09:24.124521 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.124488    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57e11ae8-25af-4625-8ce8-f36875e393a2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-stfjc\" (UID: \"57e11ae8-25af-4625-8ce8-f36875e393a2\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-stfjc"
Sep 17 14:09:24.144071 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.144026    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrxh4\" (UniqueName: \"kubernetes.io/projected/57e11ae8-25af-4625-8ce8-f36875e393a2-kube-api-access-zrxh4\") pod \"openshift-state-metrics-67dcf8c979-stfjc\" (UID: \"57e11ae8-25af-4625-8ce8-f36875e393a2\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-stfjc"
Sep 17 14:09:24.222577 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.222541    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59d983dc-3c76-4025-9cf6-9085f232616c-metrics-client-ca\") pod \"node-exporter-qf9s8\" (UID: \"59d983dc-3c76-4025-9cf6-9085f232616c\") " pod="openshift-monitoring/node-exporter-qf9s8"
Sep 17 14:09:24.222782 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.222591    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/59d983dc-3c76-4025-9cf6-9085f232616c-node-exporter-accelerators-collector-config\") pod \"node-exporter-qf9s8\" (UID: \"59d983dc-3c76-4025-9cf6-9085f232616c\") " pod="openshift-monitoring/node-exporter-qf9s8"
Sep 17 14:09:24.222782 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.222616    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59d983dc-3c76-4025-9cf6-9085f232616c-node-exporter-tls\") pod \"node-exporter-qf9s8\" (UID: \"59d983dc-3c76-4025-9cf6-9085f232616c\") " pod="openshift-monitoring/node-exporter-qf9s8"
Sep 17 14:09:24.222782 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.222648    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/59d983dc-3c76-4025-9cf6-9085f232616c-node-exporter-wtmp\") pod \"node-exporter-qf9s8\" (UID: \"59d983dc-3c76-4025-9cf6-9085f232616c\") " pod="openshift-monitoring/node-exporter-qf9s8"
Sep 17 14:09:24.222782 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.222691    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd5rk\" (UniqueName: \"kubernetes.io/projected/59d983dc-3c76-4025-9cf6-9085f232616c-kube-api-access-fd5rk\") pod \"node-exporter-qf9s8\" (UID: \"59d983dc-3c76-4025-9cf6-9085f232616c\") " pod="openshift-monitoring/node-exporter-qf9s8"
Sep 17 14:09:24.222782 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.222752    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/59d983dc-3c76-4025-9cf6-9085f232616c-root\") pod \"node-exporter-qf9s8\" (UID: \"59d983dc-3c76-4025-9cf6-9085f232616c\") " pod="openshift-monitoring/node-exporter-qf9s8"
Sep 17 14:09:24.222782 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.222784    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/59d983dc-3c76-4025-9cf6-9085f232616c-node-exporter-textfile\") pod \"node-exporter-qf9s8\" (UID: \"59d983dc-3c76-4025-9cf6-9085f232616c\") " pod="openshift-monitoring/node-exporter-qf9s8"
Sep 17 14:09:24.223093 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.222823    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59d983dc-3c76-4025-9cf6-9085f232616c-sys\") pod \"node-exporter-qf9s8\" (UID: \"59d983dc-3c76-4025-9cf6-9085f232616c\") " pod="openshift-monitoring/node-exporter-qf9s8"
Sep 17 14:09:24.223093 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.222863    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59d983dc-3c76-4025-9cf6-9085f232616c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qf9s8\" (UID: \"59d983dc-3c76-4025-9cf6-9085f232616c\") " pod="openshift-monitoring/node-exporter-qf9s8"
Sep 17 14:09:24.223517 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.223245    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59d983dc-3c76-4025-9cf6-9085f232616c-metrics-client-ca\") pod \"node-exporter-qf9s8\" (UID: \"59d983dc-3c76-4025-9cf6-9085f232616c\") " pod="openshift-monitoring/node-exporter-qf9s8"
Sep 17 14:09:24.223517 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:09:24.223311    2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 17 14:09:24.223517 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:09:24.223365    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59d983dc-3c76-4025-9cf6-9085f232616c-node-exporter-tls podName:59d983dc-3c76-4025-9cf6-9085f232616c nodeName:}" failed. No retries permitted until 2026-09-17 14:09:24.723348904 +0000 UTC m=+152.167424475 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/59d983dc-3c76-4025-9cf6-9085f232616c-node-exporter-tls") pod "node-exporter-qf9s8" (UID: "59d983dc-3c76-4025-9cf6-9085f232616c") : secret "node-exporter-tls" not found
Sep 17 14:09:24.223517 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.223368    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59d983dc-3c76-4025-9cf6-9085f232616c-sys\") pod \"node-exporter-qf9s8\" (UID: \"59d983dc-3c76-4025-9cf6-9085f232616c\") " pod="openshift-monitoring/node-exporter-qf9s8"
Sep 17 14:09:24.223517 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.223391    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/59d983dc-3c76-4025-9cf6-9085f232616c-node-exporter-wtmp\") pod \"node-exporter-qf9s8\" (UID: \"59d983dc-3c76-4025-9cf6-9085f232616c\") " pod="openshift-monitoring/node-exporter-qf9s8"
Sep 17 14:09:24.223517 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.223436    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/59d983dc-3c76-4025-9cf6-9085f232616c-root\") pod \"node-exporter-qf9s8\" (UID: \"59d983dc-3c76-4025-9cf6-9085f232616c\") " pod="openshift-monitoring/node-exporter-qf9s8"
Sep 17 14:09:24.223517 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.223465    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/59d983dc-3c76-4025-9cf6-9085f232616c-node-exporter-textfile\") pod \"node-exporter-qf9s8\" (UID: \"59d983dc-3c76-4025-9cf6-9085f232616c\") " pod="openshift-monitoring/node-exporter-qf9s8"
Sep 17 14:09:24.223945 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.223857    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/59d983dc-3c76-4025-9cf6-9085f232616c-node-exporter-accelerators-collector-config\") pod \"node-exporter-qf9s8\" (UID: \"59d983dc-3c76-4025-9cf6-9085f232616c\") " pod="openshift-monitoring/node-exporter-qf9s8"
Sep 17 14:09:24.225934 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.225909    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59d983dc-3c76-4025-9cf6-9085f232616c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qf9s8\" (UID: \"59d983dc-3c76-4025-9cf6-9085f232616c\") " pod="openshift-monitoring/node-exporter-qf9s8"
Sep 17 14:09:24.246157 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.246095    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd5rk\" (UniqueName: \"kubernetes.io/projected/59d983dc-3c76-4025-9cf6-9085f232616c-kube-api-access-fd5rk\") pod \"node-exporter-qf9s8\" (UID: \"59d983dc-3c76-4025-9cf6-9085f232616c\") " pod="openshift-monitoring/node-exporter-qf9s8"
Sep 17 14:09:24.627852 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.627758    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/57e11ae8-25af-4625-8ce8-f36875e393a2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-stfjc\" (UID: \"57e11ae8-25af-4625-8ce8-f36875e393a2\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-stfjc"
Sep 17 14:09:24.630887 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.630854    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/57e11ae8-25af-4625-8ce8-f36875e393a2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-stfjc\" (UID: \"57e11ae8-25af-4625-8ce8-f36875e393a2\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-stfjc"
Sep 17 14:09:24.728670 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.728632    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59d983dc-3c76-4025-9cf6-9085f232616c-node-exporter-tls\") pod \"node-exporter-qf9s8\" (UID: \"59d983dc-3c76-4025-9cf6-9085f232616c\") " pod="openshift-monitoring/node-exporter-qf9s8"
Sep 17 14:09:24.731316 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.731292    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59d983dc-3c76-4025-9cf6-9085f232616c-node-exporter-tls\") pod \"node-exporter-qf9s8\" (UID: \"59d983dc-3c76-4025-9cf6-9085f232616c\") " pod="openshift-monitoring/node-exporter-qf9s8"
Sep 17 14:09:24.899382 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.899296    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-stfjc"
Sep 17 14:09:24.938806 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:24.938537    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qf9s8"
Sep 17 14:09:24.951661 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:09:24.951622    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59d983dc_3c76_4025_9cf6_9085f232616c.slice/crio-bc70f916ca901f7c55993215bd7227b35f6678e8767e6ab85f2f8b6da54ec771 WatchSource:0}: Error finding container bc70f916ca901f7c55993215bd7227b35f6678e8767e6ab85f2f8b6da54ec771: Status 404 returned error can't find the container with id bc70f916ca901f7c55993215bd7227b35f6678e8767e6ab85f2f8b6da54ec771
Sep 17 14:09:25.198498 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.197817    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-stfjc"]
Sep 17 14:09:25.203587 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:09:25.203555    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57e11ae8_25af_4625_8ce8_f36875e393a2.slice/crio-6521c693751e7c2f9ba3d859e60aba9d09e0263d1011b6991964c17743aaa372 WatchSource:0}: Error finding container 6521c693751e7c2f9ba3d859e60aba9d09e0263d1011b6991964c17743aaa372: Status 404 returned error can't find the container with id 6521c693751e7c2f9ba3d859e60aba9d09e0263d1011b6991964c17743aaa372
Sep 17 14:09:25.685214 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.685095    2580 patch_prober.go:28] interesting pod/image-registry-679df86f77-4lwpc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 17 14:09:25.685214 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.685154    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-679df86f77-4lwpc" podUID="dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 14:09:25.716919 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.716881    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qf9s8" event={"ID":"59d983dc-3c76-4025-9cf6-9085f232616c","Type":"ContainerStarted","Data":"bc70f916ca901f7c55993215bd7227b35f6678e8767e6ab85f2f8b6da54ec771"}
Sep 17 14:09:25.719229 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.719198    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-stfjc" event={"ID":"57e11ae8-25af-4625-8ce8-f36875e393a2","Type":"ContainerStarted","Data":"f0a37a6da781642d7738f02091fed782fbcd86b26b787836cd1a9ea9dd5e7d40"}
Sep 17 14:09:25.719356 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.719245    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-stfjc" event={"ID":"57e11ae8-25af-4625-8ce8-f36875e393a2","Type":"ContainerStarted","Data":"fb5e138e456ea268c4dff6f51f69e5ce6da7461af6d41c81c5b61f43c76ce820"}
Sep 17 14:09:25.719427 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.719268    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-stfjc" event={"ID":"57e11ae8-25af-4625-8ce8-f36875e393a2","Type":"ContainerStarted","Data":"6521c693751e7c2f9ba3d859e60aba9d09e0263d1011b6991964c17743aaa372"}
Sep 17 14:09:25.817487 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.817448    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77df486df5-jrcj4"]
Sep 17 14:09:25.821459 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.821431    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77df486df5-jrcj4"
Sep 17 14:09:25.830828 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.830800    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-45dp8\""
Sep 17 14:09:25.830828 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.830823    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 17 14:09:25.831022 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.830998    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 17 14:09:25.831143 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.831076    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 17 14:09:25.831143 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.831123    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 17 14:09:25.831307 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.831288    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 17 14:09:25.836232 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.836174    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77df486df5-jrcj4"]
Sep 17 14:09:25.837033 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.836840    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 17 14:09:25.842352 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.842323    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41f245e1-dd14-44e1-b012-49a99616f2ba-oauth-serving-cert\") pod \"console-77df486df5-jrcj4\" (UID: \"41f245e1-dd14-44e1-b012-49a99616f2ba\") " pod="openshift-console/console-77df486df5-jrcj4"
Sep 17 14:09:25.842476 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.842360    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41f245e1-dd14-44e1-b012-49a99616f2ba-console-serving-cert\") pod \"console-77df486df5-jrcj4\" (UID: \"41f245e1-dd14-44e1-b012-49a99616f2ba\") " pod="openshift-console/console-77df486df5-jrcj4"
Sep 17 14:09:25.842476 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.842442    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41f245e1-dd14-44e1-b012-49a99616f2ba-console-oauth-config\") pod \"console-77df486df5-jrcj4\" (UID: \"41f245e1-dd14-44e1-b012-49a99616f2ba\") " pod="openshift-console/console-77df486df5-jrcj4"
Sep 17 14:09:25.842599 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.842487    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41f245e1-dd14-44e1-b012-49a99616f2ba-trusted-ca-bundle\") pod \"console-77df486df5-jrcj4\" (UID: \"41f245e1-dd14-44e1-b012-49a99616f2ba\") " pod="openshift-console/console-77df486df5-jrcj4"
Sep 17 14:09:25.842599 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.842515    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4qwl\" (UniqueName: \"kubernetes.io/projected/41f245e1-dd14-44e1-b012-49a99616f2ba-kube-api-access-r4qwl\") pod \"console-77df486df5-jrcj4\" (UID: \"41f245e1-dd14-44e1-b012-49a99616f2ba\") " pod="openshift-console/console-77df486df5-jrcj4"
Sep 17 14:09:25.842599 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.842589    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41f245e1-dd14-44e1-b012-49a99616f2ba-service-ca\") pod \"console-77df486df5-jrcj4\" (UID: \"41f245e1-dd14-44e1-b012-49a99616f2ba\") " pod="openshift-console/console-77df486df5-jrcj4"
Sep 17 14:09:25.842779 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.842621    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41f245e1-dd14-44e1-b012-49a99616f2ba-console-config\") pod \"console-77df486df5-jrcj4\" (UID: \"41f245e1-dd14-44e1-b012-49a99616f2ba\") " pod="openshift-console/console-77df486df5-jrcj4"
Sep 17 14:09:25.944087 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.944004    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41f245e1-dd14-44e1-b012-49a99616f2ba-service-ca\") pod \"console-77df486df5-jrcj4\" (UID: \"41f245e1-dd14-44e1-b012-49a99616f2ba\") " pod="openshift-console/console-77df486df5-jrcj4"
Sep 17 14:09:25.944087 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.944053    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41f245e1-dd14-44e1-b012-49a99616f2ba-console-config\") pod \"console-77df486df5-jrcj4\" (UID: \"41f245e1-dd14-44e1-b012-49a99616f2ba\") " pod="openshift-console/console-77df486df5-jrcj4"
Sep 17 14:09:25.944304 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.944175    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41f245e1-dd14-44e1-b012-49a99616f2ba-oauth-serving-cert\") pod \"console-77df486df5-jrcj4\" (UID: \"41f245e1-dd14-44e1-b012-49a99616f2ba\") " pod="openshift-console/console-77df486df5-jrcj4"
Sep 17 14:09:25.944304 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.944217    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41f245e1-dd14-44e1-b012-49a99616f2ba-console-serving-cert\") pod \"console-77df486df5-jrcj4\" (UID: \"41f245e1-dd14-44e1-b012-49a99616f2ba\") " pod="openshift-console/console-77df486df5-jrcj4"
Sep 17 14:09:25.944304 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.944263    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41f245e1-dd14-44e1-b012-49a99616f2ba-console-oauth-config\") pod \"console-77df486df5-jrcj4\" (UID: \"41f245e1-dd14-44e1-b012-49a99616f2ba\") " pod="openshift-console/console-77df486df5-jrcj4"
Sep 17 14:09:25.944304 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.944293    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41f245e1-dd14-44e1-b012-49a99616f2ba-trusted-ca-bundle\") pod \"console-77df486df5-jrcj4\" (UID: \"41f245e1-dd14-44e1-b012-49a99616f2ba\") " pod="openshift-console/console-77df486df5-jrcj4"
Sep 17 14:09:25.944570 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.944319    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4qwl\" (UniqueName: \"kubernetes.io/projected/41f245e1-dd14-44e1-b012-49a99616f2ba-kube-api-access-r4qwl\") pod \"console-77df486df5-jrcj4\" (UID: \"41f245e1-dd14-44e1-b012-49a99616f2ba\") " pod="openshift-console/console-77df486df5-jrcj4"
Sep 17 14:09:25.944820 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.944774    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41f245e1-dd14-44e1-b012-49a99616f2ba-console-config\") pod \"console-77df486df5-jrcj4\" (UID: \"41f245e1-dd14-44e1-b012-49a99616f2ba\") " pod="openshift-console/console-77df486df5-jrcj4"
Sep 17 14:09:25.944943 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.944925    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41f245e1-dd14-44e1-b012-49a99616f2ba-service-ca\") pod \"console-77df486df5-jrcj4\" (UID: \"41f245e1-dd14-44e1-b012-49a99616f2ba\") " pod="openshift-console/console-77df486df5-jrcj4"
Sep 17 14:09:25.945006 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.944967    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41f245e1-dd14-44e1-b012-49a99616f2ba-oauth-serving-cert\") pod \"console-77df486df5-jrcj4\" (UID: \"41f245e1-dd14-44e1-b012-49a99616f2ba\") " pod="openshift-console/console-77df486df5-jrcj4"
Sep 17 14:09:25.945767 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.945745    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41f245e1-dd14-44e1-b012-49a99616f2ba-trusted-ca-bundle\") pod \"console-77df486df5-jrcj4\" (UID: \"41f245e1-dd14-44e1-b012-49a99616f2ba\") " pod="openshift-console/console-77df486df5-jrcj4"
Sep 17 14:09:25.947085 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.947061    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41f245e1-dd14-44e1-b012-49a99616f2ba-console-serving-cert\") pod \"console-77df486df5-jrcj4\" (UID: \"41f245e1-dd14-44e1-b012-49a99616f2ba\") " pod="openshift-console/console-77df486df5-jrcj4"
Sep 17 14:09:25.947403 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.947381    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41f245e1-dd14-44e1-b012-49a99616f2ba-console-oauth-config\") pod \"console-77df486df5-jrcj4\" (UID: \"41f245e1-dd14-44e1-b012-49a99616f2ba\") " pod="openshift-console/console-77df486df5-jrcj4"
Sep 17 14:09:25.955689 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:25.955658    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4qwl\" (UniqueName: \"kubernetes.io/projected/41f245e1-dd14-44e1-b012-49a99616f2ba-kube-api-access-r4qwl\") pod \"console-77df486df5-jrcj4\" (UID: \"41f245e1-dd14-44e1-b012-49a99616f2ba\") " pod="openshift-console/console-77df486df5-jrcj4"
Sep 17 14:09:26.134465 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:26.134068    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77df486df5-jrcj4"
Sep 17 14:09:26.423284 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:26.423255    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77df486df5-jrcj4"]
Sep 17 14:09:26.575434 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:09:26.575391    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41f245e1_dd14_44e1_b012_49a99616f2ba.slice/crio-adcd42b5e565b7f5dacd902efbef429956f9e0992541c3918c62ab505e6a4ad9 WatchSource:0}: Error finding container adcd42b5e565b7f5dacd902efbef429956f9e0992541c3918c62ab505e6a4ad9: Status 404 returned error can't find the container with id adcd42b5e565b7f5dacd902efbef429956f9e0992541c3918c62ab505e6a4ad9
Sep 17 14:09:26.725185 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:26.725148    2580 generic.go:356] "Generic (PLEG): container finished" podID="59d983dc-3c76-4025-9cf6-9085f232616c" containerID="00b148259b95b77ce599df90dc2944e8fbbc3d95791b74a79ec6ece82825339e" exitCode=0
Sep 17 14:09:26.725366 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:26.725250    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qf9s8" event={"ID":"59d983dc-3c76-4025-9cf6-9085f232616c","Type":"ContainerDied","Data":"00b148259b95b77ce599df90dc2944e8fbbc3d95791b74a79ec6ece82825339e"}
Sep 17 14:09:26.728187 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:26.727966    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-stfjc" event={"ID":"57e11ae8-25af-4625-8ce8-f36875e393a2","Type":"ContainerStarted","Data":"251481d4323f32add858e88d876e8a867241804c0bc2583da9895ae7df68789f"}
Sep 17 14:09:26.729675 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:26.729636    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77df486df5-jrcj4" event={"ID":"41f245e1-dd14-44e1-b012-49a99616f2ba","Type":"ContainerStarted","Data":"adcd42b5e565b7f5dacd902efbef429956f9e0992541c3918c62ab505e6a4ad9"}
Sep 17 14:09:26.774249 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:26.774197    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-stfjc" podStartSLOduration=2.515097854 podStartE2EDuration="3.77417131s" totalImagesPullingTime="1.259073456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:09:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:09:26.773307387 +0000 UTC m=+154.217382991" watchObservedRunningTime="2026-09-17 14:09:26.77417131 +0000 UTC m=+154.218246896"
Sep 17 14:09:27.738665 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:27.738114    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qf9s8" event={"ID":"59d983dc-3c76-4025-9cf6-9085f232616c","Type":"ContainerStarted","Data":"9bb9b48e72acf4f5a152363db084a8381c8b5134ff8ceb43e31085208a436307"}
Sep 17 14:09:27.738665 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:27.738191    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qf9s8" event={"ID":"59d983dc-3c76-4025-9cf6-9085f232616c","Type":"ContainerStarted","Data":"b390e63c35dd75a5207b9acb621a52365db8f02feffcc0fce07b0dbbc89ff994"}
Sep 17 14:09:28.531090 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.530848    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qf9s8" podStartSLOduration=4.425319606 podStartE2EDuration="5.530822182s" totalImagesPullingTime="1.027570304s" totalInitContainerRuntime="77.932272ms" isStatefulPod=true podCreationTimestamp="2026-09-17 14:09:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:09:27.787657292 +0000 UTC m=+155.231732878" watchObservedRunningTime="2026-09-17 14:09:28.530822182 +0000 UTC m=+155.974897761"
Sep 17 14:09:28.531378 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.531356    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5679c6454f-9fcdl"]
Sep 17 14:09:28.535013 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.534987    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5679c6454f-9fcdl"
Sep 17 14:09:28.543788 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.543754    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 17 14:09:28.544208 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.543754    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 17 14:09:28.544456 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.544388    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 17 14:09:28.545611 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.545388    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-j9qxc\""
Sep 17 14:09:28.545611 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.545468    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 17 14:09:28.545914 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.545895    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-a4fkbbqlu6frp\""
Sep 17 14:09:28.567706 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.567670    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/462533fc-c268-4330-82c1-abfa086fa76c-audit-log\") pod \"metrics-server-5679c6454f-9fcdl\" (UID: \"462533fc-c268-4330-82c1-abfa086fa76c\") " pod="openshift-monitoring/metrics-server-5679c6454f-9fcdl"
Sep 17 14:09:28.567962 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.567926    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/462533fc-c268-4330-82c1-abfa086fa76c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5679c6454f-9fcdl\" (UID: \"462533fc-c268-4330-82c1-abfa086fa76c\") " pod="openshift-monitoring/metrics-server-5679c6454f-9fcdl"
Sep 17 14:09:28.568092 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.567976    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/462533fc-c268-4330-82c1-abfa086fa76c-client-ca-bundle\") pod \"metrics-server-5679c6454f-9fcdl\" (UID: \"462533fc-c268-4330-82c1-abfa086fa76c\") " pod="openshift-monitoring/metrics-server-5679c6454f-9fcdl"
Sep 17 14:09:28.568092 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.568016    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p48m4\" (UniqueName: \"kubernetes.io/projected/462533fc-c268-4330-82c1-abfa086fa76c-kube-api-access-p48m4\") pod \"metrics-server-5679c6454f-9fcdl\" (UID: \"462533fc-c268-4330-82c1-abfa086fa76c\") " pod="openshift-monitoring/metrics-server-5679c6454f-9fcdl"
Sep 17 14:09:28.568228 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.568128    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/462533fc-c268-4330-82c1-abfa086fa76c-secret-metrics-server-tls\") pod \"metrics-server-5679c6454f-9fcdl\" (UID: \"462533fc-c268-4330-82c1-abfa086fa76c\") " pod="openshift-monitoring/metrics-server-5679c6454f-9fcdl"
Sep 17 14:09:28.568228 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.568177    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/462533fc-c268-4330-82c1-abfa086fa76c-secret-metrics-server-client-certs\") pod \"metrics-server-5679c6454f-9fcdl\" (UID: \"462533fc-c268-4330-82c1-abfa086fa76c\") " pod="openshift-monitoring/metrics-server-5679c6454f-9fcdl"
Sep 17 14:09:28.568228 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.568205    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/462533fc-c268-4330-82c1-abfa086fa76c-metrics-server-audit-profiles\") pod \"metrics-server-5679c6454f-9fcdl\" (UID: \"462533fc-c268-4330-82c1-abfa086fa76c\") " pod="openshift-monitoring/metrics-server-5679c6454f-9fcdl"
Sep 17 14:09:28.578428 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.578382    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5679c6454f-9fcdl"]
Sep 17 14:09:28.669361 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.669316    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/462533fc-c268-4330-82c1-abfa086fa76c-secret-metrics-server-client-certs\") pod \"metrics-server-5679c6454f-9fcdl\" (UID: \"462533fc-c268-4330-82c1-abfa086fa76c\") " pod="openshift-monitoring/metrics-server-5679c6454f-9fcdl"
Sep 17 14:09:28.669509 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.669370    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/462533fc-c268-4330-82c1-abfa086fa76c-metrics-server-audit-profiles\") pod \"metrics-server-5679c6454f-9fcdl\" (UID: \"462533fc-c268-4330-82c1-abfa086fa76c\") " pod="openshift-monitoring/metrics-server-5679c6454f-9fcdl"
Sep 17 14:09:28.669509 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.669403    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/462533fc-c268-4330-82c1-abfa086fa76c-audit-log\") pod \"metrics-server-5679c6454f-9fcdl\" (UID: \"462533fc-c268-4330-82c1-abfa086fa76c\") " pod="openshift-monitoring/metrics-server-5679c6454f-9fcdl"
Sep 17 14:09:28.669509 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.669437    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/462533fc-c268-4330-82c1-abfa086fa76c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5679c6454f-9fcdl\" (UID: \"462533fc-c268-4330-82c1-abfa086fa76c\") " pod="openshift-monitoring/metrics-server-5679c6454f-9fcdl"
Sep 17 14:09:28.669509 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.669486    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/462533fc-c268-4330-82c1-abfa086fa76c-client-ca-bundle\") pod \"metrics-server-5679c6454f-9fcdl\" (UID: \"462533fc-c268-4330-82c1-abfa086fa76c\") " pod="openshift-monitoring/metrics-server-5679c6454f-9fcdl"
Sep 17 14:09:28.669743 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.669531    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p48m4\" (UniqueName: \"kubernetes.io/projected/462533fc-c268-4330-82c1-abfa086fa76c-kube-api-access-p48m4\") pod \"metrics-server-5679c6454f-9fcdl\" (UID: \"462533fc-c268-4330-82c1-abfa086fa76c\") " pod="openshift-monitoring/metrics-server-5679c6454f-9fcdl"
Sep 17 14:09:28.669743 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.669585    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/462533fc-c268-4330-82c1-abfa086fa76c-secret-metrics-server-tls\") pod \"metrics-server-5679c6454f-9fcdl\" (UID: \"462533fc-c268-4330-82c1-abfa086fa76c\") " pod="openshift-monitoring/metrics-server-5679c6454f-9fcdl"
Sep 17 14:09:28.669963 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.669905    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/462533fc-c268-4330-82c1-abfa086fa76c-audit-log\") pod \"metrics-server-5679c6454f-9fcdl\" (UID: \"462533fc-c268-4330-82c1-abfa086fa76c\") " pod="openshift-monitoring/metrics-server-5679c6454f-9fcdl"
Sep 17 14:09:28.670441 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.670417    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/462533fc-c268-4330-82c1-abfa086fa76c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5679c6454f-9fcdl\" (UID: \"462533fc-c268-4330-82c1-abfa086fa76c\") " pod="openshift-monitoring/metrics-server-5679c6454f-9fcdl"
Sep 17 14:09:28.670997 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.670951    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/462533fc-c268-4330-82c1-abfa086fa76c-metrics-server-audit-profiles\") pod \"metrics-server-5679c6454f-9fcdl\" (UID: \"462533fc-c268-4330-82c1-abfa086fa76c\") " pod="openshift-monitoring/metrics-server-5679c6454f-9fcdl"
Sep 17 14:09:28.672619 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.672579    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/462533fc-c268-4330-82c1-abfa086fa76c-secret-metrics-server-client-certs\") pod \"metrics-server-5679c6454f-9fcdl\" (UID: \"462533fc-c268-4330-82c1-abfa086fa76c\") " pod="openshift-monitoring/metrics-server-5679c6454f-9fcdl"
Sep 17 14:09:28.672791 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.672769    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/462533fc-c268-4330-82c1-abfa086fa76c-client-ca-bundle\") pod \"metrics-server-5679c6454f-9fcdl\" (UID: \"462533fc-c268-4330-82c1-abfa086fa76c\") " pod="openshift-monitoring/metrics-server-5679c6454f-9fcdl"
Sep 17 14:09:28.673550 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.673530    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/462533fc-c268-4330-82c1-abfa086fa76c-secret-metrics-server-tls\") pod \"metrics-server-5679c6454f-9fcdl\" (UID: \"462533fc-c268-4330-82c1-abfa086fa76c\") " pod="openshift-monitoring/metrics-server-5679c6454f-9fcdl"
Sep 17 14:09:28.685113 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.685087    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p48m4\" (UniqueName: \"kubernetes.io/projected/462533fc-c268-4330-82c1-abfa086fa76c-kube-api-access-p48m4\") pod \"metrics-server-5679c6454f-9fcdl\" (UID: \"462533fc-c268-4330-82c1-abfa086fa76c\") " pod="openshift-monitoring/metrics-server-5679c6454f-9fcdl"
Sep 17 14:09:28.832897 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.832809    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-8jhkm"]
Sep 17 14:09:28.837696 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.837671    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8jhkm"
Sep 17 14:09:28.841394 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.841238    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-fdg8t\""
Sep 17 14:09:28.842177 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.842153    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 17 14:09:28.847674 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.847521    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5679c6454f-9fcdl"
Sep 17 14:09:28.849787 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.849764    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-8jhkm"]
Sep 17 14:09:28.872189 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.872163    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d39f4d8a-6fbc-4257-acfe-0f96d47cb369-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-8jhkm\" (UID: \"d39f4d8a-6fbc-4257-acfe-0f96d47cb369\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8jhkm"
Sep 17 14:09:28.872324 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.872231    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56tbj\" (UniqueName: \"kubernetes.io/projected/d39f4d8a-6fbc-4257-acfe-0f96d47cb369-kube-api-access-56tbj\") pod \"monitoring-plugin-5d85778b9d-8jhkm\" (UID: \"d39f4d8a-6fbc-4257-acfe-0f96d47cb369\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8jhkm"
Sep 17 14:09:28.972729 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.972682    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56tbj\" (UniqueName: \"kubernetes.io/projected/d39f4d8a-6fbc-4257-acfe-0f96d47cb369-kube-api-access-56tbj\") pod \"monitoring-plugin-5d85778b9d-8jhkm\" (UID: \"d39f4d8a-6fbc-4257-acfe-0f96d47cb369\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8jhkm"
Sep 17 14:09:28.972912 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.972803    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d39f4d8a-6fbc-4257-acfe-0f96d47cb369-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-8jhkm\" (UID: \"d39f4d8a-6fbc-4257-acfe-0f96d47cb369\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8jhkm"
Sep 17 14:09:28.977506 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.977476    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d39f4d8a-6fbc-4257-acfe-0f96d47cb369-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-8jhkm\" (UID: \"d39f4d8a-6fbc-4257-acfe-0f96d47cb369\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8jhkm"
Sep 17 14:09:28.984689 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:28.984662    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56tbj\" (UniqueName: \"kubernetes.io/projected/d39f4d8a-6fbc-4257-acfe-0f96d47cb369-kube-api-access-56tbj\") pod \"monitoring-plugin-5d85778b9d-8jhkm\" (UID: \"d39f4d8a-6fbc-4257-acfe-0f96d47cb369\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8jhkm"
Sep 17 14:09:29.149116 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:29.149022    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8jhkm"
Sep 17 14:09:30.391122 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:09:30.389966    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6nv9q" podUID="b69e72f2-4449-4197-ac80-a0284247ac28"
Sep 17 14:09:30.753528 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:30.753494    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6nv9q"
Sep 17 14:09:35.231447 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:35.231398    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b69e72f2-4449-4197-ac80-a0284247ac28-metrics-tls\") pod \"dns-default-6nv9q\" (UID: \"b69e72f2-4449-4197-ac80-a0284247ac28\") " pod="openshift-dns/dns-default-6nv9q"
Sep 17 14:09:35.235454 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:35.235421    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b69e72f2-4449-4197-ac80-a0284247ac28-metrics-tls\") pod \"dns-default-6nv9q\" (UID: \"b69e72f2-4449-4197-ac80-a0284247ac28\") " pod="openshift-dns/dns-default-6nv9q"
Sep 17 14:09:35.258103 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:35.258071    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jdh9k\""
Sep 17 14:09:35.265220 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:35.265185    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6nv9q"
Sep 17 14:09:35.684484 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:35.684400    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:09:36.738645 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:36.738617    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-8jhkm"]
Sep 17 14:09:36.740397 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:36.740355    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6nv9q"]
Sep 17 14:09:36.740929 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:09:36.740893    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd39f4d8a_6fbc_4257_acfe_0f96d47cb369.slice/crio-4826b6d5baf0788fc1877dd4a3051bf2703b992769727f75ae9583b3107e31bb WatchSource:0}: Error finding container 4826b6d5baf0788fc1877dd4a3051bf2703b992769727f75ae9583b3107e31bb: Status 404 returned error can't find the container with id 4826b6d5baf0788fc1877dd4a3051bf2703b992769727f75ae9583b3107e31bb
Sep 17 14:09:36.741588 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:09:36.741562    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod462533fc_c268_4330_82c1_abfa086fa76c.slice/crio-dd4813a7059276da6e765aed01d42d755907e64db0e6bfa445baaefa6f1cc3e9 WatchSource:0}: Error finding container dd4813a7059276da6e765aed01d42d755907e64db0e6bfa445baaefa6f1cc3e9: Status 404 returned error can't find the container with id dd4813a7059276da6e765aed01d42d755907e64db0e6bfa445baaefa6f1cc3e9
Sep 17 14:09:36.742368 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:09:36.742330    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb69e72f2_4449_4197_ac80_a0284247ac28.slice/crio-9929e2a88de6765fe2f74eb020b05113c69d8d5ade7c7828670f955761af1706 WatchSource:0}: Error finding container 9929e2a88de6765fe2f74eb020b05113c69d8d5ade7c7828670f955761af1706: Status 404 returned error can't find the container with id 9929e2a88de6765fe2f74eb020b05113c69d8d5ade7c7828670f955761af1706
Sep 17 14:09:36.742738 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:36.742669    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5679c6454f-9fcdl"]
Sep 17 14:09:36.780141 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:36.780093    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-qq8f6" event={"ID":"f32a3a50-14cd-4c4d-9c76-0b5513397f7a","Type":"ContainerStarted","Data":"6b510b1506c313ce952affadb0243c0e22c3942d86cd3103b038efea6e20381b"}
Sep 17 14:09:36.780328 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:36.780301    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-qq8f6"
Sep 17 14:09:36.782500 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:36.782475    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77df486df5-jrcj4" event={"ID":"41f245e1-dd14-44e1-b012-49a99616f2ba","Type":"ContainerStarted","Data":"0ab69fb7784784eec47de1c80bfa8bb514fa842ab34f0941525853737f0b8f90"}
Sep 17 14:09:36.783869 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:36.783846    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8jhkm" event={"ID":"d39f4d8a-6fbc-4257-acfe-0f96d47cb369","Type":"ContainerStarted","Data":"4826b6d5baf0788fc1877dd4a3051bf2703b992769727f75ae9583b3107e31bb"}
Sep 17 14:09:36.785316 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:36.785292    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5679c6454f-9fcdl" event={"ID":"462533fc-c268-4330-82c1-abfa086fa76c","Type":"ContainerStarted","Data":"dd4813a7059276da6e765aed01d42d755907e64db0e6bfa445baaefa6f1cc3e9"}
Sep 17 14:09:36.786678 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:36.786653    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6nv9q" event={"ID":"b69e72f2-4449-4197-ac80-a0284247ac28","Type":"ContainerStarted","Data":"9929e2a88de6765fe2f74eb020b05113c69d8d5ade7c7828670f955761af1706"}
Sep 17 14:09:36.795486 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:36.795462    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-qq8f6"
Sep 17 14:09:36.806537 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:36.806468    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-qq8f6" podStartSLOduration=1.63802659 podStartE2EDuration="21.806450249s" totalImagesPullingTime="20.168423659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:09:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:09:36.805313451 +0000 UTC m=+164.249389038" watchObservedRunningTime="2026-09-17 14:09:36.806450249 +0000 UTC m=+164.250525837"
Sep 17 14:09:36.864194 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:36.864127    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77df486df5-jrcj4" podStartSLOduration=1.997550458 podStartE2EDuration="11.864103178s" totalImagesPullingTime="9.86655272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:09:36.86186331 +0000 UTC m=+164.305938898" watchObservedRunningTime="2026-09-17 14:09:36.864103178 +0000 UTC m=+164.308178764"
Sep 17 14:09:40.699586 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:40.699473    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-679df86f77-4lwpc" podUID="dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4" containerName="registry" containerID="cri-o://f2dc1e3d164eb143f68811657a53b76630b039e0c2f9c5572f702765fe3e054d" gracePeriod=30
Sep 17 14:09:40.808108 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:40.807584    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8jhkm" event={"ID":"d39f4d8a-6fbc-4257-acfe-0f96d47cb369","Type":"ContainerStarted","Data":"a4ab8d2fa629d5c8181620efcf98e1803594d77dbcb5b4104a50750a135c5513"}
Sep 17 14:09:40.808108 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:40.807992    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8jhkm"
Sep 17 14:09:40.810432 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:40.809886    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5679c6454f-9fcdl" event={"ID":"462533fc-c268-4330-82c1-abfa086fa76c","Type":"ContainerStarted","Data":"ef257eb90b465f487a7055491a257613194f64d847fe6ff4ec0264871499b838"}
Sep 17 14:09:40.812144 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:40.812114    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6nv9q" event={"ID":"b69e72f2-4449-4197-ac80-a0284247ac28","Type":"ContainerStarted","Data":"fb63788d69d69079a23fd00952b78f2a53df175771b3bf31510fb04a6952390c"}
Sep 17 14:09:40.814388 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:40.814367    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8jhkm"
Sep 17 14:09:40.832203 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:40.832150    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-8jhkm" podStartSLOduration=9.169505727 podStartE2EDuration="12.832133766s" totalImagesPullingTime="3.662628039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:09:40.829077207 +0000 UTC m=+168.273152818" watchObservedRunningTime="2026-09-17 14:09:40.832133766 +0000 UTC m=+168.276209350"
Sep 17 14:09:40.850777 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:40.849420    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5679c6454f-9fcdl" podStartSLOduration=9.184272657 podStartE2EDuration="12.84939826s" totalImagesPullingTime="3.665125603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:09:40.848016329 +0000 UTC m=+168.292091919" watchObservedRunningTime="2026-09-17 14:09:40.84939826 +0000 UTC m=+168.293473847"
Sep 17 14:09:41.007841 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.007800    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:09:41.085879 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.085841    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-trusted-ca\") pod \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") "
Sep 17 14:09:41.086056 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.085895    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-registry-tls\") pod \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") "
Sep 17 14:09:41.086056 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.085945    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-installation-pull-secrets\") pod \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") "
Sep 17 14:09:41.086056 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.085986    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-bound-sa-token\") pod \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") "
Sep 17 14:09:41.086304 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.086269    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4" (UID: "dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:09:41.086436 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.086341    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-image-registry-private-configuration\") pod \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") "
Sep 17 14:09:41.086436 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.086390    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-ca-trust-extracted\") pod \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") "
Sep 17 14:09:41.086542 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.086461    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vv8hd\" (UniqueName: \"kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-kube-api-access-vv8hd\") pod \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") "
Sep 17 14:09:41.086542 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.086502    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-registry-certificates\") pod \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\" (UID: \"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4\") "
Sep 17 14:09:41.087197 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.086748    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-trusted-ca\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:09:41.087197 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.087054    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4" (UID: "dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:09:41.088857 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.088787    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4" (UID: "dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:09:41.089381 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.089353    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4" (UID: "dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:09:41.089578 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.089551    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4" (UID: "dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:09:41.092189 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.092156    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4" (UID: "dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:09:41.099891 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.099853    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4" (UID: "dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:09:41.100772 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.100745    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-kube-api-access-vv8hd" (OuterVolumeSpecName: "kube-api-access-vv8hd") pod "dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4" (UID: "dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4"). InnerVolumeSpecName "kube-api-access-vv8hd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:09:41.187365 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.187339    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vv8hd\" (UniqueName: \"kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-kube-api-access-vv8hd\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:09:41.187365 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.187365    2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-registry-certificates\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:09:41.187515 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.187375    2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-registry-tls\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:09:41.187515 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.187383    2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-installation-pull-secrets\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:09:41.187515 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.187393    2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-bound-sa-token\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:09:41.187515 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.187408    2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-image-registry-private-configuration\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:09:41.187515 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.187421    2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4-ca-trust-extracted\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:09:41.818856 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.818773    2580 generic.go:356] "Generic (PLEG): container finished" podID="dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4" containerID="f2dc1e3d164eb143f68811657a53b76630b039e0c2f9c5572f702765fe3e054d" exitCode=0
Sep 17 14:09:41.819302 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.818852    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-679df86f77-4lwpc"
Sep 17 14:09:41.819302 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.818878    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-679df86f77-4lwpc" event={"ID":"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4","Type":"ContainerDied","Data":"f2dc1e3d164eb143f68811657a53b76630b039e0c2f9c5572f702765fe3e054d"}
Sep 17 14:09:41.819302 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.818935    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-679df86f77-4lwpc" event={"ID":"dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4","Type":"ContainerDied","Data":"4dd996931924c36839bb390dc47f44428d81df2ab320a89e4c200236e51d3879"}
Sep 17 14:09:41.819302 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.818964    2580 scope.go:117] "RemoveContainer" containerID="f2dc1e3d164eb143f68811657a53b76630b039e0c2f9c5572f702765fe3e054d"
Sep 17 14:09:41.822137 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.822105    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6nv9q" event={"ID":"b69e72f2-4449-4197-ac80-a0284247ac28","Type":"ContainerStarted","Data":"870106345b92d4d2b2b726218ea602e88d953d1fd9ea23f7a6d30c798a4bdb7d"}
Sep 17 14:09:41.822800 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.822310    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6nv9q"
Sep 17 14:09:41.828806 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.828787    2580 scope.go:117] "RemoveContainer" containerID="f2dc1e3d164eb143f68811657a53b76630b039e0c2f9c5572f702765fe3e054d"
Sep 17 14:09:41.829136 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:09:41.829114    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2dc1e3d164eb143f68811657a53b76630b039e0c2f9c5572f702765fe3e054d\": container with ID starting with f2dc1e3d164eb143f68811657a53b76630b039e0c2f9c5572f702765fe3e054d not found: ID does not exist" containerID="f2dc1e3d164eb143f68811657a53b76630b039e0c2f9c5572f702765fe3e054d"
Sep 17 14:09:41.829230 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.829143    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2dc1e3d164eb143f68811657a53b76630b039e0c2f9c5572f702765fe3e054d"} err="failed to get container status \"f2dc1e3d164eb143f68811657a53b76630b039e0c2f9c5572f702765fe3e054d\": rpc error: code = NotFound desc = could not find container \"f2dc1e3d164eb143f68811657a53b76630b039e0c2f9c5572f702765fe3e054d\": container with ID starting with f2dc1e3d164eb143f68811657a53b76630b039e0c2f9c5572f702765fe3e054d not found: ID does not exist"
Sep 17 14:09:41.838743 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.838721    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-679df86f77-4lwpc"]
Sep 17 14:09:41.841123 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.841100    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-679df86f77-4lwpc"]
Sep 17 14:09:41.857681 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:41.857626    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6nv9q" podStartSLOduration=131.196040162 podStartE2EDuration="2m14.857610483s" totalImagesPullingTime="3.661570321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:07:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:09:41.856701481 +0000 UTC m=+169.300777097" watchObservedRunningTime="2026-09-17 14:09:41.857610483 +0000 UTC m=+169.301686070"
Sep 17 14:09:43.177347 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:43.177314    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4" path="/var/lib/kubelet/pods/dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4/volumes"
Sep 17 14:09:44.297539 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:44.297484    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77df486df5-jrcj4"]
Sep 17 14:09:46.134588 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:46.134504    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77df486df5-jrcj4"
Sep 17 14:09:48.848176 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:48.848139    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5679c6454f-9fcdl"
Sep 17 14:09:48.848609 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:48.848215    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5679c6454f-9fcdl"
Sep 17 14:09:51.828763 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:09:51.828727    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6nv9q"
Sep 17 14:10:07.933662 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:07.933626    2580 generic.go:356] "Generic (PLEG): container finished" podID="f4a99568-1175-40ac-ad56-24b4b507884c" containerID="19d1409bd61023b5d1f0955439bc7aac49ab38703c6f3630a20194ebab2d49a2" exitCode=0
Sep 17 14:10:07.934063 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:07.933689    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vdxdz" event={"ID":"f4a99568-1175-40ac-ad56-24b4b507884c","Type":"ContainerDied","Data":"19d1409bd61023b5d1f0955439bc7aac49ab38703c6f3630a20194ebab2d49a2"}
Sep 17 14:10:07.934063 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:07.934022    2580 scope.go:117] "RemoveContainer" containerID="19d1409bd61023b5d1f0955439bc7aac49ab38703c6f3630a20194ebab2d49a2"
Sep 17 14:10:08.853607 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:08.853579    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5679c6454f-9fcdl"
Sep 17 14:10:08.857279 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:08.857258    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5679c6454f-9fcdl"
Sep 17 14:10:08.940639 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:08.940606    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vdxdz" event={"ID":"f4a99568-1175-40ac-ad56-24b4b507884c","Type":"ContainerStarted","Data":"25f8bead1416fab52d344ddceb842114c87f0f51514be0bedfde9234bff407f8"}
Sep 17 14:10:09.321353 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.321311    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-77df486df5-jrcj4" podUID="41f245e1-dd14-44e1-b012-49a99616f2ba" containerName="console" containerID="cri-o://0ab69fb7784784eec47de1c80bfa8bb514fa842ab34f0941525853737f0b8f90" gracePeriod=15
Sep 17 14:10:09.604692 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.604536    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77df486df5-jrcj4"
Sep 17 14:10:09.616390 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.616363    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41f245e1-dd14-44e1-b012-49a99616f2ba-console-oauth-config\") pod \"41f245e1-dd14-44e1-b012-49a99616f2ba\" (UID: \"41f245e1-dd14-44e1-b012-49a99616f2ba\") "
Sep 17 14:10:09.616541 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.616409    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41f245e1-dd14-44e1-b012-49a99616f2ba-trusted-ca-bundle\") pod \"41f245e1-dd14-44e1-b012-49a99616f2ba\" (UID: \"41f245e1-dd14-44e1-b012-49a99616f2ba\") "
Sep 17 14:10:09.616541 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.616442    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41f245e1-dd14-44e1-b012-49a99616f2ba-oauth-serving-cert\") pod \"41f245e1-dd14-44e1-b012-49a99616f2ba\" (UID: \"41f245e1-dd14-44e1-b012-49a99616f2ba\") "
Sep 17 14:10:09.616541 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.616481    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41f245e1-dd14-44e1-b012-49a99616f2ba-service-ca\") pod \"41f245e1-dd14-44e1-b012-49a99616f2ba\" (UID: \"41f245e1-dd14-44e1-b012-49a99616f2ba\") "
Sep 17 14:10:09.616541 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.616504    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41f245e1-dd14-44e1-b012-49a99616f2ba-console-config\") pod \"41f245e1-dd14-44e1-b012-49a99616f2ba\" (UID: \"41f245e1-dd14-44e1-b012-49a99616f2ba\") "
Sep 17 14:10:09.616541 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.616534    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4qwl\" (UniqueName: \"kubernetes.io/projected/41f245e1-dd14-44e1-b012-49a99616f2ba-kube-api-access-r4qwl\") pod \"41f245e1-dd14-44e1-b012-49a99616f2ba\" (UID: \"41f245e1-dd14-44e1-b012-49a99616f2ba\") "
Sep 17 14:10:09.616800 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.616574    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41f245e1-dd14-44e1-b012-49a99616f2ba-console-serving-cert\") pod \"41f245e1-dd14-44e1-b012-49a99616f2ba\" (UID: \"41f245e1-dd14-44e1-b012-49a99616f2ba\") "
Sep 17 14:10:09.616863 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.616802    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41f245e1-dd14-44e1-b012-49a99616f2ba-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "41f245e1-dd14-44e1-b012-49a99616f2ba" (UID: "41f245e1-dd14-44e1-b012-49a99616f2ba"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:10:09.616917 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.616872    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41f245e1-dd14-44e1-b012-49a99616f2ba-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "41f245e1-dd14-44e1-b012-49a99616f2ba" (UID: "41f245e1-dd14-44e1-b012-49a99616f2ba"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:10:09.616972 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.616896    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41f245e1-dd14-44e1-b012-49a99616f2ba-service-ca" (OuterVolumeSpecName: "service-ca") pod "41f245e1-dd14-44e1-b012-49a99616f2ba" (UID: "41f245e1-dd14-44e1-b012-49a99616f2ba"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:10:09.616972 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.616938    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41f245e1-dd14-44e1-b012-49a99616f2ba-console-config" (OuterVolumeSpecName: "console-config") pod "41f245e1-dd14-44e1-b012-49a99616f2ba" (UID: "41f245e1-dd14-44e1-b012-49a99616f2ba"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:10:09.618599 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.618574    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41f245e1-dd14-44e1-b012-49a99616f2ba-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "41f245e1-dd14-44e1-b012-49a99616f2ba" (UID: "41f245e1-dd14-44e1-b012-49a99616f2ba"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:10:09.618707 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.618632    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41f245e1-dd14-44e1-b012-49a99616f2ba-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "41f245e1-dd14-44e1-b012-49a99616f2ba" (UID: "41f245e1-dd14-44e1-b012-49a99616f2ba"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:10:09.618707 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.618674    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41f245e1-dd14-44e1-b012-49a99616f2ba-kube-api-access-r4qwl" (OuterVolumeSpecName: "kube-api-access-r4qwl") pod "41f245e1-dd14-44e1-b012-49a99616f2ba" (UID: "41f245e1-dd14-44e1-b012-49a99616f2ba"). InnerVolumeSpecName "kube-api-access-r4qwl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:10:09.717632 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.717591    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41f245e1-dd14-44e1-b012-49a99616f2ba-service-ca\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:10:09.717632 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.717634    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41f245e1-dd14-44e1-b012-49a99616f2ba-console-config\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:10:09.717890 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.717648    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4qwl\" (UniqueName: \"kubernetes.io/projected/41f245e1-dd14-44e1-b012-49a99616f2ba-kube-api-access-r4qwl\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:10:09.717890 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.717680    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41f245e1-dd14-44e1-b012-49a99616f2ba-console-serving-cert\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:10:09.717890 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.717697    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41f245e1-dd14-44e1-b012-49a99616f2ba-console-oauth-config\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:10:09.717890 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.717725    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41f245e1-dd14-44e1-b012-49a99616f2ba-trusted-ca-bundle\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:10:09.717890 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.717742    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41f245e1-dd14-44e1-b012-49a99616f2ba-oauth-serving-cert\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:10:09.949599 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.949562    2580 generic.go:356] "Generic (PLEG): container finished" podID="41f245e1-dd14-44e1-b012-49a99616f2ba" containerID="0ab69fb7784784eec47de1c80bfa8bb514fa842ab34f0941525853737f0b8f90" exitCode=0
Sep 17 14:10:09.950018 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.949622    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77df486df5-jrcj4"
Sep 17 14:10:09.950018 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.949648    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77df486df5-jrcj4" event={"ID":"41f245e1-dd14-44e1-b012-49a99616f2ba","Type":"ContainerDied","Data":"0ab69fb7784784eec47de1c80bfa8bb514fa842ab34f0941525853737f0b8f90"}
Sep 17 14:10:09.950018 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.949736    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77df486df5-jrcj4" event={"ID":"41f245e1-dd14-44e1-b012-49a99616f2ba","Type":"ContainerDied","Data":"adcd42b5e565b7f5dacd902efbef429956f9e0992541c3918c62ab505e6a4ad9"}
Sep 17 14:10:09.950018 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.949761    2580 scope.go:117] "RemoveContainer" containerID="0ab69fb7784784eec47de1c80bfa8bb514fa842ab34f0941525853737f0b8f90"
Sep 17 14:10:09.958133 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.958117    2580 scope.go:117] "RemoveContainer" containerID="0ab69fb7784784eec47de1c80bfa8bb514fa842ab34f0941525853737f0b8f90"
Sep 17 14:10:09.958397 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:10:09.958378    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ab69fb7784784eec47de1c80bfa8bb514fa842ab34f0941525853737f0b8f90\": container with ID starting with 0ab69fb7784784eec47de1c80bfa8bb514fa842ab34f0941525853737f0b8f90 not found: ID does not exist" containerID="0ab69fb7784784eec47de1c80bfa8bb514fa842ab34f0941525853737f0b8f90"
Sep 17 14:10:09.958465 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.958407    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ab69fb7784784eec47de1c80bfa8bb514fa842ab34f0941525853737f0b8f90"} err="failed to get container status \"0ab69fb7784784eec47de1c80bfa8bb514fa842ab34f0941525853737f0b8f90\": rpc error: code = NotFound desc = could not find container \"0ab69fb7784784eec47de1c80bfa8bb514fa842ab34f0941525853737f0b8f90\": container with ID starting with 0ab69fb7784784eec47de1c80bfa8bb514fa842ab34f0941525853737f0b8f90 not found: ID does not exist"
Sep 17 14:10:09.971217 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.971196    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77df486df5-jrcj4"]
Sep 17 14:10:09.978102 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:09.978083    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77df486df5-jrcj4"]
Sep 17 14:10:11.175549 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:11.175515    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41f245e1-dd14-44e1-b012-49a99616f2ba" path="/var/lib/kubelet/pods/41f245e1-dd14-44e1-b012-49a99616f2ba/volumes"
Sep 17 14:10:46.592921 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.592876    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 14:10:46.593397 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.593157    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41f245e1-dd14-44e1-b012-49a99616f2ba" containerName="console"
Sep 17 14:10:46.593397 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.593168    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="41f245e1-dd14-44e1-b012-49a99616f2ba" containerName="console"
Sep 17 14:10:46.593397 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.593182    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4" containerName="registry"
Sep 17 14:10:46.593397 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.593188    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4" containerName="registry"
Sep 17 14:10:46.593397 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.593236    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc7a2273-eab1-4cae-b6d4-31c2a2db8ac4" containerName="registry"
Sep 17 14:10:46.593397 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.593245    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="41f245e1-dd14-44e1-b012-49a99616f2ba" containerName="console"
Sep 17 14:10:46.596042 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.596023    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.598953 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.598922    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 17 14:10:46.599077 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.598925    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-lc9pn\""
Sep 17 14:10:46.599077 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.598925    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 17 14:10:46.599207 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.599142    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 17 14:10:46.599207 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.599176    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 17 14:10:46.599307 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.599272    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 17 14:10:46.599358 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.599328    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 17 14:10:46.599410 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.599330    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 17 14:10:46.599410 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.599367    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 17 14:10:46.605089 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.605071    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 17 14:10:46.611053 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.611032    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 14:10:46.677923 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.677867    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f2863cb0-e9fa-4b1d-b49d-397470b79385-web-config\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.678070 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.677934    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f2863cb0-e9fa-4b1d-b49d-397470b79385-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.678070 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.677969    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f2863cb0-e9fa-4b1d-b49d-397470b79385-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.678070 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.678010    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f2863cb0-e9fa-4b1d-b49d-397470b79385-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.678070 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.678037    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f2863cb0-e9fa-4b1d-b49d-397470b79385-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.678234 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.678080    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2863cb0-e9fa-4b1d-b49d-397470b79385-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.678234 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.678096    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25bwg\" (UniqueName: \"kubernetes.io/projected/f2863cb0-e9fa-4b1d-b49d-397470b79385-kube-api-access-25bwg\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.678234 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.678121    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f2863cb0-e9fa-4b1d-b49d-397470b79385-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.678234 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.678191    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f2863cb0-e9fa-4b1d-b49d-397470b79385-config-volume\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.678360 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.678234    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f2863cb0-e9fa-4b1d-b49d-397470b79385-config-out\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.678360 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.678254    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f2863cb0-e9fa-4b1d-b49d-397470b79385-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.678360 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.678273    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f2863cb0-e9fa-4b1d-b49d-397470b79385-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.678360 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.678288    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2863cb0-e9fa-4b1d-b49d-397470b79385-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.779319 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.779286    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f2863cb0-e9fa-4b1d-b49d-397470b79385-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.779486 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.779325    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f2863cb0-e9fa-4b1d-b49d-397470b79385-config-volume\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.779486 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.779344    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f2863cb0-e9fa-4b1d-b49d-397470b79385-config-out\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.779486 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.779362    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f2863cb0-e9fa-4b1d-b49d-397470b79385-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.779486 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.779382    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f2863cb0-e9fa-4b1d-b49d-397470b79385-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.779486 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.779405    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2863cb0-e9fa-4b1d-b49d-397470b79385-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.779486 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.779434    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f2863cb0-e9fa-4b1d-b49d-397470b79385-web-config\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.779486 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.779460    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f2863cb0-e9fa-4b1d-b49d-397470b79385-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.779486 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.779488    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f2863cb0-e9fa-4b1d-b49d-397470b79385-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.779986 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.779542    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f2863cb0-e9fa-4b1d-b49d-397470b79385-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.779986 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.779569    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f2863cb0-e9fa-4b1d-b49d-397470b79385-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.779986 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.779610    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2863cb0-e9fa-4b1d-b49d-397470b79385-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.779986 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.779633    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25bwg\" (UniqueName: \"kubernetes.io/projected/f2863cb0-e9fa-4b1d-b49d-397470b79385-kube-api-access-25bwg\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.781682 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.780888    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2863cb0-e9fa-4b1d-b49d-397470b79385-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.782488 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.782458    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f2863cb0-e9fa-4b1d-b49d-397470b79385-web-config\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.782589 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.782490    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f2863cb0-e9fa-4b1d-b49d-397470b79385-config-out\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.782589 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.782541    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f2863cb0-e9fa-4b1d-b49d-397470b79385-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.782961 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.782934    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f2863cb0-e9fa-4b1d-b49d-397470b79385-config-volume\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.783212 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.783159    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f2863cb0-e9fa-4b1d-b49d-397470b79385-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.783351 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.783332    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f2863cb0-e9fa-4b1d-b49d-397470b79385-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.783489 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.783463    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f2863cb0-e9fa-4b1d-b49d-397470b79385-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.783558 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.783493    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f2863cb0-e9fa-4b1d-b49d-397470b79385-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.783764 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.783745    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2863cb0-e9fa-4b1d-b49d-397470b79385-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.784074 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.784055    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f2863cb0-e9fa-4b1d-b49d-397470b79385-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.784504 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.784490    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f2863cb0-e9fa-4b1d-b49d-397470b79385-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.788313 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.788296    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25bwg\" (UniqueName: \"kubernetes.io/projected/f2863cb0-e9fa-4b1d-b49d-397470b79385-kube-api-access-25bwg\") pod \"alertmanager-main-0\" (UID: \"f2863cb0-e9fa-4b1d-b49d-397470b79385\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:46.906553 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:46.906470    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 14:10:47.240117 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:47.240092    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 14:10:47.241788 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:10:47.241761    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2863cb0_e9fa_4b1d_b49d_397470b79385.slice/crio-f8f5e7d440f852ffa585ffe21ff4cd873d3abeb14c1d4e0cde17ea85e0f107be WatchSource:0}: Error finding container f8f5e7d440f852ffa585ffe21ff4cd873d3abeb14c1d4e0cde17ea85e0f107be: Status 404 returned error can't find the container with id f8f5e7d440f852ffa585ffe21ff4cd873d3abeb14c1d4e0cde17ea85e0f107be
Sep 17 14:10:48.092916 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.092882    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2863cb0-e9fa-4b1d-b49d-397470b79385","Type":"ContainerStarted","Data":"f8f5e7d440f852ffa585ffe21ff4cd873d3abeb14c1d4e0cde17ea85e0f107be"}
Sep 17 14:10:48.423123 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.423034    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-68946bfd7f-467rt"]
Sep 17 14:10:48.425762 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.425736    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-68946bfd7f-467rt"
Sep 17 14:10:48.430958 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.430933    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 17 14:10:48.431230 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.431177    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 17 14:10:48.431531 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.431515    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 17 14:10:48.431744 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.431722    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 17 14:10:48.431924 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.431906    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 17 14:10:48.432269 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.432250    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-tszpt\""
Sep 17 14:10:48.444368 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.442011    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 17 14:10:48.454951 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.454924    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-68946bfd7f-467rt"]
Sep 17 14:10:48.495129 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.495086    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3-serving-certs-ca-bundle\") pod \"telemeter-client-68946bfd7f-467rt\" (UID: \"7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3\") " pod="openshift-monitoring/telemeter-client-68946bfd7f-467rt"
Sep 17 14:10:48.495310 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.495242    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3-telemeter-client-tls\") pod \"telemeter-client-68946bfd7f-467rt\" (UID: \"7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3\") " pod="openshift-monitoring/telemeter-client-68946bfd7f-467rt"
Sep 17 14:10:48.495310 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.495277    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zslnr\" (UniqueName: \"kubernetes.io/projected/7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3-kube-api-access-zslnr\") pod \"telemeter-client-68946bfd7f-467rt\" (UID: \"7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3\") " pod="openshift-monitoring/telemeter-client-68946bfd7f-467rt"
Sep 17 14:10:48.495431 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.495316    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68946bfd7f-467rt\" (UID: \"7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3\") " pod="openshift-monitoring/telemeter-client-68946bfd7f-467rt"
Sep 17 14:10:48.495431 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.495369    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3-federate-client-tls\") pod \"telemeter-client-68946bfd7f-467rt\" (UID: \"7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3\") " pod="openshift-monitoring/telemeter-client-68946bfd7f-467rt"
Sep 17 14:10:48.495431 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.495396    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3-metrics-client-ca\") pod \"telemeter-client-68946bfd7f-467rt\" (UID: \"7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3\") " pod="openshift-monitoring/telemeter-client-68946bfd7f-467rt"
Sep 17 14:10:48.495581 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.495427    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68946bfd7f-467rt\" (UID: \"7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3\") " pod="openshift-monitoring/telemeter-client-68946bfd7f-467rt"
Sep 17 14:10:48.497352 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.497270    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3-secret-telemeter-client\") pod \"telemeter-client-68946bfd7f-467rt\" (UID: \"7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3\") " pod="openshift-monitoring/telemeter-client-68946bfd7f-467rt"
Sep 17 14:10:48.597862 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.597827    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3-serving-certs-ca-bundle\") pod \"telemeter-client-68946bfd7f-467rt\" (UID: \"7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3\") " pod="openshift-monitoring/telemeter-client-68946bfd7f-467rt"
Sep 17 14:10:48.597862 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.597868    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3-telemeter-client-tls\") pod \"telemeter-client-68946bfd7f-467rt\" (UID: \"7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3\") " pod="openshift-monitoring/telemeter-client-68946bfd7f-467rt"
Sep 17 14:10:48.598095 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.597890    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zslnr\" (UniqueName: \"kubernetes.io/projected/7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3-kube-api-access-zslnr\") pod \"telemeter-client-68946bfd7f-467rt\" (UID: \"7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3\") " pod="openshift-monitoring/telemeter-client-68946bfd7f-467rt"
Sep 17 14:10:48.598095 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.597927    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68946bfd7f-467rt\" (UID: \"7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3\") " pod="openshift-monitoring/telemeter-client-68946bfd7f-467rt"
Sep 17 14:10:48.598095 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.597974    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3-federate-client-tls\") pod \"telemeter-client-68946bfd7f-467rt\" (UID: \"7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3\") " pod="openshift-monitoring/telemeter-client-68946bfd7f-467rt"
Sep 17 14:10:48.598095 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.597998    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3-metrics-client-ca\") pod \"telemeter-client-68946bfd7f-467rt\" (UID: \"7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3\") " pod="openshift-monitoring/telemeter-client-68946bfd7f-467rt"
Sep 17 14:10:48.598095 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.598027    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68946bfd7f-467rt\" (UID: \"7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3\") " pod="openshift-monitoring/telemeter-client-68946bfd7f-467rt"
Sep 17 14:10:48.598095 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.598054    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3-secret-telemeter-client\") pod \"telemeter-client-68946bfd7f-467rt\" (UID: \"7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3\") " pod="openshift-monitoring/telemeter-client-68946bfd7f-467rt"
Sep 17 14:10:48.598999 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.598606    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3-serving-certs-ca-bundle\") pod \"telemeter-client-68946bfd7f-467rt\" (UID: \"7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3\") " pod="openshift-monitoring/telemeter-client-68946bfd7f-467rt"
Sep 17 14:10:48.598999 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.598950    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3-metrics-client-ca\") pod \"telemeter-client-68946bfd7f-467rt\" (UID: \"7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3\") " pod="openshift-monitoring/telemeter-client-68946bfd7f-467rt"
Sep 17 14:10:48.599228 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.599183    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-68946bfd7f-467rt\" (UID: \"7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3\") " pod="openshift-monitoring/telemeter-client-68946bfd7f-467rt"
Sep 17 14:10:48.601121 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.601055    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-68946bfd7f-467rt\" (UID: \"7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3\") " pod="openshift-monitoring/telemeter-client-68946bfd7f-467rt"
Sep 17 14:10:48.601121 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.601060    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3-secret-telemeter-client\") pod \"telemeter-client-68946bfd7f-467rt\" (UID: \"7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3\") " pod="openshift-monitoring/telemeter-client-68946bfd7f-467rt"
Sep 17 14:10:48.602889 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.602864    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3-federate-client-tls\") pod \"telemeter-client-68946bfd7f-467rt\" (UID: \"7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3\") " pod="openshift-monitoring/telemeter-client-68946bfd7f-467rt"
Sep 17 14:10:48.603292 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.603264    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3-telemeter-client-tls\") pod \"telemeter-client-68946bfd7f-467rt\" (UID: \"7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3\") " pod="openshift-monitoring/telemeter-client-68946bfd7f-467rt"
Sep 17 14:10:48.606811 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.606792    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zslnr\" (UniqueName: \"kubernetes.io/projected/7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3-kube-api-access-zslnr\") pod \"telemeter-client-68946bfd7f-467rt\" (UID: \"7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3\") " pod="openshift-monitoring/telemeter-client-68946bfd7f-467rt"
Sep 17 14:10:48.739629 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:48.739603    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-68946bfd7f-467rt"
Sep 17 14:10:49.030484 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:49.030459    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-68946bfd7f-467rt"]
Sep 17 14:10:49.032522 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:10:49.032495    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c8e1daf_c93c_4eb2_a9cd_c0e3d9e7f8c3.slice/crio-53b0dd48680c4e7c9030cb3410ae843e549e876078d25dbb8a1c2863fb43e9b3 WatchSource:0}: Error finding container 53b0dd48680c4e7c9030cb3410ae843e549e876078d25dbb8a1c2863fb43e9b3: Status 404 returned error can't find the container with id 53b0dd48680c4e7c9030cb3410ae843e549e876078d25dbb8a1c2863fb43e9b3
Sep 17 14:10:49.098282 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:49.098244    2580 generic.go:356] "Generic (PLEG): container finished" podID="f2863cb0-e9fa-4b1d-b49d-397470b79385" containerID="039605e8e3ea41c351d7bc9183dafe3929c40237ca62e215d0add11a3ff3747a" exitCode=0
Sep 17 14:10:49.098739 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:49.098334    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2863cb0-e9fa-4b1d-b49d-397470b79385","Type":"ContainerDied","Data":"039605e8e3ea41c351d7bc9183dafe3929c40237ca62e215d0add11a3ff3747a"}
Sep 17 14:10:49.099652 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:49.099627    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68946bfd7f-467rt" event={"ID":"7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3","Type":"ContainerStarted","Data":"53b0dd48680c4e7c9030cb3410ae843e549e876078d25dbb8a1c2863fb43e9b3"}
Sep 17 14:10:51.112524 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:51.112442    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2863cb0-e9fa-4b1d-b49d-397470b79385","Type":"ContainerStarted","Data":"0c581e0be79ea026a5b993b180ff88aabf1c40eb6a9a33396dadf351532325b4"}
Sep 17 14:10:52.119806 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.119764    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2863cb0-e9fa-4b1d-b49d-397470b79385","Type":"ContainerStarted","Data":"b4a40963573d26973bfc69648ba3b226e1a8fe94b77e0d877aa507a3e5e6c201"}
Sep 17 14:10:52.120232 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.119885    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2863cb0-e9fa-4b1d-b49d-397470b79385","Type":"ContainerStarted","Data":"09d132d18db058c0e3c8ba773779b1606ac81bb05f94076e5481b04d582e992d"}
Sep 17 14:10:52.120232 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.119933    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2863cb0-e9fa-4b1d-b49d-397470b79385","Type":"ContainerStarted","Data":"55c00cd62d142536063eca74a5c9917fd4fe5d22624e1cf9505c5405f664e817"}
Sep 17 14:10:52.120232 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.119975    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2863cb0-e9fa-4b1d-b49d-397470b79385","Type":"ContainerStarted","Data":"a840c6656ec7c8ec107c020de8a08c64cd3e03ead542708541e7d02a8637f0c8"}
Sep 17 14:10:52.121966 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.121938    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68946bfd7f-467rt" event={"ID":"7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3","Type":"ContainerStarted","Data":"6c05b63ee3a322ecac1ca75dafa72f2889a29a09c8e3fa9b6cbbb2bd1b39b6c4"}
Sep 17 14:10:52.122091 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.121987    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68946bfd7f-467rt" event={"ID":"7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3","Type":"ContainerStarted","Data":"23810af1e9d4a464967ba7934a66dede0ad895a56a24a505ff0144795438721c"}
Sep 17 14:10:52.122091 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.122005    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-68946bfd7f-467rt" event={"ID":"7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3","Type":"ContainerStarted","Data":"a0c1a865ced911fd5010a703cff8e5e30512fba6c8e65a68100aa689d1f3028b"}
Sep 17 14:10:52.151358 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.151237    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-68946bfd7f-467rt" podStartSLOduration=1.8890826779999998 podStartE2EDuration="4.15121849s" totalImagesPullingTime="2.262135812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:10:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:10:52.149970894 +0000 UTC m=+239.594046525" watchObservedRunningTime="2026-09-17 14:10:52.15121849 +0000 UTC m=+239.595294079"
Sep 17 14:10:52.258436 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.258406    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bcfdc9f6b-bzsgr"]
Sep 17 14:10:52.260599 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.260583    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcfdc9f6b-bzsgr"
Sep 17 14:10:52.265813 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.265791    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 17 14:10:52.265933 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.265908    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 17 14:10:52.266131 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.266093    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 17 14:10:52.266226 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.266149    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-45dp8\""
Sep 17 14:10:52.266905 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.266883    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 17 14:10:52.267024 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.266980    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 17 14:10:52.271985 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.271966    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 17 14:10:52.278322 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.278299    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bcfdc9f6b-bzsgr"]
Sep 17 14:10:52.332006 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.331975    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e33eb58-38b0-45c9-81ec-9b4c00946754-console-config\") pod \"console-7bcfdc9f6b-bzsgr\" (UID: \"6e33eb58-38b0-45c9-81ec-9b4c00946754\") " pod="openshift-console/console-7bcfdc9f6b-bzsgr"
Sep 17 14:10:52.332184 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.332014    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e33eb58-38b0-45c9-81ec-9b4c00946754-trusted-ca-bundle\") pod \"console-7bcfdc9f6b-bzsgr\" (UID: \"6e33eb58-38b0-45c9-81ec-9b4c00946754\") " pod="openshift-console/console-7bcfdc9f6b-bzsgr"
Sep 17 14:10:52.332184 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.332039    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e33eb58-38b0-45c9-81ec-9b4c00946754-oauth-serving-cert\") pod \"console-7bcfdc9f6b-bzsgr\" (UID: \"6e33eb58-38b0-45c9-81ec-9b4c00946754\") " pod="openshift-console/console-7bcfdc9f6b-bzsgr"
Sep 17 14:10:52.332184 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.332062    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk6mx\" (UniqueName: \"kubernetes.io/projected/6e33eb58-38b0-45c9-81ec-9b4c00946754-kube-api-access-zk6mx\") pod \"console-7bcfdc9f6b-bzsgr\" (UID: \"6e33eb58-38b0-45c9-81ec-9b4c00946754\") " pod="openshift-console/console-7bcfdc9f6b-bzsgr"
Sep 17 14:10:52.332184 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.332154    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e33eb58-38b0-45c9-81ec-9b4c00946754-console-oauth-config\") pod \"console-7bcfdc9f6b-bzsgr\" (UID: \"6e33eb58-38b0-45c9-81ec-9b4c00946754\") " pod="openshift-console/console-7bcfdc9f6b-bzsgr"
Sep 17 14:10:52.332382 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.332210    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e33eb58-38b0-45c9-81ec-9b4c00946754-console-serving-cert\") pod \"console-7bcfdc9f6b-bzsgr\" (UID: \"6e33eb58-38b0-45c9-81ec-9b4c00946754\") " pod="openshift-console/console-7bcfdc9f6b-bzsgr"
Sep 17 14:10:52.332382 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.332241    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e33eb58-38b0-45c9-81ec-9b4c00946754-service-ca\") pod \"console-7bcfdc9f6b-bzsgr\" (UID: \"6e33eb58-38b0-45c9-81ec-9b4c00946754\") " pod="openshift-console/console-7bcfdc9f6b-bzsgr"
Sep 17 14:10:52.433033 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.432959    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e33eb58-38b0-45c9-81ec-9b4c00946754-console-config\") pod \"console-7bcfdc9f6b-bzsgr\" (UID: \"6e33eb58-38b0-45c9-81ec-9b4c00946754\") " pod="openshift-console/console-7bcfdc9f6b-bzsgr"
Sep 17 14:10:52.433033 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.432994    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e33eb58-38b0-45c9-81ec-9b4c00946754-trusted-ca-bundle\") pod \"console-7bcfdc9f6b-bzsgr\" (UID: \"6e33eb58-38b0-45c9-81ec-9b4c00946754\") " pod="openshift-console/console-7bcfdc9f6b-bzsgr"
Sep 17 14:10:52.433033 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.433016    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e33eb58-38b0-45c9-81ec-9b4c00946754-oauth-serving-cert\") pod \"console-7bcfdc9f6b-bzsgr\" (UID: \"6e33eb58-38b0-45c9-81ec-9b4c00946754\") " pod="openshift-console/console-7bcfdc9f6b-bzsgr"
Sep 17 14:10:52.433033 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.433033    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk6mx\" (UniqueName: \"kubernetes.io/projected/6e33eb58-38b0-45c9-81ec-9b4c00946754-kube-api-access-zk6mx\") pod \"console-7bcfdc9f6b-bzsgr\" (UID: \"6e33eb58-38b0-45c9-81ec-9b4c00946754\") " pod="openshift-console/console-7bcfdc9f6b-bzsgr"
Sep 17 14:10:52.433375 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.433214    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e33eb58-38b0-45c9-81ec-9b4c00946754-console-oauth-config\") pod \"console-7bcfdc9f6b-bzsgr\" (UID: \"6e33eb58-38b0-45c9-81ec-9b4c00946754\") " pod="openshift-console/console-7bcfdc9f6b-bzsgr"
Sep 17 14:10:52.433375 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.433253    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e33eb58-38b0-45c9-81ec-9b4c00946754-console-serving-cert\") pod \"console-7bcfdc9f6b-bzsgr\" (UID: \"6e33eb58-38b0-45c9-81ec-9b4c00946754\") " pod="openshift-console/console-7bcfdc9f6b-bzsgr"
Sep 17 14:10:52.433375 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.433276    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e33eb58-38b0-45c9-81ec-9b4c00946754-service-ca\") pod \"console-7bcfdc9f6b-bzsgr\" (UID: \"6e33eb58-38b0-45c9-81ec-9b4c00946754\") " pod="openshift-console/console-7bcfdc9f6b-bzsgr"
Sep 17 14:10:52.433748 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.433722    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e33eb58-38b0-45c9-81ec-9b4c00946754-console-config\") pod \"console-7bcfdc9f6b-bzsgr\" (UID: \"6e33eb58-38b0-45c9-81ec-9b4c00946754\") " pod="openshift-console/console-7bcfdc9f6b-bzsgr"
Sep 17 14:10:52.433905 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.433886    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e33eb58-38b0-45c9-81ec-9b4c00946754-trusted-ca-bundle\") pod \"console-7bcfdc9f6b-bzsgr\" (UID: \"6e33eb58-38b0-45c9-81ec-9b4c00946754\") " pod="openshift-console/console-7bcfdc9f6b-bzsgr"
Sep 17 14:10:52.434005 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.433960    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e33eb58-38b0-45c9-81ec-9b4c00946754-oauth-serving-cert\") pod \"console-7bcfdc9f6b-bzsgr\" (UID: \"6e33eb58-38b0-45c9-81ec-9b4c00946754\") " pod="openshift-console/console-7bcfdc9f6b-bzsgr"
Sep 17 14:10:52.434099 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.434079    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e33eb58-38b0-45c9-81ec-9b4c00946754-service-ca\") pod \"console-7bcfdc9f6b-bzsgr\" (UID: \"6e33eb58-38b0-45c9-81ec-9b4c00946754\") " pod="openshift-console/console-7bcfdc9f6b-bzsgr"
Sep 17 14:10:52.436060 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.436004    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e33eb58-38b0-45c9-81ec-9b4c00946754-console-oauth-config\") pod \"console-7bcfdc9f6b-bzsgr\" (UID: \"6e33eb58-38b0-45c9-81ec-9b4c00946754\") " pod="openshift-console/console-7bcfdc9f6b-bzsgr"
Sep 17 14:10:52.436156 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.436134    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e33eb58-38b0-45c9-81ec-9b4c00946754-console-serving-cert\") pod \"console-7bcfdc9f6b-bzsgr\" (UID: \"6e33eb58-38b0-45c9-81ec-9b4c00946754\") " pod="openshift-console/console-7bcfdc9f6b-bzsgr"
Sep 17 14:10:52.450585 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.450561    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk6mx\" (UniqueName: \"kubernetes.io/projected/6e33eb58-38b0-45c9-81ec-9b4c00946754-kube-api-access-zk6mx\") pod \"console-7bcfdc9f6b-bzsgr\" (UID: \"6e33eb58-38b0-45c9-81ec-9b4c00946754\") " pod="openshift-console/console-7bcfdc9f6b-bzsgr"
Sep 17 14:10:52.570409 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.570376    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcfdc9f6b-bzsgr"
Sep 17 14:10:52.861067 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:52.861040    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bcfdc9f6b-bzsgr"]
Sep 17 14:10:52.863247 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:10:52.863217    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e33eb58_38b0_45c9_81ec_9b4c00946754.slice/crio-93ee4e15f1e9c59e4a85bbfb58cba5d7b8e4508686a8949ff672fa34ed5e6d69 WatchSource:0}: Error finding container 93ee4e15f1e9c59e4a85bbfb58cba5d7b8e4508686a8949ff672fa34ed5e6d69: Status 404 returned error can't find the container with id 93ee4e15f1e9c59e4a85bbfb58cba5d7b8e4508686a8949ff672fa34ed5e6d69
Sep 17 14:10:53.127540 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:53.127437    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcfdc9f6b-bzsgr" event={"ID":"6e33eb58-38b0-45c9-81ec-9b4c00946754","Type":"ContainerStarted","Data":"9addf15ef24255e17796c4401652e186ef40ba68fc128204d066de797cb65fed"}
Sep 17 14:10:53.127540 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:53.127501    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcfdc9f6b-bzsgr" event={"ID":"6e33eb58-38b0-45c9-81ec-9b4c00946754","Type":"ContainerStarted","Data":"93ee4e15f1e9c59e4a85bbfb58cba5d7b8e4508686a8949ff672fa34ed5e6d69"}
Sep 17 14:10:53.130941 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:53.130912    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f2863cb0-e9fa-4b1d-b49d-397470b79385","Type":"ContainerStarted","Data":"368ef7d623ebb6f7d26565bec9f24a3c93c04cffa56a45af7e1265bb8c4a4cb4"}
Sep 17 14:10:53.150292 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:53.150248    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bcfdc9f6b-bzsgr" podStartSLOduration=1.150232111 podStartE2EDuration="1.150232111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:10:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:10:53.148974333 +0000 UTC m=+240.593049944" watchObservedRunningTime="2026-09-17 14:10:53.150232111 +0000 UTC m=+240.594307696"
Sep 17 14:10:53.194329 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:10:53.190106    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.054694918 podStartE2EDuration="7.190079009s" totalImagesPullingTime="4.113326766s" totalInitContainerRuntime="22.057325ms" isStatefulPod=false podCreationTimestamp="2026-09-17 14:10:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:10:53.18855917 +0000 UTC m=+240.632634756" watchObservedRunningTime="2026-09-17 14:10:53.190079009 +0000 UTC m=+240.634154597"
Sep 17 14:11:02.570501 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:11:02.570460    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bcfdc9f6b-bzsgr"
Sep 17 14:11:02.571043 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:11:02.570525    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bcfdc9f6b-bzsgr"
Sep 17 14:11:02.575327 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:11:02.575302    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bcfdc9f6b-bzsgr"
Sep 17 14:11:03.184211 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:11:03.184182    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bcfdc9f6b-bzsgr"
Sep 17 14:11:52.930222 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:11:52.930195    2580 kubelet.go:1648] "Image garbage collection succeeded"
Sep 17 14:12:07.116117 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:07.116085    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b6d68d965-vfjjb"]
Sep 17 14:12:07.119256 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:07.119240    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6d68d965-vfjjb"
Sep 17 14:12:07.139723 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:07.139684    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b6d68d965-vfjjb"]
Sep 17 14:12:07.159303 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:07.159272    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad7512ed-910b-4703-b298-701594cbdf5b-service-ca\") pod \"console-6b6d68d965-vfjjb\" (UID: \"ad7512ed-910b-4703-b298-701594cbdf5b\") " pod="openshift-console/console-6b6d68d965-vfjjb"
Sep 17 14:12:07.159432 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:07.159325    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnxfc\" (UniqueName: \"kubernetes.io/projected/ad7512ed-910b-4703-b298-701594cbdf5b-kube-api-access-xnxfc\") pod \"console-6b6d68d965-vfjjb\" (UID: \"ad7512ed-910b-4703-b298-701594cbdf5b\") " pod="openshift-console/console-6b6d68d965-vfjjb"
Sep 17 14:12:07.159432 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:07.159386    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad7512ed-910b-4703-b298-701594cbdf5b-trusted-ca-bundle\") pod \"console-6b6d68d965-vfjjb\" (UID: \"ad7512ed-910b-4703-b298-701594cbdf5b\") " pod="openshift-console/console-6b6d68d965-vfjjb"
Sep 17 14:12:07.159741 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:07.159455    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad7512ed-910b-4703-b298-701594cbdf5b-console-oauth-config\") pod \"console-6b6d68d965-vfjjb\" (UID: \"ad7512ed-910b-4703-b298-701594cbdf5b\") " pod="openshift-console/console-6b6d68d965-vfjjb"
Sep 17 14:12:07.159741 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:07.159520    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad7512ed-910b-4703-b298-701594cbdf5b-console-serving-cert\") pod \"console-6b6d68d965-vfjjb\" (UID: \"ad7512ed-910b-4703-b298-701594cbdf5b\") " pod="openshift-console/console-6b6d68d965-vfjjb"
Sep 17 14:12:07.159741 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:07.159550    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad7512ed-910b-4703-b298-701594cbdf5b-oauth-serving-cert\") pod \"console-6b6d68d965-vfjjb\" (UID: \"ad7512ed-910b-4703-b298-701594cbdf5b\") " pod="openshift-console/console-6b6d68d965-vfjjb"
Sep 17 14:12:07.159741 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:07.159576    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad7512ed-910b-4703-b298-701594cbdf5b-console-config\") pod \"console-6b6d68d965-vfjjb\" (UID: \"ad7512ed-910b-4703-b298-701594cbdf5b\") " pod="openshift-console/console-6b6d68d965-vfjjb"
Sep 17 14:12:07.260266 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:07.260229    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad7512ed-910b-4703-b298-701594cbdf5b-console-oauth-config\") pod \"console-6b6d68d965-vfjjb\" (UID: \"ad7512ed-910b-4703-b298-701594cbdf5b\") " pod="openshift-console/console-6b6d68d965-vfjjb"
Sep 17 14:12:07.260433 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:07.260278    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad7512ed-910b-4703-b298-701594cbdf5b-console-serving-cert\") pod \"console-6b6d68d965-vfjjb\" (UID: \"ad7512ed-910b-4703-b298-701594cbdf5b\") " pod="openshift-console/console-6b6d68d965-vfjjb"
Sep 17 14:12:07.260433 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:07.260322    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad7512ed-910b-4703-b298-701594cbdf5b-oauth-serving-cert\") pod \"console-6b6d68d965-vfjjb\" (UID: \"ad7512ed-910b-4703-b298-701594cbdf5b\") " pod="openshift-console/console-6b6d68d965-vfjjb"
Sep 17 14:12:07.260433 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:07.260354    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad7512ed-910b-4703-b298-701594cbdf5b-console-config\") pod \"console-6b6d68d965-vfjjb\" (UID: \"ad7512ed-910b-4703-b298-701594cbdf5b\") " pod="openshift-console/console-6b6d68d965-vfjjb"
Sep 17 14:12:07.260433 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:07.260415    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad7512ed-910b-4703-b298-701594cbdf5b-service-ca\") pod \"console-6b6d68d965-vfjjb\" (UID: \"ad7512ed-910b-4703-b298-701594cbdf5b\") " pod="openshift-console/console-6b6d68d965-vfjjb"
Sep 17 14:12:07.260615 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:07.260462    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnxfc\" (UniqueName: \"kubernetes.io/projected/ad7512ed-910b-4703-b298-701594cbdf5b-kube-api-access-xnxfc\") pod \"console-6b6d68d965-vfjjb\" (UID: \"ad7512ed-910b-4703-b298-701594cbdf5b\") " pod="openshift-console/console-6b6d68d965-vfjjb"
Sep 17 14:12:07.260665 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:07.260603    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad7512ed-910b-4703-b298-701594cbdf5b-trusted-ca-bundle\") pod \"console-6b6d68d965-vfjjb\" (UID: \"ad7512ed-910b-4703-b298-701594cbdf5b\") " pod="openshift-console/console-6b6d68d965-vfjjb"
Sep 17 14:12:07.261307 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:07.261276    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad7512ed-910b-4703-b298-701594cbdf5b-oauth-serving-cert\") pod \"console-6b6d68d965-vfjjb\" (UID: \"ad7512ed-910b-4703-b298-701594cbdf5b\") " pod="openshift-console/console-6b6d68d965-vfjjb"
Sep 17 14:12:07.261307 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:07.261294    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad7512ed-910b-4703-b298-701594cbdf5b-console-config\") pod \"console-6b6d68d965-vfjjb\" (UID: \"ad7512ed-910b-4703-b298-701594cbdf5b\") " pod="openshift-console/console-6b6d68d965-vfjjb"
Sep 17 14:12:07.261474 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:07.261367    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad7512ed-910b-4703-b298-701594cbdf5b-service-ca\") pod \"console-6b6d68d965-vfjjb\" (UID: \"ad7512ed-910b-4703-b298-701594cbdf5b\") " pod="openshift-console/console-6b6d68d965-vfjjb"
Sep 17 14:12:07.261474 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:07.261461    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad7512ed-910b-4703-b298-701594cbdf5b-trusted-ca-bundle\") pod \"console-6b6d68d965-vfjjb\" (UID: \"ad7512ed-910b-4703-b298-701594cbdf5b\") " pod="openshift-console/console-6b6d68d965-vfjjb"
Sep 17 14:12:07.262682 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:07.262659    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad7512ed-910b-4703-b298-701594cbdf5b-console-serving-cert\") pod \"console-6b6d68d965-vfjjb\" (UID: \"ad7512ed-910b-4703-b298-701594cbdf5b\") " pod="openshift-console/console-6b6d68d965-vfjjb"
Sep 17 14:12:07.262843 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:07.262825    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad7512ed-910b-4703-b298-701594cbdf5b-console-oauth-config\") pod \"console-6b6d68d965-vfjjb\" (UID: \"ad7512ed-910b-4703-b298-701594cbdf5b\") " pod="openshift-console/console-6b6d68d965-vfjjb"
Sep 17 14:12:07.271842 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:07.271823    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnxfc\" (UniqueName: \"kubernetes.io/projected/ad7512ed-910b-4703-b298-701594cbdf5b-kube-api-access-xnxfc\") pod \"console-6b6d68d965-vfjjb\" (UID: \"ad7512ed-910b-4703-b298-701594cbdf5b\") " pod="openshift-console/console-6b6d68d965-vfjjb"
Sep 17 14:12:07.428640 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:07.428560    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6d68d965-vfjjb"
Sep 17 14:12:07.700579 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:07.700551    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b6d68d965-vfjjb"]
Sep 17 14:12:07.703221 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:12:07.703193    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad7512ed_910b_4703_b298_701594cbdf5b.slice/crio-b5f569caccb8b106356048e214ab654bee8c87dcb8247023d64c76f04259c0b6 WatchSource:0}: Error finding container b5f569caccb8b106356048e214ab654bee8c87dcb8247023d64c76f04259c0b6: Status 404 returned error can't find the container with id b5f569caccb8b106356048e214ab654bee8c87dcb8247023d64c76f04259c0b6
Sep 17 14:12:08.427379 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:08.427344    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6d68d965-vfjjb" event={"ID":"ad7512ed-910b-4703-b298-701594cbdf5b","Type":"ContainerStarted","Data":"2734de3c741eb1e38ea5b866f7fe645200b8bea27d29e5391d4b7014c94cc315"}
Sep 17 14:12:08.427785 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:08.427399    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6d68d965-vfjjb" event={"ID":"ad7512ed-910b-4703-b298-701594cbdf5b","Type":"ContainerStarted","Data":"b5f569caccb8b106356048e214ab654bee8c87dcb8247023d64c76f04259c0b6"}
Sep 17 14:12:08.456495 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:08.456437    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b6d68d965-vfjjb" podStartSLOduration=1.456414889 podStartE2EDuration="1.456414889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:12:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:12:08.454868099 +0000 UTC m=+315.898943684" watchObservedRunningTime="2026-09-17 14:12:08.456414889 +0000 UTC m=+315.900490477"
Sep 17 14:12:17.429247 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:17.429211    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b6d68d965-vfjjb"
Sep 17 14:12:17.429676 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:17.429271    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b6d68d965-vfjjb"
Sep 17 14:12:17.433695 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:17.433674    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b6d68d965-vfjjb"
Sep 17 14:12:17.471878 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:17.471848    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b6d68d965-vfjjb"
Sep 17 14:12:17.523383 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:17.523350    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bcfdc9f6b-bzsgr"]
Sep 17 14:12:42.542625 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:42.542579    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7bcfdc9f6b-bzsgr" podUID="6e33eb58-38b0-45c9-81ec-9b4c00946754" containerName="console" containerID="cri-o://9addf15ef24255e17796c4401652e186ef40ba68fc128204d066de797cb65fed" gracePeriod=15
Sep 17 14:12:42.783397 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:42.783370    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcfdc9f6b-bzsgr"
Sep 17 14:12:42.866579 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:42.866480    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e33eb58-38b0-45c9-81ec-9b4c00946754-console-config\") pod \"6e33eb58-38b0-45c9-81ec-9b4c00946754\" (UID: \"6e33eb58-38b0-45c9-81ec-9b4c00946754\") "
Sep 17 14:12:42.866579 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:42.866555    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e33eb58-38b0-45c9-81ec-9b4c00946754-oauth-serving-cert\") pod \"6e33eb58-38b0-45c9-81ec-9b4c00946754\" (UID: \"6e33eb58-38b0-45c9-81ec-9b4c00946754\") "
Sep 17 14:12:42.866579 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:42.866577    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e33eb58-38b0-45c9-81ec-9b4c00946754-console-oauth-config\") pod \"6e33eb58-38b0-45c9-81ec-9b4c00946754\" (UID: \"6e33eb58-38b0-45c9-81ec-9b4c00946754\") "
Sep 17 14:12:42.866906 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:42.866603    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e33eb58-38b0-45c9-81ec-9b4c00946754-trusted-ca-bundle\") pod \"6e33eb58-38b0-45c9-81ec-9b4c00946754\" (UID: \"6e33eb58-38b0-45c9-81ec-9b4c00946754\") "
Sep 17 14:12:42.866906 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:42.866625    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zk6mx\" (UniqueName: \"kubernetes.io/projected/6e33eb58-38b0-45c9-81ec-9b4c00946754-kube-api-access-zk6mx\") pod \"6e33eb58-38b0-45c9-81ec-9b4c00946754\" (UID: \"6e33eb58-38b0-45c9-81ec-9b4c00946754\") "
Sep 17 14:12:42.866906 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:42.866646    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e33eb58-38b0-45c9-81ec-9b4c00946754-console-serving-cert\") pod \"6e33eb58-38b0-45c9-81ec-9b4c00946754\" (UID: \"6e33eb58-38b0-45c9-81ec-9b4c00946754\") "
Sep 17 14:12:42.866906 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:42.866675    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e33eb58-38b0-45c9-81ec-9b4c00946754-service-ca\") pod \"6e33eb58-38b0-45c9-81ec-9b4c00946754\" (UID: \"6e33eb58-38b0-45c9-81ec-9b4c00946754\") "
Sep 17 14:12:42.867125 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:42.866936    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e33eb58-38b0-45c9-81ec-9b4c00946754-console-config" (OuterVolumeSpecName: "console-config") pod "6e33eb58-38b0-45c9-81ec-9b4c00946754" (UID: "6e33eb58-38b0-45c9-81ec-9b4c00946754"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:12:42.867125 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:42.867032    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e33eb58-38b0-45c9-81ec-9b4c00946754-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6e33eb58-38b0-45c9-81ec-9b4c00946754" (UID: "6e33eb58-38b0-45c9-81ec-9b4c00946754"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:12:42.867291 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:42.867046    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e33eb58-38b0-45c9-81ec-9b4c00946754-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6e33eb58-38b0-45c9-81ec-9b4c00946754" (UID: "6e33eb58-38b0-45c9-81ec-9b4c00946754"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:12:42.867291 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:42.867249    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e33eb58-38b0-45c9-81ec-9b4c00946754-service-ca" (OuterVolumeSpecName: "service-ca") pod "6e33eb58-38b0-45c9-81ec-9b4c00946754" (UID: "6e33eb58-38b0-45c9-81ec-9b4c00946754"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:12:42.868894 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:42.868860    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e33eb58-38b0-45c9-81ec-9b4c00946754-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6e33eb58-38b0-45c9-81ec-9b4c00946754" (UID: "6e33eb58-38b0-45c9-81ec-9b4c00946754"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:12:42.868996 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:42.868890    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e33eb58-38b0-45c9-81ec-9b4c00946754-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6e33eb58-38b0-45c9-81ec-9b4c00946754" (UID: "6e33eb58-38b0-45c9-81ec-9b4c00946754"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:12:42.868996 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:42.868911    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e33eb58-38b0-45c9-81ec-9b4c00946754-kube-api-access-zk6mx" (OuterVolumeSpecName: "kube-api-access-zk6mx") pod "6e33eb58-38b0-45c9-81ec-9b4c00946754" (UID: "6e33eb58-38b0-45c9-81ec-9b4c00946754"). InnerVolumeSpecName "kube-api-access-zk6mx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:12:42.967657 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:42.967613    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e33eb58-38b0-45c9-81ec-9b4c00946754-console-serving-cert\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:12:42.967657 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:42.967650    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e33eb58-38b0-45c9-81ec-9b4c00946754-service-ca\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:12:42.967657 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:42.967666    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e33eb58-38b0-45c9-81ec-9b4c00946754-console-config\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:12:42.967926 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:42.967677    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e33eb58-38b0-45c9-81ec-9b4c00946754-oauth-serving-cert\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:12:42.967926 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:42.967689    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e33eb58-38b0-45c9-81ec-9b4c00946754-console-oauth-config\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:12:42.967926 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:42.967700    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e33eb58-38b0-45c9-81ec-9b4c00946754-trusted-ca-bundle\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:12:42.967926 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:42.967737    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zk6mx\" (UniqueName: \"kubernetes.io/projected/6e33eb58-38b0-45c9-81ec-9b4c00946754-kube-api-access-zk6mx\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:12:43.572395 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:43.572362    2580 generic.go:356] "Generic (PLEG): container finished" podID="6e33eb58-38b0-45c9-81ec-9b4c00946754" containerID="9addf15ef24255e17796c4401652e186ef40ba68fc128204d066de797cb65fed" exitCode=0
Sep 17 14:12:43.572847 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:43.572401    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcfdc9f6b-bzsgr" event={"ID":"6e33eb58-38b0-45c9-81ec-9b4c00946754","Type":"ContainerDied","Data":"9addf15ef24255e17796c4401652e186ef40ba68fc128204d066de797cb65fed"}
Sep 17 14:12:43.572847 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:43.572406    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bcfdc9f6b-bzsgr"
Sep 17 14:12:43.572847 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:43.572441    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bcfdc9f6b-bzsgr" event={"ID":"6e33eb58-38b0-45c9-81ec-9b4c00946754","Type":"ContainerDied","Data":"93ee4e15f1e9c59e4a85bbfb58cba5d7b8e4508686a8949ff672fa34ed5e6d69"}
Sep 17 14:12:43.572847 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:43.572463    2580 scope.go:117] "RemoveContainer" containerID="9addf15ef24255e17796c4401652e186ef40ba68fc128204d066de797cb65fed"
Sep 17 14:12:43.581180 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:43.581156    2580 scope.go:117] "RemoveContainer" containerID="9addf15ef24255e17796c4401652e186ef40ba68fc128204d066de797cb65fed"
Sep 17 14:12:43.581427 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:12:43.581409    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9addf15ef24255e17796c4401652e186ef40ba68fc128204d066de797cb65fed\": container with ID starting with 9addf15ef24255e17796c4401652e186ef40ba68fc128204d066de797cb65fed not found: ID does not exist" containerID="9addf15ef24255e17796c4401652e186ef40ba68fc128204d066de797cb65fed"
Sep 17 14:12:43.581496 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:43.581433    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9addf15ef24255e17796c4401652e186ef40ba68fc128204d066de797cb65fed"} err="failed to get container status \"9addf15ef24255e17796c4401652e186ef40ba68fc128204d066de797cb65fed\": rpc error: code = NotFound desc = could not find container \"9addf15ef24255e17796c4401652e186ef40ba68fc128204d066de797cb65fed\": container with ID starting with 9addf15ef24255e17796c4401652e186ef40ba68fc128204d066de797cb65fed not found: ID does not exist"
Sep 17 14:12:43.591295 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:43.591259    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bcfdc9f6b-bzsgr"]
Sep 17 14:12:43.593459 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:43.593439    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bcfdc9f6b-bzsgr"]
Sep 17 14:12:45.176144 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:12:45.176109    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e33eb58-38b0-45c9-81ec-9b4c00946754" path="/var/lib/kubelet/pods/6e33eb58-38b0-45c9-81ec-9b4c00946754/volumes"
Sep 17 14:13:23.093498 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:23.093458    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754066bgm"]
Sep 17 14:13:23.094089 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:23.093953    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e33eb58-38b0-45c9-81ec-9b4c00946754" containerName="console"
Sep 17 14:13:23.094089 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:23.093974    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e33eb58-38b0-45c9-81ec-9b4c00946754" containerName="console"
Sep 17 14:13:23.094089 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:23.094059    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e33eb58-38b0-45c9-81ec-9b4c00946754" containerName="console"
Sep 17 14:13:23.097193 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:23.097171    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754066bgm"
Sep 17 14:13:23.101949 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:23.101925    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q2vmb\""
Sep 17 14:13:23.101949 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:23.101945    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 14:13:23.103092 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:23.103074    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 14:13:23.112009 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:23.111984    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754066bgm"]
Sep 17 14:13:23.156268 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:23.156240    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjdtc\" (UniqueName: \"kubernetes.io/projected/fcb8d5f1-2138-4e3c-a1a9-4539621578f2-kube-api-access-mjdtc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754066bgm\" (UID: \"fcb8d5f1-2138-4e3c-a1a9-4539621578f2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754066bgm"
Sep 17 14:13:23.156413 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:23.156282    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fcb8d5f1-2138-4e3c-a1a9-4539621578f2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754066bgm\" (UID: \"fcb8d5f1-2138-4e3c-a1a9-4539621578f2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754066bgm"
Sep 17 14:13:23.156413 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:23.156313    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fcb8d5f1-2138-4e3c-a1a9-4539621578f2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754066bgm\" (UID: \"fcb8d5f1-2138-4e3c-a1a9-4539621578f2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754066bgm"
Sep 17 14:13:23.257035 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:23.257002    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fcb8d5f1-2138-4e3c-a1a9-4539621578f2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754066bgm\" (UID: \"fcb8d5f1-2138-4e3c-a1a9-4539621578f2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754066bgm"
Sep 17 14:13:23.257197 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:23.257058    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fcb8d5f1-2138-4e3c-a1a9-4539621578f2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754066bgm\" (UID: \"fcb8d5f1-2138-4e3c-a1a9-4539621578f2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754066bgm"
Sep 17 14:13:23.257197 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:23.257112    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjdtc\" (UniqueName: \"kubernetes.io/projected/fcb8d5f1-2138-4e3c-a1a9-4539621578f2-kube-api-access-mjdtc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754066bgm\" (UID: \"fcb8d5f1-2138-4e3c-a1a9-4539621578f2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754066bgm"
Sep 17 14:13:23.257341 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:23.257320    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fcb8d5f1-2138-4e3c-a1a9-4539621578f2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754066bgm\" (UID: \"fcb8d5f1-2138-4e3c-a1a9-4539621578f2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754066bgm"
Sep 17 14:13:23.257430 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:23.257411    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fcb8d5f1-2138-4e3c-a1a9-4539621578f2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754066bgm\" (UID: \"fcb8d5f1-2138-4e3c-a1a9-4539621578f2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754066bgm"
Sep 17 14:13:23.267212 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:23.267185    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjdtc\" (UniqueName: \"kubernetes.io/projected/fcb8d5f1-2138-4e3c-a1a9-4539621578f2-kube-api-access-mjdtc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754066bgm\" (UID: \"fcb8d5f1-2138-4e3c-a1a9-4539621578f2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754066bgm"
Sep 17 14:13:23.406166 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:23.406063    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754066bgm"
Sep 17 14:13:23.682267 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:23.682190    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754066bgm"]
Sep 17 14:13:23.685389 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:13:23.685358    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcb8d5f1_2138_4e3c_a1a9_4539621578f2.slice/crio-1bbed6056abcf0c27ac3181386e71696cd5db5e5784c037572c3aa8c4f843648 WatchSource:0}: Error finding container 1bbed6056abcf0c27ac3181386e71696cd5db5e5784c037572c3aa8c4f843648: Status 404 returned error can't find the container with id 1bbed6056abcf0c27ac3181386e71696cd5db5e5784c037572c3aa8c4f843648
Sep 17 14:13:23.687335 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:23.687319    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 14:13:23.736871 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:23.736836    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754066bgm" event={"ID":"fcb8d5f1-2138-4e3c-a1a9-4539621578f2","Type":"ContainerStarted","Data":"1bbed6056abcf0c27ac3181386e71696cd5db5e5784c037572c3aa8c4f843648"}
Sep 17 14:13:30.767660 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:30.767621    2580 generic.go:356] "Generic (PLEG): container finished" podID="fcb8d5f1-2138-4e3c-a1a9-4539621578f2" containerID="c7dd876ce40d98a8cb8a7a84091076693dfa2d891e54d7799e97bb8076ac0277" exitCode=0
Sep 17 14:13:30.768063 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:30.767694    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754066bgm" event={"ID":"fcb8d5f1-2138-4e3c-a1a9-4539621578f2","Type":"ContainerDied","Data":"c7dd876ce40d98a8cb8a7a84091076693dfa2d891e54d7799e97bb8076ac0277"}
Sep 17 14:13:40.810792 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:40.810753    2580 generic.go:356] "Generic (PLEG): container finished" podID="fcb8d5f1-2138-4e3c-a1a9-4539621578f2" containerID="111ea3ab09696781c6a1b09de58cad808b2ba579dfb08b4504412c9a768a9fa2" exitCode=0
Sep 17 14:13:40.811149 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:40.810823    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754066bgm" event={"ID":"fcb8d5f1-2138-4e3c-a1a9-4539621578f2","Type":"ContainerDied","Data":"111ea3ab09696781c6a1b09de58cad808b2ba579dfb08b4504412c9a768a9fa2"}
Sep 17 14:13:47.846657 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:47.846622    2580 generic.go:356] "Generic (PLEG): container finished" podID="fcb8d5f1-2138-4e3c-a1a9-4539621578f2" containerID="f0594d11a51f72bd7668918a441b27e0d95eb6d0286372bd500adc32530f9de2" exitCode=0
Sep 17 14:13:47.846657 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:47.846661    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754066bgm" event={"ID":"fcb8d5f1-2138-4e3c-a1a9-4539621578f2","Type":"ContainerDied","Data":"f0594d11a51f72bd7668918a441b27e0d95eb6d0286372bd500adc32530f9de2"}
Sep 17 14:13:48.971140 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:48.971114    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754066bgm"
Sep 17 14:13:49.089224 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:49.089187    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fcb8d5f1-2138-4e3c-a1a9-4539621578f2-util\") pod \"fcb8d5f1-2138-4e3c-a1a9-4539621578f2\" (UID: \"fcb8d5f1-2138-4e3c-a1a9-4539621578f2\") "
Sep 17 14:13:49.089224 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:49.089234    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjdtc\" (UniqueName: \"kubernetes.io/projected/fcb8d5f1-2138-4e3c-a1a9-4539621578f2-kube-api-access-mjdtc\") pod \"fcb8d5f1-2138-4e3c-a1a9-4539621578f2\" (UID: \"fcb8d5f1-2138-4e3c-a1a9-4539621578f2\") "
Sep 17 14:13:49.089473 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:49.089279    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fcb8d5f1-2138-4e3c-a1a9-4539621578f2-bundle\") pod \"fcb8d5f1-2138-4e3c-a1a9-4539621578f2\" (UID: \"fcb8d5f1-2138-4e3c-a1a9-4539621578f2\") "
Sep 17 14:13:49.089977 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:49.089953    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcb8d5f1-2138-4e3c-a1a9-4539621578f2-bundle" (OuterVolumeSpecName: "bundle") pod "fcb8d5f1-2138-4e3c-a1a9-4539621578f2" (UID: "fcb8d5f1-2138-4e3c-a1a9-4539621578f2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:13:49.091520 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:49.091492    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcb8d5f1-2138-4e3c-a1a9-4539621578f2-kube-api-access-mjdtc" (OuterVolumeSpecName: "kube-api-access-mjdtc") pod "fcb8d5f1-2138-4e3c-a1a9-4539621578f2" (UID: "fcb8d5f1-2138-4e3c-a1a9-4539621578f2"). InnerVolumeSpecName "kube-api-access-mjdtc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:13:49.093334 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:49.093306    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcb8d5f1-2138-4e3c-a1a9-4539621578f2-util" (OuterVolumeSpecName: "util") pod "fcb8d5f1-2138-4e3c-a1a9-4539621578f2" (UID: "fcb8d5f1-2138-4e3c-a1a9-4539621578f2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:13:49.190874 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:49.190849    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fcb8d5f1-2138-4e3c-a1a9-4539621578f2-bundle\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:13:49.190874 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:49.190871    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fcb8d5f1-2138-4e3c-a1a9-4539621578f2-util\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:13:49.191029 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:49.190880    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjdtc\" (UniqueName: \"kubernetes.io/projected/fcb8d5f1-2138-4e3c-a1a9-4539621578f2-kube-api-access-mjdtc\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:13:49.857285 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:49.857257    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754066bgm"
Sep 17 14:13:49.857454 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:49.857287    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754066bgm" event={"ID":"fcb8d5f1-2138-4e3c-a1a9-4539621578f2","Type":"ContainerDied","Data":"1bbed6056abcf0c27ac3181386e71696cd5db5e5784c037572c3aa8c4f843648"}
Sep 17 14:13:49.857454 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:49.857327    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1bbed6056abcf0c27ac3181386e71696cd5db5e5784c037572c3aa8c4f843648"
Sep 17 14:13:56.186353 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:56.186314    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qfwfn"]
Sep 17 14:13:56.186777 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:56.186654    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcb8d5f1-2138-4e3c-a1a9-4539621578f2" containerName="util"
Sep 17 14:13:56.186777 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:56.186667    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcb8d5f1-2138-4e3c-a1a9-4539621578f2" containerName="util"
Sep 17 14:13:56.186777 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:56.186686    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcb8d5f1-2138-4e3c-a1a9-4539621578f2" containerName="pull"
Sep 17 14:13:56.186777 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:56.186691    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcb8d5f1-2138-4e3c-a1a9-4539621578f2" containerName="pull"
Sep 17 14:13:56.186777 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:56.186701    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcb8d5f1-2138-4e3c-a1a9-4539621578f2" containerName="extract"
Sep 17 14:13:56.186777 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:56.186706    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcb8d5f1-2138-4e3c-a1a9-4539621578f2" containerName="extract"
Sep 17 14:13:56.186777 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:56.186766    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcb8d5f1-2138-4e3c-a1a9-4539621578f2" containerName="extract"
Sep 17 14:13:56.188645 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:56.188630    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qfwfn"
Sep 17 14:13:56.191898 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:56.191880    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 17 14:13:56.192367 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:56.192351    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 17 14:13:56.197978 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:56.197957    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-cfd5l\""
Sep 17 14:13:56.279678 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:56.279646    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qfwfn"]
Sep 17 14:13:56.355432 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:56.355391    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30902c21-97e4-42ed-890f-5fe5ad806cdf-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qfwfn\" (UID: \"30902c21-97e4-42ed-890f-5fe5ad806cdf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qfwfn"
Sep 17 14:13:56.355629 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:56.355452    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bnnt\" (UniqueName: \"kubernetes.io/projected/30902c21-97e4-42ed-890f-5fe5ad806cdf-kube-api-access-6bnnt\") pod \"cert-manager-operator-controller-manager-55c444bf86-qfwfn\" (UID: \"30902c21-97e4-42ed-890f-5fe5ad806cdf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qfwfn"
Sep 17 14:13:56.456861 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:56.456823    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30902c21-97e4-42ed-890f-5fe5ad806cdf-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qfwfn\" (UID: \"30902c21-97e4-42ed-890f-5fe5ad806cdf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qfwfn"
Sep 17 14:13:56.457007 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:56.456875    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bnnt\" (UniqueName: \"kubernetes.io/projected/30902c21-97e4-42ed-890f-5fe5ad806cdf-kube-api-access-6bnnt\") pod \"cert-manager-operator-controller-manager-55c444bf86-qfwfn\" (UID: \"30902c21-97e4-42ed-890f-5fe5ad806cdf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qfwfn"
Sep 17 14:13:56.457256 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:56.457232    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30902c21-97e4-42ed-890f-5fe5ad806cdf-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qfwfn\" (UID: \"30902c21-97e4-42ed-890f-5fe5ad806cdf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qfwfn"
Sep 17 14:13:56.474465 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:56.474442    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bnnt\" (UniqueName: \"kubernetes.io/projected/30902c21-97e4-42ed-890f-5fe5ad806cdf-kube-api-access-6bnnt\") pod \"cert-manager-operator-controller-manager-55c444bf86-qfwfn\" (UID: \"30902c21-97e4-42ed-890f-5fe5ad806cdf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qfwfn"
Sep 17 14:13:56.498278 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:56.498237    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qfwfn"
Sep 17 14:13:56.775080 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:56.775053    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qfwfn"]
Sep 17 14:13:56.777411 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:13:56.777381    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30902c21_97e4_42ed_890f_5fe5ad806cdf.slice/crio-89798390bbfea805a11faca661974fab8c7c3762c5795534bccc124e1fc8a276 WatchSource:0}: Error finding container 89798390bbfea805a11faca661974fab8c7c3762c5795534bccc124e1fc8a276: Status 404 returned error can't find the container with id 89798390bbfea805a11faca661974fab8c7c3762c5795534bccc124e1fc8a276
Sep 17 14:13:56.886451 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:56.886415    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qfwfn" event={"ID":"30902c21-97e4-42ed-890f-5fe5ad806cdf","Type":"ContainerStarted","Data":"89798390bbfea805a11faca661974fab8c7c3762c5795534bccc124e1fc8a276"}
Sep 17 14:13:59.904385 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:59.904348    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qfwfn" event={"ID":"30902c21-97e4-42ed-890f-5fe5ad806cdf","Type":"ContainerStarted","Data":"1a595e9fd13a0537b7e7658267b15691c28b3f38ec74eda62eab2eb83fc25bdf"}
Sep 17 14:13:59.931415 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:13:59.931362    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qfwfn" podStartSLOduration=1.465002859 podStartE2EDuration="3.931346741s" totalImagesPullingTime="2.466343882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:13:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:13:59.928463869 +0000 UTC m=+427.372539456" watchObservedRunningTime="2026-09-17 14:13:59.931346741 +0000 UTC m=+427.375422327"
Sep 17 14:14:00.433097 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:00.433059    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-f8n7r"]
Sep 17 14:14:00.435372 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:00.435356    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-f8n7r"
Sep 17 14:14:00.439310 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:00.439284    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 17 14:14:00.439532 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:00.439517    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 17 14:14:00.455058 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:00.455034    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-f8n7r"]
Sep 17 14:14:00.491555 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:00.491517    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv8j5\" (UniqueName: \"kubernetes.io/projected/92f2e587-cf29-47ea-83c1-313900b6b0ea-kube-api-access-kv8j5\") pod \"cert-manager-webhook-6486ffd997-f8n7r\" (UID: \"92f2e587-cf29-47ea-83c1-313900b6b0ea\") " pod="cert-manager/cert-manager-webhook-6486ffd997-f8n7r"
Sep 17 14:14:00.491748 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:00.491590    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92f2e587-cf29-47ea-83c1-313900b6b0ea-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-f8n7r\" (UID: \"92f2e587-cf29-47ea-83c1-313900b6b0ea\") " pod="cert-manager/cert-manager-webhook-6486ffd997-f8n7r"
Sep 17 14:14:00.591995 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:00.591962    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92f2e587-cf29-47ea-83c1-313900b6b0ea-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-f8n7r\" (UID: \"92f2e587-cf29-47ea-83c1-313900b6b0ea\") " pod="cert-manager/cert-manager-webhook-6486ffd997-f8n7r"
Sep 17 14:14:00.592163 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:00.592015    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv8j5\" (UniqueName: \"kubernetes.io/projected/92f2e587-cf29-47ea-83c1-313900b6b0ea-kube-api-access-kv8j5\") pod \"cert-manager-webhook-6486ffd997-f8n7r\" (UID: \"92f2e587-cf29-47ea-83c1-313900b6b0ea\") " pod="cert-manager/cert-manager-webhook-6486ffd997-f8n7r"
Sep 17 14:14:00.619854 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:00.619822    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92f2e587-cf29-47ea-83c1-313900b6b0ea-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-f8n7r\" (UID: \"92f2e587-cf29-47ea-83c1-313900b6b0ea\") " pod="cert-manager/cert-manager-webhook-6486ffd997-f8n7r"
Sep 17 14:14:00.626680 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:00.626658    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv8j5\" (UniqueName: \"kubernetes.io/projected/92f2e587-cf29-47ea-83c1-313900b6b0ea-kube-api-access-kv8j5\") pod \"cert-manager-webhook-6486ffd997-f8n7r\" (UID: \"92f2e587-cf29-47ea-83c1-313900b6b0ea\") " pod="cert-manager/cert-manager-webhook-6486ffd997-f8n7r"
Sep 17 14:14:00.754984 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:00.754946    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-f8n7r"
Sep 17 14:14:00.920462 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:00.920428    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7txrp"]
Sep 17 14:14:00.945391 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:00.945361    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7txrp"
Sep 17 14:14:00.950105 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:00.950077    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 14:14:00.950579 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:00.950558    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q2vmb\""
Sep 17 14:14:00.951699 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:00.951660    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 14:14:00.994769 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:00.994705    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54833175-c17c-4866-930b-bf6c65dc2b42-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7txrp\" (UID: \"54833175-c17c-4866-930b-bf6c65dc2b42\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7txrp"
Sep 17 14:14:00.994936 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:00.994800    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54833175-c17c-4866-930b-bf6c65dc2b42-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7txrp\" (UID: \"54833175-c17c-4866-930b-bf6c65dc2b42\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7txrp"
Sep 17 14:14:00.994936 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:00.994829    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tvr2\" (UniqueName: \"kubernetes.io/projected/54833175-c17c-4866-930b-bf6c65dc2b42-kube-api-access-8tvr2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7txrp\" (UID: \"54833175-c17c-4866-930b-bf6c65dc2b42\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7txrp"
Sep 17 14:14:01.030742 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:01.030635    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7txrp"]
Sep 17 14:14:01.039882 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:01.039844    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-f8n7r"]
Sep 17 14:14:01.042866 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:14:01.042837    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92f2e587_cf29_47ea_83c1_313900b6b0ea.slice/crio-893ee452b962280a3ecdf01d6e16f8375e6eeea052fdfe4822f371477a2054e4 WatchSource:0}: Error finding container 893ee452b962280a3ecdf01d6e16f8375e6eeea052fdfe4822f371477a2054e4: Status 404 returned error can't find the container with id 893ee452b962280a3ecdf01d6e16f8375e6eeea052fdfe4822f371477a2054e4
Sep 17 14:14:01.095419 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:01.095375    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54833175-c17c-4866-930b-bf6c65dc2b42-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7txrp\" (UID: \"54833175-c17c-4866-930b-bf6c65dc2b42\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7txrp"
Sep 17 14:14:01.095562 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:01.095462    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54833175-c17c-4866-930b-bf6c65dc2b42-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7txrp\" (UID: \"54833175-c17c-4866-930b-bf6c65dc2b42\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7txrp"
Sep 17 14:14:01.095562 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:01.095497    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tvr2\" (UniqueName: \"kubernetes.io/projected/54833175-c17c-4866-930b-bf6c65dc2b42-kube-api-access-8tvr2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7txrp\" (UID: \"54833175-c17c-4866-930b-bf6c65dc2b42\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7txrp"
Sep 17 14:14:01.095886 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:01.095866    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54833175-c17c-4866-930b-bf6c65dc2b42-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7txrp\" (UID: \"54833175-c17c-4866-930b-bf6c65dc2b42\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7txrp"
Sep 17 14:14:01.095933 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:01.095877    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54833175-c17c-4866-930b-bf6c65dc2b42-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7txrp\" (UID: \"54833175-c17c-4866-930b-bf6c65dc2b42\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7txrp"
Sep 17 14:14:01.105267 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:01.105236    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tvr2\" (UniqueName: \"kubernetes.io/projected/54833175-c17c-4866-930b-bf6c65dc2b42-kube-api-access-8tvr2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7txrp\" (UID: \"54833175-c17c-4866-930b-bf6c65dc2b42\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7txrp"
Sep 17 14:14:01.260592 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:01.260556    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7txrp"
Sep 17 14:14:01.548196 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:01.548170    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7txrp"]
Sep 17 14:14:01.550449 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:14:01.550415    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54833175_c17c_4866_930b_bf6c65dc2b42.slice/crio-ce1f74311e5bf7e9863a54d0d2a1fa0c6b340b981b58e69d21fcb150e987aa8e WatchSource:0}: Error finding container ce1f74311e5bf7e9863a54d0d2a1fa0c6b340b981b58e69d21fcb150e987aa8e: Status 404 returned error can't find the container with id ce1f74311e5bf7e9863a54d0d2a1fa0c6b340b981b58e69d21fcb150e987aa8e
Sep 17 14:14:01.915162 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:01.915068    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-f8n7r" event={"ID":"92f2e587-cf29-47ea-83c1-313900b6b0ea","Type":"ContainerStarted","Data":"893ee452b962280a3ecdf01d6e16f8375e6eeea052fdfe4822f371477a2054e4"}
Sep 17 14:14:01.916515 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:01.916487    2580 generic.go:356] "Generic (PLEG): container finished" podID="54833175-c17c-4866-930b-bf6c65dc2b42" containerID="822f45e35eb87b084f124e9152605631c21a3e6ddf2bdf09741a1dfaf2355de6" exitCode=0
Sep 17 14:14:01.916630 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:01.916517    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7txrp" event={"ID":"54833175-c17c-4866-930b-bf6c65dc2b42","Type":"ContainerDied","Data":"822f45e35eb87b084f124e9152605631c21a3e6ddf2bdf09741a1dfaf2355de6"}
Sep 17 14:14:01.916630 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:01.916560    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7txrp" event={"ID":"54833175-c17c-4866-930b-bf6c65dc2b42","Type":"ContainerStarted","Data":"ce1f74311e5bf7e9863a54d0d2a1fa0c6b340b981b58e69d21fcb150e987aa8e"}
Sep 17 14:14:03.290924 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:03.290887    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-j7f9v"]
Sep 17 14:14:03.293900 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:03.293875    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-j7f9v"
Sep 17 14:14:03.298500 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:03.298476    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-2wm48\""
Sep 17 14:14:03.310657 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:03.310625    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hkdg\" (UniqueName: \"kubernetes.io/projected/5e82ea20-593a-4cc9-ac88-34fb5ddbf45e-kube-api-access-5hkdg\") pod \"cert-manager-cainjector-559cdd8c87-j7f9v\" (UID: \"5e82ea20-593a-4cc9-ac88-34fb5ddbf45e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j7f9v"
Sep 17 14:14:03.310819 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:03.310669    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e82ea20-593a-4cc9-ac88-34fb5ddbf45e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-j7f9v\" (UID: \"5e82ea20-593a-4cc9-ac88-34fb5ddbf45e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j7f9v"
Sep 17 14:14:03.316384 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:03.316349    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-j7f9v"]
Sep 17 14:14:03.411760 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:03.411701    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hkdg\" (UniqueName: \"kubernetes.io/projected/5e82ea20-593a-4cc9-ac88-34fb5ddbf45e-kube-api-access-5hkdg\") pod \"cert-manager-cainjector-559cdd8c87-j7f9v\" (UID: \"5e82ea20-593a-4cc9-ac88-34fb5ddbf45e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j7f9v"
Sep 17 14:14:03.411976 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:03.411774    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e82ea20-593a-4cc9-ac88-34fb5ddbf45e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-j7f9v\" (UID: \"5e82ea20-593a-4cc9-ac88-34fb5ddbf45e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j7f9v"
Sep 17 14:14:03.423634 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:03.423596    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5e82ea20-593a-4cc9-ac88-34fb5ddbf45e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-j7f9v\" (UID: \"5e82ea20-593a-4cc9-ac88-34fb5ddbf45e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j7f9v"
Sep 17 14:14:03.423831 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:03.423754    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hkdg\" (UniqueName: \"kubernetes.io/projected/5e82ea20-593a-4cc9-ac88-34fb5ddbf45e-kube-api-access-5hkdg\") pod \"cert-manager-cainjector-559cdd8c87-j7f9v\" (UID: \"5e82ea20-593a-4cc9-ac88-34fb5ddbf45e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j7f9v"
Sep 17 14:14:03.606286 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:03.606193    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-j7f9v"
Sep 17 14:14:04.934035 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:04.933995    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-f8n7r" event={"ID":"92f2e587-cf29-47ea-83c1-313900b6b0ea","Type":"ContainerStarted","Data":"2624459d7214c3c098049ff607c8b761e304216103b9c854b1eb2c8b2422e371"}
Sep 17 14:14:04.934402 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:04.934325    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-f8n7r"
Sep 17 14:14:04.936761 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:04.936729    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7txrp" event={"ID":"54833175-c17c-4866-930b-bf6c65dc2b42","Type":"ContainerStarted","Data":"48fc254b098ac22d09ccfa8018cecbc219912b577fbed03064445f81ba753f88"}
Sep 17 14:14:04.993299 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:04.993248    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-f8n7r" podStartSLOduration=1.225843835 podStartE2EDuration="4.993232324s" totalImagesPullingTime="3.767388489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:14:04.992586485 +0000 UTC m=+432.436662073" watchObservedRunningTime="2026-09-17 14:14:04.993232324 +0000 UTC m=+432.437307910"
Sep 17 14:14:05.099118 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:05.099036    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-j7f9v"]
Sep 17 14:14:05.101356 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:14:05.101326    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e82ea20_593a_4cc9_ac88_34fb5ddbf45e.slice/crio-6ad31bb09b3c1e26d7533c3745eb2b58d7099838842173100f733d6fc91a6d79 WatchSource:0}: Error finding container 6ad31bb09b3c1e26d7533c3745eb2b58d7099838842173100f733d6fc91a6d79: Status 404 returned error can't find the container with id 6ad31bb09b3c1e26d7533c3745eb2b58d7099838842173100f733d6fc91a6d79
Sep 17 14:14:05.943364 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:05.943327    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-j7f9v" event={"ID":"5e82ea20-593a-4cc9-ac88-34fb5ddbf45e","Type":"ContainerStarted","Data":"8749a54acf8ba00af3a4512b6bf35dbea4057e04360fad1ebb384f4e148bf6b6"}
Sep 17 14:14:05.943364 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:05.943372    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-j7f9v" event={"ID":"5e82ea20-593a-4cc9-ac88-34fb5ddbf45e","Type":"ContainerStarted","Data":"6ad31bb09b3c1e26d7533c3745eb2b58d7099838842173100f733d6fc91a6d79"}
Sep 17 14:14:05.945271 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:05.945245    2580 generic.go:356] "Generic (PLEG): container finished" podID="54833175-c17c-4866-930b-bf6c65dc2b42" containerID="48fc254b098ac22d09ccfa8018cecbc219912b577fbed03064445f81ba753f88" exitCode=0
Sep 17 14:14:05.945381 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:05.945331    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7txrp" event={"ID":"54833175-c17c-4866-930b-bf6c65dc2b42","Type":"ContainerDied","Data":"48fc254b098ac22d09ccfa8018cecbc219912b577fbed03064445f81ba753f88"}
Sep 17 14:14:05.969494 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:05.969452    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-j7f9v" podStartSLOduration=2.96943723 podStartE2EDuration="2.96943723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:14:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:14:05.966595768 +0000 UTC m=+433.410671355" watchObservedRunningTime="2026-09-17 14:14:05.96943723 +0000 UTC m=+433.413512816"
Sep 17 14:14:06.952271 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:06.952235    2580 generic.go:356] "Generic (PLEG): container finished" podID="54833175-c17c-4866-930b-bf6c65dc2b42" containerID="ea1861fddb64aa7f01ceb3d86cddbd7f68f8bc1ec8c2b8be17285c43bcceb5b6" exitCode=0
Sep 17 14:14:06.952737 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:06.952319    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7txrp" event={"ID":"54833175-c17c-4866-930b-bf6c65dc2b42","Type":"ContainerDied","Data":"ea1861fddb64aa7f01ceb3d86cddbd7f68f8bc1ec8c2b8be17285c43bcceb5b6"}
Sep 17 14:14:08.085608 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:08.085577    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7txrp"
Sep 17 14:14:08.145077 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:08.145042    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tvr2\" (UniqueName: \"kubernetes.io/projected/54833175-c17c-4866-930b-bf6c65dc2b42-kube-api-access-8tvr2\") pod \"54833175-c17c-4866-930b-bf6c65dc2b42\" (UID: \"54833175-c17c-4866-930b-bf6c65dc2b42\") "
Sep 17 14:14:08.145236 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:08.145157    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54833175-c17c-4866-930b-bf6c65dc2b42-util\") pod \"54833175-c17c-4866-930b-bf6c65dc2b42\" (UID: \"54833175-c17c-4866-930b-bf6c65dc2b42\") "
Sep 17 14:14:08.145236 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:08.145186    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54833175-c17c-4866-930b-bf6c65dc2b42-bundle\") pod \"54833175-c17c-4866-930b-bf6c65dc2b42\" (UID: \"54833175-c17c-4866-930b-bf6c65dc2b42\") "
Sep 17 14:14:08.145620 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:08.145578    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54833175-c17c-4866-930b-bf6c65dc2b42-bundle" (OuterVolumeSpecName: "bundle") pod "54833175-c17c-4866-930b-bf6c65dc2b42" (UID: "54833175-c17c-4866-930b-bf6c65dc2b42"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:14:08.147228 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:08.147206    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54833175-c17c-4866-930b-bf6c65dc2b42-kube-api-access-8tvr2" (OuterVolumeSpecName: "kube-api-access-8tvr2") pod "54833175-c17c-4866-930b-bf6c65dc2b42" (UID: "54833175-c17c-4866-930b-bf6c65dc2b42"). InnerVolumeSpecName "kube-api-access-8tvr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:14:08.149788 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:08.149767    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54833175-c17c-4866-930b-bf6c65dc2b42-util" (OuterVolumeSpecName: "util") pod "54833175-c17c-4866-930b-bf6c65dc2b42" (UID: "54833175-c17c-4866-930b-bf6c65dc2b42"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:14:08.246003 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:08.245921    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54833175-c17c-4866-930b-bf6c65dc2b42-util\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:14:08.246003 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:08.245949    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54833175-c17c-4866-930b-bf6c65dc2b42-bundle\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:14:08.246003 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:08.245959    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tvr2\" (UniqueName: \"kubernetes.io/projected/54833175-c17c-4866-930b-bf6c65dc2b42-kube-api-access-8tvr2\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:14:08.963222 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:08.963193    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7txrp"
Sep 17 14:14:08.963222 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:08.963214    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7txrp" event={"ID":"54833175-c17c-4866-930b-bf6c65dc2b42","Type":"ContainerDied","Data":"ce1f74311e5bf7e9863a54d0d2a1fa0c6b340b981b58e69d21fcb150e987aa8e"}
Sep 17 14:14:08.963429 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:08.963294    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce1f74311e5bf7e9863a54d0d2a1fa0c6b340b981b58e69d21fcb150e987aa8e"
Sep 17 14:14:10.948103 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:10.948075    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-f8n7r"
Sep 17 14:14:20.052892 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:20.052804    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqfhk7"]
Sep 17 14:14:20.053242 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:20.053125    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54833175-c17c-4866-930b-bf6c65dc2b42" containerName="util"
Sep 17 14:14:20.053242 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:20.053135    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="54833175-c17c-4866-930b-bf6c65dc2b42" containerName="util"
Sep 17 14:14:20.053242 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:20.053144    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54833175-c17c-4866-930b-bf6c65dc2b42" containerName="pull"
Sep 17 14:14:20.053242 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:20.053150    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="54833175-c17c-4866-930b-bf6c65dc2b42" containerName="pull"
Sep 17 14:14:20.053242 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:20.053173    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54833175-c17c-4866-930b-bf6c65dc2b42" containerName="extract"
Sep 17 14:14:20.053242 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:20.053178    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="54833175-c17c-4866-930b-bf6c65dc2b42" containerName="extract"
Sep 17 14:14:20.053242 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:20.053230    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="54833175-c17c-4866-930b-bf6c65dc2b42" containerName="extract"
Sep 17 14:14:20.069227 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:20.069196    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqfhk7"]
Sep 17 14:14:20.069359 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:20.069341    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqfhk7"
Sep 17 14:14:20.072482 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:20.072461    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 14:14:20.073744 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:20.073706    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 14:14:20.073882 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:20.073868    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q2vmb\""
Sep 17 14:14:20.129650 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:20.129617    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz7wt\" (UniqueName: \"kubernetes.io/projected/5a427075-f747-431b-aced-dfd49f13bd36-kube-api-access-vz7wt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqfhk7\" (UID: \"5a427075-f747-431b-aced-dfd49f13bd36\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqfhk7"
Sep 17 14:14:20.129872 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:20.129658    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a427075-f747-431b-aced-dfd49f13bd36-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqfhk7\" (UID: \"5a427075-f747-431b-aced-dfd49f13bd36\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqfhk7"
Sep 17 14:14:20.129872 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:20.129779    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a427075-f747-431b-aced-dfd49f13bd36-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqfhk7\" (UID: \"5a427075-f747-431b-aced-dfd49f13bd36\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqfhk7"
Sep 17 14:14:20.231114 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:20.231082    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a427075-f747-431b-aced-dfd49f13bd36-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqfhk7\" (UID: \"5a427075-f747-431b-aced-dfd49f13bd36\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqfhk7"
Sep 17 14:14:20.231268 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:20.231146    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a427075-f747-431b-aced-dfd49f13bd36-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqfhk7\" (UID: \"5a427075-f747-431b-aced-dfd49f13bd36\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqfhk7"
Sep 17 14:14:20.231268 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:20.231231    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz7wt\" (UniqueName: \"kubernetes.io/projected/5a427075-f747-431b-aced-dfd49f13bd36-kube-api-access-vz7wt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqfhk7\" (UID: \"5a427075-f747-431b-aced-dfd49f13bd36\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqfhk7"
Sep 17 14:14:20.231577 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:20.231555    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a427075-f747-431b-aced-dfd49f13bd36-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqfhk7\" (UID: \"5a427075-f747-431b-aced-dfd49f13bd36\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqfhk7"
Sep 17 14:14:20.231633 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:20.231563    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a427075-f747-431b-aced-dfd49f13bd36-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqfhk7\" (UID: \"5a427075-f747-431b-aced-dfd49f13bd36\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqfhk7"
Sep 17 14:14:20.241736 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:20.241685    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz7wt\" (UniqueName: \"kubernetes.io/projected/5a427075-f747-431b-aced-dfd49f13bd36-kube-api-access-vz7wt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqfhk7\" (UID: \"5a427075-f747-431b-aced-dfd49f13bd36\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqfhk7"
Sep 17 14:14:20.379200 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:20.379107    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqfhk7"
Sep 17 14:14:20.663559 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:20.663533    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqfhk7"]
Sep 17 14:14:20.665682 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:14:20.665655    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a427075_f747_431b_aced_dfd49f13bd36.slice/crio-e379b2f7644dfccfbc18d97a8883bb305d5ce867daebc596ffdc0a9fc456b81d WatchSource:0}: Error finding container e379b2f7644dfccfbc18d97a8883bb305d5ce867daebc596ffdc0a9fc456b81d: Status 404 returned error can't find the container with id e379b2f7644dfccfbc18d97a8883bb305d5ce867daebc596ffdc0a9fc456b81d
Sep 17 14:14:21.019196 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:21.019160    2580 generic.go:356] "Generic (PLEG): container finished" podID="5a427075-f747-431b-aced-dfd49f13bd36" containerID="810da676d578b4c18caac336c86b4386eb95536739a63634999f44fd7b8ea2e4" exitCode=0
Sep 17 14:14:21.019406 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:21.019213    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqfhk7" event={"ID":"5a427075-f747-431b-aced-dfd49f13bd36","Type":"ContainerDied","Data":"810da676d578b4c18caac336c86b4386eb95536739a63634999f44fd7b8ea2e4"}
Sep 17 14:14:21.019406 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:21.019283    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqfhk7" event={"ID":"5a427075-f747-431b-aced-dfd49f13bd36","Type":"ContainerStarted","Data":"e379b2f7644dfccfbc18d97a8883bb305d5ce867daebc596ffdc0a9fc456b81d"}
Sep 17 14:14:22.027427 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:22.027330    2580 generic.go:356] "Generic (PLEG): container finished" podID="5a427075-f747-431b-aced-dfd49f13bd36" containerID="b45ae3bf326e4a94c3d7f24f646eeeb09ab2bebc856eaf4fc16f7924f01cbba5" exitCode=0
Sep 17 14:14:22.027825 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:22.027415    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqfhk7" event={"ID":"5a427075-f747-431b-aced-dfd49f13bd36","Type":"ContainerDied","Data":"b45ae3bf326e4a94c3d7f24f646eeeb09ab2bebc856eaf4fc16f7924f01cbba5"}
Sep 17 14:14:23.035986 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:23.035953    2580 generic.go:356] "Generic (PLEG): container finished" podID="5a427075-f747-431b-aced-dfd49f13bd36" containerID="4c0dc5d61e81e962f4704a8d8c64731c001d2fa4128e430d6afa83b218a387ce" exitCode=0
Sep 17 14:14:23.036366 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:23.036105    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqfhk7" event={"ID":"5a427075-f747-431b-aced-dfd49f13bd36","Type":"ContainerDied","Data":"4c0dc5d61e81e962f4704a8d8c64731c001d2fa4128e430d6afa83b218a387ce"}
Sep 17 14:14:24.169786 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:24.169758    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqfhk7"
Sep 17 14:14:24.265088 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:24.265048    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a427075-f747-431b-aced-dfd49f13bd36-util\") pod \"5a427075-f747-431b-aced-dfd49f13bd36\" (UID: \"5a427075-f747-431b-aced-dfd49f13bd36\") "
Sep 17 14:14:24.265088 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:24.265093    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a427075-f747-431b-aced-dfd49f13bd36-bundle\") pod \"5a427075-f747-431b-aced-dfd49f13bd36\" (UID: \"5a427075-f747-431b-aced-dfd49f13bd36\") "
Sep 17 14:14:24.265302 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:24.265137    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vz7wt\" (UniqueName: \"kubernetes.io/projected/5a427075-f747-431b-aced-dfd49f13bd36-kube-api-access-vz7wt\") pod \"5a427075-f747-431b-aced-dfd49f13bd36\" (UID: \"5a427075-f747-431b-aced-dfd49f13bd36\") "
Sep 17 14:14:24.265876 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:24.265846    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a427075-f747-431b-aced-dfd49f13bd36-bundle" (OuterVolumeSpecName: "bundle") pod "5a427075-f747-431b-aced-dfd49f13bd36" (UID: "5a427075-f747-431b-aced-dfd49f13bd36"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:14:24.267331 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:24.267306    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a427075-f747-431b-aced-dfd49f13bd36-kube-api-access-vz7wt" (OuterVolumeSpecName: "kube-api-access-vz7wt") pod "5a427075-f747-431b-aced-dfd49f13bd36" (UID: "5a427075-f747-431b-aced-dfd49f13bd36"). InnerVolumeSpecName "kube-api-access-vz7wt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:14:24.270688 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:24.270640    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a427075-f747-431b-aced-dfd49f13bd36-util" (OuterVolumeSpecName: "util") pod "5a427075-f747-431b-aced-dfd49f13bd36" (UID: "5a427075-f747-431b-aced-dfd49f13bd36"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:14:24.366415 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:24.366334    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a427075-f747-431b-aced-dfd49f13bd36-util\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:14:24.366415 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:24.366366    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a427075-f747-431b-aced-dfd49f13bd36-bundle\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:14:24.366415 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:24.366375    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vz7wt\" (UniqueName: \"kubernetes.io/projected/5a427075-f747-431b-aced-dfd49f13bd36-kube-api-access-vz7wt\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:14:25.047957 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:25.047917    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqfhk7" event={"ID":"5a427075-f747-431b-aced-dfd49f13bd36","Type":"ContainerDied","Data":"e379b2f7644dfccfbc18d97a8883bb305d5ce867daebc596ffdc0a9fc456b81d"}
Sep 17 14:14:25.047957 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:25.047952    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqfhk7"
Sep 17 14:14:25.048164 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:25.047999    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e379b2f7644dfccfbc18d97a8883bb305d5ce867daebc596ffdc0a9fc456b81d"
Sep 17 14:14:37.062858 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.062824    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dbvq9"]
Sep 17 14:14:37.063404 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.063296    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a427075-f747-431b-aced-dfd49f13bd36" containerName="util"
Sep 17 14:14:37.063404 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.063316    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a427075-f747-431b-aced-dfd49f13bd36" containerName="util"
Sep 17 14:14:37.063404 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.063345    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a427075-f747-431b-aced-dfd49f13bd36" containerName="pull"
Sep 17 14:14:37.063404 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.063354    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a427075-f747-431b-aced-dfd49f13bd36" containerName="pull"
Sep 17 14:14:37.063404 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.063373    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a427075-f747-431b-aced-dfd49f13bd36" containerName="extract"
Sep 17 14:14:37.063404 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.063383    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a427075-f747-431b-aced-dfd49f13bd36" containerName="extract"
Sep 17 14:14:37.063732 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.063465    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a427075-f747-431b-aced-dfd49f13bd36" containerName="extract"
Sep 17 14:14:37.068103 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.068082    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dbvq9"
Sep 17 14:14:37.071209 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.071183    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 14:14:37.072593 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.072573    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 14:14:37.072702 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.072573    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q2vmb\""
Sep 17 14:14:37.078114 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.078093    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dbvq9"]
Sep 17 14:14:37.172381 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.172340    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xjlj\" (UniqueName: \"kubernetes.io/projected/2560903c-2d46-4051-a8c1-a16e766de829-kube-api-access-7xjlj\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dbvq9\" (UID: \"2560903c-2d46-4051-a8c1-a16e766de829\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dbvq9"
Sep 17 14:14:37.172580 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.172400    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2560903c-2d46-4051-a8c1-a16e766de829-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dbvq9\" (UID: \"2560903c-2d46-4051-a8c1-a16e766de829\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dbvq9"
Sep 17 14:14:37.172580 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.172487    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2560903c-2d46-4051-a8c1-a16e766de829-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dbvq9\" (UID: \"2560903c-2d46-4051-a8c1-a16e766de829\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dbvq9"
Sep 17 14:14:37.273896 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.273851    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xjlj\" (UniqueName: \"kubernetes.io/projected/2560903c-2d46-4051-a8c1-a16e766de829-kube-api-access-7xjlj\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dbvq9\" (UID: \"2560903c-2d46-4051-a8c1-a16e766de829\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dbvq9"
Sep 17 14:14:37.274071 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.273922    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2560903c-2d46-4051-a8c1-a16e766de829-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dbvq9\" (UID: \"2560903c-2d46-4051-a8c1-a16e766de829\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dbvq9"
Sep 17 14:14:37.274071 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.273958    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2560903c-2d46-4051-a8c1-a16e766de829-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dbvq9\" (UID: \"2560903c-2d46-4051-a8c1-a16e766de829\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dbvq9"
Sep 17 14:14:37.274312 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.274296    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2560903c-2d46-4051-a8c1-a16e766de829-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dbvq9\" (UID: \"2560903c-2d46-4051-a8c1-a16e766de829\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dbvq9"
Sep 17 14:14:37.274402 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.274382    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2560903c-2d46-4051-a8c1-a16e766de829-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dbvq9\" (UID: \"2560903c-2d46-4051-a8c1-a16e766de829\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dbvq9"
Sep 17 14:14:37.293406 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.293375    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xjlj\" (UniqueName: \"kubernetes.io/projected/2560903c-2d46-4051-a8c1-a16e766de829-kube-api-access-7xjlj\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dbvq9\" (UID: \"2560903c-2d46-4051-a8c1-a16e766de829\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dbvq9"
Sep 17 14:14:37.296265 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.296241    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-569db487f9-4v4d8"]
Sep 17 14:14:37.300530 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.300505    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-569db487f9-4v4d8"
Sep 17 14:14:37.304093 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.304072    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 17 14:14:37.304583 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.304560    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 17 14:14:37.304583 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.304579    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 17 14:14:37.304753 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.304660    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 17 14:14:37.304753 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.304672    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fx4tc\""
Sep 17 14:14:37.339078 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.339003    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-569db487f9-4v4d8"]
Sep 17 14:14:37.374962 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.374924    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8txw\" (UniqueName: \"kubernetes.io/projected/ed27d2df-c7e1-438c-8c97-213b6c717b1d-kube-api-access-q8txw\") pod \"opendatahub-operator-controller-manager-569db487f9-4v4d8\" (UID: \"ed27d2df-c7e1-438c-8c97-213b6c717b1d\") " pod="opendatahub/opendatahub-operator-controller-manager-569db487f9-4v4d8"
Sep 17 14:14:37.375160 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.374997    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed27d2df-c7e1-438c-8c97-213b6c717b1d-tmp\") pod \"opendatahub-operator-controller-manager-569db487f9-4v4d8\" (UID: \"ed27d2df-c7e1-438c-8c97-213b6c717b1d\") " pod="opendatahub/opendatahub-operator-controller-manager-569db487f9-4v4d8"
Sep 17 14:14:37.375160 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.375018    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ed27d2df-c7e1-438c-8c97-213b6c717b1d-webhook-cert\") pod \"opendatahub-operator-controller-manager-569db487f9-4v4d8\" (UID: \"ed27d2df-c7e1-438c-8c97-213b6c717b1d\") " pod="opendatahub/opendatahub-operator-controller-manager-569db487f9-4v4d8"
Sep 17 14:14:37.375160 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.375052    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ed27d2df-c7e1-438c-8c97-213b6c717b1d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-569db487f9-4v4d8\" (UID: \"ed27d2df-c7e1-438c-8c97-213b6c717b1d\") " pod="opendatahub/opendatahub-operator-controller-manager-569db487f9-4v4d8"
Sep 17 14:14:37.375160 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.375080    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ed27d2df-c7e1-438c-8c97-213b6c717b1d-manifests\") pod \"opendatahub-operator-controller-manager-569db487f9-4v4d8\" (UID: \"ed27d2df-c7e1-438c-8c97-213b6c717b1d\") " pod="opendatahub/opendatahub-operator-controller-manager-569db487f9-4v4d8"
Sep 17 14:14:37.378806 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.378784    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dbvq9"
Sep 17 14:14:37.476456 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.476421    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ed27d2df-c7e1-438c-8c97-213b6c717b1d-webhook-cert\") pod \"opendatahub-operator-controller-manager-569db487f9-4v4d8\" (UID: \"ed27d2df-c7e1-438c-8c97-213b6c717b1d\") " pod="opendatahub/opendatahub-operator-controller-manager-569db487f9-4v4d8"
Sep 17 14:14:37.476639 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.476475    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ed27d2df-c7e1-438c-8c97-213b6c717b1d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-569db487f9-4v4d8\" (UID: \"ed27d2df-c7e1-438c-8c97-213b6c717b1d\") " pod="opendatahub/opendatahub-operator-controller-manager-569db487f9-4v4d8"
Sep 17 14:14:37.476639 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.476497    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ed27d2df-c7e1-438c-8c97-213b6c717b1d-manifests\") pod \"opendatahub-operator-controller-manager-569db487f9-4v4d8\" (UID: \"ed27d2df-c7e1-438c-8c97-213b6c717b1d\") " pod="opendatahub/opendatahub-operator-controller-manager-569db487f9-4v4d8"
Sep 17 14:14:37.476639 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.476530    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8txw\" (UniqueName: \"kubernetes.io/projected/ed27d2df-c7e1-438c-8c97-213b6c717b1d-kube-api-access-q8txw\") pod \"opendatahub-operator-controller-manager-569db487f9-4v4d8\" (UID: \"ed27d2df-c7e1-438c-8c97-213b6c717b1d\") " pod="opendatahub/opendatahub-operator-controller-manager-569db487f9-4v4d8"
Sep 17 14:14:37.476639 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.476573    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed27d2df-c7e1-438c-8c97-213b6c717b1d-tmp\") pod \"opendatahub-operator-controller-manager-569db487f9-4v4d8\" (UID: \"ed27d2df-c7e1-438c-8c97-213b6c717b1d\") " pod="opendatahub/opendatahub-operator-controller-manager-569db487f9-4v4d8"
Sep 17 14:14:37.476938 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.476915    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ed27d2df-c7e1-438c-8c97-213b6c717b1d-manifests\") pod \"opendatahub-operator-controller-manager-569db487f9-4v4d8\" (UID: \"ed27d2df-c7e1-438c-8c97-213b6c717b1d\") " pod="opendatahub/opendatahub-operator-controller-manager-569db487f9-4v4d8"
Sep 17 14:14:37.478861 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.478833    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed27d2df-c7e1-438c-8c97-213b6c717b1d-tmp\") pod \"opendatahub-operator-controller-manager-569db487f9-4v4d8\" (UID: \"ed27d2df-c7e1-438c-8c97-213b6c717b1d\") " pod="opendatahub/opendatahub-operator-controller-manager-569db487f9-4v4d8"
Sep 17 14:14:37.478986 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.478969    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ed27d2df-c7e1-438c-8c97-213b6c717b1d-webhook-cert\") pod \"opendatahub-operator-controller-manager-569db487f9-4v4d8\" (UID: \"ed27d2df-c7e1-438c-8c97-213b6c717b1d\") " pod="opendatahub/opendatahub-operator-controller-manager-569db487f9-4v4d8"
Sep 17 14:14:37.479054 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.479037    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ed27d2df-c7e1-438c-8c97-213b6c717b1d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-569db487f9-4v4d8\" (UID: \"ed27d2df-c7e1-438c-8c97-213b6c717b1d\") " pod="opendatahub/opendatahub-operator-controller-manager-569db487f9-4v4d8"
Sep 17 14:14:37.489262 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.489235    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8txw\" (UniqueName: \"kubernetes.io/projected/ed27d2df-c7e1-438c-8c97-213b6c717b1d-kube-api-access-q8txw\") pod \"opendatahub-operator-controller-manager-569db487f9-4v4d8\" (UID: \"ed27d2df-c7e1-438c-8c97-213b6c717b1d\") " pod="opendatahub/opendatahub-operator-controller-manager-569db487f9-4v4d8"
Sep 17 14:14:37.611733 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.611617    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-569db487f9-4v4d8"
Sep 17 14:14:37.672774 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.672511    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dbvq9"]
Sep 17 14:14:37.675616 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:14:37.675587    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2560903c_2d46_4051_a8c1_a16e766de829.slice/crio-67fcbda95d24820b52e6e1e3fb52e2e811b747454b4d20cf0f7cdfd4e87835d2 WatchSource:0}: Error finding container 67fcbda95d24820b52e6e1e3fb52e2e811b747454b4d20cf0f7cdfd4e87835d2: Status 404 returned error can't find the container with id 67fcbda95d24820b52e6e1e3fb52e2e811b747454b4d20cf0f7cdfd4e87835d2
Sep 17 14:14:37.895566 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:37.895482    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-569db487f9-4v4d8"]
Sep 17 14:14:37.898887 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:14:37.898861    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded27d2df_c7e1_438c_8c97_213b6c717b1d.slice/crio-a10cff5e949c5e2462533768cfdcf63e7ab860f199a8fd081d175c98046b2e06 WatchSource:0}: Error finding container a10cff5e949c5e2462533768cfdcf63e7ab860f199a8fd081d175c98046b2e06: Status 404 returned error can't find the container with id a10cff5e949c5e2462533768cfdcf63e7ab860f199a8fd081d175c98046b2e06
Sep 17 14:14:38.112300 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:38.112265    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-569db487f9-4v4d8" event={"ID":"ed27d2df-c7e1-438c-8c97-213b6c717b1d","Type":"ContainerStarted","Data":"a10cff5e949c5e2462533768cfdcf63e7ab860f199a8fd081d175c98046b2e06"}
Sep 17 14:14:38.113907 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:38.113877    2580 generic.go:356] "Generic (PLEG): container finished" podID="2560903c-2d46-4051-a8c1-a16e766de829" containerID="fd984d3e459baa977e4a25a39bdbcab280ab7113850919cc872369fb3140098f" exitCode=0
Sep 17 14:14:38.114036 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:38.113932    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dbvq9" event={"ID":"2560903c-2d46-4051-a8c1-a16e766de829","Type":"ContainerDied","Data":"fd984d3e459baa977e4a25a39bdbcab280ab7113850919cc872369fb3140098f"}
Sep 17 14:14:38.114036 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:38.113976    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dbvq9" event={"ID":"2560903c-2d46-4051-a8c1-a16e766de829","Type":"ContainerStarted","Data":"67fcbda95d24820b52e6e1e3fb52e2e811b747454b4d20cf0f7cdfd4e87835d2"}
Sep 17 14:14:39.124554 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:39.124467    2580 generic.go:356] "Generic (PLEG): container finished" podID="2560903c-2d46-4051-a8c1-a16e766de829" containerID="9a98785526bda79bf34c941daa8f99763fe823f16d751ed50a3a40fcf6cda13c" exitCode=0
Sep 17 14:14:39.125028 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:39.124557    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dbvq9" event={"ID":"2560903c-2d46-4051-a8c1-a16e766de829","Type":"ContainerDied","Data":"9a98785526bda79bf34c941daa8f99763fe823f16d751ed50a3a40fcf6cda13c"}
Sep 17 14:14:40.132622 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:40.132577    2580 generic.go:356] "Generic (PLEG): container finished" podID="2560903c-2d46-4051-a8c1-a16e766de829" containerID="fd26644a2167a8c19138d78ad7131e564fedc8a6b06d1b27d655018d443283c3" exitCode=0
Sep 17 14:14:40.133064 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:40.132650    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dbvq9" event={"ID":"2560903c-2d46-4051-a8c1-a16e766de829","Type":"ContainerDied","Data":"fd26644a2167a8c19138d78ad7131e564fedc8a6b06d1b27d655018d443283c3"}
Sep 17 14:14:41.146040 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:41.145934    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-569db487f9-4v4d8" event={"ID":"ed27d2df-c7e1-438c-8c97-213b6c717b1d","Type":"ContainerStarted","Data":"e0604eca0e14520f484e74b7a583441f57af9698ad4c41859c05e81433361e1f"}
Sep 17 14:14:41.277661 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:41.277633    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dbvq9"
Sep 17 14:14:41.417690 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:41.417597    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2560903c-2d46-4051-a8c1-a16e766de829-util\") pod \"2560903c-2d46-4051-a8c1-a16e766de829\" (UID: \"2560903c-2d46-4051-a8c1-a16e766de829\") "
Sep 17 14:14:41.417858 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:41.417786    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xjlj\" (UniqueName: \"kubernetes.io/projected/2560903c-2d46-4051-a8c1-a16e766de829-kube-api-access-7xjlj\") pod \"2560903c-2d46-4051-a8c1-a16e766de829\" (UID: \"2560903c-2d46-4051-a8c1-a16e766de829\") "
Sep 17 14:14:41.417858 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:41.417807    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2560903c-2d46-4051-a8c1-a16e766de829-bundle\") pod \"2560903c-2d46-4051-a8c1-a16e766de829\" (UID: \"2560903c-2d46-4051-a8c1-a16e766de829\") "
Sep 17 14:14:41.418768 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:41.418743    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2560903c-2d46-4051-a8c1-a16e766de829-bundle" (OuterVolumeSpecName: "bundle") pod "2560903c-2d46-4051-a8c1-a16e766de829" (UID: "2560903c-2d46-4051-a8c1-a16e766de829"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:14:41.419975 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:41.419949    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2560903c-2d46-4051-a8c1-a16e766de829-kube-api-access-7xjlj" (OuterVolumeSpecName: "kube-api-access-7xjlj") pod "2560903c-2d46-4051-a8c1-a16e766de829" (UID: "2560903c-2d46-4051-a8c1-a16e766de829"). InnerVolumeSpecName "kube-api-access-7xjlj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:14:41.423144 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:41.423124    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2560903c-2d46-4051-a8c1-a16e766de829-util" (OuterVolumeSpecName: "util") pod "2560903c-2d46-4051-a8c1-a16e766de829" (UID: "2560903c-2d46-4051-a8c1-a16e766de829"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:14:41.518537 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:41.518497    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xjlj\" (UniqueName: \"kubernetes.io/projected/2560903c-2d46-4051-a8c1-a16e766de829-kube-api-access-7xjlj\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:14:41.518537 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:41.518530    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2560903c-2d46-4051-a8c1-a16e766de829-bundle\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:14:41.518537 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:41.518540    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2560903c-2d46-4051-a8c1-a16e766de829-util\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:14:42.152513 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:42.152482    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dbvq9"
Sep 17 14:14:42.152958 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:42.152481    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dbvq9" event={"ID":"2560903c-2d46-4051-a8c1-a16e766de829","Type":"ContainerDied","Data":"67fcbda95d24820b52e6e1e3fb52e2e811b747454b4d20cf0f7cdfd4e87835d2"}
Sep 17 14:14:42.152958 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:42.152610    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67fcbda95d24820b52e6e1e3fb52e2e811b747454b4d20cf0f7cdfd4e87835d2"
Sep 17 14:14:42.154275 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:42.154248    2580 generic.go:356] "Generic (PLEG): container finished" podID="ed27d2df-c7e1-438c-8c97-213b6c717b1d" containerID="e0604eca0e14520f484e74b7a583441f57af9698ad4c41859c05e81433361e1f" exitCode=0
Sep 17 14:14:42.154430 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:42.154312    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-569db487f9-4v4d8" event={"ID":"ed27d2df-c7e1-438c-8c97-213b6c717b1d","Type":"ContainerDied","Data":"e0604eca0e14520f484e74b7a583441f57af9698ad4c41859c05e81433361e1f"}
Sep 17 14:14:43.162911 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:43.162872    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-569db487f9-4v4d8" event={"ID":"ed27d2df-c7e1-438c-8c97-213b6c717b1d","Type":"ContainerStarted","Data":"ff823bbc4bb53b818db7a5340955d96b402f706ee71e3d20609f926f819ef103"}
Sep 17 14:14:43.163293 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:43.162996    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-569db487f9-4v4d8"
Sep 17 14:14:43.205422 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:43.205368    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-569db487f9-4v4d8" podStartSLOduration=1.805366798 podStartE2EDuration="6.205348809s" totalImagesPullingTime="3.369640498s" totalInitContainerRuntime="1.030341513s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:14:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:14:43.203840724 +0000 UTC m=+470.647916328" watchObservedRunningTime="2026-09-17 14:14:43.205348809 +0000 UTC m=+470.649424397"
Sep 17 14:14:54.170157 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:54.170120    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-569db487f9-4v4d8"
Sep 17 14:14:55.574484 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:55.574447    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-77fdd77d78-b8jvn"]
Sep 17 14:14:55.574881 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:55.574820    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2560903c-2d46-4051-a8c1-a16e766de829" containerName="util"
Sep 17 14:14:55.574881 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:55.574832    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2560903c-2d46-4051-a8c1-a16e766de829" containerName="util"
Sep 17 14:14:55.574881 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:55.574844    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2560903c-2d46-4051-a8c1-a16e766de829" containerName="extract"
Sep 17 14:14:55.574881 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:55.574850    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2560903c-2d46-4051-a8c1-a16e766de829" containerName="extract"
Sep 17 14:14:55.574881 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:55.574857    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2560903c-2d46-4051-a8c1-a16e766de829" containerName="pull"
Sep 17 14:14:55.574881 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:55.574864    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2560903c-2d46-4051-a8c1-a16e766de829" containerName="pull"
Sep 17 14:14:55.575059 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:55.574916    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2560903c-2d46-4051-a8c1-a16e766de829" containerName="extract"
Sep 17 14:14:55.579302 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:55.579281    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-77fdd77d78-b8jvn"
Sep 17 14:14:55.584112 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:55.584088    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 17 14:14:55.584112 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:55.584104    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gbr9s\""
Sep 17 14:14:55.584318 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:55.584116    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 17 14:14:55.584318 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:55.584147    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 17 14:14:55.584318 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:55.584207    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 17 14:14:55.584525 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:55.584509    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 17 14:14:55.598512 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:55.598482    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-77fdd77d78-b8jvn"]
Sep 17 14:14:55.741706 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:55.741664    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b8826d0-3e55-423e-a386-02741cdf07c9-cert\") pod \"lws-controller-manager-77fdd77d78-b8jvn\" (UID: \"5b8826d0-3e55-423e-a386-02741cdf07c9\") " pod="openshift-lws-operator/lws-controller-manager-77fdd77d78-b8jvn"
Sep 17 14:14:55.741932 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:55.741768    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5b8826d0-3e55-423e-a386-02741cdf07c9-manager-config\") pod \"lws-controller-manager-77fdd77d78-b8jvn\" (UID: \"5b8826d0-3e55-423e-a386-02741cdf07c9\") " pod="openshift-lws-operator/lws-controller-manager-77fdd77d78-b8jvn"
Sep 17 14:14:55.741932 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:55.741791    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b8826d0-3e55-423e-a386-02741cdf07c9-metrics-cert\") pod \"lws-controller-manager-77fdd77d78-b8jvn\" (UID: \"5b8826d0-3e55-423e-a386-02741cdf07c9\") " pod="openshift-lws-operator/lws-controller-manager-77fdd77d78-b8jvn"
Sep 17 14:14:55.741932 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:55.741809    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tlmq\" (UniqueName: \"kubernetes.io/projected/5b8826d0-3e55-423e-a386-02741cdf07c9-kube-api-access-4tlmq\") pod \"lws-controller-manager-77fdd77d78-b8jvn\" (UID: \"5b8826d0-3e55-423e-a386-02741cdf07c9\") " pod="openshift-lws-operator/lws-controller-manager-77fdd77d78-b8jvn"
Sep 17 14:14:55.843279 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:55.843169    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b8826d0-3e55-423e-a386-02741cdf07c9-cert\") pod \"lws-controller-manager-77fdd77d78-b8jvn\" (UID: \"5b8826d0-3e55-423e-a386-02741cdf07c9\") " pod="openshift-lws-operator/lws-controller-manager-77fdd77d78-b8jvn"
Sep 17 14:14:55.843279 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:55.843243    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5b8826d0-3e55-423e-a386-02741cdf07c9-manager-config\") pod \"lws-controller-manager-77fdd77d78-b8jvn\" (UID: \"5b8826d0-3e55-423e-a386-02741cdf07c9\") " pod="openshift-lws-operator/lws-controller-manager-77fdd77d78-b8jvn"
Sep 17 14:14:55.843279 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:55.843272    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b8826d0-3e55-423e-a386-02741cdf07c9-metrics-cert\") pod \"lws-controller-manager-77fdd77d78-b8jvn\" (UID: \"5b8826d0-3e55-423e-a386-02741cdf07c9\") " pod="openshift-lws-operator/lws-controller-manager-77fdd77d78-b8jvn"
Sep 17 14:14:55.843558 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:55.843296    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tlmq\" (UniqueName: \"kubernetes.io/projected/5b8826d0-3e55-423e-a386-02741cdf07c9-kube-api-access-4tlmq\") pod \"lws-controller-manager-77fdd77d78-b8jvn\" (UID: \"5b8826d0-3e55-423e-a386-02741cdf07c9\") " pod="openshift-lws-operator/lws-controller-manager-77fdd77d78-b8jvn"
Sep 17 14:14:55.843880 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:55.843849    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5b8826d0-3e55-423e-a386-02741cdf07c9-manager-config\") pod \"lws-controller-manager-77fdd77d78-b8jvn\" (UID: \"5b8826d0-3e55-423e-a386-02741cdf07c9\") " pod="openshift-lws-operator/lws-controller-manager-77fdd77d78-b8jvn"
Sep 17 14:14:55.845775 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:55.845756    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b8826d0-3e55-423e-a386-02741cdf07c9-metrics-cert\") pod \"lws-controller-manager-77fdd77d78-b8jvn\" (UID: \"5b8826d0-3e55-423e-a386-02741cdf07c9\") " pod="openshift-lws-operator/lws-controller-manager-77fdd77d78-b8jvn"
Sep 17 14:14:55.845942 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:55.845921    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b8826d0-3e55-423e-a386-02741cdf07c9-cert\") pod \"lws-controller-manager-77fdd77d78-b8jvn\" (UID: \"5b8826d0-3e55-423e-a386-02741cdf07c9\") " pod="openshift-lws-operator/lws-controller-manager-77fdd77d78-b8jvn"
Sep 17 14:14:55.852968 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:55.852942    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tlmq\" (UniqueName: \"kubernetes.io/projected/5b8826d0-3e55-423e-a386-02741cdf07c9-kube-api-access-4tlmq\") pod \"lws-controller-manager-77fdd77d78-b8jvn\" (UID: \"5b8826d0-3e55-423e-a386-02741cdf07c9\") " pod="openshift-lws-operator/lws-controller-manager-77fdd77d78-b8jvn"
Sep 17 14:14:55.888670 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:55.888628    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-77fdd77d78-b8jvn"
Sep 17 14:14:56.196505 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:56.196479    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-77fdd77d78-b8jvn"]
Sep 17 14:14:56.197492 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:14:56.197460    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b8826d0_3e55_423e_a386_02741cdf07c9.slice/crio-abbd299cfa0a1cf8100461be362fb3b7d43f87d453a36adb1ee6e2efce79e50c WatchSource:0}: Error finding container abbd299cfa0a1cf8100461be362fb3b7d43f87d453a36adb1ee6e2efce79e50c: Status 404 returned error can't find the container with id abbd299cfa0a1cf8100461be362fb3b7d43f87d453a36adb1ee6e2efce79e50c
Sep 17 14:14:56.235578 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:56.235541    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-77fdd77d78-b8jvn" event={"ID":"5b8826d0-3e55-423e-a386-02741cdf07c9","Type":"ContainerStarted","Data":"abbd299cfa0a1cf8100461be362fb3b7d43f87d453a36adb1ee6e2efce79e50c"}
Sep 17 14:14:57.435028 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:57.434991    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-549869464b-8trnz"]
Sep 17 14:14:57.439040 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:57.439009    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-549869464b-8trnz"
Sep 17 14:14:57.443115 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:57.443045    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 17 14:14:57.444468 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:57.444439    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-42sv6\""
Sep 17 14:14:57.444570 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:57.444484    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 17 14:14:57.444610 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:57.444568    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 17 14:14:57.444640 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:57.444484    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 17 14:14:57.455046 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:57.455021    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-549869464b-8trnz"]
Sep 17 14:14:57.557142 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:57.557105    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b3109f3-8292-43ba-aad9-815a04c0776f-tmp\") pod \"kube-auth-proxy-549869464b-8trnz\" (UID: \"4b3109f3-8292-43ba-aad9-815a04c0776f\") " pod="openshift-ingress/kube-auth-proxy-549869464b-8trnz"
Sep 17 14:14:57.557290 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:57.557181    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b3109f3-8292-43ba-aad9-815a04c0776f-tls-certs\") pod \"kube-auth-proxy-549869464b-8trnz\" (UID: \"4b3109f3-8292-43ba-aad9-815a04c0776f\") " pod="openshift-ingress/kube-auth-proxy-549869464b-8trnz"
Sep 17 14:14:57.557339 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:57.557292    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdznv\" (UniqueName: \"kubernetes.io/projected/4b3109f3-8292-43ba-aad9-815a04c0776f-kube-api-access-tdznv\") pod \"kube-auth-proxy-549869464b-8trnz\" (UID: \"4b3109f3-8292-43ba-aad9-815a04c0776f\") " pod="openshift-ingress/kube-auth-proxy-549869464b-8trnz"
Sep 17 14:14:57.657758 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:57.657697    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b3109f3-8292-43ba-aad9-815a04c0776f-tls-certs\") pod \"kube-auth-proxy-549869464b-8trnz\" (UID: \"4b3109f3-8292-43ba-aad9-815a04c0776f\") " pod="openshift-ingress/kube-auth-proxy-549869464b-8trnz"
Sep 17 14:14:57.657932 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:57.657829    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdznv\" (UniqueName: \"kubernetes.io/projected/4b3109f3-8292-43ba-aad9-815a04c0776f-kube-api-access-tdznv\") pod \"kube-auth-proxy-549869464b-8trnz\" (UID: \"4b3109f3-8292-43ba-aad9-815a04c0776f\") " pod="openshift-ingress/kube-auth-proxy-549869464b-8trnz"
Sep 17 14:14:57.657932 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:57.657881    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b3109f3-8292-43ba-aad9-815a04c0776f-tmp\") pod \"kube-auth-proxy-549869464b-8trnz\" (UID: \"4b3109f3-8292-43ba-aad9-815a04c0776f\") " pod="openshift-ingress/kube-auth-proxy-549869464b-8trnz"
Sep 17 14:14:57.657932 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:14:57.657887    2580 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 17 14:14:57.658119 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:14:57.657967    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b3109f3-8292-43ba-aad9-815a04c0776f-tls-certs podName:4b3109f3-8292-43ba-aad9-815a04c0776f nodeName:}" failed. No retries permitted until 2026-09-17 14:14:58.157943725 +0000 UTC m=+485.602019290 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/4b3109f3-8292-43ba-aad9-815a04c0776f-tls-certs") pod "kube-auth-proxy-549869464b-8trnz" (UID: "4b3109f3-8292-43ba-aad9-815a04c0776f") : secret "kube-auth-proxy-tls" not found
Sep 17 14:14:57.660536 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:57.660505    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b3109f3-8292-43ba-aad9-815a04c0776f-tmp\") pod \"kube-auth-proxy-549869464b-8trnz\" (UID: \"4b3109f3-8292-43ba-aad9-815a04c0776f\") " pod="openshift-ingress/kube-auth-proxy-549869464b-8trnz"
Sep 17 14:14:57.682641 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:57.682609    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdznv\" (UniqueName: \"kubernetes.io/projected/4b3109f3-8292-43ba-aad9-815a04c0776f-kube-api-access-tdznv\") pod \"kube-auth-proxy-549869464b-8trnz\" (UID: \"4b3109f3-8292-43ba-aad9-815a04c0776f\") " pod="openshift-ingress/kube-auth-proxy-549869464b-8trnz"
Sep 17 14:14:58.162125 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:58.162088    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b3109f3-8292-43ba-aad9-815a04c0776f-tls-certs\") pod \"kube-auth-proxy-549869464b-8trnz\" (UID: \"4b3109f3-8292-43ba-aad9-815a04c0776f\") " pod="openshift-ingress/kube-auth-proxy-549869464b-8trnz"
Sep 17 14:14:58.164505 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:58.164474    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b3109f3-8292-43ba-aad9-815a04c0776f-tls-certs\") pod \"kube-auth-proxy-549869464b-8trnz\" (UID: \"4b3109f3-8292-43ba-aad9-815a04c0776f\") " pod="openshift-ingress/kube-auth-proxy-549869464b-8trnz"
Sep 17 14:14:58.249358 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:58.249317    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-77fdd77d78-b8jvn" event={"ID":"5b8826d0-3e55-423e-a386-02741cdf07c9","Type":"ContainerStarted","Data":"84c0feb57e05e89a43bd2529182d0ed717c3d7c44d683307b3d1253f28cfe818"}
Sep 17 14:14:58.249538 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:58.249446    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-77fdd77d78-b8jvn"
Sep 17 14:14:58.279228 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:58.279169    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-77fdd77d78-b8jvn" podStartSLOduration=1.958311868 podStartE2EDuration="3.279151658s" totalImagesPullingTime="1.32083979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:14:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:14:58.276457903 +0000 UTC m=+485.720533538" watchObservedRunningTime="2026-09-17 14:14:58.279151658 +0000 UTC m=+485.723227246"
Sep 17 14:14:58.352841 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:58.352802    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-549869464b-8trnz"
Sep 17 14:14:58.630338 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:58.630002    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-549869464b-8trnz"]
Sep 17 14:14:58.632978 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:14:58.632949    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b3109f3_8292_43ba_aad9_815a04c0776f.slice/crio-bbf606542dd804d4dc5682a28a369097f17d40e4a9bee7beb3de4d360dd5953e WatchSource:0}: Error finding container bbf606542dd804d4dc5682a28a369097f17d40e4a9bee7beb3de4d360dd5953e: Status 404 returned error can't find the container with id bbf606542dd804d4dc5682a28a369097f17d40e4a9bee7beb3de4d360dd5953e
Sep 17 14:14:59.258071 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:14:59.258021    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-549869464b-8trnz" event={"ID":"4b3109f3-8292-43ba-aad9-815a04c0776f","Type":"ContainerStarted","Data":"bbf606542dd804d4dc5682a28a369097f17d40e4a9bee7beb3de4d360dd5953e"}
Sep 17 14:15:02.281903 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:15:02.281866    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-549869464b-8trnz" event={"ID":"4b3109f3-8292-43ba-aad9-815a04c0776f","Type":"ContainerStarted","Data":"2a5588a2170008473d9023cfb1a57c40b860a9ace3336a86c538d701ede671cb"}
Sep 17 14:15:02.301481 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:15:02.301424    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-549869464b-8trnz" podStartSLOduration=2.597564127 podStartE2EDuration="5.301409818s" totalImagesPullingTime="2.703845691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:14:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:15:02.299779597 +0000 UTC m=+489.743855207" watchObservedRunningTime="2026-09-17 14:15:02.301409818 +0000 UTC m=+489.745485431"
Sep 17 14:15:09.260427 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:15:09.260393    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-77fdd77d78-b8jvn"
Sep 17 14:16:12.799381 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:12.799344    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75rwp6"]
Sep 17 14:16:12.801961 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:12.801945    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75rwp6"
Sep 17 14:16:12.805389 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:12.805363    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 14:16:12.805509 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:12.805386    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 14:16:12.806764 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:12.806742    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q2vmb\""
Sep 17 14:16:12.817427 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:12.817402    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75rwp6"]
Sep 17 14:16:12.849592 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:12.849555    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/384c38a9-0b6a-4b01-afd2-8589ca06d683-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75rwp6\" (UID: \"384c38a9-0b6a-4b01-afd2-8589ca06d683\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75rwp6"
Sep 17 14:16:12.849592 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:12.849597    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/384c38a9-0b6a-4b01-afd2-8589ca06d683-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75rwp6\" (UID: \"384c38a9-0b6a-4b01-afd2-8589ca06d683\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75rwp6"
Sep 17 14:16:12.849846 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:12.849619    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2b8b\" (UniqueName: \"kubernetes.io/projected/384c38a9-0b6a-4b01-afd2-8589ca06d683-kube-api-access-m2b8b\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75rwp6\" (UID: \"384c38a9-0b6a-4b01-afd2-8589ca06d683\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75rwp6"
Sep 17 14:16:12.902254 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:12.902220    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tf67"]
Sep 17 14:16:12.904858 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:12.904836    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tf67"
Sep 17 14:16:12.918850 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:12.918815    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tf67"]
Sep 17 14:16:12.950591 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:12.950556    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/384c38a9-0b6a-4b01-afd2-8589ca06d683-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75rwp6\" (UID: \"384c38a9-0b6a-4b01-afd2-8589ca06d683\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75rwp6"
Sep 17 14:16:12.950591 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:12.950597    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/384c38a9-0b6a-4b01-afd2-8589ca06d683-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75rwp6\" (UID: \"384c38a9-0b6a-4b01-afd2-8589ca06d683\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75rwp6"
Sep 17 14:16:12.950869 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:12.950629    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2b8b\" (UniqueName: \"kubernetes.io/projected/384c38a9-0b6a-4b01-afd2-8589ca06d683-kube-api-access-m2b8b\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75rwp6\" (UID: \"384c38a9-0b6a-4b01-afd2-8589ca06d683\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75rwp6"
Sep 17 14:16:12.950869 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:12.950687    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d1951e5-75ed-4d2d-a101-c847b33ce848-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tf67\" (UID: \"4d1951e5-75ed-4d2d-a101-c847b33ce848\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tf67"
Sep 17 14:16:12.950869 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:12.950765    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d1951e5-75ed-4d2d-a101-c847b33ce848-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tf67\" (UID: \"4d1951e5-75ed-4d2d-a101-c847b33ce848\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tf67"
Sep 17 14:16:12.950869 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:12.950810    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkwj6\" (UniqueName: \"kubernetes.io/projected/4d1951e5-75ed-4d2d-a101-c847b33ce848-kube-api-access-zkwj6\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tf67\" (UID: \"4d1951e5-75ed-4d2d-a101-c847b33ce848\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tf67"
Sep 17 14:16:12.951086 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:12.951062    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/384c38a9-0b6a-4b01-afd2-8589ca06d683-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75rwp6\" (UID: \"384c38a9-0b6a-4b01-afd2-8589ca06d683\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75rwp6"
Sep 17 14:16:12.951126 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:12.951074    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/384c38a9-0b6a-4b01-afd2-8589ca06d683-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75rwp6\" (UID: \"384c38a9-0b6a-4b01-afd2-8589ca06d683\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75rwp6"
Sep 17 14:16:12.962161 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:12.962130    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2b8b\" (UniqueName: \"kubernetes.io/projected/384c38a9-0b6a-4b01-afd2-8589ca06d683-kube-api-access-m2b8b\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75rwp6\" (UID: \"384c38a9-0b6a-4b01-afd2-8589ca06d683\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75rwp6"
Sep 17 14:16:12.993580 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:12.993548    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfhb9f"]
Sep 17 14:16:12.996665 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:12.996643    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfhb9f"
Sep 17 14:16:13.014067 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.014037    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfhb9f"]
Sep 17 14:16:13.052196 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.052097    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1b61bdf-0e37-41df-8947-01283f8123b4-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfhb9f\" (UID: \"a1b61bdf-0e37-41df-8947-01283f8123b4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfhb9f"
Sep 17 14:16:13.052196 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.052147    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d1951e5-75ed-4d2d-a101-c847b33ce848-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tf67\" (UID: \"4d1951e5-75ed-4d2d-a101-c847b33ce848\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tf67"
Sep 17 14:16:13.052389 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.052271    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d1951e5-75ed-4d2d-a101-c847b33ce848-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tf67\" (UID: \"4d1951e5-75ed-4d2d-a101-c847b33ce848\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tf67"
Sep 17 14:16:13.052389 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.052311    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1b61bdf-0e37-41df-8947-01283f8123b4-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfhb9f\" (UID: \"a1b61bdf-0e37-41df-8947-01283f8123b4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfhb9f"
Sep 17 14:16:13.052389 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.052343    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkwj6\" (UniqueName: \"kubernetes.io/projected/4d1951e5-75ed-4d2d-a101-c847b33ce848-kube-api-access-zkwj6\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tf67\" (UID: \"4d1951e5-75ed-4d2d-a101-c847b33ce848\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tf67"
Sep 17 14:16:13.052389 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.052370    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csmvf\" (UniqueName: \"kubernetes.io/projected/a1b61bdf-0e37-41df-8947-01283f8123b4-kube-api-access-csmvf\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfhb9f\" (UID: \"a1b61bdf-0e37-41df-8947-01283f8123b4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfhb9f"
Sep 17 14:16:13.052635 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.052492    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d1951e5-75ed-4d2d-a101-c847b33ce848-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tf67\" (UID: \"4d1951e5-75ed-4d2d-a101-c847b33ce848\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tf67"
Sep 17 14:16:13.052635 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.052557    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d1951e5-75ed-4d2d-a101-c847b33ce848-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tf67\" (UID: \"4d1951e5-75ed-4d2d-a101-c847b33ce848\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tf67"
Sep 17 14:16:13.061788 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.061759    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkwj6\" (UniqueName: \"kubernetes.io/projected/4d1951e5-75ed-4d2d-a101-c847b33ce848-kube-api-access-zkwj6\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tf67\" (UID: \"4d1951e5-75ed-4d2d-a101-c847b33ce848\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tf67"
Sep 17 14:16:13.093967 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.093932    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l57zk"]
Sep 17 14:16:13.096982 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.096961    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l57zk"
Sep 17 14:16:13.108626 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.108596    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l57zk"]
Sep 17 14:16:13.111389 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.111365    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75rwp6"
Sep 17 14:16:13.153642 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.153605    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1b61bdf-0e37-41df-8947-01283f8123b4-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfhb9f\" (UID: \"a1b61bdf-0e37-41df-8947-01283f8123b4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfhb9f"
Sep 17 14:16:13.153642 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.153657    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csmvf\" (UniqueName: \"kubernetes.io/projected/a1b61bdf-0e37-41df-8947-01283f8123b4-kube-api-access-csmvf\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfhb9f\" (UID: \"a1b61bdf-0e37-41df-8947-01283f8123b4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfhb9f"
Sep 17 14:16:13.153918 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.153684    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4e6115a-001e-4650-9a3c-9215ed1a9f4e-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l57zk\" (UID: \"e4e6115a-001e-4650-9a3c-9215ed1a9f4e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l57zk"
Sep 17 14:16:13.153918 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.153701    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4e6115a-001e-4650-9a3c-9215ed1a9f4e-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l57zk\" (UID: \"e4e6115a-001e-4650-9a3c-9215ed1a9f4e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l57zk"
Sep 17 14:16:13.153918 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.153821    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1b61bdf-0e37-41df-8947-01283f8123b4-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfhb9f\" (UID: \"a1b61bdf-0e37-41df-8947-01283f8123b4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfhb9f"
Sep 17 14:16:13.153918 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.153885    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4pmj\" (UniqueName: \"kubernetes.io/projected/e4e6115a-001e-4650-9a3c-9215ed1a9f4e-kube-api-access-n4pmj\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l57zk\" (UID: \"e4e6115a-001e-4650-9a3c-9215ed1a9f4e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l57zk"
Sep 17 14:16:13.154142 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.154055    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1b61bdf-0e37-41df-8947-01283f8123b4-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfhb9f\" (UID: \"a1b61bdf-0e37-41df-8947-01283f8123b4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfhb9f"
Sep 17 14:16:13.154142 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.154104    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1b61bdf-0e37-41df-8947-01283f8123b4-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfhb9f\" (UID: \"a1b61bdf-0e37-41df-8947-01283f8123b4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfhb9f"
Sep 17 14:16:13.166801 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.166771    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csmvf\" (UniqueName: \"kubernetes.io/projected/a1b61bdf-0e37-41df-8947-01283f8123b4-kube-api-access-csmvf\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfhb9f\" (UID: \"a1b61bdf-0e37-41df-8947-01283f8123b4\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfhb9f"
Sep 17 14:16:13.214120 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.214072    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tf67"
Sep 17 14:16:13.255059 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.254998    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4pmj\" (UniqueName: \"kubernetes.io/projected/e4e6115a-001e-4650-9a3c-9215ed1a9f4e-kube-api-access-n4pmj\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l57zk\" (UID: \"e4e6115a-001e-4650-9a3c-9215ed1a9f4e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l57zk"
Sep 17 14:16:13.255310 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.255134    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4e6115a-001e-4650-9a3c-9215ed1a9f4e-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l57zk\" (UID: \"e4e6115a-001e-4650-9a3c-9215ed1a9f4e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l57zk"
Sep 17 14:16:13.255310 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.255175    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4e6115a-001e-4650-9a3c-9215ed1a9f4e-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l57zk\" (UID: \"e4e6115a-001e-4650-9a3c-9215ed1a9f4e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l57zk"
Sep 17 14:16:13.255940 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.255902    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4e6115a-001e-4650-9a3c-9215ed1a9f4e-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l57zk\" (UID: \"e4e6115a-001e-4650-9a3c-9215ed1a9f4e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l57zk"
Sep 17 14:16:13.255940 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.255935    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4e6115a-001e-4650-9a3c-9215ed1a9f4e-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l57zk\" (UID: \"e4e6115a-001e-4650-9a3c-9215ed1a9f4e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l57zk"
Sep 17 14:16:13.274506 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.273799    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4pmj\" (UniqueName: \"kubernetes.io/projected/e4e6115a-001e-4650-9a3c-9215ed1a9f4e-kube-api-access-n4pmj\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l57zk\" (UID: \"e4e6115a-001e-4650-9a3c-9215ed1a9f4e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l57zk"
Sep 17 14:16:13.306178 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.306100    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfhb9f"
Sep 17 14:16:13.389892 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.389863    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75rwp6"]
Sep 17 14:16:13.391355 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:16:13.391326    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod384c38a9_0b6a_4b01_afd2_8589ca06d683.slice/crio-863dc3a8e4e49c9484d9c824dc7db004ee86530e568cc17c79547c677c082e5a WatchSource:0}: Error finding container 863dc3a8e4e49c9484d9c824dc7db004ee86530e568cc17c79547c677c082e5a: Status 404 returned error can't find the container with id 863dc3a8e4e49c9484d9c824dc7db004ee86530e568cc17c79547c677c082e5a
Sep 17 14:16:13.405741 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.405700    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l57zk"
Sep 17 14:16:13.497114 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.497084    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tf67"]
Sep 17 14:16:13.498789 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:16:13.498756    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d1951e5_75ed_4d2d_a101_c847b33ce848.slice/crio-ffa872289ebc9ee650f6bad8313e7f83b3d48695c84d76e90e0e30b535de2cdf WatchSource:0}: Error finding container ffa872289ebc9ee650f6bad8313e7f83b3d48695c84d76e90e0e30b535de2cdf: Status 404 returned error can't find the container with id ffa872289ebc9ee650f6bad8313e7f83b3d48695c84d76e90e0e30b535de2cdf
Sep 17 14:16:13.606762 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.606730    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfhb9f"]
Sep 17 14:16:13.609772 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:16:13.609735    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b61bdf_0e37_41df_8947_01283f8123b4.slice/crio-ea3c8e4562f156c2d6b7a669566f7328ee6eb8b1cf99e8f1b6f44e696e65e8b6 WatchSource:0}: Error finding container ea3c8e4562f156c2d6b7a669566f7328ee6eb8b1cf99e8f1b6f44e696e65e8b6: Status 404 returned error can't find the container with id ea3c8e4562f156c2d6b7a669566f7328ee6eb8b1cf99e8f1b6f44e696e65e8b6
Sep 17 14:16:13.644079 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.644041    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tf67" event={"ID":"4d1951e5-75ed-4d2d-a101-c847b33ce848","Type":"ContainerStarted","Data":"561b07a41fa02a33a8d8fddfe7e1edce9bdc3b44dac945e9692c0ca5b7c90ae2"}
Sep 17 14:16:13.644244 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.644106    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tf67" event={"ID":"4d1951e5-75ed-4d2d-a101-c847b33ce848","Type":"ContainerStarted","Data":"ffa872289ebc9ee650f6bad8313e7f83b3d48695c84d76e90e0e30b535de2cdf"}
Sep 17 14:16:13.646103 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.646025    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfhb9f" event={"ID":"a1b61bdf-0e37-41df-8947-01283f8123b4","Type":"ContainerStarted","Data":"ea3c8e4562f156c2d6b7a669566f7328ee6eb8b1cf99e8f1b6f44e696e65e8b6"}
Sep 17 14:16:13.647934 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.647905    2580 generic.go:356] "Generic (PLEG): container finished" podID="384c38a9-0b6a-4b01-afd2-8589ca06d683" containerID="eab5f6177d1ef645ad7236af3fe072f82a8f5747cbbc299696f91dd1f01a4321" exitCode=0
Sep 17 14:16:13.648030 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.647950    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75rwp6" event={"ID":"384c38a9-0b6a-4b01-afd2-8589ca06d683","Type":"ContainerDied","Data":"eab5f6177d1ef645ad7236af3fe072f82a8f5747cbbc299696f91dd1f01a4321"}
Sep 17 14:16:13.648030 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.647991    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75rwp6" event={"ID":"384c38a9-0b6a-4b01-afd2-8589ca06d683","Type":"ContainerStarted","Data":"863dc3a8e4e49c9484d9c824dc7db004ee86530e568cc17c79547c677c082e5a"}
Sep 17 14:16:13.689791 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:13.689737    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l57zk"]
Sep 17 14:16:13.772753 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:16:13.772700    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4e6115a_001e_4650_9a3c_9215ed1a9f4e.slice/crio-4a1386e57f503ff9f281fc17fa6702cf101b24892ea636590d78a7b13d1f1a0a WatchSource:0}: Error finding container 4a1386e57f503ff9f281fc17fa6702cf101b24892ea636590d78a7b13d1f1a0a: Status 404 returned error can't find the container with id 4a1386e57f503ff9f281fc17fa6702cf101b24892ea636590d78a7b13d1f1a0a
Sep 17 14:16:14.658450 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:14.658356    2580 generic.go:356] "Generic (PLEG): container finished" podID="4d1951e5-75ed-4d2d-a101-c847b33ce848" containerID="561b07a41fa02a33a8d8fddfe7e1edce9bdc3b44dac945e9692c0ca5b7c90ae2" exitCode=0
Sep 17 14:16:14.658450 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:14.658429    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tf67" event={"ID":"4d1951e5-75ed-4d2d-a101-c847b33ce848","Type":"ContainerDied","Data":"561b07a41fa02a33a8d8fddfe7e1edce9bdc3b44dac945e9692c0ca5b7c90ae2"}
Sep 17 14:16:14.660096 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:14.660068    2580 generic.go:356] "Generic (PLEG): container finished" podID="e4e6115a-001e-4650-9a3c-9215ed1a9f4e" containerID="771142e91725a77ef4cc729153744ae474f1475c7587e1c8cf318b19bc6655fc" exitCode=0
Sep 17 14:16:14.660176 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:14.660106    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l57zk" event={"ID":"e4e6115a-001e-4650-9a3c-9215ed1a9f4e","Type":"ContainerDied","Data":"771142e91725a77ef4cc729153744ae474f1475c7587e1c8cf318b19bc6655fc"}
Sep 17 14:16:14.660176 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:14.660164    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l57zk" event={"ID":"e4e6115a-001e-4650-9a3c-9215ed1a9f4e","Type":"ContainerStarted","Data":"4a1386e57f503ff9f281fc17fa6702cf101b24892ea636590d78a7b13d1f1a0a"}
Sep 17 14:16:14.662011 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:14.661988    2580 generic.go:356] "Generic (PLEG): container finished" podID="a1b61bdf-0e37-41df-8947-01283f8123b4" containerID="e5d0928973a58607011c001ecd5e3f80f7b7d2a4f2c77d8edc56cc0cbfca213b" exitCode=0
Sep 17 14:16:14.662111 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:14.662048    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfhb9f" event={"ID":"a1b61bdf-0e37-41df-8947-01283f8123b4","Type":"ContainerDied","Data":"e5d0928973a58607011c001ecd5e3f80f7b7d2a4f2c77d8edc56cc0cbfca213b"}
Sep 17 14:16:14.664349 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:14.664327    2580 generic.go:356] "Generic (PLEG): container finished" podID="384c38a9-0b6a-4b01-afd2-8589ca06d683" containerID="ad37bb389bd68faa0a0d362855223faa65b85b0d07ca21fcaacf77990ca859d2" exitCode=0
Sep 17 14:16:14.664437 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:14.664359    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75rwp6" event={"ID":"384c38a9-0b6a-4b01-afd2-8589ca06d683","Type":"ContainerDied","Data":"ad37bb389bd68faa0a0d362855223faa65b85b0d07ca21fcaacf77990ca859d2"}
Sep 17 14:16:15.671089 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:15.671034    2580 generic.go:356] "Generic (PLEG): container finished" podID="a1b61bdf-0e37-41df-8947-01283f8123b4" containerID="fee88aa673b037c38b2a82f171e4278c24a6796e16f17bf87d10a864868d08f6" exitCode=0
Sep 17 14:16:15.671494 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:15.671115    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfhb9f" event={"ID":"a1b61bdf-0e37-41df-8947-01283f8123b4","Type":"ContainerDied","Data":"fee88aa673b037c38b2a82f171e4278c24a6796e16f17bf87d10a864868d08f6"}
Sep 17 14:16:15.673500 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:15.673476    2580 generic.go:356] "Generic (PLEG): container finished" podID="384c38a9-0b6a-4b01-afd2-8589ca06d683" containerID="405261dd80fbd05556e1973661168cf929726ec424d37c50088e715d43f81f4f" exitCode=0
Sep 17 14:16:15.673599 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:15.673560    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75rwp6" event={"ID":"384c38a9-0b6a-4b01-afd2-8589ca06d683","Type":"ContainerDied","Data":"405261dd80fbd05556e1973661168cf929726ec424d37c50088e715d43f81f4f"}
Sep 17 14:16:15.675564 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:15.675533    2580 generic.go:356] "Generic (PLEG): container finished" podID="4d1951e5-75ed-4d2d-a101-c847b33ce848" containerID="278087a78c08357e757a9804ddc15b003688d09ace865a1e03b4e4c3f9a741a2" exitCode=0
Sep 17 14:16:15.675675 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:15.675588    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tf67" event={"ID":"4d1951e5-75ed-4d2d-a101-c847b33ce848","Type":"ContainerDied","Data":"278087a78c08357e757a9804ddc15b003688d09ace865a1e03b4e4c3f9a741a2"}
Sep 17 14:16:16.686491 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:16.686397    2580 generic.go:356] "Generic (PLEG): container finished" podID="4d1951e5-75ed-4d2d-a101-c847b33ce848" containerID="bffa60efde20c2d89b75e58fcff5272a0d71784fdbc1b817f0793592fe82e32b" exitCode=0
Sep 17 14:16:16.686900 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:16.686480    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tf67" event={"ID":"4d1951e5-75ed-4d2d-a101-c847b33ce848","Type":"ContainerDied","Data":"bffa60efde20c2d89b75e58fcff5272a0d71784fdbc1b817f0793592fe82e32b"}
Sep 17 14:16:16.688794 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:16.688768    2580 generic.go:356] "Generic (PLEG): container finished" podID="a1b61bdf-0e37-41df-8947-01283f8123b4" containerID="1a37af5f4784f80d6d96aadeda811eb54207bd2036f7e1e37ff9a9dc837fadc2" exitCode=0
Sep 17 14:16:16.688921 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:16.688846    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfhb9f" event={"ID":"a1b61bdf-0e37-41df-8947-01283f8123b4","Type":"ContainerDied","Data":"1a37af5f4784f80d6d96aadeda811eb54207bd2036f7e1e37ff9a9dc837fadc2"}
Sep 17 14:16:16.837514 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:16.837487    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75rwp6"
Sep 17 14:16:16.888700 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:16.888669    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/384c38a9-0b6a-4b01-afd2-8589ca06d683-bundle\") pod \"384c38a9-0b6a-4b01-afd2-8589ca06d683\" (UID: \"384c38a9-0b6a-4b01-afd2-8589ca06d683\") "
Sep 17 14:16:16.888849 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:16.888759    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/384c38a9-0b6a-4b01-afd2-8589ca06d683-util\") pod \"384c38a9-0b6a-4b01-afd2-8589ca06d683\" (UID: \"384c38a9-0b6a-4b01-afd2-8589ca06d683\") "
Sep 17 14:16:16.888849 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:16.888824    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2b8b\" (UniqueName: \"kubernetes.io/projected/384c38a9-0b6a-4b01-afd2-8589ca06d683-kube-api-access-m2b8b\") pod \"384c38a9-0b6a-4b01-afd2-8589ca06d683\" (UID: \"384c38a9-0b6a-4b01-afd2-8589ca06d683\") "
Sep 17 14:16:16.889249 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:16.889219    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/384c38a9-0b6a-4b01-afd2-8589ca06d683-bundle" (OuterVolumeSpecName: "bundle") pod "384c38a9-0b6a-4b01-afd2-8589ca06d683" (UID: "384c38a9-0b6a-4b01-afd2-8589ca06d683"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:16:16.891058 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:16.891033    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/384c38a9-0b6a-4b01-afd2-8589ca06d683-kube-api-access-m2b8b" (OuterVolumeSpecName: "kube-api-access-m2b8b") pod "384c38a9-0b6a-4b01-afd2-8589ca06d683" (UID: "384c38a9-0b6a-4b01-afd2-8589ca06d683"). InnerVolumeSpecName "kube-api-access-m2b8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:16:16.893985 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:16.893963    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/384c38a9-0b6a-4b01-afd2-8589ca06d683-util" (OuterVolumeSpecName: "util") pod "384c38a9-0b6a-4b01-afd2-8589ca06d683" (UID: "384c38a9-0b6a-4b01-afd2-8589ca06d683"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:16:16.989730 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:16.989687    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2b8b\" (UniqueName: \"kubernetes.io/projected/384c38a9-0b6a-4b01-afd2-8589ca06d683-kube-api-access-m2b8b\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:16:16.989730 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:16.989737    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/384c38a9-0b6a-4b01-afd2-8589ca06d683-bundle\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:16:16.989938 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:16.989747    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/384c38a9-0b6a-4b01-afd2-8589ca06d683-util\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:16:17.696219 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:17.696197    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75rwp6"
Sep 17 14:16:17.696618 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:17.696227    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75rwp6" event={"ID":"384c38a9-0b6a-4b01-afd2-8589ca06d683","Type":"ContainerDied","Data":"863dc3a8e4e49c9484d9c824dc7db004ee86530e568cc17c79547c677c082e5a"}
Sep 17 14:16:17.696618 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:17.696274    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="863dc3a8e4e49c9484d9c824dc7db004ee86530e568cc17c79547c677c082e5a"
Sep 17 14:16:17.698293 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:17.698254    2580 generic.go:356] "Generic (PLEG): container finished" podID="e4e6115a-001e-4650-9a3c-9215ed1a9f4e" containerID="9ff3abc11e730b523471e3aaef309022ed750a8e5f9aa6dd76460acb74271150" exitCode=0
Sep 17 14:16:17.698434 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:17.698322    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l57zk" event={"ID":"e4e6115a-001e-4650-9a3c-9215ed1a9f4e","Type":"ContainerDied","Data":"9ff3abc11e730b523471e3aaef309022ed750a8e5f9aa6dd76460acb74271150"}
Sep 17 14:16:17.852247 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:17.852224    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tf67"
Sep 17 14:16:17.855935 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:17.855905    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfhb9f"
Sep 17 14:16:17.998394 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:17.998303    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1b61bdf-0e37-41df-8947-01283f8123b4-util\") pod \"a1b61bdf-0e37-41df-8947-01283f8123b4\" (UID: \"a1b61bdf-0e37-41df-8947-01283f8123b4\") "
Sep 17 14:16:17.998394 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:17.998356    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d1951e5-75ed-4d2d-a101-c847b33ce848-bundle\") pod \"4d1951e5-75ed-4d2d-a101-c847b33ce848\" (UID: \"4d1951e5-75ed-4d2d-a101-c847b33ce848\") "
Sep 17 14:16:17.998394 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:17.998377    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-csmvf\" (UniqueName: \"kubernetes.io/projected/a1b61bdf-0e37-41df-8947-01283f8123b4-kube-api-access-csmvf\") pod \"a1b61bdf-0e37-41df-8947-01283f8123b4\" (UID: \"a1b61bdf-0e37-41df-8947-01283f8123b4\") "
Sep 17 14:16:17.998684 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:17.998434    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkwj6\" (UniqueName: \"kubernetes.io/projected/4d1951e5-75ed-4d2d-a101-c847b33ce848-kube-api-access-zkwj6\") pod \"4d1951e5-75ed-4d2d-a101-c847b33ce848\" (UID: \"4d1951e5-75ed-4d2d-a101-c847b33ce848\") "
Sep 17 14:16:17.998684 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:17.998509    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1b61bdf-0e37-41df-8947-01283f8123b4-bundle\") pod \"a1b61bdf-0e37-41df-8947-01283f8123b4\" (UID: \"a1b61bdf-0e37-41df-8947-01283f8123b4\") "
Sep 17 14:16:17.998684 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:17.998589    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d1951e5-75ed-4d2d-a101-c847b33ce848-util\") pod \"4d1951e5-75ed-4d2d-a101-c847b33ce848\" (UID: \"4d1951e5-75ed-4d2d-a101-c847b33ce848\") "
Sep 17 14:16:17.999292 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:17.999262    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d1951e5-75ed-4d2d-a101-c847b33ce848-bundle" (OuterVolumeSpecName: "bundle") pod "4d1951e5-75ed-4d2d-a101-c847b33ce848" (UID: "4d1951e5-75ed-4d2d-a101-c847b33ce848"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:16:17.999407 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:17.999268    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1b61bdf-0e37-41df-8947-01283f8123b4-bundle" (OuterVolumeSpecName: "bundle") pod "a1b61bdf-0e37-41df-8947-01283f8123b4" (UID: "a1b61bdf-0e37-41df-8947-01283f8123b4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:16:18.000647 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:18.000617    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d1951e5-75ed-4d2d-a101-c847b33ce848-kube-api-access-zkwj6" (OuterVolumeSpecName: "kube-api-access-zkwj6") pod "4d1951e5-75ed-4d2d-a101-c847b33ce848" (UID: "4d1951e5-75ed-4d2d-a101-c847b33ce848"). InnerVolumeSpecName "kube-api-access-zkwj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:16:18.000796 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:18.000648    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1b61bdf-0e37-41df-8947-01283f8123b4-kube-api-access-csmvf" (OuterVolumeSpecName: "kube-api-access-csmvf") pod "a1b61bdf-0e37-41df-8947-01283f8123b4" (UID: "a1b61bdf-0e37-41df-8947-01283f8123b4"). InnerVolumeSpecName "kube-api-access-csmvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:16:18.007483 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:18.007454    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1b61bdf-0e37-41df-8947-01283f8123b4-util" (OuterVolumeSpecName: "util") pod "a1b61bdf-0e37-41df-8947-01283f8123b4" (UID: "a1b61bdf-0e37-41df-8947-01283f8123b4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:16:18.007666 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:18.007647    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d1951e5-75ed-4d2d-a101-c847b33ce848-util" (OuterVolumeSpecName: "util") pod "4d1951e5-75ed-4d2d-a101-c847b33ce848" (UID: "4d1951e5-75ed-4d2d-a101-c847b33ce848"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:16:18.100292 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:18.100252    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1b61bdf-0e37-41df-8947-01283f8123b4-bundle\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:16:18.100292 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:18.100287    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d1951e5-75ed-4d2d-a101-c847b33ce848-util\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:16:18.100292 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:18.100295    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1b61bdf-0e37-41df-8947-01283f8123b4-util\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:16:18.100292 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:18.100304    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d1951e5-75ed-4d2d-a101-c847b33ce848-bundle\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:16:18.100560 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:18.100314    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-csmvf\" (UniqueName: \"kubernetes.io/projected/a1b61bdf-0e37-41df-8947-01283f8123b4-kube-api-access-csmvf\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:16:18.100560 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:18.100325    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkwj6\" (UniqueName: \"kubernetes.io/projected/4d1951e5-75ed-4d2d-a101-c847b33ce848-kube-api-access-zkwj6\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:16:18.706572 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:18.706537    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tf67" event={"ID":"4d1951e5-75ed-4d2d-a101-c847b33ce848","Type":"ContainerDied","Data":"ffa872289ebc9ee650f6bad8313e7f83b3d48695c84d76e90e0e30b535de2cdf"}
Sep 17 14:16:18.707046 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:18.706589    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ffa872289ebc9ee650f6bad8313e7f83b3d48695c84d76e90e0e30b535de2cdf"
Sep 17 14:16:18.707046 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:18.706546    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tf67"
Sep 17 14:16:18.708792 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:18.708761    2580 generic.go:356] "Generic (PLEG): container finished" podID="e4e6115a-001e-4650-9a3c-9215ed1a9f4e" containerID="32850043322e4694caf5b8fab0c11a386a1fb6b3cd12f0eab939a9f0ec7cb76e" exitCode=0
Sep 17 14:16:18.708896 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:18.708836    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l57zk" event={"ID":"e4e6115a-001e-4650-9a3c-9215ed1a9f4e","Type":"ContainerDied","Data":"32850043322e4694caf5b8fab0c11a386a1fb6b3cd12f0eab939a9f0ec7cb76e"}
Sep 17 14:16:18.710887 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:18.710854    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfhb9f" event={"ID":"a1b61bdf-0e37-41df-8947-01283f8123b4","Type":"ContainerDied","Data":"ea3c8e4562f156c2d6b7a669566f7328ee6eb8b1cf99e8f1b6f44e696e65e8b6"}
Sep 17 14:16:18.710887 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:18.710870    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfhb9f"
Sep 17 14:16:18.711014 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:18.710899    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea3c8e4562f156c2d6b7a669566f7328ee6eb8b1cf99e8f1b6f44e696e65e8b6"
Sep 17 14:16:19.843607 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:19.843579    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l57zk"
Sep 17 14:16:19.915342 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:19.915298    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4e6115a-001e-4650-9a3c-9215ed1a9f4e-util\") pod \"e4e6115a-001e-4650-9a3c-9215ed1a9f4e\" (UID: \"e4e6115a-001e-4650-9a3c-9215ed1a9f4e\") "
Sep 17 14:16:19.915511 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:19.915410    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4e6115a-001e-4650-9a3c-9215ed1a9f4e-bundle\") pod \"e4e6115a-001e-4650-9a3c-9215ed1a9f4e\" (UID: \"e4e6115a-001e-4650-9a3c-9215ed1a9f4e\") "
Sep 17 14:16:19.915511 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:19.915430    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4pmj\" (UniqueName: \"kubernetes.io/projected/e4e6115a-001e-4650-9a3c-9215ed1a9f4e-kube-api-access-n4pmj\") pod \"e4e6115a-001e-4650-9a3c-9215ed1a9f4e\" (UID: \"e4e6115a-001e-4650-9a3c-9215ed1a9f4e\") "
Sep 17 14:16:19.915879 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:19.915851    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4e6115a-001e-4650-9a3c-9215ed1a9f4e-bundle" (OuterVolumeSpecName: "bundle") pod "e4e6115a-001e-4650-9a3c-9215ed1a9f4e" (UID: "e4e6115a-001e-4650-9a3c-9215ed1a9f4e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:16:19.917609 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:19.917590    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4e6115a-001e-4650-9a3c-9215ed1a9f4e-kube-api-access-n4pmj" (OuterVolumeSpecName: "kube-api-access-n4pmj") pod "e4e6115a-001e-4650-9a3c-9215ed1a9f4e" (UID: "e4e6115a-001e-4650-9a3c-9215ed1a9f4e"). InnerVolumeSpecName "kube-api-access-n4pmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:16:19.919583 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:19.919560    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4e6115a-001e-4650-9a3c-9215ed1a9f4e-util" (OuterVolumeSpecName: "util") pod "e4e6115a-001e-4650-9a3c-9215ed1a9f4e" (UID: "e4e6115a-001e-4650-9a3c-9215ed1a9f4e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:16:20.016233 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:20.016131    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4e6115a-001e-4650-9a3c-9215ed1a9f4e-bundle\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:16:20.016233 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:20.016176    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4pmj\" (UniqueName: \"kubernetes.io/projected/e4e6115a-001e-4650-9a3c-9215ed1a9f4e-kube-api-access-n4pmj\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:16:20.016233 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:20.016187    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4e6115a-001e-4650-9a3c-9215ed1a9f4e-util\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:16:20.723850 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:20.723820    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l57zk"
Sep 17 14:16:20.723850 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:20.723844    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6l57zk" event={"ID":"e4e6115a-001e-4650-9a3c-9215ed1a9f4e","Type":"ContainerDied","Data":"4a1386e57f503ff9f281fc17fa6702cf101b24892ea636590d78a7b13d1f1a0a"}
Sep 17 14:16:20.724145 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:20.723891    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4a1386e57f503ff9f281fc17fa6702cf101b24892ea636590d78a7b13d1f1a0a"
Sep 17 14:16:35.559708 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.559671    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssccb"]
Sep 17 14:16:35.560106 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.560066    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="384c38a9-0b6a-4b01-afd2-8589ca06d683" containerName="util"
Sep 17 14:16:35.560106 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.560079    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="384c38a9-0b6a-4b01-afd2-8589ca06d683" containerName="util"
Sep 17 14:16:35.560106 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.560088    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4e6115a-001e-4650-9a3c-9215ed1a9f4e" containerName="pull"
Sep 17 14:16:35.560106 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.560096    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4e6115a-001e-4650-9a3c-9215ed1a9f4e" containerName="pull"
Sep 17 14:16:35.560106 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.560106    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="384c38a9-0b6a-4b01-afd2-8589ca06d683" containerName="pull"
Sep 17 14:16:35.560255 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.560113    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="384c38a9-0b6a-4b01-afd2-8589ca06d683" containerName="pull"
Sep 17 14:16:35.560255 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.560122    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1b61bdf-0e37-41df-8947-01283f8123b4" containerName="extract"
Sep 17 14:16:35.560255 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.560127    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1b61bdf-0e37-41df-8947-01283f8123b4" containerName="extract"
Sep 17 14:16:35.560255 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.560134    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1b61bdf-0e37-41df-8947-01283f8123b4" containerName="util"
Sep 17 14:16:35.560255 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.560139    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1b61bdf-0e37-41df-8947-01283f8123b4" containerName="util"
Sep 17 14:16:35.560255 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.560144    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d1951e5-75ed-4d2d-a101-c847b33ce848" containerName="extract"
Sep 17 14:16:35.560255 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.560149    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d1951e5-75ed-4d2d-a101-c847b33ce848" containerName="extract"
Sep 17 14:16:35.560255 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.560160    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4e6115a-001e-4650-9a3c-9215ed1a9f4e" containerName="extract"
Sep 17 14:16:35.560255 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.560165    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4e6115a-001e-4650-9a3c-9215ed1a9f4e" containerName="extract"
Sep 17 14:16:35.560255 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.560171    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1b61bdf-0e37-41df-8947-01283f8123b4" containerName="pull"
Sep 17 14:16:35.560255 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.560176    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1b61bdf-0e37-41df-8947-01283f8123b4" containerName="pull"
Sep 17 14:16:35.560255 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.560182    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4e6115a-001e-4650-9a3c-9215ed1a9f4e" containerName="util"
Sep 17 14:16:35.560255 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.560188    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4e6115a-001e-4650-9a3c-9215ed1a9f4e" containerName="util"
Sep 17 14:16:35.560255 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.560194    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="384c38a9-0b6a-4b01-afd2-8589ca06d683" containerName="extract"
Sep 17 14:16:35.560255 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.560199    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="384c38a9-0b6a-4b01-afd2-8589ca06d683" containerName="extract"
Sep 17 14:16:35.560255 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.560206    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d1951e5-75ed-4d2d-a101-c847b33ce848" containerName="util"
Sep 17 14:16:35.560255 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.560210    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d1951e5-75ed-4d2d-a101-c847b33ce848" containerName="util"
Sep 17 14:16:35.560255 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.560216    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d1951e5-75ed-4d2d-a101-c847b33ce848" containerName="pull"
Sep 17 14:16:35.560255 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.560221    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d1951e5-75ed-4d2d-a101-c847b33ce848" containerName="pull"
Sep 17 14:16:35.560776 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.560277    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d1951e5-75ed-4d2d-a101-c847b33ce848" containerName="extract"
Sep 17 14:16:35.560776 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.560284    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="384c38a9-0b6a-4b01-afd2-8589ca06d683" containerName="extract"
Sep 17 14:16:35.560776 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.560291    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4e6115a-001e-4650-9a3c-9215ed1a9f4e" containerName="extract"
Sep 17 14:16:35.560776 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.560297    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1b61bdf-0e37-41df-8947-01283f8123b4" containerName="extract"
Sep 17 14:16:35.562531 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.562515    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssccb"
Sep 17 14:16:35.566451 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.566422    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 17 14:16:35.566582 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.566432    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-gddh5\""
Sep 17 14:16:35.566582 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.566433    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 17 14:16:35.579795 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.579760    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssccb"]
Sep 17 14:16:35.658288 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.658249    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4lr6\" (UniqueName: \"kubernetes.io/projected/e978b184-19e8-4c48-b0f7-edd688aceb72-kube-api-access-n4lr6\") pod \"limitador-operator-controller-manager-74495c69f8-ssccb\" (UID: \"e978b184-19e8-4c48-b0f7-edd688aceb72\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssccb"
Sep 17 14:16:35.759577 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.759534    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4lr6\" (UniqueName: \"kubernetes.io/projected/e978b184-19e8-4c48-b0f7-edd688aceb72-kube-api-access-n4lr6\") pod \"limitador-operator-controller-manager-74495c69f8-ssccb\" (UID: \"e978b184-19e8-4c48-b0f7-edd688aceb72\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssccb"
Sep 17 14:16:35.769311 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.769276    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4lr6\" (UniqueName: \"kubernetes.io/projected/e978b184-19e8-4c48-b0f7-edd688aceb72-kube-api-access-n4lr6\") pod \"limitador-operator-controller-manager-74495c69f8-ssccb\" (UID: \"e978b184-19e8-4c48-b0f7-edd688aceb72\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssccb"
Sep 17 14:16:35.873092 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:35.872997    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssccb"
Sep 17 14:16:36.159860 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:36.159834    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssccb"]
Sep 17 14:16:36.162170 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:16:36.162133    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode978b184_19e8_4c48_b0f7_edd688aceb72.slice/crio-b6f599324f21265e89729a512a8fd810b0f521442aa0168922e3454c8410d15e WatchSource:0}: Error finding container b6f599324f21265e89729a512a8fd810b0f521442aa0168922e3454c8410d15e: Status 404 returned error can't find the container with id b6f599324f21265e89729a512a8fd810b0f521442aa0168922e3454c8410d15e
Sep 17 14:16:36.811579 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:36.811529    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssccb" event={"ID":"e978b184-19e8-4c48-b0f7-edd688aceb72","Type":"ContainerStarted","Data":"b6f599324f21265e89729a512a8fd810b0f521442aa0168922e3454c8410d15e"}
Sep 17 14:16:38.827276 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:38.827239    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssccb" event={"ID":"e978b184-19e8-4c48-b0f7-edd688aceb72","Type":"ContainerStarted","Data":"e0502ecc26c49b371fc3283359221919c8abafac8b405ac94c1f7853570d34d5"}
Sep 17 14:16:38.827626 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:38.827367    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssccb"
Sep 17 14:16:38.854338 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:38.854279    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssccb" podStartSLOduration=1.739648731 podStartE2EDuration="3.854262933s" totalImagesPullingTime="2.114614202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:16:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:16:38.853188671 +0000 UTC m=+586.297264283" watchObservedRunningTime="2026-09-17 14:16:38.854262933 +0000 UTC m=+586.298338519"
Sep 17 14:16:49.835627 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:49.835594    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssccb"
Sep 17 14:16:51.690355 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:51.690312    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssccb"]
Sep 17 14:16:51.690835 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:51.690515    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssccb" podUID="e978b184-19e8-4c48-b0f7-edd688aceb72" containerName="manager" containerID="cri-o://e0502ecc26c49b371fc3283359221919c8abafac8b405ac94c1f7853570d34d5" gracePeriod=2
Sep 17 14:16:51.698485 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:51.698455    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssccb"]
Sep 17 14:16:51.775107 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:51.775073    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-m8rdb"]
Sep 17 14:16:51.775499 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:51.775481    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e978b184-19e8-4c48-b0f7-edd688aceb72" containerName="manager"
Sep 17 14:16:51.775586 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:51.775500    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e978b184-19e8-4c48-b0f7-edd688aceb72" containerName="manager"
Sep 17 14:16:51.775643 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:51.775633    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e978b184-19e8-4c48-b0f7-edd688aceb72" containerName="manager"
Sep 17 14:16:51.778650 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:51.778630    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m8rdb"
Sep 17 14:16:51.783343 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:16:51.783313    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-m8rdb\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" podUID="8ed509ed-db90-4be5-97d1-b9d0b0dd6927" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m8rdb"
Sep 17 14:16:51.789370 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:16:51.789340    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ssccb\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" podUID="e978b184-19e8-4c48-b0f7-edd688aceb72" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssccb"
Sep 17 14:16:51.796872 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:51.796845    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-m8rdb"]
Sep 17 14:16:51.806032 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:51.806005    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45jmm\" (UniqueName: \"kubernetes.io/projected/8ed509ed-db90-4be5-97d1-b9d0b0dd6927-kube-api-access-45jmm\") pod \"limitador-operator-controller-manager-74495c69f8-m8rdb\" (UID: \"8ed509ed-db90-4be5-97d1-b9d0b0dd6927\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m8rdb"
Sep 17 14:16:51.898514 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:51.898480    2580 generic.go:356] "Generic (PLEG): container finished" podID="e978b184-19e8-4c48-b0f7-edd688aceb72" containerID="e0502ecc26c49b371fc3283359221919c8abafac8b405ac94c1f7853570d34d5" exitCode=0
Sep 17 14:16:51.906675 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:51.906646    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45jmm\" (UniqueName: \"kubernetes.io/projected/8ed509ed-db90-4be5-97d1-b9d0b0dd6927-kube-api-access-45jmm\") pod \"limitador-operator-controller-manager-74495c69f8-m8rdb\" (UID: \"8ed509ed-db90-4be5-97d1-b9d0b0dd6927\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m8rdb"
Sep 17 14:16:51.929774 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:51.929746    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45jmm\" (UniqueName: \"kubernetes.io/projected/8ed509ed-db90-4be5-97d1-b9d0b0dd6927-kube-api-access-45jmm\") pod \"limitador-operator-controller-manager-74495c69f8-m8rdb\" (UID: \"8ed509ed-db90-4be5-97d1-b9d0b0dd6927\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m8rdb"
Sep 17 14:16:51.947303 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:51.947278    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssccb"
Sep 17 14:16:52.007950 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:52.007912    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4lr6\" (UniqueName: \"kubernetes.io/projected/e978b184-19e8-4c48-b0f7-edd688aceb72-kube-api-access-n4lr6\") pod \"e978b184-19e8-4c48-b0f7-edd688aceb72\" (UID: \"e978b184-19e8-4c48-b0f7-edd688aceb72\") "
Sep 17 14:16:52.010166 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:52.010132    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e978b184-19e8-4c48-b0f7-edd688aceb72-kube-api-access-n4lr6" (OuterVolumeSpecName: "kube-api-access-n4lr6") pod "e978b184-19e8-4c48-b0f7-edd688aceb72" (UID: "e978b184-19e8-4c48-b0f7-edd688aceb72"). InnerVolumeSpecName "kube-api-access-n4lr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:16:52.038624 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:16:52.038579    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ssccb\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" podUID="e978b184-19e8-4c48-b0f7-edd688aceb72" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssccb"
Sep 17 14:16:52.088410 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:52.088370    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m8rdb"
Sep 17 14:16:52.108665 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:52.108631    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4lr6\" (UniqueName: \"kubernetes.io/projected/e978b184-19e8-4c48-b0f7-edd688aceb72-kube-api-access-n4lr6\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:16:52.395379 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:52.395353    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-m8rdb"]
Sep 17 14:16:52.397365 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:16:52.397334    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ed509ed_db90_4be5_97d1_b9d0b0dd6927.slice/crio-2fc4fb89e3aa705b67e1f083d80e3b59057a4238301fbdad68962b885b1d905d WatchSource:0}: Error finding container 2fc4fb89e3aa705b67e1f083d80e3b59057a4238301fbdad68962b885b1d905d: Status 404 returned error can't find the container with id 2fc4fb89e3aa705b67e1f083d80e3b59057a4238301fbdad68962b885b1d905d
Sep 17 14:16:52.905703 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:52.905672    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssccb"
Sep 17 14:16:52.905703 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:52.905687    2580 scope.go:117] "RemoveContainer" containerID="e0502ecc26c49b371fc3283359221919c8abafac8b405ac94c1f7853570d34d5"
Sep 17 14:16:52.907889 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:52.907858    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m8rdb" event={"ID":"8ed509ed-db90-4be5-97d1-b9d0b0dd6927","Type":"ContainerStarted","Data":"721d2d219f4fa0b6c3725b6ab54ed6f47967e922becd67237ed0695192c22964"}
Sep 17 14:16:52.908014 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:52.907920    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m8rdb"
Sep 17 14:16:52.908014 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:52.907941    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m8rdb" event={"ID":"8ed509ed-db90-4be5-97d1-b9d0b0dd6927","Type":"ContainerStarted","Data":"2fc4fb89e3aa705b67e1f083d80e3b59057a4238301fbdad68962b885b1d905d"}
Sep 17 14:16:52.923820 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:16:52.923782    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ssccb\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" podUID="e978b184-19e8-4c48-b0f7-edd688aceb72" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssccb"
Sep 17 14:16:52.968946 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:16:52.968900    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ssccb\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" podUID="e978b184-19e8-4c48-b0f7-edd688aceb72" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssccb"
Sep 17 14:16:52.969499 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:52.969449    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m8rdb" podStartSLOduration=1.969431565 podStartE2EDuration="1.969431565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:16:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:16:52.965102963 +0000 UTC m=+600.409178571" watchObservedRunningTime="2026-09-17 14:16:52.969431565 +0000 UTC m=+600.413507152"
Sep 17 14:16:53.178319 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:16:53.178244    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e978b184-19e8-4c48-b0f7-edd688aceb72" path="/var/lib/kubelet/pods/e978b184-19e8-4c48-b0f7-edd688aceb72/volumes"
Sep 17 14:16:53.178687 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:16:53.178657    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ssccb\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" podUID="e978b184-19e8-4c48-b0f7-edd688aceb72" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ssccb"
Sep 17 14:17:03.915402 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:03.915371    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m8rdb"
Sep 17 14:17:23.871519 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:23.871438    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:17:23.874906 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:23.874889    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"
Sep 17 14:17:23.877979 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:23.877959    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 17 14:17:23.878098 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:23.877959    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-g5n8f\""
Sep 17 14:17:23.886041 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:23.886012    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:17:23.891572 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:23.891539    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9ch6\" (UniqueName: \"kubernetes.io/projected/4821f268-1865-4973-b814-a9e54e76cf50-kube-api-access-b9ch6\") pod \"limitador-limitador-84994f7ffc-vvdg5\" (UID: \"4821f268-1865-4973-b814-a9e54e76cf50\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"
Sep 17 14:17:23.891730 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:23.891592    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4821f268-1865-4973-b814-a9e54e76cf50-config-file\") pod \"limitador-limitador-84994f7ffc-vvdg5\" (UID: \"4821f268-1865-4973-b814-a9e54e76cf50\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"
Sep 17 14:17:23.929904 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:23.929870    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:17:23.992631 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:23.992590    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9ch6\" (UniqueName: \"kubernetes.io/projected/4821f268-1865-4973-b814-a9e54e76cf50-kube-api-access-b9ch6\") pod \"limitador-limitador-84994f7ffc-vvdg5\" (UID: \"4821f268-1865-4973-b814-a9e54e76cf50\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"
Sep 17 14:17:23.992631 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:23.992636    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4821f268-1865-4973-b814-a9e54e76cf50-config-file\") pod \"limitador-limitador-84994f7ffc-vvdg5\" (UID: \"4821f268-1865-4973-b814-a9e54e76cf50\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"
Sep 17 14:17:23.993254 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:23.993233    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4821f268-1865-4973-b814-a9e54e76cf50-config-file\") pod \"limitador-limitador-84994f7ffc-vvdg5\" (UID: \"4821f268-1865-4973-b814-a9e54e76cf50\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"
Sep 17 14:17:24.002490 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:24.002460    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9ch6\" (UniqueName: \"kubernetes.io/projected/4821f268-1865-4973-b814-a9e54e76cf50-kube-api-access-b9ch6\") pod \"limitador-limitador-84994f7ffc-vvdg5\" (UID: \"4821f268-1865-4973-b814-a9e54e76cf50\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"
Sep 17 14:17:24.186202 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:24.186113    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"
Sep 17 14:17:24.325634 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:24.325600    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-jxfmn"]
Sep 17 14:17:24.329323 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:24.329299    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-jxfmn"
Sep 17 14:17:24.332461 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:24.332443    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6svbb\""
Sep 17 14:17:24.337001 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:24.336981    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-jxfmn"]
Sep 17 14:17:24.395696 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:24.395656    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdwks\" (UniqueName: \"kubernetes.io/projected/b9aeede0-21f2-4c41-80fd-b8c8f2714dbb-kube-api-access-rdwks\") pod \"authorino-7bcfd8f9cd-jxfmn\" (UID: \"b9aeede0-21f2-4c41-80fd-b8c8f2714dbb\") " pod="kuadrant-system/authorino-7bcfd8f9cd-jxfmn"
Sep 17 14:17:24.471984 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:24.471958    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:17:24.472777 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:17:24.472754    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4821f268_1865_4973_b814_a9e54e76cf50.slice/crio-88e5619ba4132bd1bec4e3a4a40855646a5f6e21fe8794b56042273ee8d9892a WatchSource:0}: Error finding container 88e5619ba4132bd1bec4e3a4a40855646a5f6e21fe8794b56042273ee8d9892a: Status 404 returned error can't find the container with id 88e5619ba4132bd1bec4e3a4a40855646a5f6e21fe8794b56042273ee8d9892a
Sep 17 14:17:24.496513 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:24.496478    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdwks\" (UniqueName: \"kubernetes.io/projected/b9aeede0-21f2-4c41-80fd-b8c8f2714dbb-kube-api-access-rdwks\") pod \"authorino-7bcfd8f9cd-jxfmn\" (UID: \"b9aeede0-21f2-4c41-80fd-b8c8f2714dbb\") " pod="kuadrant-system/authorino-7bcfd8f9cd-jxfmn"
Sep 17 14:17:24.511935 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:24.511907    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdwks\" (UniqueName: \"kubernetes.io/projected/b9aeede0-21f2-4c41-80fd-b8c8f2714dbb-kube-api-access-rdwks\") pod \"authorino-7bcfd8f9cd-jxfmn\" (UID: \"b9aeede0-21f2-4c41-80fd-b8c8f2714dbb\") " pod="kuadrant-system/authorino-7bcfd8f9cd-jxfmn"
Sep 17 14:17:24.639795 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:24.639756    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-jxfmn"
Sep 17 14:17:24.941679 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:24.941654    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-jxfmn"]
Sep 17 14:17:24.943590 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:17:24.943564    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9aeede0_21f2_4c41_80fd_b8c8f2714dbb.slice/crio-37f10ca3fecc5675c2e6514fa0a792540fd1291fb25aba2e61276a07c3bec40e WatchSource:0}: Error finding container 37f10ca3fecc5675c2e6514fa0a792540fd1291fb25aba2e61276a07c3bec40e: Status 404 returned error can't find the container with id 37f10ca3fecc5675c2e6514fa0a792540fd1291fb25aba2e61276a07c3bec40e
Sep 17 14:17:25.078008 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:25.077968    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-jxfmn" event={"ID":"b9aeede0-21f2-4c41-80fd-b8c8f2714dbb","Type":"ContainerStarted","Data":"37f10ca3fecc5675c2e6514fa0a792540fd1291fb25aba2e61276a07c3bec40e"}
Sep 17 14:17:25.079137 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:25.079105    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-vvdg5" event={"ID":"4821f268-1865-4973-b814-a9e54e76cf50","Type":"ContainerStarted","Data":"88e5619ba4132bd1bec4e3a4a40855646a5f6e21fe8794b56042273ee8d9892a"}
Sep 17 14:17:26.087289 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:26.087249    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-vvdg5" event={"ID":"4821f268-1865-4973-b814-a9e54e76cf50","Type":"ContainerStarted","Data":"a70060af9276204ee23270419756adab798ec960dc74d2d36cc4f71374513a7a"}
Sep 17 14:17:26.087796 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:26.087373    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"
Sep 17 14:17:26.112062 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:26.112008    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-vvdg5" podStartSLOduration=2.029743092 podStartE2EDuration="3.111986947s" totalImagesPullingTime="1.082243855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:17:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:17:26.111042747 +0000 UTC m=+633.555118334" watchObservedRunningTime="2026-09-17 14:17:26.111986947 +0000 UTC m=+633.556062533"
Sep 17 14:17:27.095743 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:27.095670    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-jxfmn" event={"ID":"b9aeede0-21f2-4c41-80fd-b8c8f2714dbb","Type":"ContainerStarted","Data":"342f89866f02527a47534161c430f74470e1c7070ff11b4953613f9b57d8026d"}
Sep 17 14:17:27.134228 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:27.134171    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-jxfmn" podStartSLOduration=1.188162959 podStartE2EDuration="3.134154443s" totalImagesPullingTime="1.945991484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:17:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:17:27.131496959 +0000 UTC m=+634.575572546" watchObservedRunningTime="2026-09-17 14:17:27.134154443 +0000 UTC m=+634.578230028"
Sep 17 14:17:27.305574 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:27.305536    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-jxfmn"]
Sep 17 14:17:29.106618 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:29.106580    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-jxfmn" podUID="b9aeede0-21f2-4c41-80fd-b8c8f2714dbb" containerName="authorino" containerID="cri-o://342f89866f02527a47534161c430f74470e1c7070ff11b4953613f9b57d8026d" gracePeriod=30
Sep 17 14:17:29.342656 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:29.342630    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-jxfmn"
Sep 17 14:17:29.436669 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:29.436571    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdwks\" (UniqueName: \"kubernetes.io/projected/b9aeede0-21f2-4c41-80fd-b8c8f2714dbb-kube-api-access-rdwks\") pod \"b9aeede0-21f2-4c41-80fd-b8c8f2714dbb\" (UID: \"b9aeede0-21f2-4c41-80fd-b8c8f2714dbb\") "
Sep 17 14:17:29.438741 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:29.438693    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9aeede0-21f2-4c41-80fd-b8c8f2714dbb-kube-api-access-rdwks" (OuterVolumeSpecName: "kube-api-access-rdwks") pod "b9aeede0-21f2-4c41-80fd-b8c8f2714dbb" (UID: "b9aeede0-21f2-4c41-80fd-b8c8f2714dbb"). InnerVolumeSpecName "kube-api-access-rdwks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:17:29.537573 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:29.537529    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdwks\" (UniqueName: \"kubernetes.io/projected/b9aeede0-21f2-4c41-80fd-b8c8f2714dbb-kube-api-access-rdwks\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:17:30.113307 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:30.113269    2580 generic.go:356] "Generic (PLEG): container finished" podID="b9aeede0-21f2-4c41-80fd-b8c8f2714dbb" containerID="342f89866f02527a47534161c430f74470e1c7070ff11b4953613f9b57d8026d" exitCode=0
Sep 17 14:17:30.113784 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:30.113329    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-jxfmn"
Sep 17 14:17:30.113784 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:30.113357    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-jxfmn" event={"ID":"b9aeede0-21f2-4c41-80fd-b8c8f2714dbb","Type":"ContainerDied","Data":"342f89866f02527a47534161c430f74470e1c7070ff11b4953613f9b57d8026d"}
Sep 17 14:17:30.113784 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:30.113401    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-jxfmn" event={"ID":"b9aeede0-21f2-4c41-80fd-b8c8f2714dbb","Type":"ContainerDied","Data":"37f10ca3fecc5675c2e6514fa0a792540fd1291fb25aba2e61276a07c3bec40e"}
Sep 17 14:17:30.113784 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:30.113419    2580 scope.go:117] "RemoveContainer" containerID="342f89866f02527a47534161c430f74470e1c7070ff11b4953613f9b57d8026d"
Sep 17 14:17:30.122438 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:30.122417    2580 scope.go:117] "RemoveContainer" containerID="342f89866f02527a47534161c430f74470e1c7070ff11b4953613f9b57d8026d"
Sep 17 14:17:30.122750 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:17:30.122706    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"342f89866f02527a47534161c430f74470e1c7070ff11b4953613f9b57d8026d\": container with ID starting with 342f89866f02527a47534161c430f74470e1c7070ff11b4953613f9b57d8026d not found: ID does not exist" containerID="342f89866f02527a47534161c430f74470e1c7070ff11b4953613f9b57d8026d"
Sep 17 14:17:30.122829 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:30.122765    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"342f89866f02527a47534161c430f74470e1c7070ff11b4953613f9b57d8026d"} err="failed to get container status \"342f89866f02527a47534161c430f74470e1c7070ff11b4953613f9b57d8026d\": rpc error: code = NotFound desc = could not find container \"342f89866f02527a47534161c430f74470e1c7070ff11b4953613f9b57d8026d\": container with ID starting with 342f89866f02527a47534161c430f74470e1c7070ff11b4953613f9b57d8026d not found: ID does not exist"
Sep 17 14:17:30.137305 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:30.137271    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-jxfmn"]
Sep 17 14:17:30.144944 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:30.144911    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-jxfmn"]
Sep 17 14:17:31.176944 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:31.176902    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9aeede0-21f2-4c41-80fd-b8c8f2714dbb" path="/var/lib/kubelet/pods/b9aeede0-21f2-4c41-80fd-b8c8f2714dbb/volumes"
Sep 17 14:17:37.097243 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:37.097212    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"
Sep 17 14:17:52.290537 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:52.290504    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-wlx6l"]
Sep 17 14:17:52.290908 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:52.290894    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9aeede0-21f2-4c41-80fd-b8c8f2714dbb" containerName="authorino"
Sep 17 14:17:52.290908 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:52.290906    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9aeede0-21f2-4c41-80fd-b8c8f2714dbb" containerName="authorino"
Sep 17 14:17:52.290997 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:52.290971    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9aeede0-21f2-4c41-80fd-b8c8f2714dbb" containerName="authorino"
Sep 17 14:17:52.293617 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:52.293599    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-wlx6l"
Sep 17 14:17:52.297335 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:52.297312    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6svbb\""
Sep 17 14:17:52.323900 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:52.323860    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-wlx6l"]
Sep 17 14:17:52.441339 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:52.441297    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncl6x\" (UniqueName: \"kubernetes.io/projected/9e0b892a-6d6a-444a-b8a9-d8eab8f2e286-kube-api-access-ncl6x\") pod \"authorino-557f876f69-wlx6l\" (UID: \"9e0b892a-6d6a-444a-b8a9-d8eab8f2e286\") " pod="kuadrant-system/authorino-557f876f69-wlx6l"
Sep 17 14:17:52.447561 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:52.447533    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-wlx6l"]
Sep 17 14:17:52.447816 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:17:52.447794    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-ncl6x], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-wlx6l" podUID="9e0b892a-6d6a-444a-b8a9-d8eab8f2e286"
Sep 17 14:17:52.542467 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:52.542363    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncl6x\" (UniqueName: \"kubernetes.io/projected/9e0b892a-6d6a-444a-b8a9-d8eab8f2e286-kube-api-access-ncl6x\") pod \"authorino-557f876f69-wlx6l\" (UID: \"9e0b892a-6d6a-444a-b8a9-d8eab8f2e286\") " pod="kuadrant-system/authorino-557f876f69-wlx6l"
Sep 17 14:17:52.578844 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:52.578807    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncl6x\" (UniqueName: \"kubernetes.io/projected/9e0b892a-6d6a-444a-b8a9-d8eab8f2e286-kube-api-access-ncl6x\") pod \"authorino-557f876f69-wlx6l\" (UID: \"9e0b892a-6d6a-444a-b8a9-d8eab8f2e286\") " pod="kuadrant-system/authorino-557f876f69-wlx6l"
Sep 17 14:17:53.245196 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:53.245162    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-wlx6l"
Sep 17 14:17:53.253046 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:53.253018    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-wlx6l"
Sep 17 14:17:53.350106 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:53.350007    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncl6x\" (UniqueName: \"kubernetes.io/projected/9e0b892a-6d6a-444a-b8a9-d8eab8f2e286-kube-api-access-ncl6x\") pod \"9e0b892a-6d6a-444a-b8a9-d8eab8f2e286\" (UID: \"9e0b892a-6d6a-444a-b8a9-d8eab8f2e286\") "
Sep 17 14:17:53.352166 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:53.352127    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e0b892a-6d6a-444a-b8a9-d8eab8f2e286-kube-api-access-ncl6x" (OuterVolumeSpecName: "kube-api-access-ncl6x") pod "9e0b892a-6d6a-444a-b8a9-d8eab8f2e286" (UID: "9e0b892a-6d6a-444a-b8a9-d8eab8f2e286"). InnerVolumeSpecName "kube-api-access-ncl6x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:17:53.451341 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:53.451303    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncl6x\" (UniqueName: \"kubernetes.io/projected/9e0b892a-6d6a-444a-b8a9-d8eab8f2e286-kube-api-access-ncl6x\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:17:54.250781 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:54.250746    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-wlx6l"
Sep 17 14:17:54.308560 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:54.308523    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-wlx6l"]
Sep 17 14:17:54.315256 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:54.315221    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-wlx6l"]
Sep 17 14:17:55.177669 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:17:55.177637    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e0b892a-6d6a-444a-b8a9-d8eab8f2e286" path="/var/lib/kubelet/pods/9e0b892a-6d6a-444a-b8a9-d8eab8f2e286/volumes"
Sep 17 14:18:37.967630 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:18:37.967594    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:19:10.753469 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:19:10.753432    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:19:34.545854 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:19:34.545817    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:19:39.967022 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:19:39.963347    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b6d68d965-vfjjb"]
Sep 17 14:19:45.837142 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:19:45.837101    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:20:04.986623 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:04.986559    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b6d68d965-vfjjb" podUID="ad7512ed-910b-4703-b298-701594cbdf5b" containerName="console" containerID="cri-o://2734de3c741eb1e38ea5b866f7fe645200b8bea27d29e5391d4b7014c94cc315" gracePeriod=15
Sep 17 14:20:05.237155 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.237083    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6d68d965-vfjjb"
Sep 17 14:20:05.319573 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.319533    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad7512ed-910b-4703-b298-701594cbdf5b-console-config\") pod \"ad7512ed-910b-4703-b298-701594cbdf5b\" (UID: \"ad7512ed-910b-4703-b298-701594cbdf5b\") "
Sep 17 14:20:05.319796 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.319591    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnxfc\" (UniqueName: \"kubernetes.io/projected/ad7512ed-910b-4703-b298-701594cbdf5b-kube-api-access-xnxfc\") pod \"ad7512ed-910b-4703-b298-701594cbdf5b\" (UID: \"ad7512ed-910b-4703-b298-701594cbdf5b\") "
Sep 17 14:20:05.319796 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.319619    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad7512ed-910b-4703-b298-701594cbdf5b-console-oauth-config\") pod \"ad7512ed-910b-4703-b298-701594cbdf5b\" (UID: \"ad7512ed-910b-4703-b298-701594cbdf5b\") "
Sep 17 14:20:05.319796 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.319646    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad7512ed-910b-4703-b298-701594cbdf5b-service-ca\") pod \"ad7512ed-910b-4703-b298-701594cbdf5b\" (UID: \"ad7512ed-910b-4703-b298-701594cbdf5b\") "
Sep 17 14:20:05.319796 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.319674    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad7512ed-910b-4703-b298-701594cbdf5b-console-serving-cert\") pod \"ad7512ed-910b-4703-b298-701594cbdf5b\" (UID: \"ad7512ed-910b-4703-b298-701594cbdf5b\") "
Sep 17 14:20:05.319796 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.319731    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad7512ed-910b-4703-b298-701594cbdf5b-trusted-ca-bundle\") pod \"ad7512ed-910b-4703-b298-701594cbdf5b\" (UID: \"ad7512ed-910b-4703-b298-701594cbdf5b\") "
Sep 17 14:20:05.319796 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.319770    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad7512ed-910b-4703-b298-701594cbdf5b-oauth-serving-cert\") pod \"ad7512ed-910b-4703-b298-701594cbdf5b\" (UID: \"ad7512ed-910b-4703-b298-701594cbdf5b\") "
Sep 17 14:20:05.320138 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.320104    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad7512ed-910b-4703-b298-701594cbdf5b-console-config" (OuterVolumeSpecName: "console-config") pod "ad7512ed-910b-4703-b298-701594cbdf5b" (UID: "ad7512ed-910b-4703-b298-701594cbdf5b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:20:05.320239 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.320115    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad7512ed-910b-4703-b298-701594cbdf5b-service-ca" (OuterVolumeSpecName: "service-ca") pod "ad7512ed-910b-4703-b298-701594cbdf5b" (UID: "ad7512ed-910b-4703-b298-701594cbdf5b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:20:05.320286 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.320228    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad7512ed-910b-4703-b298-701594cbdf5b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ad7512ed-910b-4703-b298-701594cbdf5b" (UID: "ad7512ed-910b-4703-b298-701594cbdf5b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:20:05.320286 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.320269    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad7512ed-910b-4703-b298-701594cbdf5b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ad7512ed-910b-4703-b298-701594cbdf5b" (UID: "ad7512ed-910b-4703-b298-701594cbdf5b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:20:05.322041 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.322019    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad7512ed-910b-4703-b298-701594cbdf5b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ad7512ed-910b-4703-b298-701594cbdf5b" (UID: "ad7512ed-910b-4703-b298-701594cbdf5b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:20:05.322283 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.322253    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad7512ed-910b-4703-b298-701594cbdf5b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ad7512ed-910b-4703-b298-701594cbdf5b" (UID: "ad7512ed-910b-4703-b298-701594cbdf5b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:20:05.322376 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.322299    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad7512ed-910b-4703-b298-701594cbdf5b-kube-api-access-xnxfc" (OuterVolumeSpecName: "kube-api-access-xnxfc") pod "ad7512ed-910b-4703-b298-701594cbdf5b" (UID: "ad7512ed-910b-4703-b298-701594cbdf5b"). InnerVolumeSpecName "kube-api-access-xnxfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:20:05.420523 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.420476    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad7512ed-910b-4703-b298-701594cbdf5b-console-oauth-config\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:20:05.420523 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.420515    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad7512ed-910b-4703-b298-701594cbdf5b-service-ca\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:20:05.420523 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.420529    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad7512ed-910b-4703-b298-701594cbdf5b-console-serving-cert\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:20:05.420825 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.420540    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad7512ed-910b-4703-b298-701594cbdf5b-trusted-ca-bundle\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:20:05.420825 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.420553    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad7512ed-910b-4703-b298-701594cbdf5b-oauth-serving-cert\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:20:05.420825 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.420566    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad7512ed-910b-4703-b298-701594cbdf5b-console-config\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:20:05.420825 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.420578    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnxfc\" (UniqueName: \"kubernetes.io/projected/ad7512ed-910b-4703-b298-701594cbdf5b-kube-api-access-xnxfc\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:20:05.960228 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.960194    2580 generic.go:356] "Generic (PLEG): container finished" podID="ad7512ed-910b-4703-b298-701594cbdf5b" containerID="2734de3c741eb1e38ea5b866f7fe645200b8bea27d29e5391d4b7014c94cc315" exitCode=0
Sep 17 14:20:05.960407 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.960252    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6d68d965-vfjjb"
Sep 17 14:20:05.960407 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.960285    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6d68d965-vfjjb" event={"ID":"ad7512ed-910b-4703-b298-701594cbdf5b","Type":"ContainerDied","Data":"2734de3c741eb1e38ea5b866f7fe645200b8bea27d29e5391d4b7014c94cc315"}
Sep 17 14:20:05.960407 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.960332    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6d68d965-vfjjb" event={"ID":"ad7512ed-910b-4703-b298-701594cbdf5b","Type":"ContainerDied","Data":"b5f569caccb8b106356048e214ab654bee8c87dcb8247023d64c76f04259c0b6"}
Sep 17 14:20:05.960407 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.960351    2580 scope.go:117] "RemoveContainer" containerID="2734de3c741eb1e38ea5b866f7fe645200b8bea27d29e5391d4b7014c94cc315"
Sep 17 14:20:05.970584 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.970558    2580 scope.go:117] "RemoveContainer" containerID="2734de3c741eb1e38ea5b866f7fe645200b8bea27d29e5391d4b7014c94cc315"
Sep 17 14:20:05.971010 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:20:05.970988    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2734de3c741eb1e38ea5b866f7fe645200b8bea27d29e5391d4b7014c94cc315\": container with ID starting with 2734de3c741eb1e38ea5b866f7fe645200b8bea27d29e5391d4b7014c94cc315 not found: ID does not exist" containerID="2734de3c741eb1e38ea5b866f7fe645200b8bea27d29e5391d4b7014c94cc315"
Sep 17 14:20:05.971072 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.971021    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2734de3c741eb1e38ea5b866f7fe645200b8bea27d29e5391d4b7014c94cc315"} err="failed to get container status \"2734de3c741eb1e38ea5b866f7fe645200b8bea27d29e5391d4b7014c94cc315\": rpc error: code = NotFound desc = could not find container \"2734de3c741eb1e38ea5b866f7fe645200b8bea27d29e5391d4b7014c94cc315\": container with ID starting with 2734de3c741eb1e38ea5b866f7fe645200b8bea27d29e5391d4b7014c94cc315 not found: ID does not exist"
Sep 17 14:20:05.984612 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.984583    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2trkm"]
Sep 17 14:20:05.985006 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.984992    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad7512ed-910b-4703-b298-701594cbdf5b" containerName="console"
Sep 17 14:20:05.985056 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.985008    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad7512ed-910b-4703-b298-701594cbdf5b" containerName="console"
Sep 17 14:20:05.985090 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.985067    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad7512ed-910b-4703-b298-701594cbdf5b" containerName="console"
Sep 17 14:20:05.989408 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:05.989383    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2trkm"
Sep 17 14:20:06.001099 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:06.001063    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 17 14:20:06.001335 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:06.001073    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pqctc\""
Sep 17 14:20:06.001335 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:06.001074    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 17 14:20:06.001335 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:06.001107    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 17 14:20:06.007383 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:06.007360    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2trkm"]
Sep 17 14:20:06.025668 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:06.025634    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2b29a26-7f70-41d4-af32-09def28660cf-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2trkm\" (UID: \"e2b29a26-7f70-41d4-af32-09def28660cf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2trkm"
Sep 17 14:20:06.025855 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:06.025673    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2b29a26-7f70-41d4-af32-09def28660cf-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2trkm\" (UID: \"e2b29a26-7f70-41d4-af32-09def28660cf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2trkm"
Sep 17 14:20:06.025855 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:06.025695    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2b29a26-7f70-41d4-af32-09def28660cf-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2trkm\" (UID: \"e2b29a26-7f70-41d4-af32-09def28660cf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2trkm"
Sep 17 14:20:06.025855 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:06.025774    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2b29a26-7f70-41d4-af32-09def28660cf-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2trkm\" (UID: \"e2b29a26-7f70-41d4-af32-09def28660cf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2trkm"
Sep 17 14:20:06.025855 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:06.025841    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6kbp\" (UniqueName: \"kubernetes.io/projected/e2b29a26-7f70-41d4-af32-09def28660cf-kube-api-access-p6kbp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2trkm\" (UID: \"e2b29a26-7f70-41d4-af32-09def28660cf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2trkm"
Sep 17 14:20:06.026034 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:06.025878    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2b29a26-7f70-41d4-af32-09def28660cf-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2trkm\" (UID: \"e2b29a26-7f70-41d4-af32-09def28660cf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2trkm"
Sep 17 14:20:06.053804 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:06.053763    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b6d68d965-vfjjb"]
Sep 17 14:20:06.057349 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:06.057317    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b6d68d965-vfjjb"]
Sep 17 14:20:06.126990 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:06.126953    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2b29a26-7f70-41d4-af32-09def28660cf-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2trkm\" (UID: \"e2b29a26-7f70-41d4-af32-09def28660cf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2trkm"
Sep 17 14:20:06.127162 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:06.126996    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2b29a26-7f70-41d4-af32-09def28660cf-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2trkm\" (UID: \"e2b29a26-7f70-41d4-af32-09def28660cf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2trkm"
Sep 17 14:20:06.127162 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:06.127020    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2b29a26-7f70-41d4-af32-09def28660cf-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2trkm\" (UID: \"e2b29a26-7f70-41d4-af32-09def28660cf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2trkm"
Sep 17 14:20:06.127162 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:06.127042    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2b29a26-7f70-41d4-af32-09def28660cf-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2trkm\" (UID: \"e2b29a26-7f70-41d4-af32-09def28660cf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2trkm"
Sep 17 14:20:06.127162 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:06.127062    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6kbp\" (UniqueName: \"kubernetes.io/projected/e2b29a26-7f70-41d4-af32-09def28660cf-kube-api-access-p6kbp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2trkm\" (UID: \"e2b29a26-7f70-41d4-af32-09def28660cf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2trkm"
Sep 17 14:20:06.127162 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:06.127082    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2b29a26-7f70-41d4-af32-09def28660cf-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2trkm\" (UID: \"e2b29a26-7f70-41d4-af32-09def28660cf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2trkm"
Sep 17 14:20:06.127523 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:06.127500    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2b29a26-7f70-41d4-af32-09def28660cf-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2trkm\" (UID: \"e2b29a26-7f70-41d4-af32-09def28660cf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2trkm"
Sep 17 14:20:06.127583 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:06.127541    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2b29a26-7f70-41d4-af32-09def28660cf-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2trkm\" (UID: \"e2b29a26-7f70-41d4-af32-09def28660cf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2trkm"
Sep 17 14:20:06.127583 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:06.127555    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2b29a26-7f70-41d4-af32-09def28660cf-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2trkm\" (UID: \"e2b29a26-7f70-41d4-af32-09def28660cf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2trkm"
Sep 17 14:20:06.129328 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:06.129306    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2b29a26-7f70-41d4-af32-09def28660cf-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2trkm\" (UID: \"e2b29a26-7f70-41d4-af32-09def28660cf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2trkm"
Sep 17 14:20:06.129615 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:06.129599    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2b29a26-7f70-41d4-af32-09def28660cf-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2trkm\" (UID: \"e2b29a26-7f70-41d4-af32-09def28660cf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2trkm"
Sep 17 14:20:06.140981 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:06.140953    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6kbp\" (UniqueName: \"kubernetes.io/projected/e2b29a26-7f70-41d4-af32-09def28660cf-kube-api-access-p6kbp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2trkm\" (UID: \"e2b29a26-7f70-41d4-af32-09def28660cf\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2trkm"
Sep 17 14:20:06.300019 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:06.299930    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2trkm"
Sep 17 14:20:06.575568 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:06.575544    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2trkm"]
Sep 17 14:20:06.576885 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:20:06.576854    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2b29a26_7f70_41d4_af32_09def28660cf.slice/crio-fef62b43f87c7f391af79e20a433a19a84961574761aec0141ca617322a45eb7 WatchSource:0}: Error finding container fef62b43f87c7f391af79e20a433a19a84961574761aec0141ca617322a45eb7: Status 404 returned error can't find the container with id fef62b43f87c7f391af79e20a433a19a84961574761aec0141ca617322a45eb7
Sep 17 14:20:06.578081 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:06.578056    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 14:20:06.971164 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:06.971121    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2trkm" event={"ID":"e2b29a26-7f70-41d4-af32-09def28660cf","Type":"ContainerStarted","Data":"fef62b43f87c7f391af79e20a433a19a84961574761aec0141ca617322a45eb7"}
Sep 17 14:20:07.179167 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:07.179091    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad7512ed-910b-4703-b298-701594cbdf5b" path="/var/lib/kubelet/pods/ad7512ed-910b-4703-b298-701594cbdf5b/volumes"
Sep 17 14:20:07.429919 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:07.429832    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:20:07.978537 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:07.978493    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2trkm" event={"ID":"e2b29a26-7f70-41d4-af32-09def28660cf","Type":"ContainerStarted","Data":"ac8acc42b857ffb6ae2acb6c3599dcc1391667d3cb94d33f8195980c0f4e793c"}
Sep 17 14:20:08.001494 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:08.001432    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2trkm" podStartSLOduration=1.90106928 podStartE2EDuration="3.001413977s" totalImagesPullingTime="1.100344697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:20:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:20:08.000365426 +0000 UTC m=+795.444441039" watchObservedRunningTime="2026-09-17 14:20:08.001413977 +0000 UTC m=+795.445489563"
Sep 17 14:20:16.300335 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:16.300241    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2trkm"
Sep 17 14:20:16.300335 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:16.300307    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2trkm"
Sep 17 14:20:16.312919 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:16.312893    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2trkm"
Sep 17 14:20:17.035521 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:17.035492    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2trkm"
Sep 17 14:20:24.590863 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:24.590827    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:20:33.217936 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:33.217888    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:20:41.539686 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:20:41.539647    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:21:26.850791 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:26.850754    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d6cbff976-tszfl"]
Sep 17 14:21:26.853517 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:26.853493    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d6cbff976-tszfl"
Sep 17 14:21:26.857890 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:26.857867    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6svbb\""
Sep 17 14:21:26.858035 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:26.857909    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 17 14:21:26.867193 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:26.867165    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d6cbff976-tszfl"]
Sep 17 14:21:27.045856 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:27.045820    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pqgj\" (UniqueName: \"kubernetes.io/projected/c68b2bee-0ac9-4a03-8792-64b7be955a1c-kube-api-access-6pqgj\") pod \"authorino-d6cbff976-tszfl\" (UID: \"c68b2bee-0ac9-4a03-8792-64b7be955a1c\") " pod="kuadrant-system/authorino-d6cbff976-tszfl"
Sep 17 14:21:27.046027 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:27.045874    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c68b2bee-0ac9-4a03-8792-64b7be955a1c-tls-cert\") pod \"authorino-d6cbff976-tszfl\" (UID: \"c68b2bee-0ac9-4a03-8792-64b7be955a1c\") " pod="kuadrant-system/authorino-d6cbff976-tszfl"
Sep 17 14:21:27.146803 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:27.146656    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pqgj\" (UniqueName: \"kubernetes.io/projected/c68b2bee-0ac9-4a03-8792-64b7be955a1c-kube-api-access-6pqgj\") pod \"authorino-d6cbff976-tszfl\" (UID: \"c68b2bee-0ac9-4a03-8792-64b7be955a1c\") " pod="kuadrant-system/authorino-d6cbff976-tszfl"
Sep 17 14:21:27.146803 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:27.146768    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c68b2bee-0ac9-4a03-8792-64b7be955a1c-tls-cert\") pod \"authorino-d6cbff976-tszfl\" (UID: \"c68b2bee-0ac9-4a03-8792-64b7be955a1c\") " pod="kuadrant-system/authorino-d6cbff976-tszfl"
Sep 17 14:21:27.149258 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:27.149235    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c68b2bee-0ac9-4a03-8792-64b7be955a1c-tls-cert\") pod \"authorino-d6cbff976-tszfl\" (UID: \"c68b2bee-0ac9-4a03-8792-64b7be955a1c\") " pod="kuadrant-system/authorino-d6cbff976-tszfl"
Sep 17 14:21:27.156759 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:27.156705    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pqgj\" (UniqueName: \"kubernetes.io/projected/c68b2bee-0ac9-4a03-8792-64b7be955a1c-kube-api-access-6pqgj\") pod \"authorino-d6cbff976-tszfl\" (UID: \"c68b2bee-0ac9-4a03-8792-64b7be955a1c\") " pod="kuadrant-system/authorino-d6cbff976-tszfl"
Sep 17 14:21:27.162538 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:27.162514    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d6cbff976-tszfl"
Sep 17 14:21:27.442437 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:27.442401    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d6cbff976-tszfl"]
Sep 17 14:21:27.442567 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:21:27.442437    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc68b2bee_0ac9_4a03_8792_64b7be955a1c.slice/crio-7db8ccb25ca965414de18867305cf20ddf640407bbc5a23a213990ed05b8032e WatchSource:0}: Error finding container 7db8ccb25ca965414de18867305cf20ddf640407bbc5a23a213990ed05b8032e: Status 404 returned error can't find the container with id 7db8ccb25ca965414de18867305cf20ddf640407bbc5a23a213990ed05b8032e
Sep 17 14:21:28.430549 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:28.430514    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d6cbff976-tszfl" event={"ID":"c68b2bee-0ac9-4a03-8792-64b7be955a1c","Type":"ContainerStarted","Data":"61da5824ebb30fc54f686c4e650dee5ffa679271ab1c89fa5d642e55473cc744"}
Sep 17 14:21:28.430986 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:28.430560    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d6cbff976-tszfl" event={"ID":"c68b2bee-0ac9-4a03-8792-64b7be955a1c","Type":"ContainerStarted","Data":"7db8ccb25ca965414de18867305cf20ddf640407bbc5a23a213990ed05b8032e"}
Sep 17 14:21:28.455812 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:28.455736    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-d6cbff976-tszfl" podStartSLOduration=1.5795658339999998 podStartE2EDuration="2.455700115s" totalImagesPullingTime="876.134281ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:21:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:21:28.453460515 +0000 UTC m=+875.897536100" watchObservedRunningTime="2026-09-17 14:21:28.455700115 +0000 UTC m=+875.899775703"
Sep 17 14:21:51.613480 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:51.613444    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7371-75b14f"]
Sep 17 14:21:51.615888 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:51.615871    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7371-75b14f"
Sep 17 14:21:51.618752 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:51.618707    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-cflzc\""
Sep 17 14:21:51.630068 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:51.630034    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7371-75b14f"]
Sep 17 14:21:51.673735 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:51.673685    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xg8b\" (UniqueName: \"kubernetes.io/projected/ce6322cf-1c48-4e22-8ebe-4592c413e257-kube-api-access-9xg8b\") pod \"test-curl-7371-75b14f\" (UID: \"ce6322cf-1c48-4e22-8ebe-4592c413e257\") " pod="opendatahub/test-curl-7371-75b14f"
Sep 17 14:21:51.775046 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:51.775004    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xg8b\" (UniqueName: \"kubernetes.io/projected/ce6322cf-1c48-4e22-8ebe-4592c413e257-kube-api-access-9xg8b\") pod \"test-curl-7371-75b14f\" (UID: \"ce6322cf-1c48-4e22-8ebe-4592c413e257\") " pod="opendatahub/test-curl-7371-75b14f"
Sep 17 14:21:51.785591 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:51.785563    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xg8b\" (UniqueName: \"kubernetes.io/projected/ce6322cf-1c48-4e22-8ebe-4592c413e257-kube-api-access-9xg8b\") pod \"test-curl-7371-75b14f\" (UID: \"ce6322cf-1c48-4e22-8ebe-4592c413e257\") " pod="opendatahub/test-curl-7371-75b14f"
Sep 17 14:21:51.925346 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:51.925252    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7371-75b14f"
Sep 17 14:21:52.196832 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:52.196805    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7371-75b14f"]
Sep 17 14:21:52.198205 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:21:52.198178    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce6322cf_1c48_4e22_8ebe_4592c413e257.slice/crio-afa4bab41ab2d61f51e3e8f6d844b5bb79d6811f7772e606a8c3a1ff8757ed8f WatchSource:0}: Error finding container afa4bab41ab2d61f51e3e8f6d844b5bb79d6811f7772e606a8c3a1ff8757ed8f: Status 404 returned error can't find the container with id afa4bab41ab2d61f51e3e8f6d844b5bb79d6811f7772e606a8c3a1ff8757ed8f
Sep 17 14:21:52.565707 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:52.565673    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7371-75b14f" event={"ID":"ce6322cf-1c48-4e22-8ebe-4592c413e257","Type":"ContainerStarted","Data":"afa4bab41ab2d61f51e3e8f6d844b5bb79d6811f7772e606a8c3a1ff8757ed8f"}
Sep 17 14:21:53.764625 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:53.764587    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:21:54.584632 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:54.584524    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7371-75b14f" event={"ID":"ce6322cf-1c48-4e22-8ebe-4592c413e257","Type":"ContainerStarted","Data":"a0a1e5e124066761a80d03c60dea627c88d03e7cd9d6245ac94fe636e43e09d5"}
Sep 17 14:21:54.603408 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:54.603351    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7371-75b14f" podStartSLOduration=1.472414595 podStartE2EDuration="3.603333624s" totalImagesPullingTime="2.130919029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:21:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:21:54.601960934 +0000 UTC m=+902.046036547" watchObservedRunningTime="2026-09-17 14:21:54.603333624 +0000 UTC m=+902.047409209"
Sep 17 14:21:55.240921 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:55.240884    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7371-75b14f"]
Sep 17 14:21:55.252854 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:55.252778    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7371-75b14f"]
Sep 17 14:21:55.374464 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:55.374410    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7371-72fbcb"]
Sep 17 14:21:55.375274 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:55.375246    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce6322cf-1c48-4e22-8ebe-4592c413e257" containerName="test-curl-7371-75b14f"
Sep 17 14:21:55.375274 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:55.375275    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce6322cf-1c48-4e22-8ebe-4592c413e257" containerName="test-curl-7371-75b14f"
Sep 17 14:21:55.375475 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:55.375461    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce6322cf-1c48-4e22-8ebe-4592c413e257" containerName="test-curl-7371-75b14f"
Sep 17 14:21:55.378419 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:55.378389    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7371-72fbcb"
Sep 17 14:21:55.383114 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:55.383085    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7371-72fbcb"]
Sep 17 14:21:55.512766 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:55.512644    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvmjp\" (UniqueName: \"kubernetes.io/projected/68353ddb-2b38-4c71-93f1-05467d154645-kube-api-access-hvmjp\") pod \"test-curl-7371-72fbcb\" (UID: \"68353ddb-2b38-4c71-93f1-05467d154645\") " pod="opendatahub/test-curl-7371-72fbcb"
Sep 17 14:21:55.589730 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:21:55.589688    2580 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7371-75b14f" container="test-curl-7371-75b14f"
Sep 17 14:21:55.613868 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:55.613833    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvmjp\" (UniqueName: \"kubernetes.io/projected/68353ddb-2b38-4c71-93f1-05467d154645-kube-api-access-hvmjp\") pod \"test-curl-7371-72fbcb\" (UID: \"68353ddb-2b38-4c71-93f1-05467d154645\") " pod="opendatahub/test-curl-7371-72fbcb"
Sep 17 14:21:55.627134 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:55.627105    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvmjp\" (UniqueName: \"kubernetes.io/projected/68353ddb-2b38-4c71-93f1-05467d154645-kube-api-access-hvmjp\") pod \"test-curl-7371-72fbcb\" (UID: \"68353ddb-2b38-4c71-93f1-05467d154645\") " pod="opendatahub/test-curl-7371-72fbcb"
Sep 17 14:21:55.689303 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:55.689261    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7371-72fbcb"
Sep 17 14:21:55.964160 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:55.964132    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7371-72fbcb"]
Sep 17 14:21:55.965434 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:21:55.965408    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68353ddb_2b38_4c71_93f1_05467d154645.slice/crio-707e9b029f82e99efa1918bfdea69ffb53b994c84dc93458bd0012c55d6687b0 WatchSource:0}: Error finding container 707e9b029f82e99efa1918bfdea69ffb53b994c84dc93458bd0012c55d6687b0: Status 404 returned error can't find the container with id 707e9b029f82e99efa1918bfdea69ffb53b994c84dc93458bd0012c55d6687b0
Sep 17 14:21:56.597012 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:56.596972    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7371-72fbcb" event={"ID":"68353ddb-2b38-4c71-93f1-05467d154645","Type":"ContainerStarted","Data":"ca6aefd7472b4dc0e269958248feb9c4edf79295f77e5a0ec915b8753e5aced8"}
Sep 17 14:21:56.597390 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:56.597020    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7371-72fbcb" event={"ID":"68353ddb-2b38-4c71-93f1-05467d154645","Type":"ContainerStarted","Data":"707e9b029f82e99efa1918bfdea69ffb53b994c84dc93458bd0012c55d6687b0"}
Sep 17 14:21:56.597390 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:56.597128    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7371-75b14f" podUID="ce6322cf-1c48-4e22-8ebe-4592c413e257" containerName="test-curl-7371-75b14f" containerID="cri-o://a0a1e5e124066761a80d03c60dea627c88d03e7cd9d6245ac94fe636e43e09d5" gracePeriod=2
Sep 17 14:21:56.617351 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:56.617296    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7371-72fbcb" podStartSLOduration=1.617279334 podStartE2EDuration="1.617279334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:21:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:21:56.616118895 +0000 UTC m=+904.060194482" watchObservedRunningTime="2026-09-17 14:21:56.617279334 +0000 UTC m=+904.061354918"
Sep 17 14:21:56.618880 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:21:56.618852    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7371-75b14f\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" podUID="ce6322cf-1c48-4e22-8ebe-4592c413e257" pod="opendatahub/test-curl-7371-75b14f"
Sep 17 14:21:56.822086 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:56.822055    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-8b50f2-77b8c4548f-9drjt"]
Sep 17 14:21:56.824659 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:56.824636    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-8b50f2-77b8c4548f-9drjt"
Sep 17 14:21:56.828017 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:56.827990    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-8b50f2\""
Sep 17 14:21:56.831901 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:56.831878    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-8b50f2-dockercfg-pzhvz\""
Sep 17 14:21:56.842793 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:56.842757    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-8b50f2-77b8c4548f-9drjt"]
Sep 17 14:21:56.864796 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:21:56.864678    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7371-75b14f\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" podUID="ce6322cf-1c48-4e22-8ebe-4592c413e257" pod="opendatahub/test-curl-7371-75b14f"
Sep 17 14:21:56.925499 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:56.925455    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b79b\" (UniqueName: \"kubernetes.io/projected/f1058a4a-293f-4bb5-9046-85965ce053b5-kube-api-access-6b79b\") pod \"payload-processing-e2e-worker-w4-8b50f2-77b8c4548f-9drjt\" (UID: \"f1058a4a-293f-4bb5-9046-85965ce053b5\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-8b50f2-77b8c4548f-9drjt"
Sep 17 14:21:56.925707 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:56.925585    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1058a4a-293f-4bb5-9046-85965ce053b5-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-8b50f2-77b8c4548f-9drjt\" (UID: \"f1058a4a-293f-4bb5-9046-85965ce053b5\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-8b50f2-77b8c4548f-9drjt"
Sep 17 14:21:57.026160 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:57.026125    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b79b\" (UniqueName: \"kubernetes.io/projected/f1058a4a-293f-4bb5-9046-85965ce053b5-kube-api-access-6b79b\") pod \"payload-processing-e2e-worker-w4-8b50f2-77b8c4548f-9drjt\" (UID: \"f1058a4a-293f-4bb5-9046-85965ce053b5\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-8b50f2-77b8c4548f-9drjt"
Sep 17 14:21:57.026359 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:57.026212    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1058a4a-293f-4bb5-9046-85965ce053b5-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-8b50f2-77b8c4548f-9drjt\" (UID: \"f1058a4a-293f-4bb5-9046-85965ce053b5\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-8b50f2-77b8c4548f-9drjt"
Sep 17 14:21:57.027108 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:57.027081    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1058a4a-293f-4bb5-9046-85965ce053b5-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-8b50f2-77b8c4548f-9drjt\" (UID: \"f1058a4a-293f-4bb5-9046-85965ce053b5\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-8b50f2-77b8c4548f-9drjt"
Sep 17 14:21:57.035278 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:57.035250    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b79b\" (UniqueName: \"kubernetes.io/projected/f1058a4a-293f-4bb5-9046-85965ce053b5-kube-api-access-6b79b\") pod \"payload-processing-e2e-worker-w4-8b50f2-77b8c4548f-9drjt\" (UID: \"f1058a4a-293f-4bb5-9046-85965ce053b5\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-8b50f2-77b8c4548f-9drjt"
Sep 17 14:21:57.135634 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:57.135549    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-8b50f2-77b8c4548f-9drjt"
Sep 17 14:21:57.215755 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:57.215705    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb"]
Sep 17 14:21:57.219022 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:57.218989    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb"
Sep 17 14:21:57.223625 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:57.223400    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-2e1b82-serving-cert\""
Sep 17 14:21:57.223625 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:57.223421    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 14:21:57.223625 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:57.223526    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2n86r\""
Sep 17 14:21:57.223969 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:57.223946    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 17 14:21:57.224251 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:57.224234    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 17 14:21:57.235689 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:57.235660    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb"]
Sep 17 14:21:57.285199 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:57.285156    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7371-72fbcb"]
Sep 17 14:21:57.295391 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:57.295362    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7371-72fbcb"]
Sep 17 14:21:57.328513 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:57.328479    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1e02f94-127a-47f0-b390-5d70d333a04b-metrics-certs\") pod \"maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb\" (UID: \"a1e02f94-127a-47f0-b390-5d70d333a04b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb"
Sep 17 14:21:57.328513 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:57.328517    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2st8\" (UniqueName: \"kubernetes.io/projected/a1e02f94-127a-47f0-b390-5d70d333a04b-kube-api-access-p2st8\") pod \"maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb\" (UID: \"a1e02f94-127a-47f0-b390-5d70d333a04b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb"
Sep 17 14:21:57.328806 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:57.328542    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1e02f94-127a-47f0-b390-5d70d333a04b-maas-api-tls\") pod \"maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb\" (UID: \"a1e02f94-127a-47f0-b390-5d70d333a04b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb"
Sep 17 14:21:57.328806 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:57.328694    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1e02f94-127a-47f0-b390-5d70d333a04b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb\" (UID: \"a1e02f94-127a-47f0-b390-5d70d333a04b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb"
Sep 17 14:21:57.430150 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:57.430060    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1e02f94-127a-47f0-b390-5d70d333a04b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb\" (UID: \"a1e02f94-127a-47f0-b390-5d70d333a04b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb"
Sep 17 14:21:57.430150 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:57.430131    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1e02f94-127a-47f0-b390-5d70d333a04b-metrics-certs\") pod \"maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb\" (UID: \"a1e02f94-127a-47f0-b390-5d70d333a04b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb"
Sep 17 14:21:57.430150 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:57.430151    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2st8\" (UniqueName: \"kubernetes.io/projected/a1e02f94-127a-47f0-b390-5d70d333a04b-kube-api-access-p2st8\") pod \"maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb\" (UID: \"a1e02f94-127a-47f0-b390-5d70d333a04b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb"
Sep 17 14:21:57.430373 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:57.430167    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1e02f94-127a-47f0-b390-5d70d333a04b-maas-api-tls\") pod \"maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb\" (UID: \"a1e02f94-127a-47f0-b390-5d70d333a04b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb"
Sep 17 14:21:57.430373 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:21:57.430275    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-serving-cert: secret "maas-api-e2e-inf-a-2e1b82-serving-cert" not found
Sep 17 14:21:57.430373 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:21:57.430340    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1e02f94-127a-47f0-b390-5d70d333a04b-maas-api-tls podName:a1e02f94-127a-47f0-b390-5d70d333a04b nodeName:}" failed. No retries permitted until 2026-09-17 14:21:57.93032098 +0000 UTC m=+905.374396562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a1e02f94-127a-47f0-b390-5d70d333a04b-maas-api-tls") pod "maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb" (UID: "a1e02f94-127a-47f0-b390-5d70d333a04b") : secret "maas-api-e2e-inf-a-2e1b82-serving-cert" not found
Sep 17 14:21:57.430865 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:57.430841    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1e02f94-127a-47f0-b390-5d70d333a04b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb\" (UID: \"a1e02f94-127a-47f0-b390-5d70d333a04b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb"
Sep 17 14:21:57.432573 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:57.432551    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1e02f94-127a-47f0-b390-5d70d333a04b-metrics-certs\") pod \"maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb\" (UID: \"a1e02f94-127a-47f0-b390-5d70d333a04b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb"
Sep 17 14:21:57.438135 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:57.438106    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-8b50f2-77b8c4548f-9drjt"]
Sep 17 14:21:57.444069 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:21:57.444045    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1058a4a_293f_4bb5_9046_85965ce053b5.slice/crio-5c0dd7984e912faf3a298657fadfb757e8f949dce61fda7b6371d1ebff9156e6 WatchSource:0}: Error finding container 5c0dd7984e912faf3a298657fadfb757e8f949dce61fda7b6371d1ebff9156e6: Status 404 returned error can't find the container with id 5c0dd7984e912faf3a298657fadfb757e8f949dce61fda7b6371d1ebff9156e6
Sep 17 14:21:57.461855 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:57.461826    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2st8\" (UniqueName: \"kubernetes.io/projected/a1e02f94-127a-47f0-b390-5d70d333a04b-kube-api-access-p2st8\") pod \"maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb\" (UID: \"a1e02f94-127a-47f0-b390-5d70d333a04b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb"
Sep 17 14:21:57.604043 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:57.604010    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-8b50f2-77b8c4548f-9drjt" event={"ID":"f1058a4a-293f-4bb5-9046-85965ce053b5","Type":"ContainerStarted","Data":"5c0dd7984e912faf3a298657fadfb757e8f949dce61fda7b6371d1ebff9156e6"}
Sep 17 14:21:57.604425 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:21:57.604203    2580 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7371-72fbcb" container="test-curl-7371-72fbcb"
Sep 17 14:21:57.935281 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:57.935240    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1e02f94-127a-47f0-b390-5d70d333a04b-maas-api-tls\") pod \"maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb\" (UID: \"a1e02f94-127a-47f0-b390-5d70d333a04b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb"
Sep 17 14:21:57.937942 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:57.937916    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1e02f94-127a-47f0-b390-5d70d333a04b-maas-api-tls\") pod \"maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb\" (UID: \"a1e02f94-127a-47f0-b390-5d70d333a04b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb"
Sep 17 14:21:58.132362 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:58.132326    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb"
Sep 17 14:21:58.336690 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:58.336612    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-2e1b82-7d5dcc7b4f-nnbrq"]
Sep 17 14:21:58.337549 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:58.337520    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68353ddb-2b38-4c71-93f1-05467d154645" containerName="test-curl-7371-72fbcb"
Sep 17 14:21:58.337549 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:58.337549    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="68353ddb-2b38-4c71-93f1-05467d154645" containerName="test-curl-7371-72fbcb"
Sep 17 14:21:58.337798 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:58.337646    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="68353ddb-2b38-4c71-93f1-05467d154645" containerName="test-curl-7371-72fbcb"
Sep 17 14:21:58.339950 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:58.339922    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-2e1b82-7d5dcc7b4f-nnbrq"
Sep 17 14:21:58.342676 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:58.342650    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-2e1b82\""
Sep 17 14:21:58.357820 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:58.357776    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-2e1b82-7d5dcc7b4f-nnbrq"]
Sep 17 14:21:58.427472 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:58.427438    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb"]
Sep 17 14:21:58.430697 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:21:58.430654    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1e02f94_127a_47f0_b390_5d70d333a04b.slice/crio-26fc41bff6b5dcb2ce4b59b8434e938aa9132f1640c184ceb7006b41217c776c WatchSource:0}: Error finding container 26fc41bff6b5dcb2ce4b59b8434e938aa9132f1640c184ceb7006b41217c776c: Status 404 returned error can't find the container with id 26fc41bff6b5dcb2ce4b59b8434e938aa9132f1640c184ceb7006b41217c776c
Sep 17 14:21:58.439980 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:58.439906    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsjg8\" (UniqueName: \"kubernetes.io/projected/1c32bb3f-5a77-4183-8315-9f3822565150-kube-api-access-xsjg8\") pod \"payload-processing-e2e-inf-a-2e1b82-7d5dcc7b4f-nnbrq\" (UID: \"1c32bb3f-5a77-4183-8315-9f3822565150\") " pod="openshift-ingress/payload-processing-e2e-inf-a-2e1b82-7d5dcc7b4f-nnbrq"
Sep 17 14:21:58.440094 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:58.440068    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c32bb3f-5a77-4183-8315-9f3822565150-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-2e1b82-7d5dcc7b4f-nnbrq\" (UID: \"1c32bb3f-5a77-4183-8315-9f3822565150\") " pod="openshift-ingress/payload-processing-e2e-inf-a-2e1b82-7d5dcc7b4f-nnbrq"
Sep 17 14:21:58.541221 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:58.541186    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsjg8\" (UniqueName: \"kubernetes.io/projected/1c32bb3f-5a77-4183-8315-9f3822565150-kube-api-access-xsjg8\") pod \"payload-processing-e2e-inf-a-2e1b82-7d5dcc7b4f-nnbrq\" (UID: \"1c32bb3f-5a77-4183-8315-9f3822565150\") " pod="openshift-ingress/payload-processing-e2e-inf-a-2e1b82-7d5dcc7b4f-nnbrq"
Sep 17 14:21:58.541413 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:58.541289    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c32bb3f-5a77-4183-8315-9f3822565150-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-2e1b82-7d5dcc7b4f-nnbrq\" (UID: \"1c32bb3f-5a77-4183-8315-9f3822565150\") " pod="openshift-ingress/payload-processing-e2e-inf-a-2e1b82-7d5dcc7b4f-nnbrq"
Sep 17 14:21:58.542130 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:58.542106    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c32bb3f-5a77-4183-8315-9f3822565150-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-2e1b82-7d5dcc7b4f-nnbrq\" (UID: \"1c32bb3f-5a77-4183-8315-9f3822565150\") " pod="openshift-ingress/payload-processing-e2e-inf-a-2e1b82-7d5dcc7b4f-nnbrq"
Sep 17 14:21:58.551738 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:58.551684    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsjg8\" (UniqueName: \"kubernetes.io/projected/1c32bb3f-5a77-4183-8315-9f3822565150-kube-api-access-xsjg8\") pod \"payload-processing-e2e-inf-a-2e1b82-7d5dcc7b4f-nnbrq\" (UID: \"1c32bb3f-5a77-4183-8315-9f3822565150\") " pod="openshift-ingress/payload-processing-e2e-inf-a-2e1b82-7d5dcc7b4f-nnbrq"
Sep 17 14:21:58.613053 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:58.612904    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb" event={"ID":"a1e02f94-127a-47f0-b390-5d70d333a04b","Type":"ContainerStarted","Data":"26fc41bff6b5dcb2ce4b59b8434e938aa9132f1640c184ceb7006b41217c776c"}
Sep 17 14:21:58.613451 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:58.613092    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7371-72fbcb" podUID="68353ddb-2b38-4c71-93f1-05467d154645" containerName="test-curl-7371-72fbcb" containerID="cri-o://ca6aefd7472b4dc0e269958248feb9c4edf79295f77e5a0ec915b8753e5aced8" gracePeriod=2
Sep 17 14:21:58.616207 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:21:58.616160    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7371-72fbcb\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" podUID="68353ddb-2b38-4c71-93f1-05467d154645" pod="opendatahub/test-curl-7371-72fbcb"
Sep 17 14:21:58.653982 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:58.653592    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-2e1b82-7d5dcc7b4f-nnbrq"
Sep 17 14:21:58.957513 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:58.957483    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-2e1b82-7d5dcc7b4f-nnbrq"]
Sep 17 14:21:59.032567 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:21:59.032534    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c32bb3f_5a77_4183_8315_9f3822565150.slice/crio-d119d07f8aa25c34c0f5b0c3148ba4491f58e5bab4748715b5b25f0b2f20b6fa WatchSource:0}: Error finding container d119d07f8aa25c34c0f5b0c3148ba4491f58e5bab4748715b5b25f0b2f20b6fa: Status 404 returned error can't find the container with id d119d07f8aa25c34c0f5b0c3148ba4491f58e5bab4748715b5b25f0b2f20b6fa
Sep 17 14:21:59.038011 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:59.037981    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7371-75b14f"
Sep 17 14:21:59.040701 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:21:59.040672    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7371-72fbcb\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" podUID="68353ddb-2b38-4c71-93f1-05467d154645" pod="opendatahub/test-curl-7371-72fbcb"
Sep 17 14:21:59.148081 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:59.148043    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xg8b\" (UniqueName: \"kubernetes.io/projected/ce6322cf-1c48-4e22-8ebe-4592c413e257-kube-api-access-9xg8b\") pod \"ce6322cf-1c48-4e22-8ebe-4592c413e257\" (UID: \"ce6322cf-1c48-4e22-8ebe-4592c413e257\") "
Sep 17 14:21:59.150167 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:59.150139    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce6322cf-1c48-4e22-8ebe-4592c413e257-kube-api-access-9xg8b" (OuterVolumeSpecName: "kube-api-access-9xg8b") pod "ce6322cf-1c48-4e22-8ebe-4592c413e257" (UID: "ce6322cf-1c48-4e22-8ebe-4592c413e257"). InnerVolumeSpecName "kube-api-access-9xg8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:21:59.177425 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:59.177392    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce6322cf-1c48-4e22-8ebe-4592c413e257" path="/var/lib/kubelet/pods/ce6322cf-1c48-4e22-8ebe-4592c413e257/volumes"
Sep 17 14:21:59.249333 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:59.249297    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xg8b\" (UniqueName: \"kubernetes.io/projected/ce6322cf-1c48-4e22-8ebe-4592c413e257-kube-api-access-9xg8b\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:21:59.626292 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:59.626195    2580 generic.go:356] "Generic (PLEG): container finished" podID="ce6322cf-1c48-4e22-8ebe-4592c413e257" containerID="a0a1e5e124066761a80d03c60dea627c88d03e7cd9d6245ac94fe636e43e09d5" exitCode=137
Sep 17 14:21:59.626791 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:59.626426    2580 scope.go:117] "RemoveContainer" containerID="a0a1e5e124066761a80d03c60dea627c88d03e7cd9d6245ac94fe636e43e09d5"
Sep 17 14:21:59.626791 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:59.626585    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7371-75b14f"
Sep 17 14:21:59.631509 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:59.630799    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-8b50f2-77b8c4548f-9drjt" event={"ID":"f1058a4a-293f-4bb5-9046-85965ce053b5","Type":"ContainerStarted","Data":"98735c3fb9322e53abbf4b4c867e43dcf27845d31b2fe20bad20bb1a7e7252b1"}
Sep 17 14:21:59.631655 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:59.631513    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-8b50f2-77b8c4548f-9drjt"
Sep 17 14:21:59.633955 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:59.633920    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-2e1b82-7d5dcc7b4f-nnbrq" event={"ID":"1c32bb3f-5a77-4183-8315-9f3822565150","Type":"ContainerStarted","Data":"b42c240a29dbc876a0280d295692a5400e61bccf9f2812a8d25218bcc9f6367a"}
Sep 17 14:21:59.634065 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:59.633971    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-2e1b82-7d5dcc7b4f-nnbrq" event={"ID":"1c32bb3f-5a77-4183-8315-9f3822565150","Type":"ContainerStarted","Data":"d119d07f8aa25c34c0f5b0c3148ba4491f58e5bab4748715b5b25f0b2f20b6fa"}
Sep 17 14:21:59.634197 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:59.634178    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-2e1b82-7d5dcc7b4f-nnbrq"
Sep 17 14:21:59.645592 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:59.645433    2580 scope.go:117] "RemoveContainer" containerID="a0a1e5e124066761a80d03c60dea627c88d03e7cd9d6245ac94fe636e43e09d5"
Sep 17 14:21:59.646034 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:21:59.646006    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0a1e5e124066761a80d03c60dea627c88d03e7cd9d6245ac94fe636e43e09d5\": container with ID starting with a0a1e5e124066761a80d03c60dea627c88d03e7cd9d6245ac94fe636e43e09d5 not found: ID does not exist" containerID="a0a1e5e124066761a80d03c60dea627c88d03e7cd9d6245ac94fe636e43e09d5"
Sep 17 14:21:59.646129 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:59.646045    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0a1e5e124066761a80d03c60dea627c88d03e7cd9d6245ac94fe636e43e09d5"} err="failed to get container status \"a0a1e5e124066761a80d03c60dea627c88d03e7cd9d6245ac94fe636e43e09d5\": rpc error: code = NotFound desc = could not find container \"a0a1e5e124066761a80d03c60dea627c88d03e7cd9d6245ac94fe636e43e09d5\": container with ID starting with a0a1e5e124066761a80d03c60dea627c88d03e7cd9d6245ac94fe636e43e09d5 not found: ID does not exist"
Sep 17 14:21:59.653397 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:59.653342    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-8b50f2-77b8c4548f-9drjt" podStartSLOduration=2.030373506 podStartE2EDuration="3.653322212s" totalImagesPullingTime="1.622948706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:21:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:21:59.649693142 +0000 UTC m=+907.093768729" watchObservedRunningTime="2026-09-17 14:21:59.653322212 +0000 UTC m=+907.097397802"
Sep 17 14:21:59.674378 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:21:59.674317    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-2e1b82-7d5dcc7b4f-nnbrq" podStartSLOduration=1.258504928 podStartE2EDuration="1.674287402s" totalImagesPullingTime="415.782474ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:21:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:21:59.671547956 +0000 UTC m=+907.115623565" watchObservedRunningTime="2026-09-17 14:21:59.674287402 +0000 UTC m=+907.118362990"
Sep 17 14:22:01.316211 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:01.316181    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7371-72fbcb"
Sep 17 14:22:01.473529 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:01.473497    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvmjp\" (UniqueName: \"kubernetes.io/projected/68353ddb-2b38-4c71-93f1-05467d154645-kube-api-access-hvmjp\") pod \"68353ddb-2b38-4c71-93f1-05467d154645\" (UID: \"68353ddb-2b38-4c71-93f1-05467d154645\") "
Sep 17 14:22:01.475848 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:01.475806    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68353ddb-2b38-4c71-93f1-05467d154645-kube-api-access-hvmjp" (OuterVolumeSpecName: "kube-api-access-hvmjp") pod "68353ddb-2b38-4c71-93f1-05467d154645" (UID: "68353ddb-2b38-4c71-93f1-05467d154645"). InnerVolumeSpecName "kube-api-access-hvmjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:22:01.575132 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:01.575100    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvmjp\" (UniqueName: \"kubernetes.io/projected/68353ddb-2b38-4c71-93f1-05467d154645-kube-api-access-hvmjp\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:22:01.650168 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:01.650120    2580 generic.go:356] "Generic (PLEG): container finished" podID="68353ddb-2b38-4c71-93f1-05467d154645" containerID="ca6aefd7472b4dc0e269958248feb9c4edf79295f77e5a0ec915b8753e5aced8" exitCode=137
Sep 17 14:22:01.650168 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:01.650165    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7371-72fbcb"
Sep 17 14:22:01.650420 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:01.650252    2580 scope.go:117] "RemoveContainer" containerID="ca6aefd7472b4dc0e269958248feb9c4edf79295f77e5a0ec915b8753e5aced8"
Sep 17 14:22:01.653325 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:01.653013    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb" event={"ID":"a1e02f94-127a-47f0-b390-5d70d333a04b","Type":"ContainerStarted","Data":"2b25ebaddb64aaa172373099037d58eef7b379f74e15d324a9361b5f4381ef2f"}
Sep 17 14:22:01.653325 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:01.653225    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb"
Sep 17 14:22:01.661615 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:01.661593    2580 scope.go:117] "RemoveContainer" containerID="ca6aefd7472b4dc0e269958248feb9c4edf79295f77e5a0ec915b8753e5aced8"
Sep 17 14:22:01.662036 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:22:01.662010    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca6aefd7472b4dc0e269958248feb9c4edf79295f77e5a0ec915b8753e5aced8\": container with ID starting with ca6aefd7472b4dc0e269958248feb9c4edf79295f77e5a0ec915b8753e5aced8 not found: ID does not exist" containerID="ca6aefd7472b4dc0e269958248feb9c4edf79295f77e5a0ec915b8753e5aced8"
Sep 17 14:22:01.662150 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:01.662045    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca6aefd7472b4dc0e269958248feb9c4edf79295f77e5a0ec915b8753e5aced8"} err="failed to get container status \"ca6aefd7472b4dc0e269958248feb9c4edf79295f77e5a0ec915b8753e5aced8\": rpc error: code = NotFound desc = could not find container \"ca6aefd7472b4dc0e269958248feb9c4edf79295f77e5a0ec915b8753e5aced8\": container with ID starting with ca6aefd7472b4dc0e269958248feb9c4edf79295f77e5a0ec915b8753e5aced8 not found: ID does not exist"
Sep 17 14:22:01.693680 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:01.693618    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb" podStartSLOduration=1.970812754 podStartE2EDuration="4.693596607s" totalImagesPullingTime="2.722783853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:21:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:22:01.691690188 +0000 UTC m=+909.135765799" watchObservedRunningTime="2026-09-17 14:22:01.693596607 +0000 UTC m=+909.137672193"
Sep 17 14:22:01.694543 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:22:01.694510    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7371-72fbcb\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" podUID="68353ddb-2b38-4c71-93f1-05467d154645" pod="opendatahub/test-curl-7371-72fbcb"
Sep 17 14:22:03.177829 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:03.177794    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68353ddb-2b38-4c71-93f1-05467d154645" path="/var/lib/kubelet/pods/68353ddb-2b38-4c71-93f1-05467d154645/volumes"
Sep 17 14:22:03.182216 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:22:03.182183    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7371-72fbcb\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" podUID="68353ddb-2b38-4c71-93f1-05467d154645" pod="opendatahub/test-curl-7371-72fbcb"
Sep 17 14:22:06.641916 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:06.641875    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-86c464-769f99d7d9-8zwtg"]
Sep 17 14:22:06.646364 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:06.646329    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-86c464-769f99d7d9-8zwtg"
Sep 17 14:22:06.649371 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:06.649347    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-86c464-serving-cert\""
Sep 17 14:22:06.663824 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:06.663790    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-86c464-769f99d7d9-8zwtg"]
Sep 17 14:22:06.722006 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:06.721966    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3443b59-91e5-4394-a675-e2b8dcd5e9d2-openshift-service-ca\") pod \"maas-api-e2e-autores-86c464-769f99d7d9-8zwtg\" (UID: \"d3443b59-91e5-4394-a675-e2b8dcd5e9d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-86c464-769f99d7d9-8zwtg"
Sep 17 14:22:06.722194 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:06.722012    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3443b59-91e5-4394-a675-e2b8dcd5e9d2-metrics-certs\") pod \"maas-api-e2e-autores-86c464-769f99d7d9-8zwtg\" (UID: \"d3443b59-91e5-4394-a675-e2b8dcd5e9d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-86c464-769f99d7d9-8zwtg"
Sep 17 14:22:06.722194 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:06.722102    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm864\" (UniqueName: \"kubernetes.io/projected/d3443b59-91e5-4394-a675-e2b8dcd5e9d2-kube-api-access-dm864\") pod \"maas-api-e2e-autores-86c464-769f99d7d9-8zwtg\" (UID: \"d3443b59-91e5-4394-a675-e2b8dcd5e9d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-86c464-769f99d7d9-8zwtg"
Sep 17 14:22:06.722194 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:06.722177    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3443b59-91e5-4394-a675-e2b8dcd5e9d2-maas-api-tls\") pod \"maas-api-e2e-autores-86c464-769f99d7d9-8zwtg\" (UID: \"d3443b59-91e5-4394-a675-e2b8dcd5e9d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-86c464-769f99d7d9-8zwtg"
Sep 17 14:22:06.823442 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:06.823403    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3443b59-91e5-4394-a675-e2b8dcd5e9d2-maas-api-tls\") pod \"maas-api-e2e-autores-86c464-769f99d7d9-8zwtg\" (UID: \"d3443b59-91e5-4394-a675-e2b8dcd5e9d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-86c464-769f99d7d9-8zwtg"
Sep 17 14:22:06.823662 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:06.823459    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3443b59-91e5-4394-a675-e2b8dcd5e9d2-openshift-service-ca\") pod \"maas-api-e2e-autores-86c464-769f99d7d9-8zwtg\" (UID: \"d3443b59-91e5-4394-a675-e2b8dcd5e9d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-86c464-769f99d7d9-8zwtg"
Sep 17 14:22:06.823662 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:06.823483    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3443b59-91e5-4394-a675-e2b8dcd5e9d2-metrics-certs\") pod \"maas-api-e2e-autores-86c464-769f99d7d9-8zwtg\" (UID: \"d3443b59-91e5-4394-a675-e2b8dcd5e9d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-86c464-769f99d7d9-8zwtg"
Sep 17 14:22:06.823662 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:06.823514    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm864\" (UniqueName: \"kubernetes.io/projected/d3443b59-91e5-4394-a675-e2b8dcd5e9d2-kube-api-access-dm864\") pod \"maas-api-e2e-autores-86c464-769f99d7d9-8zwtg\" (UID: \"d3443b59-91e5-4394-a675-e2b8dcd5e9d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-86c464-769f99d7d9-8zwtg"
Sep 17 14:22:06.824300 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:06.824274    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3443b59-91e5-4394-a675-e2b8dcd5e9d2-openshift-service-ca\") pod \"maas-api-e2e-autores-86c464-769f99d7d9-8zwtg\" (UID: \"d3443b59-91e5-4394-a675-e2b8dcd5e9d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-86c464-769f99d7d9-8zwtg"
Sep 17 14:22:06.826169 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:06.826143    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3443b59-91e5-4394-a675-e2b8dcd5e9d2-maas-api-tls\") pod \"maas-api-e2e-autores-86c464-769f99d7d9-8zwtg\" (UID: \"d3443b59-91e5-4394-a675-e2b8dcd5e9d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-86c464-769f99d7d9-8zwtg"
Sep 17 14:22:06.826256 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:06.826174    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3443b59-91e5-4394-a675-e2b8dcd5e9d2-metrics-certs\") pod \"maas-api-e2e-autores-86c464-769f99d7d9-8zwtg\" (UID: \"d3443b59-91e5-4394-a675-e2b8dcd5e9d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-86c464-769f99d7d9-8zwtg"
Sep 17 14:22:06.834377 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:06.834347    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm864\" (UniqueName: \"kubernetes.io/projected/d3443b59-91e5-4394-a675-e2b8dcd5e9d2-kube-api-access-dm864\") pod \"maas-api-e2e-autores-86c464-769f99d7d9-8zwtg\" (UID: \"d3443b59-91e5-4394-a675-e2b8dcd5e9d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-86c464-769f99d7d9-8zwtg"
Sep 17 14:22:06.959029 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:06.958989    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-86c464-769f99d7d9-8zwtg"
Sep 17 14:22:07.237980 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:07.237947    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-86c464-769f99d7d9-8zwtg"]
Sep 17 14:22:07.238499 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:22:07.238474    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3443b59_91e5_4394_a675_e2b8dcd5e9d2.slice/crio-206a14004bf9d425fedd152e3933f57c205826a1e1b87093de19407478c37975 WatchSource:0}: Error finding container 206a14004bf9d425fedd152e3933f57c205826a1e1b87093de19407478c37975: Status 404 returned error can't find the container with id 206a14004bf9d425fedd152e3933f57c205826a1e1b87093de19407478c37975
Sep 17 14:22:07.674917 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:07.674885    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb"
Sep 17 14:22:07.697735 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:07.697669    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-86c464-769f99d7d9-8zwtg" event={"ID":"d3443b59-91e5-4394-a675-e2b8dcd5e9d2","Type":"ContainerStarted","Data":"fe15eb9248bbddf997cabaf1a4ae3374f681cd5e64fe45b75eac82c1bacd00fb"}
Sep 17 14:22:07.697904 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:07.697776    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-86c464-769f99d7d9-8zwtg"
Sep 17 14:22:07.697904 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:07.697802    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-86c464-769f99d7d9-8zwtg" event={"ID":"d3443b59-91e5-4394-a675-e2b8dcd5e9d2","Type":"ContainerStarted","Data":"206a14004bf9d425fedd152e3933f57c205826a1e1b87093de19407478c37975"}
Sep 17 14:22:07.746560 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:07.746529    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4"]
Sep 17 14:22:07.749515 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:07.749484    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4"
Sep 17 14:22:07.755552 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:07.755522    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-a48a4ae7-serving-cert\""
Sep 17 14:22:07.768376 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:07.767934    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-86c464-769f99d7d9-8zwtg" podStartSLOduration=1.408855912 podStartE2EDuration="1.767911561s" totalImagesPullingTime="359.055649ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:22:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:22:07.761288074 +0000 UTC m=+915.205363664" watchObservedRunningTime="2026-09-17 14:22:07.767911561 +0000 UTC m=+915.211987149"
Sep 17 14:22:07.771134 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:07.770983    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4"]
Sep 17 14:22:07.833076 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:07.833039    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0427cd9-bbb6-4bb3-b2f1-96dd9d635706-openshift-service-ca\") pod \"maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4\" (UID: \"f0427cd9-bbb6-4bb3-b2f1-96dd9d635706\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4"
Sep 17 14:22:07.833287 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:07.833090    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0427cd9-bbb6-4bb3-b2f1-96dd9d635706-metrics-certs\") pod \"maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4\" (UID: \"f0427cd9-bbb6-4bb3-b2f1-96dd9d635706\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4"
Sep 17 14:22:07.833287 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:07.833187    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0427cd9-bbb6-4bb3-b2f1-96dd9d635706-maas-api-tls\") pod \"maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4\" (UID: \"f0427cd9-bbb6-4bb3-b2f1-96dd9d635706\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4"
Sep 17 14:22:07.833287 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:07.833231    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79jhz\" (UniqueName: \"kubernetes.io/projected/f0427cd9-bbb6-4bb3-b2f1-96dd9d635706-kube-api-access-79jhz\") pod \"maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4\" (UID: \"f0427cd9-bbb6-4bb3-b2f1-96dd9d635706\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4"
Sep 17 14:22:07.934368 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:07.934272    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0427cd9-bbb6-4bb3-b2f1-96dd9d635706-openshift-service-ca\") pod \"maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4\" (UID: \"f0427cd9-bbb6-4bb3-b2f1-96dd9d635706\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4"
Sep 17 14:22:07.934368 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:07.934317    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0427cd9-bbb6-4bb3-b2f1-96dd9d635706-metrics-certs\") pod \"maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4\" (UID: \"f0427cd9-bbb6-4bb3-b2f1-96dd9d635706\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4"
Sep 17 14:22:07.934368 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:07.934362    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0427cd9-bbb6-4bb3-b2f1-96dd9d635706-maas-api-tls\") pod \"maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4\" (UID: \"f0427cd9-bbb6-4bb3-b2f1-96dd9d635706\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4"
Sep 17 14:22:07.934672 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:07.934388    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79jhz\" (UniqueName: \"kubernetes.io/projected/f0427cd9-bbb6-4bb3-b2f1-96dd9d635706-kube-api-access-79jhz\") pod \"maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4\" (UID: \"f0427cd9-bbb6-4bb3-b2f1-96dd9d635706\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4"
Sep 17 14:22:07.934672 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:22:07.934539    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-serving-cert: secret "maas-api-e2e-ait-a48a4ae7-serving-cert" not found
Sep 17 14:22:07.934672 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:22:07.934628    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0427cd9-bbb6-4bb3-b2f1-96dd9d635706-maas-api-tls podName:f0427cd9-bbb6-4bb3-b2f1-96dd9d635706 nodeName:}" failed. No retries permitted until 2026-09-17 14:22:08.434607774 +0000 UTC m=+915.878683342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f0427cd9-bbb6-4bb3-b2f1-96dd9d635706-maas-api-tls") pod "maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4" (UID: "f0427cd9-bbb6-4bb3-b2f1-96dd9d635706") : secret "maas-api-e2e-ait-a48a4ae7-serving-cert" not found
Sep 17 14:22:07.935085 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:07.935060    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0427cd9-bbb6-4bb3-b2f1-96dd9d635706-openshift-service-ca\") pod \"maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4\" (UID: \"f0427cd9-bbb6-4bb3-b2f1-96dd9d635706\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4"
Sep 17 14:22:07.936884 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:07.936866    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0427cd9-bbb6-4bb3-b2f1-96dd9d635706-metrics-certs\") pod \"maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4\" (UID: \"f0427cd9-bbb6-4bb3-b2f1-96dd9d635706\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4"
Sep 17 14:22:07.945877 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:07.945851    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79jhz\" (UniqueName: \"kubernetes.io/projected/f0427cd9-bbb6-4bb3-b2f1-96dd9d635706-kube-api-access-79jhz\") pod \"maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4\" (UID: \"f0427cd9-bbb6-4bb3-b2f1-96dd9d635706\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4"
Sep 17 14:22:08.439315 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:08.439282    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0427cd9-bbb6-4bb3-b2f1-96dd9d635706-maas-api-tls\") pod \"maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4\" (UID: \"f0427cd9-bbb6-4bb3-b2f1-96dd9d635706\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4"
Sep 17 14:22:08.441828 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:08.441802    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0427cd9-bbb6-4bb3-b2f1-96dd9d635706-maas-api-tls\") pod \"maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4\" (UID: \"f0427cd9-bbb6-4bb3-b2f1-96dd9d635706\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4"
Sep 17 14:22:08.663449 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:08.663407    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4"
Sep 17 14:22:08.961953 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:08.961925    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4"]
Sep 17 14:22:08.964074 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:22:08.964045    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0427cd9_bbb6_4bb3_b2f1_96dd9d635706.slice/crio-b2fff6a85b09c75a5c2ebe2e0259487663b2a1d31f478205d081f984f364de20 WatchSource:0}: Error finding container b2fff6a85b09c75a5c2ebe2e0259487663b2a1d31f478205d081f984f364de20: Status 404 returned error can't find the container with id b2fff6a85b09c75a5c2ebe2e0259487663b2a1d31f478205d081f984f364de20
Sep 17 14:22:09.712385 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:09.712350    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4" event={"ID":"f0427cd9-bbb6-4bb3-b2f1-96dd9d635706","Type":"ContainerStarted","Data":"b2fff6a85b09c75a5c2ebe2e0259487663b2a1d31f478205d081f984f364de20"}
Sep 17 14:22:10.643774 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:10.643663    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-2e1b82-7d5dcc7b4f-nnbrq"
Sep 17 14:22:10.720397 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:10.720361    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4" event={"ID":"f0427cd9-bbb6-4bb3-b2f1-96dd9d635706","Type":"ContainerStarted","Data":"b62785c18968f78fb5b8fe01b679b03bd0b66b05a6d254a3f43b33fe3c3d24b3"}
Sep 17 14:22:10.720547 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:10.720488    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4"
Sep 17 14:22:10.752592 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:10.752534    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4" podStartSLOduration=2.50738559 podStartE2EDuration="3.752517272s" totalImagesPullingTime="1.245131682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:22:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:22:10.750236357 +0000 UTC m=+918.194311962" watchObservedRunningTime="2026-09-17 14:22:10.752517272 +0000 UTC m=+918.196592892"
Sep 17 14:22:11.655152 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:11.655116    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-8b50f2-77b8c4548f-9drjt"
Sep 17 14:22:13.710622 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:13.710593    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-86c464-769f99d7d9-8zwtg"
Sep 17 14:22:15.054377 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:15.054335    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:22:16.734546 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:16.734515    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4"
Sep 17 14:22:22.025451 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:22.025413    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-28f011-d59dcb5b6-h9kwt"]
Sep 17 14:22:22.030151 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:22.030121    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-28f011-d59dcb5b6-h9kwt"
Sep 17 14:22:22.034041 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:22.034020    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-28f011\""
Sep 17 14:22:22.034497 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:22.034478    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-28f011-dockercfg-gr5fc\""
Sep 17 14:22:22.052045 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:22.052003    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl9z5\" (UniqueName: \"kubernetes.io/projected/36a32c2a-17f0-4966-8085-d01454eb88d5-kube-api-access-vl9z5\") pod \"payload-pre-processing-e2e-inf-b-28f011-d59dcb5b6-h9kwt\" (UID: \"36a32c2a-17f0-4966-8085-d01454eb88d5\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-28f011-d59dcb5b6-h9kwt"
Sep 17 14:22:22.052233 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:22.052069    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36a32c2a-17f0-4966-8085-d01454eb88d5-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-28f011-d59dcb5b6-h9kwt\" (UID: \"36a32c2a-17f0-4966-8085-d01454eb88d5\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-28f011-d59dcb5b6-h9kwt"
Sep 17 14:22:22.052608 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:22.052586    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-28f011-d59dcb5b6-h9kwt"]
Sep 17 14:22:22.152655 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:22.152605    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl9z5\" (UniqueName: \"kubernetes.io/projected/36a32c2a-17f0-4966-8085-d01454eb88d5-kube-api-access-vl9z5\") pod \"payload-pre-processing-e2e-inf-b-28f011-d59dcb5b6-h9kwt\" (UID: \"36a32c2a-17f0-4966-8085-d01454eb88d5\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-28f011-d59dcb5b6-h9kwt"
Sep 17 14:22:22.152855 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:22.152674    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36a32c2a-17f0-4966-8085-d01454eb88d5-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-28f011-d59dcb5b6-h9kwt\" (UID: \"36a32c2a-17f0-4966-8085-d01454eb88d5\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-28f011-d59dcb5b6-h9kwt"
Sep 17 14:22:22.153387 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:22.153366    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36a32c2a-17f0-4966-8085-d01454eb88d5-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-28f011-d59dcb5b6-h9kwt\" (UID: \"36a32c2a-17f0-4966-8085-d01454eb88d5\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-28f011-d59dcb5b6-h9kwt"
Sep 17 14:22:22.172109 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:22.172076    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl9z5\" (UniqueName: \"kubernetes.io/projected/36a32c2a-17f0-4966-8085-d01454eb88d5-kube-api-access-vl9z5\") pod \"payload-pre-processing-e2e-inf-b-28f011-d59dcb5b6-h9kwt\" (UID: \"36a32c2a-17f0-4966-8085-d01454eb88d5\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-28f011-d59dcb5b6-h9kwt"
Sep 17 14:22:22.340620 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:22.340542    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-28f011-d59dcb5b6-h9kwt"
Sep 17 14:22:22.629150 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:22.622641    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-28f011-d59dcb5b6-h9kwt"]
Sep 17 14:22:22.791044 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:22.790993    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-28f011-d59dcb5b6-h9kwt" event={"ID":"36a32c2a-17f0-4966-8085-d01454eb88d5","Type":"ContainerStarted","Data":"5749046e04bd64b7bf8c7a69786c207e5a1b5199a36a92c292f044982842d30a"}
Sep 17 14:22:22.791230 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:22.791065    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-28f011-d59dcb5b6-h9kwt" event={"ID":"36a32c2a-17f0-4966-8085-d01454eb88d5","Type":"ContainerStarted","Data":"35444a4b71df5a0a970664d46359838635b77dfaa13a6b80d15e6299730f4178"}
Sep 17 14:22:22.791230 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:22.791203    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-28f011-d59dcb5b6-h9kwt"
Sep 17 14:22:22.813280 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:22.813227    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-28f011-d59dcb5b6-h9kwt" podStartSLOduration=1.81321179 podStartE2EDuration="1.81321179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:22:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:22:22.810013019 +0000 UTC m=+930.254088604" watchObservedRunningTime="2026-09-17 14:22:22.81321179 +0000 UTC m=+930.257287370"
Sep 17 14:22:28.911865 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:28.911832    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"]
Sep 17 14:22:28.929155 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:28.929113    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"
Sep 17 14:22:28.935521 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:28.934694    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"]
Sep 17 14:22:28.941517 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:28.936503    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-080801\"/\"openshift-service-ca.crt\""
Sep 17 14:22:28.941517 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:28.937563    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-080801\"/\"default-dockercfg-8mcjd\""
Sep 17 14:22:28.941517 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:28.937879    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-080801\"/\"simulator-w0-080801-kserve-self-signed-certs\""
Sep 17 14:22:28.941517 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:28.938044    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-080801\"/\"kube-root-ca.crt\""
Sep 17 14:22:29.004430 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:29.004393    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70983359-2033-4f9b-ba80-dffc4e33d303-home\") pod \"simulator-w0-080801-kserve-85649f9f4d-4vtht\" (UID: \"70983359-2033-4f9b-ba80-dffc4e33d303\") " pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"
Sep 17 14:22:29.004594 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:29.004440    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70983359-2033-4f9b-ba80-dffc4e33d303-tmp-dir\") pod \"simulator-w0-080801-kserve-85649f9f4d-4vtht\" (UID: \"70983359-2033-4f9b-ba80-dffc4e33d303\") " pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"
Sep 17 14:22:29.004594 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:29.004458    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j46l2\" (UniqueName: \"kubernetes.io/projected/70983359-2033-4f9b-ba80-dffc4e33d303-kube-api-access-j46l2\") pod \"simulator-w0-080801-kserve-85649f9f4d-4vtht\" (UID: \"70983359-2033-4f9b-ba80-dffc4e33d303\") " pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"
Sep 17 14:22:29.004594 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:29.004475    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70983359-2033-4f9b-ba80-dffc4e33d303-dshm\") pod \"simulator-w0-080801-kserve-85649f9f4d-4vtht\" (UID: \"70983359-2033-4f9b-ba80-dffc4e33d303\") " pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"
Sep 17 14:22:29.004594 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:29.004536    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70983359-2033-4f9b-ba80-dffc4e33d303-model-cache\") pod \"simulator-w0-080801-kserve-85649f9f4d-4vtht\" (UID: \"70983359-2033-4f9b-ba80-dffc4e33d303\") " pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"
Sep 17 14:22:29.004797 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:29.004655    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70983359-2033-4f9b-ba80-dffc4e33d303-tls-certs\") pod \"simulator-w0-080801-kserve-85649f9f4d-4vtht\" (UID: \"70983359-2033-4f9b-ba80-dffc4e33d303\") " pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"
Sep 17 14:22:29.105237 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:29.105201    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70983359-2033-4f9b-ba80-dffc4e33d303-tmp-dir\") pod \"simulator-w0-080801-kserve-85649f9f4d-4vtht\" (UID: \"70983359-2033-4f9b-ba80-dffc4e33d303\") " pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"
Sep 17 14:22:29.105415 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:29.105248    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j46l2\" (UniqueName: \"kubernetes.io/projected/70983359-2033-4f9b-ba80-dffc4e33d303-kube-api-access-j46l2\") pod \"simulator-w0-080801-kserve-85649f9f4d-4vtht\" (UID: \"70983359-2033-4f9b-ba80-dffc4e33d303\") " pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"
Sep 17 14:22:29.105474 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:29.105430    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70983359-2033-4f9b-ba80-dffc4e33d303-dshm\") pod \"simulator-w0-080801-kserve-85649f9f4d-4vtht\" (UID: \"70983359-2033-4f9b-ba80-dffc4e33d303\") " pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"
Sep 17 14:22:29.105528 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:29.105493    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70983359-2033-4f9b-ba80-dffc4e33d303-model-cache\") pod \"simulator-w0-080801-kserve-85649f9f4d-4vtht\" (UID: \"70983359-2033-4f9b-ba80-dffc4e33d303\") " pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"
Sep 17 14:22:29.105654 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:29.105633    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70983359-2033-4f9b-ba80-dffc4e33d303-tmp-dir\") pod \"simulator-w0-080801-kserve-85649f9f4d-4vtht\" (UID: \"70983359-2033-4f9b-ba80-dffc4e33d303\") " pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"
Sep 17 14:22:29.105774 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:29.105636    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70983359-2033-4f9b-ba80-dffc4e33d303-tls-certs\") pod \"simulator-w0-080801-kserve-85649f9f4d-4vtht\" (UID: \"70983359-2033-4f9b-ba80-dffc4e33d303\") " pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"
Sep 17 14:22:29.105774 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:29.105732    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70983359-2033-4f9b-ba80-dffc4e33d303-home\") pod \"simulator-w0-080801-kserve-85649f9f4d-4vtht\" (UID: \"70983359-2033-4f9b-ba80-dffc4e33d303\") " pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"
Sep 17 14:22:29.105873 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:29.105819    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70983359-2033-4f9b-ba80-dffc4e33d303-model-cache\") pod \"simulator-w0-080801-kserve-85649f9f4d-4vtht\" (UID: \"70983359-2033-4f9b-ba80-dffc4e33d303\") " pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"
Sep 17 14:22:29.106049 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:29.106027    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70983359-2033-4f9b-ba80-dffc4e33d303-home\") pod \"simulator-w0-080801-kserve-85649f9f4d-4vtht\" (UID: \"70983359-2033-4f9b-ba80-dffc4e33d303\") " pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"
Sep 17 14:22:29.107700 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:29.107672    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70983359-2033-4f9b-ba80-dffc4e33d303-dshm\") pod \"simulator-w0-080801-kserve-85649f9f4d-4vtht\" (UID: \"70983359-2033-4f9b-ba80-dffc4e33d303\") " pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"
Sep 17 14:22:29.108209 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:29.108189    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70983359-2033-4f9b-ba80-dffc4e33d303-tls-certs\") pod \"simulator-w0-080801-kserve-85649f9f4d-4vtht\" (UID: \"70983359-2033-4f9b-ba80-dffc4e33d303\") " pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"
Sep 17 14:22:29.117536 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:29.117510    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j46l2\" (UniqueName: \"kubernetes.io/projected/70983359-2033-4f9b-ba80-dffc4e33d303-kube-api-access-j46l2\") pod \"simulator-w0-080801-kserve-85649f9f4d-4vtht\" (UID: \"70983359-2033-4f9b-ba80-dffc4e33d303\") " pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"
Sep 17 14:22:29.246754 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:29.246702    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"
Sep 17 14:22:29.528019 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:29.527987    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"]
Sep 17 14:22:29.530366 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:22:29.530329    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70983359_2033_4f9b_ba80_dffc4e33d303.slice/crio-53d3f85dc4dbd7c4c6721a84f4af319fa8fce75f3356fc02e5e07ed47a1d0ada WatchSource:0}: Error finding container 53d3f85dc4dbd7c4c6721a84f4af319fa8fce75f3356fc02e5e07ed47a1d0ada: Status 404 returned error can't find the container with id 53d3f85dc4dbd7c4c6721a84f4af319fa8fce75f3356fc02e5e07ed47a1d0ada
Sep 17 14:22:29.833212 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:29.833125    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht" event={"ID":"70983359-2033-4f9b-ba80-dffc4e33d303","Type":"ContainerStarted","Data":"c4a5e0e0ced982a0bed3a6625ab9f8a892b2c63abf62671ada862c3530176fe9"}
Sep 17 14:22:29.833212 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:29.833169    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht" event={"ID":"70983359-2033-4f9b-ba80-dffc4e33d303","Type":"ContainerStarted","Data":"53d3f85dc4dbd7c4c6721a84f4af319fa8fce75f3356fc02e5e07ed47a1d0ada"}
Sep 17 14:22:29.859674 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:29.859614    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht" podStartSLOduration=1.859596404 podStartE2EDuration="1.859596404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:22:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:22:29.855695209 +0000 UTC m=+937.299770794" watchObservedRunningTime="2026-09-17 14:22:29.859596404 +0000 UTC m=+937.303671990"
Sep 17 14:22:33.798870 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:33.798837    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-28f011-d59dcb5b6-h9kwt"
Sep 17 14:22:39.247468 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:39.247425    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"
Sep 17 14:22:39.247919 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:39.247704    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"
Sep 17 14:22:39.260181 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:39.260154    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"
Sep 17 14:22:39.903453 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:39.903425    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"
Sep 17 14:22:41.127062 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:41.127015    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:22:46.358378 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:46.358339    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4"]
Sep 17 14:22:46.358968 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:46.358592    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4" podUID="f0427cd9-bbb6-4bb3-b2f1-96dd9d635706" containerName="maas-api" containerID="cri-o://b62785c18968f78fb5b8fe01b679b03bd0b66b05a6d254a3f43b33fe3c3d24b3" gracePeriod=30
Sep 17 14:22:46.622784 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:46.622723    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4"
Sep 17 14:22:46.653036 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:46.653001    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79jhz\" (UniqueName: \"kubernetes.io/projected/f0427cd9-bbb6-4bb3-b2f1-96dd9d635706-kube-api-access-79jhz\") pod \"f0427cd9-bbb6-4bb3-b2f1-96dd9d635706\" (UID: \"f0427cd9-bbb6-4bb3-b2f1-96dd9d635706\") "
Sep 17 14:22:46.653230 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:46.653044    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0427cd9-bbb6-4bb3-b2f1-96dd9d635706-openshift-service-ca\") pod \"f0427cd9-bbb6-4bb3-b2f1-96dd9d635706\" (UID: \"f0427cd9-bbb6-4bb3-b2f1-96dd9d635706\") "
Sep 17 14:22:46.653230 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:46.653081    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0427cd9-bbb6-4bb3-b2f1-96dd9d635706-maas-api-tls\") pod \"f0427cd9-bbb6-4bb3-b2f1-96dd9d635706\" (UID: \"f0427cd9-bbb6-4bb3-b2f1-96dd9d635706\") "
Sep 17 14:22:46.653230 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:46.653107    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0427cd9-bbb6-4bb3-b2f1-96dd9d635706-metrics-certs\") pod \"f0427cd9-bbb6-4bb3-b2f1-96dd9d635706\" (UID: \"f0427cd9-bbb6-4bb3-b2f1-96dd9d635706\") "
Sep 17 14:22:46.653493 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:46.653462    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0427cd9-bbb6-4bb3-b2f1-96dd9d635706-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f0427cd9-bbb6-4bb3-b2f1-96dd9d635706" (UID: "f0427cd9-bbb6-4bb3-b2f1-96dd9d635706"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:22:46.655383 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:46.655351    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0427cd9-bbb6-4bb3-b2f1-96dd9d635706-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f0427cd9-bbb6-4bb3-b2f1-96dd9d635706" (UID: "f0427cd9-bbb6-4bb3-b2f1-96dd9d635706"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:22:46.655491 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:46.655386    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0427cd9-bbb6-4bb3-b2f1-96dd9d635706-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f0427cd9-bbb6-4bb3-b2f1-96dd9d635706" (UID: "f0427cd9-bbb6-4bb3-b2f1-96dd9d635706"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:22:46.655491 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:46.655441    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0427cd9-bbb6-4bb3-b2f1-96dd9d635706-kube-api-access-79jhz" (OuterVolumeSpecName: "kube-api-access-79jhz") pod "f0427cd9-bbb6-4bb3-b2f1-96dd9d635706" (UID: "f0427cd9-bbb6-4bb3-b2f1-96dd9d635706"). InnerVolumeSpecName "kube-api-access-79jhz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:22:46.754333 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:46.754293    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79jhz\" (UniqueName: \"kubernetes.io/projected/f0427cd9-bbb6-4bb3-b2f1-96dd9d635706-kube-api-access-79jhz\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:22:46.754333 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:46.754327    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0427cd9-bbb6-4bb3-b2f1-96dd9d635706-openshift-service-ca\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:22:46.754333 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:46.754337    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0427cd9-bbb6-4bb3-b2f1-96dd9d635706-maas-api-tls\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:22:46.754333 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:46.754346    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0427cd9-bbb6-4bb3-b2f1-96dd9d635706-metrics-certs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:22:46.934835 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:46.934743    2580 generic.go:356] "Generic (PLEG): container finished" podID="f0427cd9-bbb6-4bb3-b2f1-96dd9d635706" containerID="b62785c18968f78fb5b8fe01b679b03bd0b66b05a6d254a3f43b33fe3c3d24b3" exitCode=0
Sep 17 14:22:46.934835 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:46.934792    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4"
Sep 17 14:22:46.934835 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:46.934824    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4" event={"ID":"f0427cd9-bbb6-4bb3-b2f1-96dd9d635706","Type":"ContainerDied","Data":"b62785c18968f78fb5b8fe01b679b03bd0b66b05a6d254a3f43b33fe3c3d24b3"}
Sep 17 14:22:46.935050 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:46.934879    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4" event={"ID":"f0427cd9-bbb6-4bb3-b2f1-96dd9d635706","Type":"ContainerDied","Data":"b2fff6a85b09c75a5c2ebe2e0259487663b2a1d31f478205d081f984f364de20"}
Sep 17 14:22:46.935050 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:46.934902    2580 scope.go:117] "RemoveContainer" containerID="b62785c18968f78fb5b8fe01b679b03bd0b66b05a6d254a3f43b33fe3c3d24b3"
Sep 17 14:22:46.945160 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:46.945136    2580 scope.go:117] "RemoveContainer" containerID="b62785c18968f78fb5b8fe01b679b03bd0b66b05a6d254a3f43b33fe3c3d24b3"
Sep 17 14:22:46.945458 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:22:46.945441    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b62785c18968f78fb5b8fe01b679b03bd0b66b05a6d254a3f43b33fe3c3d24b3\": container with ID starting with b62785c18968f78fb5b8fe01b679b03bd0b66b05a6d254a3f43b33fe3c3d24b3 not found: ID does not exist" containerID="b62785c18968f78fb5b8fe01b679b03bd0b66b05a6d254a3f43b33fe3c3d24b3"
Sep 17 14:22:46.945518 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:46.945465    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b62785c18968f78fb5b8fe01b679b03bd0b66b05a6d254a3f43b33fe3c3d24b3"} err="failed to get container status \"b62785c18968f78fb5b8fe01b679b03bd0b66b05a6d254a3f43b33fe3c3d24b3\": rpc error: code = NotFound desc = could not find container \"b62785c18968f78fb5b8fe01b679b03bd0b66b05a6d254a3f43b33fe3c3d24b3\": container with ID starting with b62785c18968f78fb5b8fe01b679b03bd0b66b05a6d254a3f43b33fe3c3d24b3 not found: ID does not exist"
Sep 17 14:22:46.962260 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:46.962226    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4"]
Sep 17 14:22:46.968112 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:46.968083    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a48a4ae7-75ff87b494-tmws4"]
Sep 17 14:22:47.177191 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:47.177155    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0427cd9-bbb6-4bb3-b2f1-96dd9d635706" path="/var/lib/kubelet/pods/f0427cd9-bbb6-4bb3-b2f1-96dd9d635706/volumes"
Sep 17 14:22:54.257804 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:54.257766    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd"]
Sep 17 14:22:54.258449 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:54.258429    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0427cd9-bbb6-4bb3-b2f1-96dd9d635706" containerName="maas-api"
Sep 17 14:22:54.258449 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:54.258449    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0427cd9-bbb6-4bb3-b2f1-96dd9d635706" containerName="maas-api"
Sep 17 14:22:54.258595 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:54.258542    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0427cd9-bbb6-4bb3-b2f1-96dd9d635706" containerName="maas-api"
Sep 17 14:22:54.263540 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:54.263516    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd"
Sep 17 14:22:54.266517 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:54.266492    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-7f7de479-serving-cert\""
Sep 17 14:22:54.283038 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:54.283011    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd"]
Sep 17 14:22:54.328487 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:54.328441    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10365faa-2e08-46f5-972f-4d8919e5211e-openshift-service-ca\") pod \"maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd\" (UID: \"10365faa-2e08-46f5-972f-4d8919e5211e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd"
Sep 17 14:22:54.328487 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:54.328484    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10365faa-2e08-46f5-972f-4d8919e5211e-metrics-certs\") pod \"maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd\" (UID: \"10365faa-2e08-46f5-972f-4d8919e5211e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd"
Sep 17 14:22:54.328751 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:54.328516    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10365faa-2e08-46f5-972f-4d8919e5211e-maas-api-tls\") pod \"maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd\" (UID: \"10365faa-2e08-46f5-972f-4d8919e5211e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd"
Sep 17 14:22:54.328751 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:54.328641    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv5nz\" (UniqueName: \"kubernetes.io/projected/10365faa-2e08-46f5-972f-4d8919e5211e-kube-api-access-zv5nz\") pod \"maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd\" (UID: \"10365faa-2e08-46f5-972f-4d8919e5211e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd"
Sep 17 14:22:54.429929 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:54.429889    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv5nz\" (UniqueName: \"kubernetes.io/projected/10365faa-2e08-46f5-972f-4d8919e5211e-kube-api-access-zv5nz\") pod \"maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd\" (UID: \"10365faa-2e08-46f5-972f-4d8919e5211e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd"
Sep 17 14:22:54.430134 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:54.429980    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10365faa-2e08-46f5-972f-4d8919e5211e-openshift-service-ca\") pod \"maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd\" (UID: \"10365faa-2e08-46f5-972f-4d8919e5211e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd"
Sep 17 14:22:54.430134 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:54.430001    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10365faa-2e08-46f5-972f-4d8919e5211e-metrics-certs\") pod \"maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd\" (UID: \"10365faa-2e08-46f5-972f-4d8919e5211e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd"
Sep 17 14:22:54.430134 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:54.430024    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10365faa-2e08-46f5-972f-4d8919e5211e-maas-api-tls\") pod \"maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd\" (UID: \"10365faa-2e08-46f5-972f-4d8919e5211e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd"
Sep 17 14:22:54.430816 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:54.430788    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10365faa-2e08-46f5-972f-4d8919e5211e-openshift-service-ca\") pod \"maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd\" (UID: \"10365faa-2e08-46f5-972f-4d8919e5211e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd"
Sep 17 14:22:54.432611 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:54.432577    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10365faa-2e08-46f5-972f-4d8919e5211e-metrics-certs\") pod \"maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd\" (UID: \"10365faa-2e08-46f5-972f-4d8919e5211e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd"
Sep 17 14:22:54.432768 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:54.432706    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10365faa-2e08-46f5-972f-4d8919e5211e-maas-api-tls\") pod \"maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd\" (UID: \"10365faa-2e08-46f5-972f-4d8919e5211e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd"
Sep 17 14:22:54.443459 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:54.443434    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv5nz\" (UniqueName: \"kubernetes.io/projected/10365faa-2e08-46f5-972f-4d8919e5211e-kube-api-access-zv5nz\") pod \"maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd\" (UID: \"10365faa-2e08-46f5-972f-4d8919e5211e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd"
Sep 17 14:22:54.577209 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:54.577107    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd"
Sep 17 14:22:54.911678 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:22:54.911645    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10365faa_2e08_46f5_972f_4d8919e5211e.slice/crio-853c497dee73a0203c16a1c6d0241bb447dfce76ba815c02bcc6a6f3383f0347 WatchSource:0}: Error finding container 853c497dee73a0203c16a1c6d0241bb447dfce76ba815c02bcc6a6f3383f0347: Status 404 returned error can't find the container with id 853c497dee73a0203c16a1c6d0241bb447dfce76ba815c02bcc6a6f3383f0347
Sep 17 14:22:54.912237 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:54.912216    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd"]
Sep 17 14:22:54.982687 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:54.982646    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd" event={"ID":"10365faa-2e08-46f5-972f-4d8919e5211e","Type":"ContainerStarted","Data":"853c497dee73a0203c16a1c6d0241bb447dfce76ba815c02bcc6a6f3383f0347"}
Sep 17 14:22:55.990394 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:55.990356    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd" event={"ID":"10365faa-2e08-46f5-972f-4d8919e5211e","Type":"ContainerStarted","Data":"70c195db300ec99cd03883b3d0e9a816b9f909919299153cab55c468b1c855c9"}
Sep 17 14:22:55.990813 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:55.990497    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd"
Sep 17 14:22:56.017600 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:22:56.017544    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd" podStartSLOduration=1.531781836 podStartE2EDuration="2.017528066s" totalImagesPullingTime="485.74623ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:22:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:22:56.015758151 +0000 UTC m=+963.459833737" watchObservedRunningTime="2026-09-17 14:22:56.017528066 +0000 UTC m=+963.461603652"
Sep 17 14:23:02.004275 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:02.004236    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd"
Sep 17 14:23:02.737414 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:02.737378    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:23:22.292819 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:22.292737    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:23:32.880391 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:32.880350    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd"]
Sep 17 14:23:32.880822 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:32.880622    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd" podUID="10365faa-2e08-46f5-972f-4d8919e5211e" containerName="maas-api" containerID="cri-o://70c195db300ec99cd03883b3d0e9a816b9f909919299153cab55c468b1c855c9" gracePeriod=30
Sep 17 14:23:33.133100 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:33.133035    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd"
Sep 17 14:23:33.203107 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:33.203064    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10365faa-2e08-46f5-972f-4d8919e5211e-metrics-certs\") pod \"10365faa-2e08-46f5-972f-4d8919e5211e\" (UID: \"10365faa-2e08-46f5-972f-4d8919e5211e\") "
Sep 17 14:23:33.203107 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:33.203112    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zv5nz\" (UniqueName: \"kubernetes.io/projected/10365faa-2e08-46f5-972f-4d8919e5211e-kube-api-access-zv5nz\") pod \"10365faa-2e08-46f5-972f-4d8919e5211e\" (UID: \"10365faa-2e08-46f5-972f-4d8919e5211e\") "
Sep 17 14:23:33.203374 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:33.203165    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10365faa-2e08-46f5-972f-4d8919e5211e-openshift-service-ca\") pod \"10365faa-2e08-46f5-972f-4d8919e5211e\" (UID: \"10365faa-2e08-46f5-972f-4d8919e5211e\") "
Sep 17 14:23:33.203374 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:33.203183    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10365faa-2e08-46f5-972f-4d8919e5211e-maas-api-tls\") pod \"10365faa-2e08-46f5-972f-4d8919e5211e\" (UID: \"10365faa-2e08-46f5-972f-4d8919e5211e\") "
Sep 17 14:23:33.203583 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:33.203552    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10365faa-2e08-46f5-972f-4d8919e5211e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "10365faa-2e08-46f5-972f-4d8919e5211e" (UID: "10365faa-2e08-46f5-972f-4d8919e5211e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:23:33.205398 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:33.205362    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10365faa-2e08-46f5-972f-4d8919e5211e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "10365faa-2e08-46f5-972f-4d8919e5211e" (UID: "10365faa-2e08-46f5-972f-4d8919e5211e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:23:33.205398 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:33.205379    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10365faa-2e08-46f5-972f-4d8919e5211e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "10365faa-2e08-46f5-972f-4d8919e5211e" (UID: "10365faa-2e08-46f5-972f-4d8919e5211e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:23:33.205557 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:33.205447    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10365faa-2e08-46f5-972f-4d8919e5211e-kube-api-access-zv5nz" (OuterVolumeSpecName: "kube-api-access-zv5nz") pod "10365faa-2e08-46f5-972f-4d8919e5211e" (UID: "10365faa-2e08-46f5-972f-4d8919e5211e"). InnerVolumeSpecName "kube-api-access-zv5nz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:23:33.218078 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:33.218049    2580 generic.go:356] "Generic (PLEG): container finished" podID="10365faa-2e08-46f5-972f-4d8919e5211e" containerID="70c195db300ec99cd03883b3d0e9a816b9f909919299153cab55c468b1c855c9" exitCode=0
Sep 17 14:23:33.218203 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:33.218094    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd"
Sep 17 14:23:33.218203 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:33.218124    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd" event={"ID":"10365faa-2e08-46f5-972f-4d8919e5211e","Type":"ContainerDied","Data":"70c195db300ec99cd03883b3d0e9a816b9f909919299153cab55c468b1c855c9"}
Sep 17 14:23:33.218203 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:33.218181    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd" event={"ID":"10365faa-2e08-46f5-972f-4d8919e5211e","Type":"ContainerDied","Data":"853c497dee73a0203c16a1c6d0241bb447dfce76ba815c02bcc6a6f3383f0347"}
Sep 17 14:23:33.218335 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:33.218210    2580 scope.go:117] "RemoveContainer" containerID="70c195db300ec99cd03883b3d0e9a816b9f909919299153cab55c468b1c855c9"
Sep 17 14:23:33.230559 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:33.230540    2580 scope.go:117] "RemoveContainer" containerID="70c195db300ec99cd03883b3d0e9a816b9f909919299153cab55c468b1c855c9"
Sep 17 14:23:33.230918 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:23:33.230892    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70c195db300ec99cd03883b3d0e9a816b9f909919299153cab55c468b1c855c9\": container with ID starting with 70c195db300ec99cd03883b3d0e9a816b9f909919299153cab55c468b1c855c9 not found: ID does not exist" containerID="70c195db300ec99cd03883b3d0e9a816b9f909919299153cab55c468b1c855c9"
Sep 17 14:23:33.230979 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:33.230932    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70c195db300ec99cd03883b3d0e9a816b9f909919299153cab55c468b1c855c9"} err="failed to get container status \"70c195db300ec99cd03883b3d0e9a816b9f909919299153cab55c468b1c855c9\": rpc error: code = NotFound desc = could not find container \"70c195db300ec99cd03883b3d0e9a816b9f909919299153cab55c468b1c855c9\": container with ID starting with 70c195db300ec99cd03883b3d0e9a816b9f909919299153cab55c468b1c855c9 not found: ID does not exist"
Sep 17 14:23:33.253311 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:33.253283    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd"]
Sep 17 14:23:33.257372 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:33.257345    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-7f7de479-f9f46c999-dlrkd"]
Sep 17 14:23:33.304564 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:33.304531    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10365faa-2e08-46f5-972f-4d8919e5211e-metrics-certs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:23:33.304564 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:33.304559    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zv5nz\" (UniqueName: \"kubernetes.io/projected/10365faa-2e08-46f5-972f-4d8919e5211e-kube-api-access-zv5nz\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:23:33.304564 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:33.304569    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10365faa-2e08-46f5-972f-4d8919e5211e-openshift-service-ca\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:23:33.304824 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:33.304580    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10365faa-2e08-46f5-972f-4d8919e5211e-maas-api-tls\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:23:35.178089 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:35.178048    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10365faa-2e08-46f5-972f-4d8919e5211e" path="/var/lib/kubelet/pods/10365faa-2e08-46f5-972f-4d8919e5211e/volumes"
Sep 17 14:23:35.618604 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:35.618558    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"]
Sep 17 14:23:35.619095 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:35.619077    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10365faa-2e08-46f5-972f-4d8919e5211e" containerName="maas-api"
Sep 17 14:23:35.619211 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:35.619097    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="10365faa-2e08-46f5-972f-4d8919e5211e" containerName="maas-api"
Sep 17 14:23:35.619211 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:35.619207    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="10365faa-2e08-46f5-972f-4d8919e5211e" containerName="maas-api"
Sep 17 14:23:35.623613 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:35.623589    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"
Sep 17 14:23:35.628189 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:35.628170    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-86c464\"/\"kube-root-ca.crt\""
Sep 17 14:23:35.628492 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:35.628427    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-86c464\"/\"openshift-service-ca.crt\""
Sep 17 14:23:35.628596 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:35.628494    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-86c464\"/\"autores-model-86c464-kserve-self-signed-certs\""
Sep 17 14:23:35.628596 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:35.628434    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-86c464\"/\"default-dockercfg-cgt7s\""
Sep 17 14:23:35.658800 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:35.658768    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"]
Sep 17 14:23:35.726232 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:35.726195    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-tmp-dir\") pod \"autores-model-86c464-kserve-5c668f6b8c-wmpnk\" (UID: \"34f48f3e-2db7-4a29-9bff-13ee850e4b1c\") " pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"
Sep 17 14:23:35.726452 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:35.726252    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-home\") pod \"autores-model-86c464-kserve-5c668f6b8c-wmpnk\" (UID: \"34f48f3e-2db7-4a29-9bff-13ee850e4b1c\") " pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"
Sep 17 14:23:35.726452 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:35.726296    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-model-cache\") pod \"autores-model-86c464-kserve-5c668f6b8c-wmpnk\" (UID: \"34f48f3e-2db7-4a29-9bff-13ee850e4b1c\") " pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"
Sep 17 14:23:35.726452 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:35.726381    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-dshm\") pod \"autores-model-86c464-kserve-5c668f6b8c-wmpnk\" (UID: \"34f48f3e-2db7-4a29-9bff-13ee850e4b1c\") " pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"
Sep 17 14:23:35.726631 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:35.726481    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-tls-certs\") pod \"autores-model-86c464-kserve-5c668f6b8c-wmpnk\" (UID: \"34f48f3e-2db7-4a29-9bff-13ee850e4b1c\") " pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"
Sep 17 14:23:35.726631 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:35.726511    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm2fc\" (UniqueName: \"kubernetes.io/projected/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-kube-api-access-wm2fc\") pod \"autores-model-86c464-kserve-5c668f6b8c-wmpnk\" (UID: \"34f48f3e-2db7-4a29-9bff-13ee850e4b1c\") " pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"
Sep 17 14:23:35.827749 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:35.827694    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-tls-certs\") pod \"autores-model-86c464-kserve-5c668f6b8c-wmpnk\" (UID: \"34f48f3e-2db7-4a29-9bff-13ee850e4b1c\") " pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"
Sep 17 14:23:35.827749 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:35.827748    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm2fc\" (UniqueName: \"kubernetes.io/projected/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-kube-api-access-wm2fc\") pod \"autores-model-86c464-kserve-5c668f6b8c-wmpnk\" (UID: \"34f48f3e-2db7-4a29-9bff-13ee850e4b1c\") " pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"
Sep 17 14:23:35.827997 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:35.827803    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-tmp-dir\") pod \"autores-model-86c464-kserve-5c668f6b8c-wmpnk\" (UID: \"34f48f3e-2db7-4a29-9bff-13ee850e4b1c\") " pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"
Sep 17 14:23:35.827997 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:35.827827    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-home\") pod \"autores-model-86c464-kserve-5c668f6b8c-wmpnk\" (UID: \"34f48f3e-2db7-4a29-9bff-13ee850e4b1c\") " pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"
Sep 17 14:23:35.827997 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:35.827852    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-model-cache\") pod \"autores-model-86c464-kserve-5c668f6b8c-wmpnk\" (UID: \"34f48f3e-2db7-4a29-9bff-13ee850e4b1c\") " pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"
Sep 17 14:23:35.827997 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:35.827982    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-dshm\") pod \"autores-model-86c464-kserve-5c668f6b8c-wmpnk\" (UID: \"34f48f3e-2db7-4a29-9bff-13ee850e4b1c\") " pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"
Sep 17 14:23:35.828305 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:35.828269    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-model-cache\") pod \"autores-model-86c464-kserve-5c668f6b8c-wmpnk\" (UID: \"34f48f3e-2db7-4a29-9bff-13ee850e4b1c\") " pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"
Sep 17 14:23:35.828305 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:35.828289    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-home\") pod \"autores-model-86c464-kserve-5c668f6b8c-wmpnk\" (UID: \"34f48f3e-2db7-4a29-9bff-13ee850e4b1c\") " pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"
Sep 17 14:23:35.828471 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:35.828361    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-tmp-dir\") pod \"autores-model-86c464-kserve-5c668f6b8c-wmpnk\" (UID: \"34f48f3e-2db7-4a29-9bff-13ee850e4b1c\") " pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"
Sep 17 14:23:35.830174 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:35.830144    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-dshm\") pod \"autores-model-86c464-kserve-5c668f6b8c-wmpnk\" (UID: \"34f48f3e-2db7-4a29-9bff-13ee850e4b1c\") " pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"
Sep 17 14:23:35.830364 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:35.830347    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-tls-certs\") pod \"autores-model-86c464-kserve-5c668f6b8c-wmpnk\" (UID: \"34f48f3e-2db7-4a29-9bff-13ee850e4b1c\") " pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"
Sep 17 14:23:35.843557 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:35.843524    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm2fc\" (UniqueName: \"kubernetes.io/projected/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-kube-api-access-wm2fc\") pod \"autores-model-86c464-kserve-5c668f6b8c-wmpnk\" (UID: \"34f48f3e-2db7-4a29-9bff-13ee850e4b1c\") " pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"
Sep 17 14:23:35.934366 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:35.934272    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"
Sep 17 14:23:36.229461 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:36.229428    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"]
Sep 17 14:23:36.232495 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:23:36.232466    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34f48f3e_2db7_4a29_9bff_13ee850e4b1c.slice/crio-a9baf887373987f90393dcf5325efe0f13879fb2a327e18e360208982d940939 WatchSource:0}: Error finding container a9baf887373987f90393dcf5325efe0f13879fb2a327e18e360208982d940939: Status 404 returned error can't find the container with id a9baf887373987f90393dcf5325efe0f13879fb2a327e18e360208982d940939
Sep 17 14:23:37.244825 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:37.244785    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk" event={"ID":"34f48f3e-2db7-4a29-9bff-13ee850e4b1c","Type":"ContainerStarted","Data":"e41834ed4d0f19d9370839ca453a449067165d34d53497cc24310f96deb2c453"}
Sep 17 14:23:37.245225 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:37.244834    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk" event={"ID":"34f48f3e-2db7-4a29-9bff-13ee850e4b1c","Type":"ContainerStarted","Data":"a9baf887373987f90393dcf5325efe0f13879fb2a327e18e360208982d940939"}
Sep 17 14:23:37.314857 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:37.314800    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk" podStartSLOduration=2.314782059 podStartE2EDuration="2.314782059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:23:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:23:37.313726946 +0000 UTC m=+1004.757802525" watchObservedRunningTime="2026-09-17 14:23:37.314782059 +0000 UTC m=+1004.758857644"
Sep 17 14:23:41.213845 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:41.213808    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz"]
Sep 17 14:23:41.217866 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:41.217835    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz"
Sep 17 14:23:41.221391 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:41.221336    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-1ecaca94-serving-cert\""
Sep 17 14:23:41.237851 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:41.237820    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz"]
Sep 17 14:23:41.277740 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:41.277690    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea968064-90ac-4532-b120-ea0bdb32f6ed-metrics-certs\") pod \"maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz\" (UID: \"ea968064-90ac-4532-b120-ea0bdb32f6ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz"
Sep 17 14:23:41.277902 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:41.277751    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea968064-90ac-4532-b120-ea0bdb32f6ed-maas-api-tls\") pod \"maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz\" (UID: \"ea968064-90ac-4532-b120-ea0bdb32f6ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz"
Sep 17 14:23:41.277902 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:41.277851    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpxhx\" (UniqueName: \"kubernetes.io/projected/ea968064-90ac-4532-b120-ea0bdb32f6ed-kube-api-access-zpxhx\") pod \"maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz\" (UID: \"ea968064-90ac-4532-b120-ea0bdb32f6ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz"
Sep 17 14:23:41.278012 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:41.277903    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea968064-90ac-4532-b120-ea0bdb32f6ed-openshift-service-ca\") pod \"maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz\" (UID: \"ea968064-90ac-4532-b120-ea0bdb32f6ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz"
Sep 17 14:23:41.379226 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:41.379184    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea968064-90ac-4532-b120-ea0bdb32f6ed-metrics-certs\") pod \"maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz\" (UID: \"ea968064-90ac-4532-b120-ea0bdb32f6ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz"
Sep 17 14:23:41.379226 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:41.379228    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea968064-90ac-4532-b120-ea0bdb32f6ed-maas-api-tls\") pod \"maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz\" (UID: \"ea968064-90ac-4532-b120-ea0bdb32f6ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz"
Sep 17 14:23:41.379451 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:41.379246    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpxhx\" (UniqueName: \"kubernetes.io/projected/ea968064-90ac-4532-b120-ea0bdb32f6ed-kube-api-access-zpxhx\") pod \"maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz\" (UID: \"ea968064-90ac-4532-b120-ea0bdb32f6ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz"
Sep 17 14:23:41.379451 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:41.379266    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea968064-90ac-4532-b120-ea0bdb32f6ed-openshift-service-ca\") pod \"maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz\" (UID: \"ea968064-90ac-4532-b120-ea0bdb32f6ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz"
Sep 17 14:23:41.379919 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:41.379886    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea968064-90ac-4532-b120-ea0bdb32f6ed-openshift-service-ca\") pod \"maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz\" (UID: \"ea968064-90ac-4532-b120-ea0bdb32f6ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz"
Sep 17 14:23:41.381886 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:41.381863    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea968064-90ac-4532-b120-ea0bdb32f6ed-maas-api-tls\") pod \"maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz\" (UID: \"ea968064-90ac-4532-b120-ea0bdb32f6ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz"
Sep 17 14:23:41.381997 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:41.381908    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea968064-90ac-4532-b120-ea0bdb32f6ed-metrics-certs\") pod \"maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz\" (UID: \"ea968064-90ac-4532-b120-ea0bdb32f6ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz"
Sep 17 14:23:41.400590 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:41.400534    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpxhx\" (UniqueName: \"kubernetes.io/projected/ea968064-90ac-4532-b120-ea0bdb32f6ed-kube-api-access-zpxhx\") pod \"maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz\" (UID: \"ea968064-90ac-4532-b120-ea0bdb32f6ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz"
Sep 17 14:23:41.530753 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:41.530612    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz"
Sep 17 14:23:41.808201 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:41.808123    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz"]
Sep 17 14:23:41.811581 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:23:41.811553    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea968064_90ac_4532_b120_ea0bdb32f6ed.slice/crio-15ed01a9bd6409eb0461abd95f29c73f26781b20ee69956670423aa10aeb3cdf WatchSource:0}: Error finding container 15ed01a9bd6409eb0461abd95f29c73f26781b20ee69956670423aa10aeb3cdf: Status 404 returned error can't find the container with id 15ed01a9bd6409eb0461abd95f29c73f26781b20ee69956670423aa10aeb3cdf
Sep 17 14:23:42.284457 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:42.284421    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz" event={"ID":"ea968064-90ac-4532-b120-ea0bdb32f6ed","Type":"ContainerStarted","Data":"97c56aaef2777e4b8636433424ce9be84c503cd62cdf432f78809d74dd7576c7"}
Sep 17 14:23:42.284860 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:42.284486    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz"
Sep 17 14:23:42.284860 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:42.284503    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz" event={"ID":"ea968064-90ac-4532-b120-ea0bdb32f6ed","Type":"ContainerStarted","Data":"15ed01a9bd6409eb0461abd95f29c73f26781b20ee69956670423aa10aeb3cdf"}
Sep 17 14:23:42.312790 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:42.312737    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz" podStartSLOduration=0.930091196 podStartE2EDuration="1.312707877s" totalImagesPullingTime="382.616681ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:23:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:23:42.309527416 +0000 UTC m=+1009.753603001" watchObservedRunningTime="2026-09-17 14:23:42.312707877 +0000 UTC m=+1009.756794480"
Sep 17 14:23:42.432865 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:42.432814    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:23:45.934978 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:45.934939    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"
Sep 17 14:23:45.935379 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:45.934998    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"
Sep 17 14:23:45.947425 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:45.947395    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"
Sep 17 14:23:46.322242 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:46.322203    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"
Sep 17 14:23:48.296285 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:23:48.296253    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz"
Sep 17 14:24:05.962657 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:05.962613    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:24:19.269912 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:19.269879    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz"]
Sep 17 14:24:19.270338 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:19.270085    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz" podUID="ea968064-90ac-4532-b120-ea0bdb32f6ed" containerName="maas-api" containerID="cri-o://97c56aaef2777e4b8636433424ce9be84c503cd62cdf432f78809d74dd7576c7" gracePeriod=30
Sep 17 14:24:19.512413 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:19.512381    2580 generic.go:356] "Generic (PLEG): container finished" podID="ea968064-90ac-4532-b120-ea0bdb32f6ed" containerID="97c56aaef2777e4b8636433424ce9be84c503cd62cdf432f78809d74dd7576c7" exitCode=0
Sep 17 14:24:19.512592 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:19.512456    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz" event={"ID":"ea968064-90ac-4532-b120-ea0bdb32f6ed","Type":"ContainerDied","Data":"97c56aaef2777e4b8636433424ce9be84c503cd62cdf432f78809d74dd7576c7"}
Sep 17 14:24:19.512592 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:19.512524    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz" event={"ID":"ea968064-90ac-4532-b120-ea0bdb32f6ed","Type":"ContainerDied","Data":"15ed01a9bd6409eb0461abd95f29c73f26781b20ee69956670423aa10aeb3cdf"}
Sep 17 14:24:19.512592 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:19.512549    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="15ed01a9bd6409eb0461abd95f29c73f26781b20ee69956670423aa10aeb3cdf"
Sep 17 14:24:19.522912 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:19.522850    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz"
Sep 17 14:24:19.649992 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:19.649957    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea968064-90ac-4532-b120-ea0bdb32f6ed-metrics-certs\") pod \"ea968064-90ac-4532-b120-ea0bdb32f6ed\" (UID: \"ea968064-90ac-4532-b120-ea0bdb32f6ed\") "
Sep 17 14:24:19.649992 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:19.649998    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea968064-90ac-4532-b120-ea0bdb32f6ed-openshift-service-ca\") pod \"ea968064-90ac-4532-b120-ea0bdb32f6ed\" (UID: \"ea968064-90ac-4532-b120-ea0bdb32f6ed\") "
Sep 17 14:24:19.650222 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:19.650086    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea968064-90ac-4532-b120-ea0bdb32f6ed-maas-api-tls\") pod \"ea968064-90ac-4532-b120-ea0bdb32f6ed\" (UID: \"ea968064-90ac-4532-b120-ea0bdb32f6ed\") "
Sep 17 14:24:19.650222 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:19.650104    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpxhx\" (UniqueName: \"kubernetes.io/projected/ea968064-90ac-4532-b120-ea0bdb32f6ed-kube-api-access-zpxhx\") pod \"ea968064-90ac-4532-b120-ea0bdb32f6ed\" (UID: \"ea968064-90ac-4532-b120-ea0bdb32f6ed\") "
Sep 17 14:24:19.650435 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:19.650408    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea968064-90ac-4532-b120-ea0bdb32f6ed-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ea968064-90ac-4532-b120-ea0bdb32f6ed" (UID: "ea968064-90ac-4532-b120-ea0bdb32f6ed"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:24:19.652223 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:19.652193    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea968064-90ac-4532-b120-ea0bdb32f6ed-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ea968064-90ac-4532-b120-ea0bdb32f6ed" (UID: "ea968064-90ac-4532-b120-ea0bdb32f6ed"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:24:19.652346 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:19.652216    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea968064-90ac-4532-b120-ea0bdb32f6ed-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ea968064-90ac-4532-b120-ea0bdb32f6ed" (UID: "ea968064-90ac-4532-b120-ea0bdb32f6ed"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:24:19.652346 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:19.652292    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea968064-90ac-4532-b120-ea0bdb32f6ed-kube-api-access-zpxhx" (OuterVolumeSpecName: "kube-api-access-zpxhx") pod "ea968064-90ac-4532-b120-ea0bdb32f6ed" (UID: "ea968064-90ac-4532-b120-ea0bdb32f6ed"). InnerVolumeSpecName "kube-api-access-zpxhx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:24:19.751542 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:19.751502    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea968064-90ac-4532-b120-ea0bdb32f6ed-maas-api-tls\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:24:19.751542 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:19.751536    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpxhx\" (UniqueName: \"kubernetes.io/projected/ea968064-90ac-4532-b120-ea0bdb32f6ed-kube-api-access-zpxhx\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:24:19.751542 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:19.751547    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea968064-90ac-4532-b120-ea0bdb32f6ed-metrics-certs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:24:19.751821 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:19.751555    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea968064-90ac-4532-b120-ea0bdb32f6ed-openshift-service-ca\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:24:20.518518 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:20.518485    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz"
Sep 17 14:24:20.545953 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:20.545915    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz"]
Sep 17 14:24:20.549846 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:20.549812    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1ecaca94-678f6659b8-pz9wz"]
Sep 17 14:24:21.177361 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:21.177313    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea968064-90ac-4532-b120-ea0bdb32f6ed" path="/var/lib/kubelet/pods/ea968064-90ac-4532-b120-ea0bdb32f6ed/volumes"
Sep 17 14:24:22.235806 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:22.235760    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:24:22.749309 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:22.749277    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-86c464-769f99d7d9-8zwtg"]
Sep 17 14:24:22.749538 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:22.749496    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-86c464-769f99d7d9-8zwtg" podUID="d3443b59-91e5-4394-a675-e2b8dcd5e9d2" containerName="maas-api" containerID="cri-o://fe15eb9248bbddf997cabaf1a4ae3374f681cd5e64fe45b75eac82c1bacd00fb" gracePeriod=30
Sep 17 14:24:23.013106 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:23.013039    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-86c464-769f99d7d9-8zwtg"
Sep 17 14:24:23.083480 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:23.083432    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3443b59-91e5-4394-a675-e2b8dcd5e9d2-maas-api-tls\") pod \"d3443b59-91e5-4394-a675-e2b8dcd5e9d2\" (UID: \"d3443b59-91e5-4394-a675-e2b8dcd5e9d2\") "
Sep 17 14:24:23.083666 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:23.083620    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dm864\" (UniqueName: \"kubernetes.io/projected/d3443b59-91e5-4394-a675-e2b8dcd5e9d2-kube-api-access-dm864\") pod \"d3443b59-91e5-4394-a675-e2b8dcd5e9d2\" (UID: \"d3443b59-91e5-4394-a675-e2b8dcd5e9d2\") "
Sep 17 14:24:23.083787 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:23.083767    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3443b59-91e5-4394-a675-e2b8dcd5e9d2-openshift-service-ca\") pod \"d3443b59-91e5-4394-a675-e2b8dcd5e9d2\" (UID: \"d3443b59-91e5-4394-a675-e2b8dcd5e9d2\") "
Sep 17 14:24:23.083861 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:23.083825    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3443b59-91e5-4394-a675-e2b8dcd5e9d2-metrics-certs\") pod \"d3443b59-91e5-4394-a675-e2b8dcd5e9d2\" (UID: \"d3443b59-91e5-4394-a675-e2b8dcd5e9d2\") "
Sep 17 14:24:23.084126 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:23.084095    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3443b59-91e5-4394-a675-e2b8dcd5e9d2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d3443b59-91e5-4394-a675-e2b8dcd5e9d2" (UID: "d3443b59-91e5-4394-a675-e2b8dcd5e9d2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:24:23.086078 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:23.086043    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3443b59-91e5-4394-a675-e2b8dcd5e9d2-kube-api-access-dm864" (OuterVolumeSpecName: "kube-api-access-dm864") pod "d3443b59-91e5-4394-a675-e2b8dcd5e9d2" (UID: "d3443b59-91e5-4394-a675-e2b8dcd5e9d2"). InnerVolumeSpecName "kube-api-access-dm864". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:24:23.086178 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:23.086099    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3443b59-91e5-4394-a675-e2b8dcd5e9d2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d3443b59-91e5-4394-a675-e2b8dcd5e9d2" (UID: "d3443b59-91e5-4394-a675-e2b8dcd5e9d2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:24:23.086501 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:23.086480    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3443b59-91e5-4394-a675-e2b8dcd5e9d2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d3443b59-91e5-4394-a675-e2b8dcd5e9d2" (UID: "d3443b59-91e5-4394-a675-e2b8dcd5e9d2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:24:23.185316 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:23.185266    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3443b59-91e5-4394-a675-e2b8dcd5e9d2-openshift-service-ca\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:24:23.185316 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:23.185306    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3443b59-91e5-4394-a675-e2b8dcd5e9d2-metrics-certs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:24:23.185316 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:23.185321    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3443b59-91e5-4394-a675-e2b8dcd5e9d2-maas-api-tls\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:24:23.185623 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:23.185335    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dm864\" (UniqueName: \"kubernetes.io/projected/d3443b59-91e5-4394-a675-e2b8dcd5e9d2-kube-api-access-dm864\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:24:23.539801 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:23.539765    2580 generic.go:356] "Generic (PLEG): container finished" podID="d3443b59-91e5-4394-a675-e2b8dcd5e9d2" containerID="fe15eb9248bbddf997cabaf1a4ae3374f681cd5e64fe45b75eac82c1bacd00fb" exitCode=0
Sep 17 14:24:23.540225 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:23.539824    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-86c464-769f99d7d9-8zwtg"
Sep 17 14:24:23.540225 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:23.539865    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-86c464-769f99d7d9-8zwtg" event={"ID":"d3443b59-91e5-4394-a675-e2b8dcd5e9d2","Type":"ContainerDied","Data":"fe15eb9248bbddf997cabaf1a4ae3374f681cd5e64fe45b75eac82c1bacd00fb"}
Sep 17 14:24:23.540225 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:23.539939    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-86c464-769f99d7d9-8zwtg" event={"ID":"d3443b59-91e5-4394-a675-e2b8dcd5e9d2","Type":"ContainerDied","Data":"206a14004bf9d425fedd152e3933f57c205826a1e1b87093de19407478c37975"}
Sep 17 14:24:23.540225 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:23.539971    2580 scope.go:117] "RemoveContainer" containerID="fe15eb9248bbddf997cabaf1a4ae3374f681cd5e64fe45b75eac82c1bacd00fb"
Sep 17 14:24:23.551210 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:23.551187    2580 scope.go:117] "RemoveContainer" containerID="fe15eb9248bbddf997cabaf1a4ae3374f681cd5e64fe45b75eac82c1bacd00fb"
Sep 17 14:24:23.551618 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:24:23.551596    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe15eb9248bbddf997cabaf1a4ae3374f681cd5e64fe45b75eac82c1bacd00fb\": container with ID starting with fe15eb9248bbddf997cabaf1a4ae3374f681cd5e64fe45b75eac82c1bacd00fb not found: ID does not exist" containerID="fe15eb9248bbddf997cabaf1a4ae3374f681cd5e64fe45b75eac82c1bacd00fb"
Sep 17 14:24:23.551696 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:23.551633    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe15eb9248bbddf997cabaf1a4ae3374f681cd5e64fe45b75eac82c1bacd00fb"} err="failed to get container status \"fe15eb9248bbddf997cabaf1a4ae3374f681cd5e64fe45b75eac82c1bacd00fb\": rpc error: code = NotFound desc = could not find container \"fe15eb9248bbddf997cabaf1a4ae3374f681cd5e64fe45b75eac82c1bacd00fb\": container with ID starting with fe15eb9248bbddf997cabaf1a4ae3374f681cd5e64fe45b75eac82c1bacd00fb not found: ID does not exist"
Sep 17 14:24:23.560194 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:23.560159    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-86c464-769f99d7d9-8zwtg"]
Sep 17 14:24:23.567585 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:23.567552    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-86c464-769f99d7d9-8zwtg"]
Sep 17 14:24:25.177110 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:25.177079    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3443b59-91e5-4394-a675-e2b8dcd5e9d2" path="/var/lib/kubelet/pods/d3443b59-91e5-4394-a675-e2b8dcd5e9d2/volumes"
Sep 17 14:24:27.740909 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:27.740866    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4"]
Sep 17 14:24:27.741493 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:27.741478    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea968064-90ac-4532-b120-ea0bdb32f6ed" containerName="maas-api"
Sep 17 14:24:27.741545 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:27.741496    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea968064-90ac-4532-b120-ea0bdb32f6ed" containerName="maas-api"
Sep 17 14:24:27.741545 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:27.741525    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3443b59-91e5-4394-a675-e2b8dcd5e9d2" containerName="maas-api"
Sep 17 14:24:27.741545 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:27.741535    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3443b59-91e5-4394-a675-e2b8dcd5e9d2" containerName="maas-api"
Sep 17 14:24:27.741641 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:27.741635    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea968064-90ac-4532-b120-ea0bdb32f6ed" containerName="maas-api"
Sep 17 14:24:27.741675 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:27.741647    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3443b59-91e5-4394-a675-e2b8dcd5e9d2" containerName="maas-api"
Sep 17 14:24:27.752982 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:27.752942    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4"
Sep 17 14:24:27.756363 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:27.756339    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-2f37280d-serving-cert\""
Sep 17 14:24:27.756696 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:27.756675    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4"]
Sep 17 14:24:27.832923 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:27.832891    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d2f735b-8478-4c50-a70a-929f5972e1ae-maas-api-tls\") pod \"maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4\" (UID: \"0d2f735b-8478-4c50-a70a-929f5972e1ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4"
Sep 17 14:24:27.833100 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:27.832930    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxxrr\" (UniqueName: \"kubernetes.io/projected/0d2f735b-8478-4c50-a70a-929f5972e1ae-kube-api-access-xxxrr\") pod \"maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4\" (UID: \"0d2f735b-8478-4c50-a70a-929f5972e1ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4"
Sep 17 14:24:27.833100 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:27.832958    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d2f735b-8478-4c50-a70a-929f5972e1ae-metrics-certs\") pod \"maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4\" (UID: \"0d2f735b-8478-4c50-a70a-929f5972e1ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4"
Sep 17 14:24:27.833100 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:27.833049    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d2f735b-8478-4c50-a70a-929f5972e1ae-openshift-service-ca\") pod \"maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4\" (UID: \"0d2f735b-8478-4c50-a70a-929f5972e1ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4"
Sep 17 14:24:27.933599 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:27.933557    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d2f735b-8478-4c50-a70a-929f5972e1ae-maas-api-tls\") pod \"maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4\" (UID: \"0d2f735b-8478-4c50-a70a-929f5972e1ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4"
Sep 17 14:24:27.933599 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:27.933597    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxxrr\" (UniqueName: \"kubernetes.io/projected/0d2f735b-8478-4c50-a70a-929f5972e1ae-kube-api-access-xxxrr\") pod \"maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4\" (UID: \"0d2f735b-8478-4c50-a70a-929f5972e1ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4"
Sep 17 14:24:27.933862 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:27.933628    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d2f735b-8478-4c50-a70a-929f5972e1ae-metrics-certs\") pod \"maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4\" (UID: \"0d2f735b-8478-4c50-a70a-929f5972e1ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4"
Sep 17 14:24:27.933862 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:27.933667    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d2f735b-8478-4c50-a70a-929f5972e1ae-openshift-service-ca\") pod \"maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4\" (UID: \"0d2f735b-8478-4c50-a70a-929f5972e1ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4"
Sep 17 14:24:27.934430 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:27.934403    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d2f735b-8478-4c50-a70a-929f5972e1ae-openshift-service-ca\") pod \"maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4\" (UID: \"0d2f735b-8478-4c50-a70a-929f5972e1ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4"
Sep 17 14:24:27.936226 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:27.936205    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d2f735b-8478-4c50-a70a-929f5972e1ae-metrics-certs\") pod \"maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4\" (UID: \"0d2f735b-8478-4c50-a70a-929f5972e1ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4"
Sep 17 14:24:27.936312 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:27.936240    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d2f735b-8478-4c50-a70a-929f5972e1ae-maas-api-tls\") pod \"maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4\" (UID: \"0d2f735b-8478-4c50-a70a-929f5972e1ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4"
Sep 17 14:24:27.942963 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:27.942939    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxxrr\" (UniqueName: \"kubernetes.io/projected/0d2f735b-8478-4c50-a70a-929f5972e1ae-kube-api-access-xxxrr\") pod \"maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4\" (UID: \"0d2f735b-8478-4c50-a70a-929f5972e1ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4"
Sep 17 14:24:28.065116 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:28.065020    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4"
Sep 17 14:24:28.354921 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:28.354887    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4"]
Sep 17 14:24:28.355949 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:24:28.355919    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d2f735b_8478_4c50_a70a_929f5972e1ae.slice/crio-793e8adca47bf403100ed58c38a63b51c0c2dbe32c229406a7c8a329fc248670 WatchSource:0}: Error finding container 793e8adca47bf403100ed58c38a63b51c0c2dbe32c229406a7c8a329fc248670: Status 404 returned error can't find the container with id 793e8adca47bf403100ed58c38a63b51c0c2dbe32c229406a7c8a329fc248670
Sep 17 14:24:28.446216 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:28.446182    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"]
Sep 17 14:24:28.571892 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:28.571853    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4" event={"ID":"0d2f735b-8478-4c50-a70a-929f5972e1ae","Type":"ContainerStarted","Data":"793e8adca47bf403100ed58c38a63b51c0c2dbe32c229406a7c8a329fc248670"}
Sep 17 14:24:29.578800 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:29.578766    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4" event={"ID":"0d2f735b-8478-4c50-a70a-929f5972e1ae","Type":"ContainerStarted","Data":"59fcb59713a18f4141e6e4382eac46620f7a8a549aecb53475b49fbc692ae5e9"}
Sep 17 14:24:29.579178 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:29.578920    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4"
Sep 17 14:24:29.600107 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:29.600042    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4" podStartSLOduration=2.120269658 podStartE2EDuration="2.600021215s" totalImagesPullingTime="479.751557ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:24:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:24:29.599299124 +0000 UTC m=+1057.043374739" watchObservedRunningTime="2026-09-17 14:24:29.600021215 +0000 UTC m=+1057.044096799"
Sep 17 14:24:35.591161 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:35.591130    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4"
Sep 17 14:24:43.465764 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:43.465685    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk" podUID="34f48f3e-2db7-4a29-9bff-13ee850e4b1c" containerName="main" containerID="cri-o://e41834ed4d0f19d9370839ca453a449067165d34d53497cc24310f96deb2c453" gracePeriod=45
Sep 17 14:24:43.665805 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:43.665738    2580 generic.go:356] "Generic (PLEG): container finished" podID="34f48f3e-2db7-4a29-9bff-13ee850e4b1c" containerID="e41834ed4d0f19d9370839ca453a449067165d34d53497cc24310f96deb2c453" exitCode=0
Sep 17 14:24:43.665958 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:43.665818    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk" event={"ID":"34f48f3e-2db7-4a29-9bff-13ee850e4b1c","Type":"ContainerDied","Data":"e41834ed4d0f19d9370839ca453a449067165d34d53497cc24310f96deb2c453"}
Sep 17 14:24:43.726476 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:43.726409    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"
Sep 17 14:24:43.779548 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:43.779508    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-tls-certs\") pod \"34f48f3e-2db7-4a29-9bff-13ee850e4b1c\" (UID: \"34f48f3e-2db7-4a29-9bff-13ee850e4b1c\") "
Sep 17 14:24:43.779770 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:43.779594    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-tmp-dir\") pod \"34f48f3e-2db7-4a29-9bff-13ee850e4b1c\" (UID: \"34f48f3e-2db7-4a29-9bff-13ee850e4b1c\") "
Sep 17 14:24:43.779770 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:43.779680    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-model-cache\") pod \"34f48f3e-2db7-4a29-9bff-13ee850e4b1c\" (UID: \"34f48f3e-2db7-4a29-9bff-13ee850e4b1c\") "
Sep 17 14:24:43.779770 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:43.779749    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-home\") pod \"34f48f3e-2db7-4a29-9bff-13ee850e4b1c\" (UID: \"34f48f3e-2db7-4a29-9bff-13ee850e4b1c\") "
Sep 17 14:24:43.780059 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:43.779774    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-dshm\") pod \"34f48f3e-2db7-4a29-9bff-13ee850e4b1c\" (UID: \"34f48f3e-2db7-4a29-9bff-13ee850e4b1c\") "
Sep 17 14:24:43.780059 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:43.779802    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wm2fc\" (UniqueName: \"kubernetes.io/projected/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-kube-api-access-wm2fc\") pod \"34f48f3e-2db7-4a29-9bff-13ee850e4b1c\" (UID: \"34f48f3e-2db7-4a29-9bff-13ee850e4b1c\") "
Sep 17 14:24:43.780059 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:43.779951    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-model-cache" (OuterVolumeSpecName: "model-cache") pod "34f48f3e-2db7-4a29-9bff-13ee850e4b1c" (UID: "34f48f3e-2db7-4a29-9bff-13ee850e4b1c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:24:43.780059 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:43.779959    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "34f48f3e-2db7-4a29-9bff-13ee850e4b1c" (UID: "34f48f3e-2db7-4a29-9bff-13ee850e4b1c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:24:43.780358 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:43.780114    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-home" (OuterVolumeSpecName: "home") pod "34f48f3e-2db7-4a29-9bff-13ee850e4b1c" (UID: "34f48f3e-2db7-4a29-9bff-13ee850e4b1c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:24:43.780358 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:43.780130    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-tmp-dir\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:24:43.780358 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:43.780167    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-model-cache\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:24:43.782054 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:43.782022    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "34f48f3e-2db7-4a29-9bff-13ee850e4b1c" (UID: "34f48f3e-2db7-4a29-9bff-13ee850e4b1c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:24:43.782456 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:43.782427    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-dshm" (OuterVolumeSpecName: "dshm") pod "34f48f3e-2db7-4a29-9bff-13ee850e4b1c" (UID: "34f48f3e-2db7-4a29-9bff-13ee850e4b1c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:24:43.782581 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:43.782561    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-kube-api-access-wm2fc" (OuterVolumeSpecName: "kube-api-access-wm2fc") pod "34f48f3e-2db7-4a29-9bff-13ee850e4b1c" (UID: "34f48f3e-2db7-4a29-9bff-13ee850e4b1c"). InnerVolumeSpecName "kube-api-access-wm2fc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:24:43.881528 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:43.881485    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-home\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:24:43.881528 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:43.881524    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-dshm\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:24:43.881528 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:43.881537    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wm2fc\" (UniqueName: \"kubernetes.io/projected/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-kube-api-access-wm2fc\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:24:43.881807 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:43.881551    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34f48f3e-2db7-4a29-9bff-13ee850e4b1c-tls-certs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:24:44.674109 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:44.674080    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"
Sep 17 14:24:44.674109 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:44.674092    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk" event={"ID":"34f48f3e-2db7-4a29-9bff-13ee850e4b1c","Type":"ContainerDied","Data":"a9baf887373987f90393dcf5325efe0f13879fb2a327e18e360208982d940939"}
Sep 17 14:24:44.674575 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:44.674144    2580 scope.go:117] "RemoveContainer" containerID="e41834ed4d0f19d9370839ca453a449067165d34d53497cc24310f96deb2c453"
Sep 17 14:24:44.706107 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:44.706076    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"]
Sep 17 14:24:44.713629 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:44.713603    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-86c464/autores-model-86c464-kserve-5c668f6b8c-wmpnk"]
Sep 17 14:24:45.177498 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:45.177461    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34f48f3e-2db7-4a29-9bff-13ee850e4b1c" path="/var/lib/kubelet/pods/34f48f3e-2db7-4a29-9bff-13ee850e4b1c/volumes"
Sep 17 14:24:51.962054 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:24:51.962017    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:25:05.444925 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:05.444885    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"]
Sep 17 14:25:05.445418 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:05.445328    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34f48f3e-2db7-4a29-9bff-13ee850e4b1c" containerName="main"
Sep 17 14:25:05.445418 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:05.445340    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="34f48f3e-2db7-4a29-9bff-13ee850e4b1c" containerName="main"
Sep 17 14:25:05.445418 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:05.445416    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="34f48f3e-2db7-4a29-9bff-13ee850e4b1c" containerName="main"
Sep 17 14:25:05.450168 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:05.450139    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"
Sep 17 14:25:05.453498 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:05.453474    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-080801\"/\"premium-w0-080801-kserve-self-signed-certs\""
Sep 17 14:25:05.516818 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:05.516783    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"]
Sep 17 14:25:05.588110 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:05.588073    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cffa421-5a61-4eb0-ab22-49fdccc497bd-tls-certs\") pod \"premium-w0-080801-kserve-865464ffb5-5hz5z\" (UID: \"7cffa421-5a61-4eb0-ab22-49fdccc497bd\") " pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"
Sep 17 14:25:05.588110 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:05.588110    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7cffa421-5a61-4eb0-ab22-49fdccc497bd-home\") pod \"premium-w0-080801-kserve-865464ffb5-5hz5z\" (UID: \"7cffa421-5a61-4eb0-ab22-49fdccc497bd\") " pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"
Sep 17 14:25:05.588367 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:05.588199    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7cffa421-5a61-4eb0-ab22-49fdccc497bd-model-cache\") pod \"premium-w0-080801-kserve-865464ffb5-5hz5z\" (UID: \"7cffa421-5a61-4eb0-ab22-49fdccc497bd\") " pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"
Sep 17 14:25:05.588367 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:05.588240    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cffa421-5a61-4eb0-ab22-49fdccc497bd-tmp-dir\") pod \"premium-w0-080801-kserve-865464ffb5-5hz5z\" (UID: \"7cffa421-5a61-4eb0-ab22-49fdccc497bd\") " pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"
Sep 17 14:25:05.588367 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:05.588271    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz6q9\" (UniqueName: \"kubernetes.io/projected/7cffa421-5a61-4eb0-ab22-49fdccc497bd-kube-api-access-nz6q9\") pod \"premium-w0-080801-kserve-865464ffb5-5hz5z\" (UID: \"7cffa421-5a61-4eb0-ab22-49fdccc497bd\") " pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"
Sep 17 14:25:05.588367 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:05.588337    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7cffa421-5a61-4eb0-ab22-49fdccc497bd-dshm\") pod \"premium-w0-080801-kserve-865464ffb5-5hz5z\" (UID: \"7cffa421-5a61-4eb0-ab22-49fdccc497bd\") " pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"
Sep 17 14:25:05.689250 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:05.689202    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7cffa421-5a61-4eb0-ab22-49fdccc497bd-model-cache\") pod \"premium-w0-080801-kserve-865464ffb5-5hz5z\" (UID: \"7cffa421-5a61-4eb0-ab22-49fdccc497bd\") " pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"
Sep 17 14:25:05.689250 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:05.689245    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cffa421-5a61-4eb0-ab22-49fdccc497bd-tmp-dir\") pod \"premium-w0-080801-kserve-865464ffb5-5hz5z\" (UID: \"7cffa421-5a61-4eb0-ab22-49fdccc497bd\") " pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"
Sep 17 14:25:05.689517 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:05.689264    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz6q9\" (UniqueName: \"kubernetes.io/projected/7cffa421-5a61-4eb0-ab22-49fdccc497bd-kube-api-access-nz6q9\") pod \"premium-w0-080801-kserve-865464ffb5-5hz5z\" (UID: \"7cffa421-5a61-4eb0-ab22-49fdccc497bd\") " pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"
Sep 17 14:25:05.689517 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:05.689292    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7cffa421-5a61-4eb0-ab22-49fdccc497bd-dshm\") pod \"premium-w0-080801-kserve-865464ffb5-5hz5z\" (UID: \"7cffa421-5a61-4eb0-ab22-49fdccc497bd\") " pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"
Sep 17 14:25:05.689517 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:05.689343    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cffa421-5a61-4eb0-ab22-49fdccc497bd-tls-certs\") pod \"premium-w0-080801-kserve-865464ffb5-5hz5z\" (UID: \"7cffa421-5a61-4eb0-ab22-49fdccc497bd\") " pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"
Sep 17 14:25:05.689517 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:05.689361    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7cffa421-5a61-4eb0-ab22-49fdccc497bd-home\") pod \"premium-w0-080801-kserve-865464ffb5-5hz5z\" (UID: \"7cffa421-5a61-4eb0-ab22-49fdccc497bd\") " pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"
Sep 17 14:25:05.689768 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:05.689678    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7cffa421-5a61-4eb0-ab22-49fdccc497bd-model-cache\") pod \"premium-w0-080801-kserve-865464ffb5-5hz5z\" (UID: \"7cffa421-5a61-4eb0-ab22-49fdccc497bd\") " pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"
Sep 17 14:25:05.689829 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:05.689762    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cffa421-5a61-4eb0-ab22-49fdccc497bd-tmp-dir\") pod \"premium-w0-080801-kserve-865464ffb5-5hz5z\" (UID: \"7cffa421-5a61-4eb0-ab22-49fdccc497bd\") " pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"
Sep 17 14:25:05.689867 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:05.689852    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7cffa421-5a61-4eb0-ab22-49fdccc497bd-home\") pod \"premium-w0-080801-kserve-865464ffb5-5hz5z\" (UID: \"7cffa421-5a61-4eb0-ab22-49fdccc497bd\") " pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"
Sep 17 14:25:05.691630 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:05.691611    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7cffa421-5a61-4eb0-ab22-49fdccc497bd-dshm\") pod \"premium-w0-080801-kserve-865464ffb5-5hz5z\" (UID: \"7cffa421-5a61-4eb0-ab22-49fdccc497bd\") " pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"
Sep 17 14:25:05.692068 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:05.692048    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cffa421-5a61-4eb0-ab22-49fdccc497bd-tls-certs\") pod \"premium-w0-080801-kserve-865464ffb5-5hz5z\" (UID: \"7cffa421-5a61-4eb0-ab22-49fdccc497bd\") " pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"
Sep 17 14:25:05.706849 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:05.706817    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz6q9\" (UniqueName: \"kubernetes.io/projected/7cffa421-5a61-4eb0-ab22-49fdccc497bd-kube-api-access-nz6q9\") pod \"premium-w0-080801-kserve-865464ffb5-5hz5z\" (UID: \"7cffa421-5a61-4eb0-ab22-49fdccc497bd\") " pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"
Sep 17 14:25:05.760583 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:05.760535    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"
Sep 17 14:25:06.044448 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:06.044414    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"]
Sep 17 14:25:06.046447 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:25:06.046419    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7cffa421_5a61_4eb0_ab22_49fdccc497bd.slice/crio-f175c09a2a38d891afcced622231ea4d35c0ae26e6de6e88a72f7460b7dbece9 WatchSource:0}: Error finding container f175c09a2a38d891afcced622231ea4d35c0ae26e6de6e88a72f7460b7dbece9: Status 404 returned error can't find the container with id f175c09a2a38d891afcced622231ea4d35c0ae26e6de6e88a72f7460b7dbece9
Sep 17 14:25:06.450987 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:06.450952    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4"]
Sep 17 14:25:06.451458 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:06.451161    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4" podUID="0d2f735b-8478-4c50-a70a-929f5972e1ae" containerName="maas-api" containerID="cri-o://59fcb59713a18f4141e6e4382eac46620f7a8a549aecb53475b49fbc692ae5e9" gracePeriod=30
Sep 17 14:25:06.689196 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:06.689171    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4"
Sep 17 14:25:06.798968 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:06.798872    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d2f735b-8478-4c50-a70a-929f5972e1ae-maas-api-tls\") pod \"0d2f735b-8478-4c50-a70a-929f5972e1ae\" (UID: \"0d2f735b-8478-4c50-a70a-929f5972e1ae\") "
Sep 17 14:25:06.798968 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:06.798957    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxxrr\" (UniqueName: \"kubernetes.io/projected/0d2f735b-8478-4c50-a70a-929f5972e1ae-kube-api-access-xxxrr\") pod \"0d2f735b-8478-4c50-a70a-929f5972e1ae\" (UID: \"0d2f735b-8478-4c50-a70a-929f5972e1ae\") "
Sep 17 14:25:06.799195 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:06.799065    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d2f735b-8478-4c50-a70a-929f5972e1ae-openshift-service-ca\") pod \"0d2f735b-8478-4c50-a70a-929f5972e1ae\" (UID: \"0d2f735b-8478-4c50-a70a-929f5972e1ae\") "
Sep 17 14:25:06.799195 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:06.799103    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d2f735b-8478-4c50-a70a-929f5972e1ae-metrics-certs\") pod \"0d2f735b-8478-4c50-a70a-929f5972e1ae\" (UID: \"0d2f735b-8478-4c50-a70a-929f5972e1ae\") "
Sep 17 14:25:06.799480 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:06.799456    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d2f735b-8478-4c50-a70a-929f5972e1ae-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0d2f735b-8478-4c50-a70a-929f5972e1ae" (UID: "0d2f735b-8478-4c50-a70a-929f5972e1ae"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:25:06.801251 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:06.801216    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d2f735b-8478-4c50-a70a-929f5972e1ae-kube-api-access-xxxrr" (OuterVolumeSpecName: "kube-api-access-xxxrr") pod "0d2f735b-8478-4c50-a70a-929f5972e1ae" (UID: "0d2f735b-8478-4c50-a70a-929f5972e1ae"). InnerVolumeSpecName "kube-api-access-xxxrr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:25:06.801576 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:06.801552    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d2f735b-8478-4c50-a70a-929f5972e1ae-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0d2f735b-8478-4c50-a70a-929f5972e1ae" (UID: "0d2f735b-8478-4c50-a70a-929f5972e1ae"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:25:06.801655 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:06.801581    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d2f735b-8478-4c50-a70a-929f5972e1ae-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0d2f735b-8478-4c50-a70a-929f5972e1ae" (UID: "0d2f735b-8478-4c50-a70a-929f5972e1ae"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:25:06.806608 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:06.806570    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z" event={"ID":"7cffa421-5a61-4eb0-ab22-49fdccc497bd","Type":"ContainerStarted","Data":"1b5eb444739b37f2c975d00dfe5a84ed72169ee0ce0a92dba942731586942552"}
Sep 17 14:25:06.806774 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:06.806636    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z" event={"ID":"7cffa421-5a61-4eb0-ab22-49fdccc497bd","Type":"ContainerStarted","Data":"f175c09a2a38d891afcced622231ea4d35c0ae26e6de6e88a72f7460b7dbece9"}
Sep 17 14:25:06.808198 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:06.808131    2580 generic.go:356] "Generic (PLEG): container finished" podID="0d2f735b-8478-4c50-a70a-929f5972e1ae" containerID="59fcb59713a18f4141e6e4382eac46620f7a8a549aecb53475b49fbc692ae5e9" exitCode=0
Sep 17 14:25:06.808198 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:06.808181    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4"
Sep 17 14:25:06.808321 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:06.808215    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4" event={"ID":"0d2f735b-8478-4c50-a70a-929f5972e1ae","Type":"ContainerDied","Data":"59fcb59713a18f4141e6e4382eac46620f7a8a549aecb53475b49fbc692ae5e9"}
Sep 17 14:25:06.808321 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:06.808311    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4" event={"ID":"0d2f735b-8478-4c50-a70a-929f5972e1ae","Type":"ContainerDied","Data":"793e8adca47bf403100ed58c38a63b51c0c2dbe32c229406a7c8a329fc248670"}
Sep 17 14:25:06.808506 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:06.808346    2580 scope.go:117] "RemoveContainer" containerID="59fcb59713a18f4141e6e4382eac46620f7a8a549aecb53475b49fbc692ae5e9"
Sep 17 14:25:06.823130 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:06.823111    2580 scope.go:117] "RemoveContainer" containerID="59fcb59713a18f4141e6e4382eac46620f7a8a549aecb53475b49fbc692ae5e9"
Sep 17 14:25:06.823433 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:25:06.823416    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59fcb59713a18f4141e6e4382eac46620f7a8a549aecb53475b49fbc692ae5e9\": container with ID starting with 59fcb59713a18f4141e6e4382eac46620f7a8a549aecb53475b49fbc692ae5e9 not found: ID does not exist" containerID="59fcb59713a18f4141e6e4382eac46620f7a8a549aecb53475b49fbc692ae5e9"
Sep 17 14:25:06.823475 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:06.823443    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59fcb59713a18f4141e6e4382eac46620f7a8a549aecb53475b49fbc692ae5e9"} err="failed to get container status \"59fcb59713a18f4141e6e4382eac46620f7a8a549aecb53475b49fbc692ae5e9\": rpc error: code = NotFound desc = could not find container \"59fcb59713a18f4141e6e4382eac46620f7a8a549aecb53475b49fbc692ae5e9\": container with ID starting with 59fcb59713a18f4141e6e4382eac46620f7a8a549aecb53475b49fbc692ae5e9 not found: ID does not exist"
Sep 17 14:25:06.832265 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:06.832218    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z" podStartSLOduration=1.832204061 podStartE2EDuration="1.832204061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:25:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:25:06.829061835 +0000 UTC m=+1094.273137420" watchObservedRunningTime="2026-09-17 14:25:06.832204061 +0000 UTC m=+1094.276279647"
Sep 17 14:25:06.846142 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:06.846108    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4"]
Sep 17 14:25:06.852854 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:06.852827    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2f37280d-6fd8dd9596-4nsj4"]
Sep 17 14:25:06.900093 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:06.900063    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d2f735b-8478-4c50-a70a-929f5972e1ae-openshift-service-ca\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:25:06.900093 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:06.900090    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d2f735b-8478-4c50-a70a-929f5972e1ae-metrics-certs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:25:06.900308 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:06.900105    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d2f735b-8478-4c50-a70a-929f5972e1ae-maas-api-tls\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:25:06.900308 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:06.900193    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxxrr\" (UniqueName: \"kubernetes.io/projected/0d2f735b-8478-4c50-a70a-929f5972e1ae-kube-api-access-xxxrr\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:25:07.177734 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:07.177626    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d2f735b-8478-4c50-a70a-929f5972e1ae" path="/var/lib/kubelet/pods/0d2f735b-8478-4c50-a70a-929f5972e1ae/volumes"
Sep 17 14:25:14.840153 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:14.840109    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:25:15.761602 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:15.761555    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"
Sep 17 14:25:15.761845 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:15.761656    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"
Sep 17 14:25:15.777439 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:15.777408    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"
Sep 17 14:25:15.881323 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:15.881292    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"
Sep 17 14:25:17.267043 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:17.267007    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm"]
Sep 17 14:25:17.270683 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:17.268481    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d2f735b-8478-4c50-a70a-929f5972e1ae" containerName="maas-api"
Sep 17 14:25:17.270683 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:17.268523    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d2f735b-8478-4c50-a70a-929f5972e1ae" containerName="maas-api"
Sep 17 14:25:17.270683 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:17.268724    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d2f735b-8478-4c50-a70a-929f5972e1ae" containerName="maas-api"
Sep 17 14:25:17.275882 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:17.274059    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm"
Sep 17 14:25:17.278668 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:17.278636    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-0e6aaa-serving-cert\""
Sep 17 14:25:17.306841 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:17.306802    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm"]
Sep 17 14:25:17.395851 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:17.395803    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5hlm\" (UniqueName: \"kubernetes.io/projected/0c18636c-3a0e-4086-9c14-61c38881b54c-kube-api-access-m5hlm\") pod \"maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm\" (UID: \"0c18636c-3a0e-4086-9c14-61c38881b54c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm"
Sep 17 14:25:17.396076 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:17.395864    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c18636c-3a0e-4086-9c14-61c38881b54c-metrics-certs\") pod \"maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm\" (UID: \"0c18636c-3a0e-4086-9c14-61c38881b54c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm"
Sep 17 14:25:17.396076 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:17.395954    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c18636c-3a0e-4086-9c14-61c38881b54c-openshift-service-ca\") pod \"maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm\" (UID: \"0c18636c-3a0e-4086-9c14-61c38881b54c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm"
Sep 17 14:25:17.396186 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:17.396075    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c18636c-3a0e-4086-9c14-61c38881b54c-maas-api-tls\") pod \"maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm\" (UID: \"0c18636c-3a0e-4086-9c14-61c38881b54c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm"
Sep 17 14:25:17.496887 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:17.496844    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c18636c-3a0e-4086-9c14-61c38881b54c-maas-api-tls\") pod \"maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm\" (UID: \"0c18636c-3a0e-4086-9c14-61c38881b54c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm"
Sep 17 14:25:17.497097 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:17.496907    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5hlm\" (UniqueName: \"kubernetes.io/projected/0c18636c-3a0e-4086-9c14-61c38881b54c-kube-api-access-m5hlm\") pod \"maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm\" (UID: \"0c18636c-3a0e-4086-9c14-61c38881b54c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm"
Sep 17 14:25:17.497097 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:25:17.497014    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-serving-cert: secret "maas-api-e2e-explicit-0e6aaa-serving-cert" not found
Sep 17 14:25:17.497097 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:17.497041    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c18636c-3a0e-4086-9c14-61c38881b54c-metrics-certs\") pod \"maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm\" (UID: \"0c18636c-3a0e-4086-9c14-61c38881b54c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm"
Sep 17 14:25:17.497097 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:25:17.497098    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c18636c-3a0e-4086-9c14-61c38881b54c-maas-api-tls podName:0c18636c-3a0e-4086-9c14-61c38881b54c nodeName:}" failed. No retries permitted until 2026-09-17 14:25:17.997077836 +0000 UTC m=+1105.441153407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0c18636c-3a0e-4086-9c14-61c38881b54c-maas-api-tls") pod "maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm" (UID: "0c18636c-3a0e-4086-9c14-61c38881b54c") : secret "maas-api-e2e-explicit-0e6aaa-serving-cert" not found
Sep 17 14:25:17.497331 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:17.497137    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c18636c-3a0e-4086-9c14-61c38881b54c-openshift-service-ca\") pod \"maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm\" (UID: \"0c18636c-3a0e-4086-9c14-61c38881b54c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm"
Sep 17 14:25:17.497804 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:17.497784    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c18636c-3a0e-4086-9c14-61c38881b54c-openshift-service-ca\") pod \"maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm\" (UID: \"0c18636c-3a0e-4086-9c14-61c38881b54c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm"
Sep 17 14:25:17.499586 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:17.499562    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c18636c-3a0e-4086-9c14-61c38881b54c-metrics-certs\") pod \"maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm\" (UID: \"0c18636c-3a0e-4086-9c14-61c38881b54c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm"
Sep 17 14:25:17.510381 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:17.510348    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5hlm\" (UniqueName: \"kubernetes.io/projected/0c18636c-3a0e-4086-9c14-61c38881b54c-kube-api-access-m5hlm\") pod \"maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm\" (UID: \"0c18636c-3a0e-4086-9c14-61c38881b54c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm"
Sep 17 14:25:18.002783 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:18.002706    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c18636c-3a0e-4086-9c14-61c38881b54c-maas-api-tls\") pod \"maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm\" (UID: \"0c18636c-3a0e-4086-9c14-61c38881b54c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm"
Sep 17 14:25:18.005177 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:18.005153    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c18636c-3a0e-4086-9c14-61c38881b54c-maas-api-tls\") pod \"maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm\" (UID: \"0c18636c-3a0e-4086-9c14-61c38881b54c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm"
Sep 17 14:25:18.186775 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:18.186701    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm"
Sep 17 14:25:18.475043 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:18.475017    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm"]
Sep 17 14:25:18.476546 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:25:18.476512    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c18636c_3a0e_4086_9c14_61c38881b54c.slice/crio-5fabcd2c9cc0b13c5aef822d8aeccb92688633553b5796f0b2bf16b388a38314 WatchSource:0}: Error finding container 5fabcd2c9cc0b13c5aef822d8aeccb92688633553b5796f0b2bf16b388a38314: Status 404 returned error can't find the container with id 5fabcd2c9cc0b13c5aef822d8aeccb92688633553b5796f0b2bf16b388a38314
Sep 17 14:25:18.478001 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:18.477983    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 14:25:18.889642 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:18.889611    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm" event={"ID":"0c18636c-3a0e-4086-9c14-61c38881b54c","Type":"ContainerStarted","Data":"5fabcd2c9cc0b13c5aef822d8aeccb92688633553b5796f0b2bf16b388a38314"}
Sep 17 14:25:19.897729 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:19.897677    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm" event={"ID":"0c18636c-3a0e-4086-9c14-61c38881b54c","Type":"ContainerStarted","Data":"f92e712397bee2592b83abe962bc176918c9afab122a3a17dc1e0bee9b5a2f0c"}
Sep 17 14:25:19.898145 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:19.897864    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm"
Sep 17 14:25:19.929048 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:19.928989    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm" podStartSLOduration=2.5728936620000002 podStartE2EDuration="2.928970721s" totalImagesPullingTime="356.077059ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:25:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:25:19.926697468 +0000 UTC m=+1107.370773076" watchObservedRunningTime="2026-09-17 14:25:19.928970721 +0000 UTC m=+1107.373046307"
Sep 17 14:25:25.910186 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:25.910148    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm"
Sep 17 14:25:37.422767 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:37.422720    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:25:55.653042 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:55.652997    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"]
Sep 17 14:25:55.660069 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:55.660027    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"
Sep 17 14:25:55.679883 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:25:55.679851    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"ai-tenant-e2e-inf-b-28f011\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"ai-tenant-e2e-inf-b-28f011\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Sep 17 14:25:55.686504 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:25:55.686477    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"ai-tenant-e2e-inf-b-28f011\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"ai-tenant-e2e-inf-b-28f011\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Sep 17 14:25:55.697987 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:25:55.697958    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-dockercfg-w6777\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"ai-tenant-e2e-inf-b-28f011\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"ai-tenant-e2e-inf-b-28f011\"/\"default-dockercfg-w6777\"" type="*v1.Secret"
Sep 17 14:25:55.701450 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:25:55.701420    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-model-28f011-kserve-6d8577f68f-xznn7\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"ai-tenant-e2e-inf-b-28f011\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" podUID="23524c07-d2cf-410b-99c4-31e68f7dbce4" pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"
Sep 17 14:25:55.701602 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:25:55.701577    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"test-model-28f011-kserve-self-signed-certs\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"ai-tenant-e2e-inf-b-28f011\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"ai-tenant-e2e-inf-b-28f011\"/\"test-model-28f011-kserve-self-signed-certs\"" type="*v1.Secret"
Sep 17 14:25:55.757792 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:55.757758    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23524c07-d2cf-410b-99c4-31e68f7dbce4-model-cache\") pod \"test-model-28f011-kserve-6d8577f68f-xznn7\" (UID: \"23524c07-d2cf-410b-99c4-31e68f7dbce4\") " pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"
Sep 17 14:25:55.757792 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:55.757793    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhc2v\" (UniqueName: \"kubernetes.io/projected/23524c07-d2cf-410b-99c4-31e68f7dbce4-kube-api-access-nhc2v\") pod \"test-model-28f011-kserve-6d8577f68f-xznn7\" (UID: \"23524c07-d2cf-410b-99c4-31e68f7dbce4\") " pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"
Sep 17 14:25:55.757969 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:55.757839    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23524c07-d2cf-410b-99c4-31e68f7dbce4-dshm\") pod \"test-model-28f011-kserve-6d8577f68f-xznn7\" (UID: \"23524c07-d2cf-410b-99c4-31e68f7dbce4\") " pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"
Sep 17 14:25:55.757969 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:55.757877    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23524c07-d2cf-410b-99c4-31e68f7dbce4-tmp-dir\") pod \"test-model-28f011-kserve-6d8577f68f-xznn7\" (UID: \"23524c07-d2cf-410b-99c4-31e68f7dbce4\") " pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"
Sep 17 14:25:55.757969 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:55.757907    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23524c07-d2cf-410b-99c4-31e68f7dbce4-tls-certs\") pod \"test-model-28f011-kserve-6d8577f68f-xznn7\" (UID: \"23524c07-d2cf-410b-99c4-31e68f7dbce4\") " pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"
Sep 17 14:25:55.758084 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:55.757976    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23524c07-d2cf-410b-99c4-31e68f7dbce4-home\") pod \"test-model-28f011-kserve-6d8577f68f-xznn7\" (UID: \"23524c07-d2cf-410b-99c4-31e68f7dbce4\") " pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"
Sep 17 14:25:55.776657 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:55.776622    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"]
Sep 17 14:25:55.858637 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:55.858596    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23524c07-d2cf-410b-99c4-31e68f7dbce4-tmp-dir\") pod \"test-model-28f011-kserve-6d8577f68f-xznn7\" (UID: \"23524c07-d2cf-410b-99c4-31e68f7dbce4\") " pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"
Sep 17 14:25:55.858846 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:55.858659    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23524c07-d2cf-410b-99c4-31e68f7dbce4-tls-certs\") pod \"test-model-28f011-kserve-6d8577f68f-xznn7\" (UID: \"23524c07-d2cf-410b-99c4-31e68f7dbce4\") " pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"
Sep 17 14:25:55.858846 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:55.858704    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23524c07-d2cf-410b-99c4-31e68f7dbce4-home\") pod \"test-model-28f011-kserve-6d8577f68f-xznn7\" (UID: \"23524c07-d2cf-410b-99c4-31e68f7dbce4\") " pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"
Sep 17 14:25:55.858846 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:55.858807    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23524c07-d2cf-410b-99c4-31e68f7dbce4-model-cache\") pod \"test-model-28f011-kserve-6d8577f68f-xznn7\" (UID: \"23524c07-d2cf-410b-99c4-31e68f7dbce4\") " pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"
Sep 17 14:25:55.858846 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:55.858833    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhc2v\" (UniqueName: \"kubernetes.io/projected/23524c07-d2cf-410b-99c4-31e68f7dbce4-kube-api-access-nhc2v\") pod \"test-model-28f011-kserve-6d8577f68f-xznn7\" (UID: \"23524c07-d2cf-410b-99c4-31e68f7dbce4\") " pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"
Sep 17 14:25:55.859011 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:55.858892    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23524c07-d2cf-410b-99c4-31e68f7dbce4-dshm\") pod \"test-model-28f011-kserve-6d8577f68f-xznn7\" (UID: \"23524c07-d2cf-410b-99c4-31e68f7dbce4\") " pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"
Sep 17 14:25:55.859128 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:55.859109    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23524c07-d2cf-410b-99c4-31e68f7dbce4-tmp-dir\") pod \"test-model-28f011-kserve-6d8577f68f-xznn7\" (UID: \"23524c07-d2cf-410b-99c4-31e68f7dbce4\") " pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"
Sep 17 14:25:55.859199 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:55.859174    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23524c07-d2cf-410b-99c4-31e68f7dbce4-home\") pod \"test-model-28f011-kserve-6d8577f68f-xznn7\" (UID: \"23524c07-d2cf-410b-99c4-31e68f7dbce4\") " pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"
Sep 17 14:25:55.859239 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:55.859188    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23524c07-d2cf-410b-99c4-31e68f7dbce4-model-cache\") pod \"test-model-28f011-kserve-6d8577f68f-xznn7\" (UID: \"23524c07-d2cf-410b-99c4-31e68f7dbce4\") " pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"
Sep 17 14:25:55.861178 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:55.861162    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23524c07-d2cf-410b-99c4-31e68f7dbce4-dshm\") pod \"test-model-28f011-kserve-6d8577f68f-xznn7\" (UID: \"23524c07-d2cf-410b-99c4-31e68f7dbce4\") " pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"
Sep 17 14:25:56.845564 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:56.845530    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-28f011\"/\"test-model-28f011-kserve-self-signed-certs\""
Sep 17 14:25:56.852201 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:56.852156    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23524c07-d2cf-410b-99c4-31e68f7dbce4-tls-certs\") pod \"test-model-28f011-kserve-6d8577f68f-xznn7\" (UID: \"23524c07-d2cf-410b-99c4-31e68f7dbce4\") " pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"
Sep 17 14:25:56.872761 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:56.872698    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-28f011\"/\"kube-root-ca.crt\""
Sep 17 14:25:57.003650 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:57.003612    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:25:57.078942 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:57.078904    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-28f011\"/\"openshift-service-ca.crt\""
Sep 17 14:25:57.083909 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:57.083879    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhc2v\" (UniqueName: \"kubernetes.io/projected/23524c07-d2cf-410b-99c4-31e68f7dbce4-kube-api-access-nhc2v\") pod \"test-model-28f011-kserve-6d8577f68f-xznn7\" (UID: \"23524c07-d2cf-410b-99c4-31e68f7dbce4\") " pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"
Sep 17 14:25:57.084870 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:57.084852    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-28f011\"/\"default-dockercfg-w6777\""
Sep 17 14:25:57.169556 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:57.169464    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"
Sep 17 14:25:57.501823 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:57.501796    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"]
Sep 17 14:25:57.502777 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:25:57.502749    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23524c07_d2cf_410b_99c4_31e68f7dbce4.slice/crio-4687ff7fa285bfe3584d10c6c427d20d9c2a8a9f96e4954918e4d7cdb27d15d6 WatchSource:0}: Error finding container 4687ff7fa285bfe3584d10c6c427d20d9c2a8a9f96e4954918e4d7cdb27d15d6: Status 404 returned error can't find the container with id 4687ff7fa285bfe3584d10c6c427d20d9c2a8a9f96e4954918e4d7cdb27d15d6
Sep 17 14:25:58.120245 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:58.120207    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7" event={"ID":"23524c07-d2cf-410b-99c4-31e68f7dbce4","Type":"ContainerStarted","Data":"5e08875cab859ca98f72c558d72f07796cd60c4580459d3eaa1540ae76820ee5"}
Sep 17 14:25:58.120245 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:58.120253    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7" event={"ID":"23524c07-d2cf-410b-99c4-31e68f7dbce4","Type":"ContainerStarted","Data":"4687ff7fa285bfe3584d10c6c427d20d9c2a8a9f96e4954918e4d7cdb27d15d6"}
Sep 17 14:25:58.159850 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:25:58.159790    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7" podStartSLOduration=3.159772074 podStartE2EDuration="3.159772074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:25:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:25:58.157869885 +0000 UTC m=+1145.601945472" watchObservedRunningTime="2026-09-17 14:25:58.159772074 +0000 UTC m=+1145.603847691"
Sep 17 14:26:07.177793 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:26:07.177756    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"
Sep 17 14:26:07.177793 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:26:07.177793    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"
Sep 17 14:26:07.184528 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:26:07.184504    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"
Sep 17 14:26:08.193408 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:26:08.193375    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"
Sep 17 14:26:16.646171 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:26:16.646077    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:26:44.665062 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:26:44.665020    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:27:10.176609 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.176572    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm"]
Sep 17 14:27:10.177209 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.176840    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm" podUID="0c18636c-3a0e-4086-9c14-61c38881b54c" containerName="maas-api" containerID="cri-o://f92e712397bee2592b83abe962bc176918c9afab122a3a17dc1e0bee9b5a2f0c" gracePeriod=30
Sep 17 14:27:10.439344 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.439283    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm"
Sep 17 14:27:10.468938 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.468901    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c18636c-3a0e-4086-9c14-61c38881b54c-metrics-certs\") pod \"0c18636c-3a0e-4086-9c14-61c38881b54c\" (UID: \"0c18636c-3a0e-4086-9c14-61c38881b54c\") "
Sep 17 14:27:10.468938 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.468940    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c18636c-3a0e-4086-9c14-61c38881b54c-openshift-service-ca\") pod \"0c18636c-3a0e-4086-9c14-61c38881b54c\" (UID: \"0c18636c-3a0e-4086-9c14-61c38881b54c\") "
Sep 17 14:27:10.469197 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.468988    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c18636c-3a0e-4086-9c14-61c38881b54c-maas-api-tls\") pod \"0c18636c-3a0e-4086-9c14-61c38881b54c\" (UID: \"0c18636c-3a0e-4086-9c14-61c38881b54c\") "
Sep 17 14:27:10.469197 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.469037    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5hlm\" (UniqueName: \"kubernetes.io/projected/0c18636c-3a0e-4086-9c14-61c38881b54c-kube-api-access-m5hlm\") pod \"0c18636c-3a0e-4086-9c14-61c38881b54c\" (UID: \"0c18636c-3a0e-4086-9c14-61c38881b54c\") "
Sep 17 14:27:10.469397 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.469362    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c18636c-3a0e-4086-9c14-61c38881b54c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0c18636c-3a0e-4086-9c14-61c38881b54c" (UID: "0c18636c-3a0e-4086-9c14-61c38881b54c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:27:10.471153 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.471125    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c18636c-3a0e-4086-9c14-61c38881b54c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0c18636c-3a0e-4086-9c14-61c38881b54c" (UID: "0c18636c-3a0e-4086-9c14-61c38881b54c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:27:10.471298 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.471281    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c18636c-3a0e-4086-9c14-61c38881b54c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0c18636c-3a0e-4086-9c14-61c38881b54c" (UID: "0c18636c-3a0e-4086-9c14-61c38881b54c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:27:10.471366 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.471313    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c18636c-3a0e-4086-9c14-61c38881b54c-kube-api-access-m5hlm" (OuterVolumeSpecName: "kube-api-access-m5hlm") pod "0c18636c-3a0e-4086-9c14-61c38881b54c" (UID: "0c18636c-3a0e-4086-9c14-61c38881b54c"). InnerVolumeSpecName "kube-api-access-m5hlm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:27:10.569841 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.569809    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c18636c-3a0e-4086-9c14-61c38881b54c-metrics-certs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:27:10.569841 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.569836    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c18636c-3a0e-4086-9c14-61c38881b54c-openshift-service-ca\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:27:10.569841 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.569845    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c18636c-3a0e-4086-9c14-61c38881b54c-maas-api-tls\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:27:10.570084 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.569854    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5hlm\" (UniqueName: \"kubernetes.io/projected/0c18636c-3a0e-4086-9c14-61c38881b54c-kube-api-access-m5hlm\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:27:10.572359 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.572330    2580 generic.go:356] "Generic (PLEG): container finished" podID="0c18636c-3a0e-4086-9c14-61c38881b54c" containerID="f92e712397bee2592b83abe962bc176918c9afab122a3a17dc1e0bee9b5a2f0c" exitCode=0
Sep 17 14:27:10.572552 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.572378    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm"
Sep 17 14:27:10.572552 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.572420    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm" event={"ID":"0c18636c-3a0e-4086-9c14-61c38881b54c","Type":"ContainerDied","Data":"f92e712397bee2592b83abe962bc176918c9afab122a3a17dc1e0bee9b5a2f0c"}
Sep 17 14:27:10.572552 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.572479    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm" event={"ID":"0c18636c-3a0e-4086-9c14-61c38881b54c","Type":"ContainerDied","Data":"5fabcd2c9cc0b13c5aef822d8aeccb92688633553b5796f0b2bf16b388a38314"}
Sep 17 14:27:10.572552 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.572508    2580 scope.go:117] "RemoveContainer" containerID="f92e712397bee2592b83abe962bc176918c9afab122a3a17dc1e0bee9b5a2f0c"
Sep 17 14:27:10.582914 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.582892    2580 scope.go:117] "RemoveContainer" containerID="f92e712397bee2592b83abe962bc176918c9afab122a3a17dc1e0bee9b5a2f0c"
Sep 17 14:27:10.583243 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:27:10.583221    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f92e712397bee2592b83abe962bc176918c9afab122a3a17dc1e0bee9b5a2f0c\": container with ID starting with f92e712397bee2592b83abe962bc176918c9afab122a3a17dc1e0bee9b5a2f0c not found: ID does not exist" containerID="f92e712397bee2592b83abe962bc176918c9afab122a3a17dc1e0bee9b5a2f0c"
Sep 17 14:27:10.583326 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.583255    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f92e712397bee2592b83abe962bc176918c9afab122a3a17dc1e0bee9b5a2f0c"} err="failed to get container status \"f92e712397bee2592b83abe962bc176918c9afab122a3a17dc1e0bee9b5a2f0c\": rpc error: code = NotFound desc = could not find container \"f92e712397bee2592b83abe962bc176918c9afab122a3a17dc1e0bee9b5a2f0c\": container with ID starting with f92e712397bee2592b83abe962bc176918c9afab122a3a17dc1e0bee9b5a2f0c not found: ID does not exist"
Sep 17 14:27:10.615595 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.615552    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm"]
Sep 17 14:27:10.627013 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.626983    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-0e6aaa-5d4766bf55-2t5zm"]
Sep 17 14:27:10.689780 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.689674    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx"]
Sep 17 14:27:10.690219 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.690200    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c18636c-3a0e-4086-9c14-61c38881b54c" containerName="maas-api"
Sep 17 14:27:10.690305 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.690222    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c18636c-3a0e-4086-9c14-61c38881b54c" containerName="maas-api"
Sep 17 14:27:10.690358 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.690323    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c18636c-3a0e-4086-9c14-61c38881b54c" containerName="maas-api"
Sep 17 14:27:10.694785 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.694763    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx"
Sep 17 14:27:10.697607 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.697585    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-130b7aa1-serving-cert\""
Sep 17 14:27:10.710845 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.710815    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx"]
Sep 17 14:27:10.771584 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.771544    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94091032-5ac4-40fa-b775-dfbea5750eb5-metrics-certs\") pod \"maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx\" (UID: \"94091032-5ac4-40fa-b775-dfbea5750eb5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx"
Sep 17 14:27:10.771764 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.771645    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94091032-5ac4-40fa-b775-dfbea5750eb5-openshift-service-ca\") pod \"maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx\" (UID: \"94091032-5ac4-40fa-b775-dfbea5750eb5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx"
Sep 17 14:27:10.771764 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.771722    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94091032-5ac4-40fa-b775-dfbea5750eb5-maas-api-tls\") pod \"maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx\" (UID: \"94091032-5ac4-40fa-b775-dfbea5750eb5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx"
Sep 17 14:27:10.771848 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.771771    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4kr6\" (UniqueName: \"kubernetes.io/projected/94091032-5ac4-40fa-b775-dfbea5750eb5-kube-api-access-x4kr6\") pod \"maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx\" (UID: \"94091032-5ac4-40fa-b775-dfbea5750eb5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx"
Sep 17 14:27:10.872666 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.872628    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94091032-5ac4-40fa-b775-dfbea5750eb5-metrics-certs\") pod \"maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx\" (UID: \"94091032-5ac4-40fa-b775-dfbea5750eb5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx"
Sep 17 14:27:10.872899 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.872683    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94091032-5ac4-40fa-b775-dfbea5750eb5-openshift-service-ca\") pod \"maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx\" (UID: \"94091032-5ac4-40fa-b775-dfbea5750eb5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx"
Sep 17 14:27:10.872899 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.872742    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94091032-5ac4-40fa-b775-dfbea5750eb5-maas-api-tls\") pod \"maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx\" (UID: \"94091032-5ac4-40fa-b775-dfbea5750eb5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx"
Sep 17 14:27:10.872899 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.872762    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4kr6\" (UniqueName: \"kubernetes.io/projected/94091032-5ac4-40fa-b775-dfbea5750eb5-kube-api-access-x4kr6\") pod \"maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx\" (UID: \"94091032-5ac4-40fa-b775-dfbea5750eb5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx"
Sep 17 14:27:10.872899 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:27:10.872874    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-serving-cert: secret "maas-api-e2e-mt-130b7aa1-serving-cert" not found
Sep 17 14:27:10.873130 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:27:10.872973    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94091032-5ac4-40fa-b775-dfbea5750eb5-maas-api-tls podName:94091032-5ac4-40fa-b775-dfbea5750eb5 nodeName:}" failed. No retries permitted until 2026-09-17 14:27:11.372947502 +0000 UTC m=+1218.817023074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/94091032-5ac4-40fa-b775-dfbea5750eb5-maas-api-tls") pod "maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx" (UID: "94091032-5ac4-40fa-b775-dfbea5750eb5") : secret "maas-api-e2e-mt-130b7aa1-serving-cert" not found
Sep 17 14:27:10.873555 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.873532    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94091032-5ac4-40fa-b775-dfbea5750eb5-openshift-service-ca\") pod \"maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx\" (UID: \"94091032-5ac4-40fa-b775-dfbea5750eb5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx"
Sep 17 14:27:10.875212 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.875192    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94091032-5ac4-40fa-b775-dfbea5750eb5-metrics-certs\") pod \"maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx\" (UID: \"94091032-5ac4-40fa-b775-dfbea5750eb5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx"
Sep 17 14:27:10.888459 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:10.888419    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4kr6\" (UniqueName: \"kubernetes.io/projected/94091032-5ac4-40fa-b775-dfbea5750eb5-kube-api-access-x4kr6\") pod \"maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx\" (UID: \"94091032-5ac4-40fa-b775-dfbea5750eb5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx"
Sep 17 14:27:11.186304 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:11.186257    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c18636c-3a0e-4086-9c14-61c38881b54c" path="/var/lib/kubelet/pods/0c18636c-3a0e-4086-9c14-61c38881b54c/volumes"
Sep 17 14:27:11.378116 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:11.378073    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94091032-5ac4-40fa-b775-dfbea5750eb5-maas-api-tls\") pod \"maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx\" (UID: \"94091032-5ac4-40fa-b775-dfbea5750eb5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx"
Sep 17 14:27:11.380567 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:11.380533    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94091032-5ac4-40fa-b775-dfbea5750eb5-maas-api-tls\") pod \"maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx\" (UID: \"94091032-5ac4-40fa-b775-dfbea5750eb5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx"
Sep 17 14:27:11.607880 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:11.607829    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx"
Sep 17 14:27:11.902806 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:11.902775    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx"]
Sep 17 14:27:11.904916 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:27:11.904880    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94091032_5ac4_40fa_b775_dfbea5750eb5.slice/crio-5b1fa10e6de0071c864fcafc1c4c336ec9a1e3ef7c6e117e962525d089e159e0 WatchSource:0}: Error finding container 5b1fa10e6de0071c864fcafc1c4c336ec9a1e3ef7c6e117e962525d089e159e0: Status 404 returned error can't find the container with id 5b1fa10e6de0071c864fcafc1c4c336ec9a1e3ef7c6e117e962525d089e159e0
Sep 17 14:27:12.588018 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:12.587975    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx" event={"ID":"94091032-5ac4-40fa-b775-dfbea5750eb5","Type":"ContainerStarted","Data":"984cd5031312aa382858ec09e0602299271fd09cdfee50dbe46b7edbde5262e9"}
Sep 17 14:27:12.588438 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:12.588043    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx" event={"ID":"94091032-5ac4-40fa-b775-dfbea5750eb5","Type":"ContainerStarted","Data":"5b1fa10e6de0071c864fcafc1c4c336ec9a1e3ef7c6e117e962525d089e159e0"}
Sep 17 14:27:12.588438 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:12.588126    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx"
Sep 17 14:27:12.634322 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:12.634263    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx" podStartSLOduration=2.137664169 podStartE2EDuration="2.634245682s" totalImagesPullingTime="496.581513ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:27:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:27:12.631647254 +0000 UTC m=+1220.075722868" watchObservedRunningTime="2026-09-17 14:27:12.634245682 +0000 UTC m=+1220.078321267"
Sep 17 14:27:18.599126 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:18.599083    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx"
Sep 17 14:27:19.178944 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:19.178904    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:27:46.793668 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:46.793577    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx"]
Sep 17 14:27:46.794253 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:46.793865    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx" podUID="94091032-5ac4-40fa-b775-dfbea5750eb5" containerName="maas-api" containerID="cri-o://984cd5031312aa382858ec09e0602299271fd09cdfee50dbe46b7edbde5262e9" gracePeriod=30
Sep 17 14:27:47.047542 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:47.047481    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx"
Sep 17 14:27:47.122741 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:47.122669    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94091032-5ac4-40fa-b775-dfbea5750eb5-maas-api-tls\") pod \"94091032-5ac4-40fa-b775-dfbea5750eb5\" (UID: \"94091032-5ac4-40fa-b775-dfbea5750eb5\") "
Sep 17 14:27:47.122944 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:47.122749    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94091032-5ac4-40fa-b775-dfbea5750eb5-metrics-certs\") pod \"94091032-5ac4-40fa-b775-dfbea5750eb5\" (UID: \"94091032-5ac4-40fa-b775-dfbea5750eb5\") "
Sep 17 14:27:47.122944 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:47.122790    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4kr6\" (UniqueName: \"kubernetes.io/projected/94091032-5ac4-40fa-b775-dfbea5750eb5-kube-api-access-x4kr6\") pod \"94091032-5ac4-40fa-b775-dfbea5750eb5\" (UID: \"94091032-5ac4-40fa-b775-dfbea5750eb5\") "
Sep 17 14:27:47.122944 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:47.122854    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94091032-5ac4-40fa-b775-dfbea5750eb5-openshift-service-ca\") pod \"94091032-5ac4-40fa-b775-dfbea5750eb5\" (UID: \"94091032-5ac4-40fa-b775-dfbea5750eb5\") "
Sep 17 14:27:47.123272 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:47.123245    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94091032-5ac4-40fa-b775-dfbea5750eb5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "94091032-5ac4-40fa-b775-dfbea5750eb5" (UID: "94091032-5ac4-40fa-b775-dfbea5750eb5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:27:47.125001 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:47.124972    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94091032-5ac4-40fa-b775-dfbea5750eb5-kube-api-access-x4kr6" (OuterVolumeSpecName: "kube-api-access-x4kr6") pod "94091032-5ac4-40fa-b775-dfbea5750eb5" (UID: "94091032-5ac4-40fa-b775-dfbea5750eb5"). InnerVolumeSpecName "kube-api-access-x4kr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:27:47.125105 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:47.124978    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94091032-5ac4-40fa-b775-dfbea5750eb5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "94091032-5ac4-40fa-b775-dfbea5750eb5" (UID: "94091032-5ac4-40fa-b775-dfbea5750eb5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:27:47.125105 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:47.125054    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94091032-5ac4-40fa-b775-dfbea5750eb5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "94091032-5ac4-40fa-b775-dfbea5750eb5" (UID: "94091032-5ac4-40fa-b775-dfbea5750eb5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:27:47.224580 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:47.224535    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94091032-5ac4-40fa-b775-dfbea5750eb5-maas-api-tls\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:27:47.224580 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:47.224571    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94091032-5ac4-40fa-b775-dfbea5750eb5-metrics-certs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:27:47.224580 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:47.224586    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4kr6\" (UniqueName: \"kubernetes.io/projected/94091032-5ac4-40fa-b775-dfbea5750eb5-kube-api-access-x4kr6\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:27:47.224885 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:47.224604    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94091032-5ac4-40fa-b775-dfbea5750eb5-openshift-service-ca\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:27:47.794604 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:47.794563    2580 generic.go:356] "Generic (PLEG): container finished" podID="94091032-5ac4-40fa-b775-dfbea5750eb5" containerID="984cd5031312aa382858ec09e0602299271fd09cdfee50dbe46b7edbde5262e9" exitCode=0
Sep 17 14:27:47.795026 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:47.794620    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx"
Sep 17 14:27:47.795026 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:47.794654    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx" event={"ID":"94091032-5ac4-40fa-b775-dfbea5750eb5","Type":"ContainerDied","Data":"984cd5031312aa382858ec09e0602299271fd09cdfee50dbe46b7edbde5262e9"}
Sep 17 14:27:47.795026 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:47.794725    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx" event={"ID":"94091032-5ac4-40fa-b775-dfbea5750eb5","Type":"ContainerDied","Data":"5b1fa10e6de0071c864fcafc1c4c336ec9a1e3ef7c6e117e962525d089e159e0"}
Sep 17 14:27:47.795026 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:47.794750    2580 scope.go:117] "RemoveContainer" containerID="984cd5031312aa382858ec09e0602299271fd09cdfee50dbe46b7edbde5262e9"
Sep 17 14:27:47.805001 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:47.804983    2580 scope.go:117] "RemoveContainer" containerID="984cd5031312aa382858ec09e0602299271fd09cdfee50dbe46b7edbde5262e9"
Sep 17 14:27:47.805315 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:27:47.805293    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"984cd5031312aa382858ec09e0602299271fd09cdfee50dbe46b7edbde5262e9\": container with ID starting with 984cd5031312aa382858ec09e0602299271fd09cdfee50dbe46b7edbde5262e9 not found: ID does not exist" containerID="984cd5031312aa382858ec09e0602299271fd09cdfee50dbe46b7edbde5262e9"
Sep 17 14:27:47.805368 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:47.805325    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"984cd5031312aa382858ec09e0602299271fd09cdfee50dbe46b7edbde5262e9"} err="failed to get container status \"984cd5031312aa382858ec09e0602299271fd09cdfee50dbe46b7edbde5262e9\": rpc error: code = NotFound desc = could not find container \"984cd5031312aa382858ec09e0602299271fd09cdfee50dbe46b7edbde5262e9\": container with ID starting with 984cd5031312aa382858ec09e0602299271fd09cdfee50dbe46b7edbde5262e9 not found: ID does not exist"
Sep 17 14:27:47.815278 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:47.815245    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx"]
Sep 17 14:27:47.818934 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:47.818908    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-130b7aa1-87cc5bb54-2kbfx"]
Sep 17 14:27:48.251987 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:48.251950    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:27:49.177939 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:27:49.177904    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94091032-5ac4-40fa-b775-dfbea5750eb5" path="/var/lib/kubelet/pods/94091032-5ac4-40fa-b775-dfbea5750eb5/volumes"
Sep 17 14:28:10.328188 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:10.328143    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"]
Sep 17 14:28:10.328765 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:10.328749    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94091032-5ac4-40fa-b775-dfbea5750eb5" containerName="maas-api"
Sep 17 14:28:10.328765 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:10.328766    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="94091032-5ac4-40fa-b775-dfbea5750eb5" containerName="maas-api"
Sep 17 14:28:10.328879 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:10.328849    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="94091032-5ac4-40fa-b775-dfbea5750eb5" containerName="maas-api"
Sep 17 14:28:10.333577 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:10.333552    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"
Sep 17 14:28:10.338095 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:10.338063    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-adae21\"/\"openshift-service-ca.crt\""
Sep 17 14:28:10.338095 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:10.338085    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-adae21\"/\"noten-model-adae21-kserve-self-signed-certs\""
Sep 17 14:28:10.338272 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:10.338108    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-adae21\"/\"default-dockercfg-cf77x\""
Sep 17 14:28:10.338272 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:10.338074    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-adae21\"/\"kube-root-ca.crt\""
Sep 17 14:28:10.344355 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:10.344329    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"]
Sep 17 14:28:10.454777 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:10.454741    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c830ca9-abe6-4423-89f9-7abcd86b51be-model-cache\") pod \"noten-model-adae21-kserve-8598cb7fb7-t8kvr\" (UID: \"3c830ca9-abe6-4423-89f9-7abcd86b51be\") " pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"
Sep 17 14:28:10.454994 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:10.454790    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c830ca9-abe6-4423-89f9-7abcd86b51be-home\") pod \"noten-model-adae21-kserve-8598cb7fb7-t8kvr\" (UID: \"3c830ca9-abe6-4423-89f9-7abcd86b51be\") " pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"
Sep 17 14:28:10.454994 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:10.454836    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c830ca9-abe6-4423-89f9-7abcd86b51be-dshm\") pod \"noten-model-adae21-kserve-8598cb7fb7-t8kvr\" (UID: \"3c830ca9-abe6-4423-89f9-7abcd86b51be\") " pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"
Sep 17 14:28:10.454994 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:10.454854    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c830ca9-abe6-4423-89f9-7abcd86b51be-tmp-dir\") pod \"noten-model-adae21-kserve-8598cb7fb7-t8kvr\" (UID: \"3c830ca9-abe6-4423-89f9-7abcd86b51be\") " pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"
Sep 17 14:28:10.454994 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:10.454877    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbsw4\" (UniqueName: \"kubernetes.io/projected/3c830ca9-abe6-4423-89f9-7abcd86b51be-kube-api-access-lbsw4\") pod \"noten-model-adae21-kserve-8598cb7fb7-t8kvr\" (UID: \"3c830ca9-abe6-4423-89f9-7abcd86b51be\") " pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"
Sep 17 14:28:10.455195 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:10.455002    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c830ca9-abe6-4423-89f9-7abcd86b51be-tls-certs\") pod \"noten-model-adae21-kserve-8598cb7fb7-t8kvr\" (UID: \"3c830ca9-abe6-4423-89f9-7abcd86b51be\") " pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"
Sep 17 14:28:10.556067 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:10.556031    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c830ca9-abe6-4423-89f9-7abcd86b51be-tls-certs\") pod \"noten-model-adae21-kserve-8598cb7fb7-t8kvr\" (UID: \"3c830ca9-abe6-4423-89f9-7abcd86b51be\") " pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"
Sep 17 14:28:10.556266 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:10.556141    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c830ca9-abe6-4423-89f9-7abcd86b51be-model-cache\") pod \"noten-model-adae21-kserve-8598cb7fb7-t8kvr\" (UID: \"3c830ca9-abe6-4423-89f9-7abcd86b51be\") " pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"
Sep 17 14:28:10.556266 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:10.556187    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c830ca9-abe6-4423-89f9-7abcd86b51be-home\") pod \"noten-model-adae21-kserve-8598cb7fb7-t8kvr\" (UID: \"3c830ca9-abe6-4423-89f9-7abcd86b51be\") " pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"
Sep 17 14:28:10.556378 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:10.556352    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c830ca9-abe6-4423-89f9-7abcd86b51be-dshm\") pod \"noten-model-adae21-kserve-8598cb7fb7-t8kvr\" (UID: \"3c830ca9-abe6-4423-89f9-7abcd86b51be\") " pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"
Sep 17 14:28:10.556438 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:10.556417    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c830ca9-abe6-4423-89f9-7abcd86b51be-tmp-dir\") pod \"noten-model-adae21-kserve-8598cb7fb7-t8kvr\" (UID: \"3c830ca9-abe6-4423-89f9-7abcd86b51be\") " pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"
Sep 17 14:28:10.556491 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:10.556450    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbsw4\" (UniqueName: \"kubernetes.io/projected/3c830ca9-abe6-4423-89f9-7abcd86b51be-kube-api-access-lbsw4\") pod \"noten-model-adae21-kserve-8598cb7fb7-t8kvr\" (UID: \"3c830ca9-abe6-4423-89f9-7abcd86b51be\") " pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"
Sep 17 14:28:10.556607 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:10.556585    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c830ca9-abe6-4423-89f9-7abcd86b51be-home\") pod \"noten-model-adae21-kserve-8598cb7fb7-t8kvr\" (UID: \"3c830ca9-abe6-4423-89f9-7abcd86b51be\") " pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"
Sep 17 14:28:10.556816 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:10.556627    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c830ca9-abe6-4423-89f9-7abcd86b51be-model-cache\") pod \"noten-model-adae21-kserve-8598cb7fb7-t8kvr\" (UID: \"3c830ca9-abe6-4423-89f9-7abcd86b51be\") " pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"
Sep 17 14:28:10.556975 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:10.556880    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c830ca9-abe6-4423-89f9-7abcd86b51be-tmp-dir\") pod \"noten-model-adae21-kserve-8598cb7fb7-t8kvr\" (UID: \"3c830ca9-abe6-4423-89f9-7abcd86b51be\") " pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"
Sep 17 14:28:10.558915 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:10.558882    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c830ca9-abe6-4423-89f9-7abcd86b51be-dshm\") pod \"noten-model-adae21-kserve-8598cb7fb7-t8kvr\" (UID: \"3c830ca9-abe6-4423-89f9-7abcd86b51be\") " pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"
Sep 17 14:28:10.559283 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:10.559264    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c830ca9-abe6-4423-89f9-7abcd86b51be-tls-certs\") pod \"noten-model-adae21-kserve-8598cb7fb7-t8kvr\" (UID: \"3c830ca9-abe6-4423-89f9-7abcd86b51be\") " pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"
Sep 17 14:28:10.573805 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:10.573770    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbsw4\" (UniqueName: \"kubernetes.io/projected/3c830ca9-abe6-4423-89f9-7abcd86b51be-kube-api-access-lbsw4\") pod \"noten-model-adae21-kserve-8598cb7fb7-t8kvr\" (UID: \"3c830ca9-abe6-4423-89f9-7abcd86b51be\") " pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"
Sep 17 14:28:10.644097 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:10.643994    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"
Sep 17 14:28:10.925848 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:10.925820    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"]
Sep 17 14:28:10.927144 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:28:10.927119    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c830ca9_abe6_4423_89f9_7abcd86b51be.slice/crio-a95478d175525e4eb0fd96515c83f8f1d25d5924b6637ff3b4fa8c84d5129037 WatchSource:0}: Error finding container a95478d175525e4eb0fd96515c83f8f1d25d5924b6637ff3b4fa8c84d5129037: Status 404 returned error can't find the container with id a95478d175525e4eb0fd96515c83f8f1d25d5924b6637ff3b4fa8c84d5129037
Sep 17 14:28:11.936680 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:11.936637    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr" event={"ID":"3c830ca9-abe6-4423-89f9-7abcd86b51be","Type":"ContainerStarted","Data":"5976c10c130cf0d52cb69496cdd46dc38415e8cdc845c6bead38b976e834e2a7"}
Sep 17 14:28:11.937382 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:11.936690    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr" event={"ID":"3c830ca9-abe6-4423-89f9-7abcd86b51be","Type":"ContainerStarted","Data":"a95478d175525e4eb0fd96515c83f8f1d25d5924b6637ff3b4fa8c84d5129037"}
Sep 17 14:28:11.967410 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:11.967351    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr" podStartSLOduration=1.9673332270000001 podStartE2EDuration="1.967333227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:28:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:28:11.965302927 +0000 UTC m=+1279.409378513" watchObservedRunningTime="2026-09-17 14:28:11.967333227 +0000 UTC m=+1279.411408813"
Sep 17 14:28:18.608045 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:18.608010    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p"]
Sep 17 14:28:18.611699 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:18.611676    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p"
Sep 17 14:28:18.615593 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:18.615572    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-4009da-serving-cert\""
Sep 17 14:28:18.624541 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:18.624519    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cec4114f-83b9-4ee3-bca4-845498e1c57b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p\" (UID: \"cec4114f-83b9-4ee3-bca4-845498e1c57b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p"
Sep 17 14:28:18.624668 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:18.624553    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cec4114f-83b9-4ee3-bca4-845498e1c57b-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p\" (UID: \"cec4114f-83b9-4ee3-bca4-845498e1c57b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p"
Sep 17 14:28:18.624740 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:18.624686    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qj2n\" (UniqueName: \"kubernetes.io/projected/cec4114f-83b9-4ee3-bca4-845498e1c57b-kube-api-access-5qj2n\") pod \"maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p\" (UID: \"cec4114f-83b9-4ee3-bca4-845498e1c57b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p"
Sep 17 14:28:18.624785 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:18.624759    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cec4114f-83b9-4ee3-bca4-845498e1c57b-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p\" (UID: \"cec4114f-83b9-4ee3-bca4-845498e1c57b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p"
Sep 17 14:28:18.634499 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:18.634468    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p"]
Sep 17 14:28:18.726113 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:18.726075    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cec4114f-83b9-4ee3-bca4-845498e1c57b-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p\" (UID: \"cec4114f-83b9-4ee3-bca4-845498e1c57b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p"
Sep 17 14:28:18.726355 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:18.726135    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cec4114f-83b9-4ee3-bca4-845498e1c57b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p\" (UID: \"cec4114f-83b9-4ee3-bca4-845498e1c57b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p"
Sep 17 14:28:18.726355 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:18.726174    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cec4114f-83b9-4ee3-bca4-845498e1c57b-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p\" (UID: \"cec4114f-83b9-4ee3-bca4-845498e1c57b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p"
Sep 17 14:28:18.726355 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:18.726300    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qj2n\" (UniqueName: \"kubernetes.io/projected/cec4114f-83b9-4ee3-bca4-845498e1c57b-kube-api-access-5qj2n\") pod \"maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p\" (UID: \"cec4114f-83b9-4ee3-bca4-845498e1c57b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p"
Sep 17 14:28:18.726530 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:28:18.726405    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-serving-cert: secret "maas-api-e2e-shared-a-w2-4009da-serving-cert" not found
Sep 17 14:28:18.726530 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:28:18.726485    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cec4114f-83b9-4ee3-bca4-845498e1c57b-maas-api-tls podName:cec4114f-83b9-4ee3-bca4-845498e1c57b nodeName:}" failed. No retries permitted until 2026-09-17 14:28:19.226462673 +0000 UTC m=+1286.670538254 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cec4114f-83b9-4ee3-bca4-845498e1c57b-maas-api-tls") pod "maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p" (UID: "cec4114f-83b9-4ee3-bca4-845498e1c57b") : secret "maas-api-e2e-shared-a-w2-4009da-serving-cert" not found
Sep 17 14:28:18.727054 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:18.727028    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cec4114f-83b9-4ee3-bca4-845498e1c57b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p\" (UID: \"cec4114f-83b9-4ee3-bca4-845498e1c57b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p"
Sep 17 14:28:18.729347 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:18.729315    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cec4114f-83b9-4ee3-bca4-845498e1c57b-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p\" (UID: \"cec4114f-83b9-4ee3-bca4-845498e1c57b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p"
Sep 17 14:28:18.744474 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:18.744446    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qj2n\" (UniqueName: \"kubernetes.io/projected/cec4114f-83b9-4ee3-bca4-845498e1c57b-kube-api-access-5qj2n\") pod \"maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p\" (UID: \"cec4114f-83b9-4ee3-bca4-845498e1c57b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p"
Sep 17 14:28:19.232355 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:19.232320    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cec4114f-83b9-4ee3-bca4-845498e1c57b-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p\" (UID: \"cec4114f-83b9-4ee3-bca4-845498e1c57b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p"
Sep 17 14:28:19.235166 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:19.235141    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cec4114f-83b9-4ee3-bca4-845498e1c57b-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p\" (UID: \"cec4114f-83b9-4ee3-bca4-845498e1c57b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p"
Sep 17 14:28:19.278651 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:19.278613    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:28:19.523247 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:19.523151    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p"
Sep 17 14:28:19.853568 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:19.853520    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p"]
Sep 17 14:28:19.854604 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:28:19.854575    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcec4114f_83b9_4ee3_bca4_845498e1c57b.slice/crio-c265ef1cab91fc28fcbc649d389a3eca62b38ba58df7440660c1726eac726e70 WatchSource:0}: Error finding container c265ef1cab91fc28fcbc649d389a3eca62b38ba58df7440660c1726eac726e70: Status 404 returned error can't find the container with id c265ef1cab91fc28fcbc649d389a3eca62b38ba58df7440660c1726eac726e70
Sep 17 14:28:19.986169 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:19.986131    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p" event={"ID":"cec4114f-83b9-4ee3-bca4-845498e1c57b","Type":"ContainerStarted","Data":"c265ef1cab91fc28fcbc649d389a3eca62b38ba58df7440660c1726eac726e70"}
Sep 17 14:28:20.644815 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:20.644778    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"
Sep 17 14:28:20.645028 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:20.644835    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"
Sep 17 14:28:20.657642 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:20.657608    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"
Sep 17 14:28:20.993524 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:20.993484    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p" event={"ID":"cec4114f-83b9-4ee3-bca4-845498e1c57b","Type":"ContainerStarted","Data":"ed45304dac62a950ac3430817a4c8c840a0ad0b9dac8c0b300714d36b61fc09b"}
Sep 17 14:28:21.004896 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:21.004865    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"
Sep 17 14:28:21.020690 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:21.020630    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p" podStartSLOduration=2.336197622 podStartE2EDuration="3.020614912s" totalImagesPullingTime="684.41729ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:28:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:28:21.017851487 +0000 UTC m=+1288.461927092" watchObservedRunningTime="2026-09-17 14:28:21.020614912 +0000 UTC m=+1288.464690498"
Sep 17 14:28:21.999986 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:21.999949    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p"
Sep 17 14:28:28.011544 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:28.011512    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p"
Sep 17 14:28:47.778226 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:47.778177    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"]
Sep 17 14:28:53.283453 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:53.283420    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:28:54.298429 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:54.298388    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc"]
Sep 17 14:28:54.302406 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:54.302384    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc"
Sep 17 14:28:54.305590 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:54.305565    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-60bf73-serving-cert\""
Sep 17 14:28:54.374017 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:54.373983    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc"]
Sep 17 14:28:54.397853 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:54.397810    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfp65\" (UniqueName: \"kubernetes.io/projected/e0d020ed-36ab-48ea-8639-f25a50435b6c-kube-api-access-mfp65\") pod \"maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc\" (UID: \"e0d020ed-36ab-48ea-8639-f25a50435b6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc"
Sep 17 14:28:54.398037 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:54.397858    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0d020ed-36ab-48ea-8639-f25a50435b6c-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc\" (UID: \"e0d020ed-36ab-48ea-8639-f25a50435b6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc"
Sep 17 14:28:54.398037 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:54.397915    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0d020ed-36ab-48ea-8639-f25a50435b6c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc\" (UID: \"e0d020ed-36ab-48ea-8639-f25a50435b6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc"
Sep 17 14:28:54.398154 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:54.398037    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0d020ed-36ab-48ea-8639-f25a50435b6c-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc\" (UID: \"e0d020ed-36ab-48ea-8639-f25a50435b6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc"
Sep 17 14:28:54.498892 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:54.498852    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0d020ed-36ab-48ea-8639-f25a50435b6c-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc\" (UID: \"e0d020ed-36ab-48ea-8639-f25a50435b6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc"
Sep 17 14:28:54.499096 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:54.498922    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfp65\" (UniqueName: \"kubernetes.io/projected/e0d020ed-36ab-48ea-8639-f25a50435b6c-kube-api-access-mfp65\") pod \"maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc\" (UID: \"e0d020ed-36ab-48ea-8639-f25a50435b6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc"
Sep 17 14:28:54.499096 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:54.498945    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0d020ed-36ab-48ea-8639-f25a50435b6c-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc\" (UID: \"e0d020ed-36ab-48ea-8639-f25a50435b6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc"
Sep 17 14:28:54.499096 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:54.498967    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0d020ed-36ab-48ea-8639-f25a50435b6c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc\" (UID: \"e0d020ed-36ab-48ea-8639-f25a50435b6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc"
Sep 17 14:28:54.499657 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:54.499633    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0d020ed-36ab-48ea-8639-f25a50435b6c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc\" (UID: \"e0d020ed-36ab-48ea-8639-f25a50435b6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc"
Sep 17 14:28:54.501377 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:54.501351    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0d020ed-36ab-48ea-8639-f25a50435b6c-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc\" (UID: \"e0d020ed-36ab-48ea-8639-f25a50435b6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc"
Sep 17 14:28:54.501470 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:54.501405    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0d020ed-36ab-48ea-8639-f25a50435b6c-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc\" (UID: \"e0d020ed-36ab-48ea-8639-f25a50435b6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc"
Sep 17 14:28:54.546030 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:54.545994    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfp65\" (UniqueName: \"kubernetes.io/projected/e0d020ed-36ab-48ea-8639-f25a50435b6c-kube-api-access-mfp65\") pod \"maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc\" (UID: \"e0d020ed-36ab-48ea-8639-f25a50435b6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc"
Sep 17 14:28:54.612772 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:54.612632    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc"
Sep 17 14:28:54.918344 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:54.918311    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc"]
Sep 17 14:28:54.919170 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:28:54.919147    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0d020ed_36ab_48ea_8639_f25a50435b6c.slice/crio-7e6bc4a1a585dd6db11cd9cab6787855eb4111d1c1193bab6fdcd100bc5d659e WatchSource:0}: Error finding container 7e6bc4a1a585dd6db11cd9cab6787855eb4111d1c1193bab6fdcd100bc5d659e: Status 404 returned error can't find the container with id 7e6bc4a1a585dd6db11cd9cab6787855eb4111d1c1193bab6fdcd100bc5d659e
Sep 17 14:28:55.196938 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:55.196907    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc" event={"ID":"e0d020ed-36ab-48ea-8639-f25a50435b6c","Type":"ContainerStarted","Data":"7e6bc4a1a585dd6db11cd9cab6787855eb4111d1c1193bab6fdcd100bc5d659e"}
Sep 17 14:28:56.205354 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:56.205302    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc" event={"ID":"e0d020ed-36ab-48ea-8639-f25a50435b6c","Type":"ContainerStarted","Data":"e932f015abd3eca7e81d9d509568abe9a9329673d63dcf4e47ab0d68c37b3fc3"}
Sep 17 14:28:56.205853 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:56.205501    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc"
Sep 17 14:28:56.267031 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:56.266971    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc" podStartSLOduration=1.8743140459999998 podStartE2EDuration="2.266954094s" totalImagesPullingTime="392.640048ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:28:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:28:56.264357147 +0000 UTC m=+1323.708432752" watchObservedRunningTime="2026-09-17 14:28:56.266954094 +0000 UTC m=+1323.711029680"
Sep 17 14:28:59.027778 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:59.027731    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb"]
Sep 17 14:28:59.028270 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:59.027999    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb" podUID="a1e02f94-127a-47f0-b390-5d70d333a04b" containerName="maas-api" containerID="cri-o://2b25ebaddb64aaa172373099037d58eef7b379f74e15d324a9361b5f4381ef2f" gracePeriod=30
Sep 17 14:28:59.226227 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:59.226078    2580 generic.go:356] "Generic (PLEG): container finished" podID="a1e02f94-127a-47f0-b390-5d70d333a04b" containerID="2b25ebaddb64aaa172373099037d58eef7b379f74e15d324a9361b5f4381ef2f" exitCode=0
Sep 17 14:28:59.226227 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:59.226148    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb" event={"ID":"a1e02f94-127a-47f0-b390-5d70d333a04b","Type":"ContainerDied","Data":"2b25ebaddb64aaa172373099037d58eef7b379f74e15d324a9361b5f4381ef2f"}
Sep 17 14:28:59.267224 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:59.267186    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-2e1b82-7d5dcc7b4f-nnbrq"]
Sep 17 14:28:59.267441 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:59.267403    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-2e1b82-7d5dcc7b4f-nnbrq" podUID="1c32bb3f-5a77-4183-8315-9f3822565150" containerName="payload-processing" containerID="cri-o://b42c240a29dbc876a0280d295692a5400e61bccf9f2812a8d25218bcc9f6367a" gracePeriod=30
Sep 17 14:28:59.395900 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:59.395871    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb"
Sep 17 14:28:59.445778 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:59.445252    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1e02f94-127a-47f0-b390-5d70d333a04b-openshift-service-ca\") pod \"a1e02f94-127a-47f0-b390-5d70d333a04b\" (UID: \"a1e02f94-127a-47f0-b390-5d70d333a04b\") "
Sep 17 14:28:59.445989 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:59.445789    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1e02f94-127a-47f0-b390-5d70d333a04b-metrics-certs\") pod \"a1e02f94-127a-47f0-b390-5d70d333a04b\" (UID: \"a1e02f94-127a-47f0-b390-5d70d333a04b\") "
Sep 17 14:28:59.445989 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:59.445836    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1e02f94-127a-47f0-b390-5d70d333a04b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a1e02f94-127a-47f0-b390-5d70d333a04b" (UID: "a1e02f94-127a-47f0-b390-5d70d333a04b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:28:59.445989 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:59.445905    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2st8\" (UniqueName: \"kubernetes.io/projected/a1e02f94-127a-47f0-b390-5d70d333a04b-kube-api-access-p2st8\") pod \"a1e02f94-127a-47f0-b390-5d70d333a04b\" (UID: \"a1e02f94-127a-47f0-b390-5d70d333a04b\") "
Sep 17 14:28:59.445989 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:59.445940    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1e02f94-127a-47f0-b390-5d70d333a04b-maas-api-tls\") pod \"a1e02f94-127a-47f0-b390-5d70d333a04b\" (UID: \"a1e02f94-127a-47f0-b390-5d70d333a04b\") "
Sep 17 14:28:59.447104 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:59.446844    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1e02f94-127a-47f0-b390-5d70d333a04b-openshift-service-ca\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:28:59.449480 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:59.449437    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1e02f94-127a-47f0-b390-5d70d333a04b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a1e02f94-127a-47f0-b390-5d70d333a04b" (UID: "a1e02f94-127a-47f0-b390-5d70d333a04b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:28:59.449480 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:59.449459    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1e02f94-127a-47f0-b390-5d70d333a04b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a1e02f94-127a-47f0-b390-5d70d333a04b" (UID: "a1e02f94-127a-47f0-b390-5d70d333a04b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:28:59.449652 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:59.449478    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1e02f94-127a-47f0-b390-5d70d333a04b-kube-api-access-p2st8" (OuterVolumeSpecName: "kube-api-access-p2st8") pod "a1e02f94-127a-47f0-b390-5d70d333a04b" (UID: "a1e02f94-127a-47f0-b390-5d70d333a04b"). InnerVolumeSpecName "kube-api-access-p2st8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:28:59.517888 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:59.517859    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-2e1b82-7d5dcc7b4f-nnbrq"
Sep 17 14:28:59.547995 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:59.547886    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1e02f94-127a-47f0-b390-5d70d333a04b-metrics-certs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:28:59.547995 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:59.547920    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2st8\" (UniqueName: \"kubernetes.io/projected/a1e02f94-127a-47f0-b390-5d70d333a04b-kube-api-access-p2st8\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:28:59.547995 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:59.547930    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1e02f94-127a-47f0-b390-5d70d333a04b-maas-api-tls\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:28:59.648773 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:59.648732    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c32bb3f-5a77-4183-8315-9f3822565150-plugins-config-volume\") pod \"1c32bb3f-5a77-4183-8315-9f3822565150\" (UID: \"1c32bb3f-5a77-4183-8315-9f3822565150\") "
Sep 17 14:28:59.648977 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:59.648878    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xsjg8\" (UniqueName: \"kubernetes.io/projected/1c32bb3f-5a77-4183-8315-9f3822565150-kube-api-access-xsjg8\") pod \"1c32bb3f-5a77-4183-8315-9f3822565150\" (UID: \"1c32bb3f-5a77-4183-8315-9f3822565150\") "
Sep 17 14:28:59.649136 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:59.649111    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c32bb3f-5a77-4183-8315-9f3822565150-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1c32bb3f-5a77-4183-8315-9f3822565150" (UID: "1c32bb3f-5a77-4183-8315-9f3822565150"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:28:59.651136 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:59.651111    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c32bb3f-5a77-4183-8315-9f3822565150-kube-api-access-xsjg8" (OuterVolumeSpecName: "kube-api-access-xsjg8") pod "1c32bb3f-5a77-4183-8315-9f3822565150" (UID: "1c32bb3f-5a77-4183-8315-9f3822565150"). InnerVolumeSpecName "kube-api-access-xsjg8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:28:59.749994 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:59.749954    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xsjg8\" (UniqueName: \"kubernetes.io/projected/1c32bb3f-5a77-4183-8315-9f3822565150-kube-api-access-xsjg8\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:28:59.749994 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:28:59.749989    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c32bb3f-5a77-4183-8315-9f3822565150-plugins-config-volume\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:29:00.234561 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:00.234527    2580 generic.go:356] "Generic (PLEG): container finished" podID="1c32bb3f-5a77-4183-8315-9f3822565150" containerID="b42c240a29dbc876a0280d295692a5400e61bccf9f2812a8d25218bcc9f6367a" exitCode=0
Sep 17 14:29:00.235040 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:00.234572    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-2e1b82-7d5dcc7b4f-nnbrq"
Sep 17 14:29:00.235040 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:00.234600    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-2e1b82-7d5dcc7b4f-nnbrq" event={"ID":"1c32bb3f-5a77-4183-8315-9f3822565150","Type":"ContainerDied","Data":"b42c240a29dbc876a0280d295692a5400e61bccf9f2812a8d25218bcc9f6367a"}
Sep 17 14:29:00.235040 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:00.234648    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-2e1b82-7d5dcc7b4f-nnbrq" event={"ID":"1c32bb3f-5a77-4183-8315-9f3822565150","Type":"ContainerDied","Data":"d119d07f8aa25c34c0f5b0c3148ba4491f58e5bab4748715b5b25f0b2f20b6fa"}
Sep 17 14:29:00.235040 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:00.234674    2580 scope.go:117] "RemoveContainer" containerID="b42c240a29dbc876a0280d295692a5400e61bccf9f2812a8d25218bcc9f6367a"
Sep 17 14:29:00.236278 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:00.236258    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb" event={"ID":"a1e02f94-127a-47f0-b390-5d70d333a04b","Type":"ContainerDied","Data":"26fc41bff6b5dcb2ce4b59b8434e938aa9132f1640c184ceb7006b41217c776c"}
Sep 17 14:29:00.236373 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:00.236287    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb"
Sep 17 14:29:00.245795 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:00.245770    2580 scope.go:117] "RemoveContainer" containerID="b42c240a29dbc876a0280d295692a5400e61bccf9f2812a8d25218bcc9f6367a"
Sep 17 14:29:00.246083 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:29:00.246067    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b42c240a29dbc876a0280d295692a5400e61bccf9f2812a8d25218bcc9f6367a\": container with ID starting with b42c240a29dbc876a0280d295692a5400e61bccf9f2812a8d25218bcc9f6367a not found: ID does not exist" containerID="b42c240a29dbc876a0280d295692a5400e61bccf9f2812a8d25218bcc9f6367a"
Sep 17 14:29:00.246137 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:00.246091    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b42c240a29dbc876a0280d295692a5400e61bccf9f2812a8d25218bcc9f6367a"} err="failed to get container status \"b42c240a29dbc876a0280d295692a5400e61bccf9f2812a8d25218bcc9f6367a\": rpc error: code = NotFound desc = could not find container \"b42c240a29dbc876a0280d295692a5400e61bccf9f2812a8d25218bcc9f6367a\": container with ID starting with b42c240a29dbc876a0280d295692a5400e61bccf9f2812a8d25218bcc9f6367a not found: ID does not exist"
Sep 17 14:29:00.246137 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:00.246108    2580 scope.go:117] "RemoveContainer" containerID="2b25ebaddb64aaa172373099037d58eef7b379f74e15d324a9361b5f4381ef2f"
Sep 17 14:29:00.288374 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:00.288333    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb"]
Sep 17 14:29:00.302206 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:00.302126    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2e1b82-6bb8759954-qgchb"]
Sep 17 14:29:00.339416 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:00.339383    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-2e1b82-7d5dcc7b4f-nnbrq"]
Sep 17 14:29:00.349426 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:00.349382    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-2e1b82-7d5dcc7b4f-nnbrq"]
Sep 17 14:29:01.177364 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:01.177330    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c32bb3f-5a77-4183-8315-9f3822565150" path="/var/lib/kubelet/pods/1c32bb3f-5a77-4183-8315-9f3822565150/volumes"
Sep 17 14:29:01.177780 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:01.177764    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1e02f94-127a-47f0-b390-5d70d333a04b" path="/var/lib/kubelet/pods/a1e02f94-127a-47f0-b390-5d70d333a04b/volumes"
Sep 17 14:29:02.217324 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:02.217294    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc"
Sep 17 14:29:02.797675 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:02.797635    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr" podUID="3c830ca9-abe6-4423-89f9-7abcd86b51be" containerName="main" containerID="cri-o://5976c10c130cf0d52cb69496cdd46dc38415e8cdc845c6bead38b976e834e2a7" gracePeriod=45
Sep 17 14:29:03.059151 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:03.059083    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"
Sep 17 14:29:03.185397 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:03.185349    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c830ca9-abe6-4423-89f9-7abcd86b51be-home\") pod \"3c830ca9-abe6-4423-89f9-7abcd86b51be\" (UID: \"3c830ca9-abe6-4423-89f9-7abcd86b51be\") "
Sep 17 14:29:03.185557 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:03.185433    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c830ca9-abe6-4423-89f9-7abcd86b51be-tls-certs\") pod \"3c830ca9-abe6-4423-89f9-7abcd86b51be\" (UID: \"3c830ca9-abe6-4423-89f9-7abcd86b51be\") "
Sep 17 14:29:03.185557 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:03.185503    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c830ca9-abe6-4423-89f9-7abcd86b51be-model-cache\") pod \"3c830ca9-abe6-4423-89f9-7abcd86b51be\" (UID: \"3c830ca9-abe6-4423-89f9-7abcd86b51be\") "
Sep 17 14:29:03.185557 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:03.185531    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c830ca9-abe6-4423-89f9-7abcd86b51be-dshm\") pod \"3c830ca9-abe6-4423-89f9-7abcd86b51be\" (UID: \"3c830ca9-abe6-4423-89f9-7abcd86b51be\") "
Sep 17 14:29:03.185740 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:03.185570    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c830ca9-abe6-4423-89f9-7abcd86b51be-tmp-dir\") pod \"3c830ca9-abe6-4423-89f9-7abcd86b51be\" (UID: \"3c830ca9-abe6-4423-89f9-7abcd86b51be\") "
Sep 17 14:29:03.185740 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:03.185596    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbsw4\" (UniqueName: \"kubernetes.io/projected/3c830ca9-abe6-4423-89f9-7abcd86b51be-kube-api-access-lbsw4\") pod \"3c830ca9-abe6-4423-89f9-7abcd86b51be\" (UID: \"3c830ca9-abe6-4423-89f9-7abcd86b51be\") "
Sep 17 14:29:03.185740 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:03.185645    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c830ca9-abe6-4423-89f9-7abcd86b51be-home" (OuterVolumeSpecName: "home") pod "3c830ca9-abe6-4423-89f9-7abcd86b51be" (UID: "3c830ca9-abe6-4423-89f9-7abcd86b51be"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:29:03.185907 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:03.185825    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c830ca9-abe6-4423-89f9-7abcd86b51be-model-cache" (OuterVolumeSpecName: "model-cache") pod "3c830ca9-abe6-4423-89f9-7abcd86b51be" (UID: "3c830ca9-abe6-4423-89f9-7abcd86b51be"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:29:03.186013 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:03.185993    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c830ca9-abe6-4423-89f9-7abcd86b51be-home\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:29:03.186084 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:03.186018    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c830ca9-abe6-4423-89f9-7abcd86b51be-model-cache\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:29:03.186218 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:03.186179    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c830ca9-abe6-4423-89f9-7abcd86b51be-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3c830ca9-abe6-4423-89f9-7abcd86b51be" (UID: "3c830ca9-abe6-4423-89f9-7abcd86b51be"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:29:03.187909 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:03.187879    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c830ca9-abe6-4423-89f9-7abcd86b51be-dshm" (OuterVolumeSpecName: "dshm") pod "3c830ca9-abe6-4423-89f9-7abcd86b51be" (UID: "3c830ca9-abe6-4423-89f9-7abcd86b51be"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:29:03.188042 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:03.187925    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c830ca9-abe6-4423-89f9-7abcd86b51be-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3c830ca9-abe6-4423-89f9-7abcd86b51be" (UID: "3c830ca9-abe6-4423-89f9-7abcd86b51be"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:29:03.188042 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:03.187949    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c830ca9-abe6-4423-89f9-7abcd86b51be-kube-api-access-lbsw4" (OuterVolumeSpecName: "kube-api-access-lbsw4") pod "3c830ca9-abe6-4423-89f9-7abcd86b51be" (UID: "3c830ca9-abe6-4423-89f9-7abcd86b51be"). InnerVolumeSpecName "kube-api-access-lbsw4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:29:03.256451 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:03.256408    2580 generic.go:356] "Generic (PLEG): container finished" podID="3c830ca9-abe6-4423-89f9-7abcd86b51be" containerID="5976c10c130cf0d52cb69496cdd46dc38415e8cdc845c6bead38b976e834e2a7" exitCode=0
Sep 17 14:29:03.256933 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:03.256464    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"
Sep 17 14:29:03.256933 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:03.256488    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr" event={"ID":"3c830ca9-abe6-4423-89f9-7abcd86b51be","Type":"ContainerDied","Data":"5976c10c130cf0d52cb69496cdd46dc38415e8cdc845c6bead38b976e834e2a7"}
Sep 17 14:29:03.256933 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:03.256532    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr" event={"ID":"3c830ca9-abe6-4423-89f9-7abcd86b51be","Type":"ContainerDied","Data":"a95478d175525e4eb0fd96515c83f8f1d25d5924b6637ff3b4fa8c84d5129037"}
Sep 17 14:29:03.256933 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:03.256552    2580 scope.go:117] "RemoveContainer" containerID="5976c10c130cf0d52cb69496cdd46dc38415e8cdc845c6bead38b976e834e2a7"
Sep 17 14:29:03.266837 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:03.266816    2580 scope.go:117] "RemoveContainer" containerID="5976c10c130cf0d52cb69496cdd46dc38415e8cdc845c6bead38b976e834e2a7"
Sep 17 14:29:03.267198 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:29:03.267178    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5976c10c130cf0d52cb69496cdd46dc38415e8cdc845c6bead38b976e834e2a7\": container with ID starting with 5976c10c130cf0d52cb69496cdd46dc38415e8cdc845c6bead38b976e834e2a7 not found: ID does not exist" containerID="5976c10c130cf0d52cb69496cdd46dc38415e8cdc845c6bead38b976e834e2a7"
Sep 17 14:29:03.267261 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:03.267208    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5976c10c130cf0d52cb69496cdd46dc38415e8cdc845c6bead38b976e834e2a7"} err="failed to get container status \"5976c10c130cf0d52cb69496cdd46dc38415e8cdc845c6bead38b976e834e2a7\": rpc error: code = NotFound desc = could not find container \"5976c10c130cf0d52cb69496cdd46dc38415e8cdc845c6bead38b976e834e2a7\": container with ID starting with 5976c10c130cf0d52cb69496cdd46dc38415e8cdc845c6bead38b976e834e2a7 not found: ID does not exist"
Sep 17 14:29:03.286897 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:03.286852    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c830ca9-abe6-4423-89f9-7abcd86b51be-tls-certs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:29:03.286897 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:03.286885    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c830ca9-abe6-4423-89f9-7abcd86b51be-dshm\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:29:03.286897 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:03.286893    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c830ca9-abe6-4423-89f9-7abcd86b51be-tmp-dir\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:29:03.286897 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:03.286901    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbsw4\" (UniqueName: \"kubernetes.io/projected/3c830ca9-abe6-4423-89f9-7abcd86b51be-kube-api-access-lbsw4\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:29:03.297324 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:03.297286    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"]
Sep 17 14:29:03.338945 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:03.338859    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-adae21/noten-model-adae21-kserve-8598cb7fb7-t8kvr"]
Sep 17 14:29:05.177698 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:05.177655    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c830ca9-abe6-4423-89f9-7abcd86b51be" path="/var/lib/kubelet/pods/3c830ca9-abe6-4423-89f9-7abcd86b51be/volumes"
Sep 17 14:29:08.622534 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:08.622495    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"]
Sep 17 14:29:09.638387 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:09.638348    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7359-7b9dcc"]
Sep 17 14:29:09.638790 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:09.638771    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c830ca9-abe6-4423-89f9-7abcd86b51be" containerName="main"
Sep 17 14:29:09.638790 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:09.638784    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c830ca9-abe6-4423-89f9-7abcd86b51be" containerName="main"
Sep 17 14:29:09.638890 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:09.638797    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1e02f94-127a-47f0-b390-5d70d333a04b" containerName="maas-api"
Sep 17 14:29:09.638890 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:09.638802    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1e02f94-127a-47f0-b390-5d70d333a04b" containerName="maas-api"
Sep 17 14:29:09.638890 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:09.638823    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c32bb3f-5a77-4183-8315-9f3822565150" containerName="payload-processing"
Sep 17 14:29:09.638890 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:09.638828    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c32bb3f-5a77-4183-8315-9f3822565150" containerName="payload-processing"
Sep 17 14:29:09.638890 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:09.638888    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c32bb3f-5a77-4183-8315-9f3822565150" containerName="payload-processing"
Sep 17 14:29:09.639046 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:09.638897    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1e02f94-127a-47f0-b390-5d70d333a04b" containerName="maas-api"
Sep 17 14:29:09.639046 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:09.638904    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c830ca9-abe6-4423-89f9-7abcd86b51be" containerName="main"
Sep 17 14:29:09.643267 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:09.643250    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7359-7b9dcc"
Sep 17 14:29:09.656784 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:09.656761    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-cflzc\""
Sep 17 14:29:09.671575 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:09.671549    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7359-7b9dcc"]
Sep 17 14:29:09.753115 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:09.753076    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-756df\" (UniqueName: \"kubernetes.io/projected/f5afd5a4-3bad-4e2c-ab1d-51d4f6d01d5f-kube-api-access-756df\") pod \"test-curl-7359-7b9dcc\" (UID: \"f5afd5a4-3bad-4e2c-ab1d-51d4f6d01d5f\") " pod="opendatahub/test-curl-7359-7b9dcc"
Sep 17 14:29:09.854491 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:09.854457    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-756df\" (UniqueName: \"kubernetes.io/projected/f5afd5a4-3bad-4e2c-ab1d-51d4f6d01d5f-kube-api-access-756df\") pod \"test-curl-7359-7b9dcc\" (UID: \"f5afd5a4-3bad-4e2c-ab1d-51d4f6d01d5f\") " pod="opendatahub/test-curl-7359-7b9dcc"
Sep 17 14:29:09.866053 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:09.866015    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-756df\" (UniqueName: \"kubernetes.io/projected/f5afd5a4-3bad-4e2c-ab1d-51d4f6d01d5f-kube-api-access-756df\") pod \"test-curl-7359-7b9dcc\" (UID: \"f5afd5a4-3bad-4e2c-ab1d-51d4f6d01d5f\") " pod="opendatahub/test-curl-7359-7b9dcc"
Sep 17 14:29:09.952352 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:09.952319    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7359-7b9dcc"
Sep 17 14:29:10.249489 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:10.249460    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7359-7b9dcc"]
Sep 17 14:29:10.250497 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:29:10.250464    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5afd5a4_3bad_4e2c_ab1d_51d4f6d01d5f.slice/crio-a05e5f6acff9d6a0b65b7e2d430f6a1a81f209648a409e06111b8a8a12fa434c WatchSource:0}: Error finding container a05e5f6acff9d6a0b65b7e2d430f6a1a81f209648a409e06111b8a8a12fa434c: Status 404 returned error can't find the container with id a05e5f6acff9d6a0b65b7e2d430f6a1a81f209648a409e06111b8a8a12fa434c
Sep 17 14:29:10.304446 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:10.304414    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7359-7b9dcc" event={"ID":"f5afd5a4-3bad-4e2c-ab1d-51d4f6d01d5f","Type":"ContainerStarted","Data":"a05e5f6acff9d6a0b65b7e2d430f6a1a81f209648a409e06111b8a8a12fa434c"}
Sep 17 14:29:11.311912 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:11.311875    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7359-7b9dcc" event={"ID":"f5afd5a4-3bad-4e2c-ab1d-51d4f6d01d5f","Type":"ContainerStarted","Data":"9fea881df0a5e5dcab28eebe90b45aee23a0e3d8c7aec3a189b55bfd21bbd9ff"}
Sep 17 14:29:12.384097 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:12.383984    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7359-7b9dcc" podStartSLOduration=3.383965794 podStartE2EDuration="3.383965794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:29:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:29:11.358463735 +0000 UTC m=+1338.802539322" watchObservedRunningTime="2026-09-17 14:29:12.383965794 +0000 UTC m=+1339.828041424"
Sep 17 14:29:12.384474 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:12.384393    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7359-7b9dcc"]
Sep 17 14:29:12.397477 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:12.397448    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7359-7b9dcc"]
Sep 17 14:29:12.543104 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:12.543059    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7359-e77f93"]
Sep 17 14:29:12.543552 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:12.543532    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5afd5a4-3bad-4e2c-ab1d-51d4f6d01d5f" containerName="test-curl-7359-7b9dcc"
Sep 17 14:29:12.543661 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:12.543555    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5afd5a4-3bad-4e2c-ab1d-51d4f6d01d5f" containerName="test-curl-7359-7b9dcc"
Sep 17 14:29:12.543754 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:12.543674    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5afd5a4-3bad-4e2c-ab1d-51d4f6d01d5f" containerName="test-curl-7359-7b9dcc"
Sep 17 14:29:12.546927 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:12.546906    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7359-e77f93"
Sep 17 14:29:12.589299 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:12.589269    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7359-e77f93"]
Sep 17 14:29:12.682541 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:12.682439    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lft7v\" (UniqueName: \"kubernetes.io/projected/3454c9e5-1cd6-4c69-a1f0-52137f827eda-kube-api-access-lft7v\") pod \"test-curl-7359-e77f93\" (UID: \"3454c9e5-1cd6-4c69-a1f0-52137f827eda\") " pod="opendatahub/test-curl-7359-e77f93"
Sep 17 14:29:12.783531 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:12.783481    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lft7v\" (UniqueName: \"kubernetes.io/projected/3454c9e5-1cd6-4c69-a1f0-52137f827eda-kube-api-access-lft7v\") pod \"test-curl-7359-e77f93\" (UID: \"3454c9e5-1cd6-4c69-a1f0-52137f827eda\") " pod="opendatahub/test-curl-7359-e77f93"
Sep 17 14:29:12.806945 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:12.806904    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lft7v\" (UniqueName: \"kubernetes.io/projected/3454c9e5-1cd6-4c69-a1f0-52137f827eda-kube-api-access-lft7v\") pod \"test-curl-7359-e77f93\" (UID: \"3454c9e5-1cd6-4c69-a1f0-52137f827eda\") " pod="opendatahub/test-curl-7359-e77f93"
Sep 17 14:29:12.855991 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:12.855954    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7359-e77f93"
Sep 17 14:29:13.154870 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:13.154841    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7359-e77f93"]
Sep 17 14:29:13.156052 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:29:13.156026    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3454c9e5_1cd6_4c69_a1f0_52137f827eda.slice/crio-50cfa6432907adaa4a57538d0121cdaaa740708c1ec772d38563d755bd561ccd WatchSource:0}: Error finding container 50cfa6432907adaa4a57538d0121cdaaa740708c1ec772d38563d755bd561ccd: Status 404 returned error can't find the container with id 50cfa6432907adaa4a57538d0121cdaaa740708c1ec772d38563d755bd561ccd
Sep 17 14:29:13.325078 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:13.325037    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7359-e77f93" event={"ID":"3454c9e5-1cd6-4c69-a1f0-52137f827eda","Type":"ContainerStarted","Data":"f218e652d557f2e9c42911fa3e62c55cc99d979db30750d2a0a5b8c2c24d0a32"}
Sep 17 14:29:13.325078 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:13.325084    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7359-e77f93" event={"ID":"3454c9e5-1cd6-4c69-a1f0-52137f827eda","Type":"ContainerStarted","Data":"50cfa6432907adaa4a57538d0121cdaaa740708c1ec772d38563d755bd561ccd"}
Sep 17 14:29:13.325342 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:13.325148    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7359-7b9dcc" podUID="f5afd5a4-3bad-4e2c-ab1d-51d4f6d01d5f" containerName="test-curl-7359-7b9dcc" containerID="cri-o://9fea881df0a5e5dcab28eebe90b45aee23a0e3d8c7aec3a189b55bfd21bbd9ff" gracePeriod=2
Sep 17 14:29:13.374163 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:13.374103    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7359-e77f93" podStartSLOduration=1.374085088 podStartE2EDuration="1.374085088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:29:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:29:13.372705061 +0000 UTC m=+1340.816780646" watchObservedRunningTime="2026-09-17 14:29:13.374085088 +0000 UTC m=+1340.818160700"
Sep 17 14:29:14.169913 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:14.169831    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7359-e77f93"]
Sep 17 14:29:14.175886 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:14.175855    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7359-e77f93"]
Sep 17 14:29:14.324405 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:14.324367    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7359-8ee25e"]
Sep 17 14:29:14.324828 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:14.324814    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3454c9e5-1cd6-4c69-a1f0-52137f827eda" containerName="test-curl-7359-e77f93"
Sep 17 14:29:14.324892 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:14.324830    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3454c9e5-1cd6-4c69-a1f0-52137f827eda" containerName="test-curl-7359-e77f93"
Sep 17 14:29:14.324892 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:14.324890    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3454c9e5-1cd6-4c69-a1f0-52137f827eda" containerName="test-curl-7359-e77f93"
Sep 17 14:29:14.328091 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:14.328068    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7359-8ee25e"
Sep 17 14:29:14.331343 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:29:14.331321    2580 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7359-e77f93" container="test-curl-7359-e77f93"
Sep 17 14:29:14.341679 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:14.341644    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7359-8ee25e"]
Sep 17 14:29:14.398778 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:14.398739    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5z5h\" (UniqueName: \"kubernetes.io/projected/3d925a61-eb0f-491e-9706-c19ea7df6fd0-kube-api-access-k5z5h\") pod \"test-curl-7359-8ee25e\" (UID: \"3d925a61-eb0f-491e-9706-c19ea7df6fd0\") " pod="opendatahub/test-curl-7359-8ee25e"
Sep 17 14:29:14.499421 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:14.499376    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5z5h\" (UniqueName: \"kubernetes.io/projected/3d925a61-eb0f-491e-9706-c19ea7df6fd0-kube-api-access-k5z5h\") pod \"test-curl-7359-8ee25e\" (UID: \"3d925a61-eb0f-491e-9706-c19ea7df6fd0\") " pod="opendatahub/test-curl-7359-8ee25e"
Sep 17 14:29:14.522621 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:14.522580    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5z5h\" (UniqueName: \"kubernetes.io/projected/3d925a61-eb0f-491e-9706-c19ea7df6fd0-kube-api-access-k5z5h\") pod \"test-curl-7359-8ee25e\" (UID: \"3d925a61-eb0f-491e-9706-c19ea7df6fd0\") " pod="opendatahub/test-curl-7359-8ee25e"
Sep 17 14:29:14.638019 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:14.637978    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7359-8ee25e"
Sep 17 14:29:14.937884 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:14.937860    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7359-8ee25e"]
Sep 17 14:29:14.938898 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:29:14.938873    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d925a61_eb0f_491e_9706_c19ea7df6fd0.slice/crio-130d924eb089f9e206b510f2b7f5d3490ff3e7b0e23f6e0811d4bb6ff6daf503 WatchSource:0}: Error finding container 130d924eb089f9e206b510f2b7f5d3490ff3e7b0e23f6e0811d4bb6ff6daf503: Status 404 returned error can't find the container with id 130d924eb089f9e206b510f2b7f5d3490ff3e7b0e23f6e0811d4bb6ff6daf503
Sep 17 14:29:15.338817 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:15.338699    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7359-8ee25e" event={"ID":"3d925a61-eb0f-491e-9706-c19ea7df6fd0","Type":"ContainerStarted","Data":"54a8ca91dfe5eaff44f1307e2e64fa960adf5b3e766aa29078231c083bcd1717"}
Sep 17 14:29:15.339181 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:15.338838    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7359-8ee25e" event={"ID":"3d925a61-eb0f-491e-9706-c19ea7df6fd0","Type":"ContainerStarted","Data":"130d924eb089f9e206b510f2b7f5d3490ff3e7b0e23f6e0811d4bb6ff6daf503"}
Sep 17 14:29:15.339460 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:15.339407    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7359-e77f93" podUID="3454c9e5-1cd6-4c69-a1f0-52137f827eda" containerName="test-curl-7359-e77f93" containerID="cri-o://f218e652d557f2e9c42911fa3e62c55cc99d979db30750d2a0a5b8c2c24d0a32" gracePeriod=2
Sep 17 14:29:15.486459 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:15.486433    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7359-7b9dcc"
Sep 17 14:29:15.610391 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:15.610369    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-756df\" (UniqueName: \"kubernetes.io/projected/f5afd5a4-3bad-4e2c-ab1d-51d4f6d01d5f-kube-api-access-756df\") pod \"f5afd5a4-3bad-4e2c-ab1d-51d4f6d01d5f\" (UID: \"f5afd5a4-3bad-4e2c-ab1d-51d4f6d01d5f\") "
Sep 17 14:29:15.612524 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:15.612496    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5afd5a4-3bad-4e2c-ab1d-51d4f6d01d5f-kube-api-access-756df" (OuterVolumeSpecName: "kube-api-access-756df") pod "f5afd5a4-3bad-4e2c-ab1d-51d4f6d01d5f" (UID: "f5afd5a4-3bad-4e2c-ab1d-51d4f6d01d5f"). InnerVolumeSpecName "kube-api-access-756df". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:29:15.712183 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:15.712153    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-756df\" (UniqueName: \"kubernetes.io/projected/f5afd5a4-3bad-4e2c-ab1d-51d4f6d01d5f-kube-api-access-756df\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:29:16.194507 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:16.194453    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7359-8ee25e" podStartSLOduration=2.194432403 podStartE2EDuration="2.194432403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:29:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:29:15.381217148 +0000 UTC m=+1342.825292735" watchObservedRunningTime="2026-09-17 14:29:16.194432403 +0000 UTC m=+1343.638507989"
Sep 17 14:29:16.196848 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:16.196821    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7359-8ee25e"]
Sep 17 14:29:16.200227 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:16.200196    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7359-8ee25e"]
Sep 17 14:29:16.317294 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:16.317208    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7359-158b12"]
Sep 17 14:29:16.317651 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:16.317638    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d925a61-eb0f-491e-9706-c19ea7df6fd0" containerName="test-curl-7359-8ee25e"
Sep 17 14:29:16.317699 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:16.317653    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d925a61-eb0f-491e-9706-c19ea7df6fd0" containerName="test-curl-7359-8ee25e"
Sep 17 14:29:16.317760 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:16.317748    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d925a61-eb0f-491e-9706-c19ea7df6fd0" containerName="test-curl-7359-8ee25e"
Sep 17 14:29:16.320781 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:16.320763    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7359-158b12"
Sep 17 14:29:16.334262 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:16.334230    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7359-158b12"]
Sep 17 14:29:16.348988 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:16.348953    2580 generic.go:356] "Generic (PLEG): container finished" podID="f5afd5a4-3bad-4e2c-ab1d-51d4f6d01d5f" containerID="9fea881df0a5e5dcab28eebe90b45aee23a0e3d8c7aec3a189b55bfd21bbd9ff" exitCode=137
Sep 17 14:29:16.349438 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:16.348998    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7359-7b9dcc"
Sep 17 14:29:16.349438 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:16.349061    2580 scope.go:117] "RemoveContainer" containerID="9fea881df0a5e5dcab28eebe90b45aee23a0e3d8c7aec3a189b55bfd21bbd9ff"
Sep 17 14:29:16.349438 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:29:16.349322    2580 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7359-8ee25e" container="test-curl-7359-8ee25e"
Sep 17 14:29:16.360743 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:29:16.360696    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7359-7b9dcc\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" podUID="f5afd5a4-3bad-4e2c-ab1d-51d4f6d01d5f" pod="opendatahub/test-curl-7359-7b9dcc"
Sep 17 14:29:16.361592 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:16.361569    2580 scope.go:117] "RemoveContainer" containerID="9fea881df0a5e5dcab28eebe90b45aee23a0e3d8c7aec3a189b55bfd21bbd9ff"
Sep 17 14:29:16.361956 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:29:16.361936    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fea881df0a5e5dcab28eebe90b45aee23a0e3d8c7aec3a189b55bfd21bbd9ff\": container with ID starting with 9fea881df0a5e5dcab28eebe90b45aee23a0e3d8c7aec3a189b55bfd21bbd9ff not found: ID does not exist" containerID="9fea881df0a5e5dcab28eebe90b45aee23a0e3d8c7aec3a189b55bfd21bbd9ff"
Sep 17 14:29:16.362021 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:16.361969    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fea881df0a5e5dcab28eebe90b45aee23a0e3d8c7aec3a189b55bfd21bbd9ff"} err="failed to get container status \"9fea881df0a5e5dcab28eebe90b45aee23a0e3d8c7aec3a189b55bfd21bbd9ff\": rpc error: code = NotFound desc = could not find container \"9fea881df0a5e5dcab28eebe90b45aee23a0e3d8c7aec3a189b55bfd21bbd9ff\": container with ID starting with 9fea881df0a5e5dcab28eebe90b45aee23a0e3d8c7aec3a189b55bfd21bbd9ff not found: ID does not exist"
Sep 17 14:29:16.418630 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:16.418591    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2l5d\" (UniqueName: \"kubernetes.io/projected/e3977ab2-0aee-4a2d-8ba0-81b70b33dc8d-kube-api-access-j2l5d\") pod \"test-curl-7359-158b12\" (UID: \"e3977ab2-0aee-4a2d-8ba0-81b70b33dc8d\") " pod="opendatahub/test-curl-7359-158b12"
Sep 17 14:29:16.519367 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:16.519333    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2l5d\" (UniqueName: \"kubernetes.io/projected/e3977ab2-0aee-4a2d-8ba0-81b70b33dc8d-kube-api-access-j2l5d\") pod \"test-curl-7359-158b12\" (UID: \"e3977ab2-0aee-4a2d-8ba0-81b70b33dc8d\") " pod="opendatahub/test-curl-7359-158b12"
Sep 17 14:29:16.530750 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:16.530694    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2l5d\" (UniqueName: \"kubernetes.io/projected/e3977ab2-0aee-4a2d-8ba0-81b70b33dc8d-kube-api-access-j2l5d\") pod \"test-curl-7359-158b12\" (UID: \"e3977ab2-0aee-4a2d-8ba0-81b70b33dc8d\") " pod="opendatahub/test-curl-7359-158b12"
Sep 17 14:29:16.630224 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:16.630140    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7359-158b12"
Sep 17 14:29:16.932602 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:16.932575    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7359-158b12"]
Sep 17 14:29:16.934583 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:29:16.934556    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3977ab2_0aee_4a2d_8ba0_81b70b33dc8d.slice/crio-07aa9a64460a3d2cb7d9a047500caa59cd3f2b96f80ffc3e93fd1660fff23b7b WatchSource:0}: Error finding container 07aa9a64460a3d2cb7d9a047500caa59cd3f2b96f80ffc3e93fd1660fff23b7b: Status 404 returned error can't find the container with id 07aa9a64460a3d2cb7d9a047500caa59cd3f2b96f80ffc3e93fd1660fff23b7b
Sep 17 14:29:17.177140 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:17.177109    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5afd5a4-3bad-4e2c-ab1d-51d4f6d01d5f" path="/var/lib/kubelet/pods/f5afd5a4-3bad-4e2c-ab1d-51d4f6d01d5f/volumes"
Sep 17 14:29:17.356548 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:17.356518    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7359-158b12" event={"ID":"e3977ab2-0aee-4a2d-8ba0-81b70b33dc8d","Type":"ContainerStarted","Data":"3c8cb0e51fe50575e442f8d8ad3cf7d392c09aa52072f97be5a43bde7d37dd6d"}
Sep 17 14:29:17.356932 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:17.356561    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7359-158b12" event={"ID":"e3977ab2-0aee-4a2d-8ba0-81b70b33dc8d","Type":"ContainerStarted","Data":"07aa9a64460a3d2cb7d9a047500caa59cd3f2b96f80ffc3e93fd1660fff23b7b"}
Sep 17 14:29:17.357603 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:17.357576    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7359-8ee25e" podUID="3d925a61-eb0f-491e-9706-c19ea7df6fd0" containerName="test-curl-7359-8ee25e" containerID="cri-o://54a8ca91dfe5eaff44f1307e2e64fa960adf5b3e766aa29078231c083bcd1717" gracePeriod=2
Sep 17 14:29:17.381825 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:17.381777    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7359-158b12" podStartSLOduration=1.3817597130000001 podStartE2EDuration="1.381759713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:29:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:29:17.379473541 +0000 UTC m=+1344.823549120" watchObservedRunningTime="2026-09-17 14:29:17.381759713 +0000 UTC m=+1344.825835299"
Sep 17 14:29:17.499979 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:17.499954    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7359-e77f93"
Sep 17 14:29:17.631492 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:17.631415    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lft7v\" (UniqueName: \"kubernetes.io/projected/3454c9e5-1cd6-4c69-a1f0-52137f827eda-kube-api-access-lft7v\") pod \"3454c9e5-1cd6-4c69-a1f0-52137f827eda\" (UID: \"3454c9e5-1cd6-4c69-a1f0-52137f827eda\") "
Sep 17 14:29:17.633480 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:17.633454    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3454c9e5-1cd6-4c69-a1f0-52137f827eda-kube-api-access-lft7v" (OuterVolumeSpecName: "kube-api-access-lft7v") pod "3454c9e5-1cd6-4c69-a1f0-52137f827eda" (UID: "3454c9e5-1cd6-4c69-a1f0-52137f827eda"). InnerVolumeSpecName "kube-api-access-lft7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:29:17.732998 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:17.732961    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lft7v\" (UniqueName: \"kubernetes.io/projected/3454c9e5-1cd6-4c69-a1f0-52137f827eda-kube-api-access-lft7v\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:29:18.006727 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.006683    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7359-158b12"]
Sep 17 14:29:18.010468 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.010433    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7359-158b12"]
Sep 17 14:29:18.365265 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.365166    2580 generic.go:356] "Generic (PLEG): container finished" podID="3454c9e5-1cd6-4c69-a1f0-52137f827eda" containerID="f218e652d557f2e9c42911fa3e62c55cc99d979db30750d2a0a5b8c2c24d0a32" exitCode=137
Sep 17 14:29:18.365265 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.365207    2580 scope.go:117] "RemoveContainer" containerID="f218e652d557f2e9c42911fa3e62c55cc99d979db30750d2a0a5b8c2c24d0a32"
Sep 17 14:29:18.365265 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.365224    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7359-e77f93"
Sep 17 14:29:18.365747 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:29:18.365538    2580 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7359-158b12" container="test-curl-7359-158b12"
Sep 17 14:29:18.375125 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.375108    2580 scope.go:117] "RemoveContainer" containerID="f218e652d557f2e9c42911fa3e62c55cc99d979db30750d2a0a5b8c2c24d0a32"
Sep 17 14:29:18.375439 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:29:18.375419    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f218e652d557f2e9c42911fa3e62c55cc99d979db30750d2a0a5b8c2c24d0a32\": container with ID starting with f218e652d557f2e9c42911fa3e62c55cc99d979db30750d2a0a5b8c2c24d0a32 not found: ID does not exist" containerID="f218e652d557f2e9c42911fa3e62c55cc99d979db30750d2a0a5b8c2c24d0a32"
Sep 17 14:29:18.375519 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.375449    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f218e652d557f2e9c42911fa3e62c55cc99d979db30750d2a0a5b8c2c24d0a32"} err="failed to get container status \"f218e652d557f2e9c42911fa3e62c55cc99d979db30750d2a0a5b8c2c24d0a32\": rpc error: code = NotFound desc = could not find container \"f218e652d557f2e9c42911fa3e62c55cc99d979db30750d2a0a5b8c2c24d0a32\": container with ID starting with f218e652d557f2e9c42911fa3e62c55cc99d979db30750d2a0a5b8c2c24d0a32 not found: ID does not exist"
Sep 17 14:29:18.376236 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:29:18.376212    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7359-e77f93\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" podUID="3454c9e5-1cd6-4c69-a1f0-52137f827eda" pod="opendatahub/test-curl-7359-e77f93"
Sep 17 14:29:18.727558 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.727517    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"]
Sep 17 14:29:18.728013 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.727996    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3977ab2-0aee-4a2d-8ba0-81b70b33dc8d" containerName="test-curl-7359-158b12"
Sep 17 14:29:18.728013 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.728011    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3977ab2-0aee-4a2d-8ba0-81b70b33dc8d" containerName="test-curl-7359-158b12"
Sep 17 14:29:18.728162 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.728087    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3977ab2-0aee-4a2d-8ba0-81b70b33dc8d" containerName="test-curl-7359-158b12"
Sep 17 14:29:18.732826 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.732804    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"
Sep 17 14:29:18.735749 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.735699    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-8b50f2\"/\"openshift-service-ca.crt\""
Sep 17 14:29:18.737037 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:29:18.737001    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7359-e77f93\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" podUID="3454c9e5-1cd6-4c69-a1f0-52137f827eda" pod="opendatahub/test-curl-7359-e77f93"
Sep 17 14:29:18.737136 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.737065    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-8b50f2\"/\"e2e-conflict-b-4102a62c-kserve-self-signed-certs\""
Sep 17 14:29:18.737136 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.737069    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-8b50f2\"/\"kube-root-ca.crt\""
Sep 17 14:29:18.737136 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.737022    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-8b50f2\"/\"default-dockercfg-pcxz4\""
Sep 17 14:29:18.749374 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.749336    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"]
Sep 17 14:29:18.843338 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.843293    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88nwx\" (UniqueName: \"kubernetes.io/projected/cce1095c-b797-4f9d-869a-cc0ea0a59a49-kube-api-access-88nwx\") pod \"e2e-conflict-b-4102a62c-kserve-594c685f48-fz927\" (UID: \"cce1095c-b797-4f9d-869a-cc0ea0a59a49\") " pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"
Sep 17 14:29:18.843338 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.843340    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cce1095c-b797-4f9d-869a-cc0ea0a59a49-tmp-dir\") pod \"e2e-conflict-b-4102a62c-kserve-594c685f48-fz927\" (UID: \"cce1095c-b797-4f9d-869a-cc0ea0a59a49\") " pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"
Sep 17 14:29:18.843580 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.843367    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cce1095c-b797-4f9d-869a-cc0ea0a59a49-dshm\") pod \"e2e-conflict-b-4102a62c-kserve-594c685f48-fz927\" (UID: \"cce1095c-b797-4f9d-869a-cc0ea0a59a49\") " pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"
Sep 17 14:29:18.843580 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.843416    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cce1095c-b797-4f9d-869a-cc0ea0a59a49-model-cache\") pod \"e2e-conflict-b-4102a62c-kserve-594c685f48-fz927\" (UID: \"cce1095c-b797-4f9d-869a-cc0ea0a59a49\") " pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"
Sep 17 14:29:18.843580 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.843494    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cce1095c-b797-4f9d-869a-cc0ea0a59a49-home\") pod \"e2e-conflict-b-4102a62c-kserve-594c685f48-fz927\" (UID: \"cce1095c-b797-4f9d-869a-cc0ea0a59a49\") " pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"
Sep 17 14:29:18.843580 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.843519    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cce1095c-b797-4f9d-869a-cc0ea0a59a49-tls-certs\") pod \"e2e-conflict-b-4102a62c-kserve-594c685f48-fz927\" (UID: \"cce1095c-b797-4f9d-869a-cc0ea0a59a49\") " pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"
Sep 17 14:29:18.944472 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.944436    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cce1095c-b797-4f9d-869a-cc0ea0a59a49-home\") pod \"e2e-conflict-b-4102a62c-kserve-594c685f48-fz927\" (UID: \"cce1095c-b797-4f9d-869a-cc0ea0a59a49\") " pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"
Sep 17 14:29:18.944472 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.944479    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cce1095c-b797-4f9d-869a-cc0ea0a59a49-tls-certs\") pod \"e2e-conflict-b-4102a62c-kserve-594c685f48-fz927\" (UID: \"cce1095c-b797-4f9d-869a-cc0ea0a59a49\") " pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"
Sep 17 14:29:18.944741 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.944563    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88nwx\" (UniqueName: \"kubernetes.io/projected/cce1095c-b797-4f9d-869a-cc0ea0a59a49-kube-api-access-88nwx\") pod \"e2e-conflict-b-4102a62c-kserve-594c685f48-fz927\" (UID: \"cce1095c-b797-4f9d-869a-cc0ea0a59a49\") " pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"
Sep 17 14:29:18.944741 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.944597    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cce1095c-b797-4f9d-869a-cc0ea0a59a49-tmp-dir\") pod \"e2e-conflict-b-4102a62c-kserve-594c685f48-fz927\" (UID: \"cce1095c-b797-4f9d-869a-cc0ea0a59a49\") " pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"
Sep 17 14:29:18.944741 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.944702    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cce1095c-b797-4f9d-869a-cc0ea0a59a49-dshm\") pod \"e2e-conflict-b-4102a62c-kserve-594c685f48-fz927\" (UID: \"cce1095c-b797-4f9d-869a-cc0ea0a59a49\") " pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"
Sep 17 14:29:18.944908 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.944755    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cce1095c-b797-4f9d-869a-cc0ea0a59a49-model-cache\") pod \"e2e-conflict-b-4102a62c-kserve-594c685f48-fz927\" (UID: \"cce1095c-b797-4f9d-869a-cc0ea0a59a49\") " pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"
Sep 17 14:29:18.944972 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.944900    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cce1095c-b797-4f9d-869a-cc0ea0a59a49-home\") pod \"e2e-conflict-b-4102a62c-kserve-594c685f48-fz927\" (UID: \"cce1095c-b797-4f9d-869a-cc0ea0a59a49\") " pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"
Sep 17 14:29:18.944972 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.944953    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cce1095c-b797-4f9d-869a-cc0ea0a59a49-tmp-dir\") pod \"e2e-conflict-b-4102a62c-kserve-594c685f48-fz927\" (UID: \"cce1095c-b797-4f9d-869a-cc0ea0a59a49\") " pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"
Sep 17 14:29:18.945165 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.945143    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cce1095c-b797-4f9d-869a-cc0ea0a59a49-model-cache\") pod \"e2e-conflict-b-4102a62c-kserve-594c685f48-fz927\" (UID: \"cce1095c-b797-4f9d-869a-cc0ea0a59a49\") " pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"
Sep 17 14:29:18.946918 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.946895    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cce1095c-b797-4f9d-869a-cc0ea0a59a49-dshm\") pod \"e2e-conflict-b-4102a62c-kserve-594c685f48-fz927\" (UID: \"cce1095c-b797-4f9d-869a-cc0ea0a59a49\") " pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"
Sep 17 14:29:18.947111 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.947091    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cce1095c-b797-4f9d-869a-cc0ea0a59a49-tls-certs\") pod \"e2e-conflict-b-4102a62c-kserve-594c685f48-fz927\" (UID: \"cce1095c-b797-4f9d-869a-cc0ea0a59a49\") " pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"
Sep 17 14:29:18.960691 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:18.960657    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88nwx\" (UniqueName: \"kubernetes.io/projected/cce1095c-b797-4f9d-869a-cc0ea0a59a49-kube-api-access-88nwx\") pod \"e2e-conflict-b-4102a62c-kserve-594c685f48-fz927\" (UID: \"cce1095c-b797-4f9d-869a-cc0ea0a59a49\") " pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"
Sep 17 14:29:19.042964 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:19.042867    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"
Sep 17 14:29:19.177275 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:19.177245    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3454c9e5-1cd6-4c69-a1f0-52137f827eda" path="/var/lib/kubelet/pods/3454c9e5-1cd6-4c69-a1f0-52137f827eda/volumes"
Sep 17 14:29:19.324405 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:19.324373    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"]
Sep 17 14:29:19.325173 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:29:19.325150    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcce1095c_b797_4f9d_869a_cc0ea0a59a49.slice/crio-ed541881ff5baabe3b5e64478661ca7d501f5fddf30c27f3b4ab53ce25980141 WatchSource:0}: Error finding container ed541881ff5baabe3b5e64478661ca7d501f5fddf30c27f3b4ab53ce25980141: Status 404 returned error can't find the container with id ed541881ff5baabe3b5e64478661ca7d501f5fddf30c27f3b4ab53ce25980141
Sep 17 14:29:19.372621 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:19.372592    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927" event={"ID":"cce1095c-b797-4f9d-869a-cc0ea0a59a49","Type":"ContainerStarted","Data":"ed541881ff5baabe3b5e64478661ca7d501f5fddf30c27f3b4ab53ce25980141"}
Sep 17 14:29:19.373853 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:19.373827    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7359-158b12" podUID="e3977ab2-0aee-4a2d-8ba0-81b70b33dc8d" containerName="test-curl-7359-158b12" containerID="cri-o://3c8cb0e51fe50575e442f8d8ad3cf7d392c09aa52072f97be5a43bde7d37dd6d" gracePeriod=2
Sep 17 14:29:19.499468 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:19.499441    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7359-8ee25e"
Sep 17 14:29:19.652121 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:19.652027    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5z5h\" (UniqueName: \"kubernetes.io/projected/3d925a61-eb0f-491e-9706-c19ea7df6fd0-kube-api-access-k5z5h\") pod \"3d925a61-eb0f-491e-9706-c19ea7df6fd0\" (UID: \"3d925a61-eb0f-491e-9706-c19ea7df6fd0\") "
Sep 17 14:29:19.654115 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:19.654092    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d925a61-eb0f-491e-9706-c19ea7df6fd0-kube-api-access-k5z5h" (OuterVolumeSpecName: "kube-api-access-k5z5h") pod "3d925a61-eb0f-491e-9706-c19ea7df6fd0" (UID: "3d925a61-eb0f-491e-9706-c19ea7df6fd0"). InnerVolumeSpecName "kube-api-access-k5z5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:29:19.752869 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:19.752831    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5z5h\" (UniqueName: \"kubernetes.io/projected/3d925a61-eb0f-491e-9706-c19ea7df6fd0-kube-api-access-k5z5h\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:29:20.381367 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:20.381275    2580 generic.go:356] "Generic (PLEG): container finished" podID="3d925a61-eb0f-491e-9706-c19ea7df6fd0" containerID="54a8ca91dfe5eaff44f1307e2e64fa960adf5b3e766aa29078231c083bcd1717" exitCode=137
Sep 17 14:29:20.381367 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:20.381320    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7359-8ee25e"
Sep 17 14:29:20.381849 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:20.381383    2580 scope.go:117] "RemoveContainer" containerID="54a8ca91dfe5eaff44f1307e2e64fa960adf5b3e766aa29078231c083bcd1717"
Sep 17 14:29:20.383251 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:20.383225    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927" event={"ID":"cce1095c-b797-4f9d-869a-cc0ea0a59a49","Type":"ContainerStarted","Data":"b73167b755c5cbb532e2ef0b349be761f532879fc4abfdd520f879fdf03873fa"}
Sep 17 14:29:20.391264 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:20.391241    2580 scope.go:117] "RemoveContainer" containerID="54a8ca91dfe5eaff44f1307e2e64fa960adf5b3e766aa29078231c083bcd1717"
Sep 17 14:29:20.391571 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:29:20.391551    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54a8ca91dfe5eaff44f1307e2e64fa960adf5b3e766aa29078231c083bcd1717\": container with ID starting with 54a8ca91dfe5eaff44f1307e2e64fa960adf5b3e766aa29078231c083bcd1717 not found: ID does not exist" containerID="54a8ca91dfe5eaff44f1307e2e64fa960adf5b3e766aa29078231c083bcd1717"
Sep 17 14:29:20.391618 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:20.391583    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54a8ca91dfe5eaff44f1307e2e64fa960adf5b3e766aa29078231c083bcd1717"} err="failed to get container status \"54a8ca91dfe5eaff44f1307e2e64fa960adf5b3e766aa29078231c083bcd1717\": rpc error: code = NotFound desc = could not find container \"54a8ca91dfe5eaff44f1307e2e64fa960adf5b3e766aa29078231c083bcd1717\": container with ID starting with 54a8ca91dfe5eaff44f1307e2e64fa960adf5b3e766aa29078231c083bcd1717 not found: ID does not exist"
Sep 17 14:29:20.430172 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:20.430117    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927" podStartSLOduration=2.430100853 podStartE2EDuration="2.430100853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:29:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:29:20.429287664 +0000 UTC m=+1347.873363261" watchObservedRunningTime="2026-09-17 14:29:20.430100853 +0000 UTC m=+1347.874176477"
Sep 17 14:29:20.436575 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:29:20.436547    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7359-8ee25e\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" podUID="3d925a61-eb0f-491e-9706-c19ea7df6fd0" pod="opendatahub/test-curl-7359-8ee25e"
Sep 17 14:29:21.177995 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:21.177959    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d925a61-eb0f-491e-9706-c19ea7df6fd0" path="/var/lib/kubelet/pods/3d925a61-eb0f-491e-9706-c19ea7df6fd0/volumes"
Sep 17 14:29:21.537823 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:21.537793    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7359-158b12"
Sep 17 14:29:21.672429 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:21.672389    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2l5d\" (UniqueName: \"kubernetes.io/projected/e3977ab2-0aee-4a2d-8ba0-81b70b33dc8d-kube-api-access-j2l5d\") pod \"e3977ab2-0aee-4a2d-8ba0-81b70b33dc8d\" (UID: \"e3977ab2-0aee-4a2d-8ba0-81b70b33dc8d\") "
Sep 17 14:29:21.674552 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:21.674515    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3977ab2-0aee-4a2d-8ba0-81b70b33dc8d-kube-api-access-j2l5d" (OuterVolumeSpecName: "kube-api-access-j2l5d") pod "e3977ab2-0aee-4a2d-8ba0-81b70b33dc8d" (UID: "e3977ab2-0aee-4a2d-8ba0-81b70b33dc8d"). InnerVolumeSpecName "kube-api-access-j2l5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:29:21.773836 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:21.773792    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2l5d\" (UniqueName: \"kubernetes.io/projected/e3977ab2-0aee-4a2d-8ba0-81b70b33dc8d-kube-api-access-j2l5d\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:29:22.397841 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:22.397798    2580 generic.go:356] "Generic (PLEG): container finished" podID="e3977ab2-0aee-4a2d-8ba0-81b70b33dc8d" containerID="3c8cb0e51fe50575e442f8d8ad3cf7d392c09aa52072f97be5a43bde7d37dd6d" exitCode=137
Sep 17 14:29:22.398036 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:22.397860    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7359-158b12"
Sep 17 14:29:22.398036 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:22.397899    2580 scope.go:117] "RemoveContainer" containerID="3c8cb0e51fe50575e442f8d8ad3cf7d392c09aa52072f97be5a43bde7d37dd6d"
Sep 17 14:29:22.407607 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:22.407588    2580 scope.go:117] "RemoveContainer" containerID="3c8cb0e51fe50575e442f8d8ad3cf7d392c09aa52072f97be5a43bde7d37dd6d"
Sep 17 14:29:22.407943 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:29:22.407920    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c8cb0e51fe50575e442f8d8ad3cf7d392c09aa52072f97be5a43bde7d37dd6d\": container with ID starting with 3c8cb0e51fe50575e442f8d8ad3cf7d392c09aa52072f97be5a43bde7d37dd6d not found: ID does not exist" containerID="3c8cb0e51fe50575e442f8d8ad3cf7d392c09aa52072f97be5a43bde7d37dd6d"
Sep 17 14:29:22.408015 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:22.407953    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c8cb0e51fe50575e442f8d8ad3cf7d392c09aa52072f97be5a43bde7d37dd6d"} err="failed to get container status \"3c8cb0e51fe50575e442f8d8ad3cf7d392c09aa52072f97be5a43bde7d37dd6d\": rpc error: code = NotFound desc = could not find container \"3c8cb0e51fe50575e442f8d8ad3cf7d392c09aa52072f97be5a43bde7d37dd6d\": container with ID starting with 3c8cb0e51fe50575e442f8d8ad3cf7d392c09aa52072f97be5a43bde7d37dd6d not found: ID does not exist"
Sep 17 14:29:22.425969 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:29:22.425929    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7359-158b12\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" podUID="e3977ab2-0aee-4a2d-8ba0-81b70b33dc8d" pod="opendatahub/test-curl-7359-158b12"
Sep 17 14:29:23.177061 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:29:23.177015    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7359-158b12\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" podUID="e3977ab2-0aee-4a2d-8ba0-81b70b33dc8d" pod="opendatahub/test-curl-7359-158b12"
Sep 17 14:29:23.178823 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:23.178782    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3977ab2-0aee-4a2d-8ba0-81b70b33dc8d" path="/var/lib/kubelet/pods/e3977ab2-0aee-4a2d-8ba0-81b70b33dc8d/volumes"
Sep 17 14:29:23.641844 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:23.641792    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7" podUID="23524c07-d2cf-410b-99c4-31e68f7dbce4" containerName="main" containerID="cri-o://5e08875cab859ca98f72c558d72f07796cd60c4580459d3eaa1540ae76820ee5" gracePeriod=45
Sep 17 14:29:23.897072 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:23.897008    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"
Sep 17 14:29:23.996953 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:23.996916    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23524c07-d2cf-410b-99c4-31e68f7dbce4-tmp-dir\") pod \"23524c07-d2cf-410b-99c4-31e68f7dbce4\" (UID: \"23524c07-d2cf-410b-99c4-31e68f7dbce4\") "
Sep 17 14:29:23.997153 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:23.996966    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23524c07-d2cf-410b-99c4-31e68f7dbce4-dshm\") pod \"23524c07-d2cf-410b-99c4-31e68f7dbce4\" (UID: \"23524c07-d2cf-410b-99c4-31e68f7dbce4\") "
Sep 17 14:29:23.997153 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:23.997027    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23524c07-d2cf-410b-99c4-31e68f7dbce4-model-cache\") pod \"23524c07-d2cf-410b-99c4-31e68f7dbce4\" (UID: \"23524c07-d2cf-410b-99c4-31e68f7dbce4\") "
Sep 17 14:29:23.997153 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:23.997088    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23524c07-d2cf-410b-99c4-31e68f7dbce4-tls-certs\") pod \"23524c07-d2cf-410b-99c4-31e68f7dbce4\" (UID: \"23524c07-d2cf-410b-99c4-31e68f7dbce4\") "
Sep 17 14:29:23.997307 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:23.997169    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhc2v\" (UniqueName: \"kubernetes.io/projected/23524c07-d2cf-410b-99c4-31e68f7dbce4-kube-api-access-nhc2v\") pod \"23524c07-d2cf-410b-99c4-31e68f7dbce4\" (UID: \"23524c07-d2cf-410b-99c4-31e68f7dbce4\") "
Sep 17 14:29:23.997307 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:23.997210    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23524c07-d2cf-410b-99c4-31e68f7dbce4-home\") pod \"23524c07-d2cf-410b-99c4-31e68f7dbce4\" (UID: \"23524c07-d2cf-410b-99c4-31e68f7dbce4\") "
Sep 17 14:29:23.997307 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:23.997220    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23524c07-d2cf-410b-99c4-31e68f7dbce4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "23524c07-d2cf-410b-99c4-31e68f7dbce4" (UID: "23524c07-d2cf-410b-99c4-31e68f7dbce4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:29:23.997441 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:23.997321    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23524c07-d2cf-410b-99c4-31e68f7dbce4-model-cache" (OuterVolumeSpecName: "model-cache") pod "23524c07-d2cf-410b-99c4-31e68f7dbce4" (UID: "23524c07-d2cf-410b-99c4-31e68f7dbce4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:29:23.997521 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:23.997491    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23524c07-d2cf-410b-99c4-31e68f7dbce4-home" (OuterVolumeSpecName: "home") pod "23524c07-d2cf-410b-99c4-31e68f7dbce4" (UID: "23524c07-d2cf-410b-99c4-31e68f7dbce4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:29:23.997589 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:23.997574    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23524c07-d2cf-410b-99c4-31e68f7dbce4-home\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:29:23.997650 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:23.997607    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23524c07-d2cf-410b-99c4-31e68f7dbce4-tmp-dir\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:29:23.997650 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:23.997617    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23524c07-d2cf-410b-99c4-31e68f7dbce4-model-cache\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:29:23.999372 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:23.999347    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23524c07-d2cf-410b-99c4-31e68f7dbce4-dshm" (OuterVolumeSpecName: "dshm") pod "23524c07-d2cf-410b-99c4-31e68f7dbce4" (UID: "23524c07-d2cf-410b-99c4-31e68f7dbce4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:29:23.999468 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:23.999420    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23524c07-d2cf-410b-99c4-31e68f7dbce4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "23524c07-d2cf-410b-99c4-31e68f7dbce4" (UID: "23524c07-d2cf-410b-99c4-31e68f7dbce4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:29:23.999468 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:23.999425    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23524c07-d2cf-410b-99c4-31e68f7dbce4-kube-api-access-nhc2v" (OuterVolumeSpecName: "kube-api-access-nhc2v") pod "23524c07-d2cf-410b-99c4-31e68f7dbce4" (UID: "23524c07-d2cf-410b-99c4-31e68f7dbce4"). InnerVolumeSpecName "kube-api-access-nhc2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:29:24.098658 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:24.098618    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhc2v\" (UniqueName: \"kubernetes.io/projected/23524c07-d2cf-410b-99c4-31e68f7dbce4-kube-api-access-nhc2v\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:29:24.098658 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:24.098653    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23524c07-d2cf-410b-99c4-31e68f7dbce4-dshm\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:29:24.098658 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:24.098665    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23524c07-d2cf-410b-99c4-31e68f7dbce4-tls-certs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:29:24.415637 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:24.413103    2580 generic.go:356] "Generic (PLEG): container finished" podID="23524c07-d2cf-410b-99c4-31e68f7dbce4" containerID="5e08875cab859ca98f72c558d72f07796cd60c4580459d3eaa1540ae76820ee5" exitCode=0
Sep 17 14:29:24.415637 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:24.413228    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7" event={"ID":"23524c07-d2cf-410b-99c4-31e68f7dbce4","Type":"ContainerDied","Data":"5e08875cab859ca98f72c558d72f07796cd60c4580459d3eaa1540ae76820ee5"}
Sep 17 14:29:24.415637 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:24.413270    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7" event={"ID":"23524c07-d2cf-410b-99c4-31e68f7dbce4","Type":"ContainerDied","Data":"4687ff7fa285bfe3584d10c6c427d20d9c2a8a9f96e4954918e4d7cdb27d15d6"}
Sep 17 14:29:24.415637 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:24.413308    2580 scope.go:117] "RemoveContainer" containerID="5e08875cab859ca98f72c558d72f07796cd60c4580459d3eaa1540ae76820ee5"
Sep 17 14:29:24.415637 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:24.413451    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"
Sep 17 14:29:24.426199 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:24.426179    2580 scope.go:117] "RemoveContainer" containerID="5e08875cab859ca98f72c558d72f07796cd60c4580459d3eaa1540ae76820ee5"
Sep 17 14:29:24.426521 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:29:24.426499    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e08875cab859ca98f72c558d72f07796cd60c4580459d3eaa1540ae76820ee5\": container with ID starting with 5e08875cab859ca98f72c558d72f07796cd60c4580459d3eaa1540ae76820ee5 not found: ID does not exist" containerID="5e08875cab859ca98f72c558d72f07796cd60c4580459d3eaa1540ae76820ee5"
Sep 17 14:29:24.426597 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:24.426530    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e08875cab859ca98f72c558d72f07796cd60c4580459d3eaa1540ae76820ee5"} err="failed to get container status \"5e08875cab859ca98f72c558d72f07796cd60c4580459d3eaa1540ae76820ee5\": rpc error: code = NotFound desc = could not find container \"5e08875cab859ca98f72c558d72f07796cd60c4580459d3eaa1540ae76820ee5\": container with ID starting with 5e08875cab859ca98f72c558d72f07796cd60c4580459d3eaa1540ae76820ee5 not found: ID does not exist"
Sep 17 14:29:24.449406 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:24.449373    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"]
Sep 17 14:29:24.453327 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:24.453296    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-28f011/test-model-28f011-kserve-6d8577f68f-xznn7"]
Sep 17 14:29:25.177456 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:25.177422    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23524c07-d2cf-410b-99c4-31e68f7dbce4" path="/var/lib/kubelet/pods/23524c07-d2cf-410b-99c4-31e68f7dbce4/volumes"
Sep 17 14:29:28.649620 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:28.649584    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:29:28.711702 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:28.711665    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq"]
Sep 17 14:29:28.712132 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:28.712116    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23524c07-d2cf-410b-99c4-31e68f7dbce4" containerName="main"
Sep 17 14:29:28.712132 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:28.712132    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="23524c07-d2cf-410b-99c4-31e68f7dbce4" containerName="main"
Sep 17 14:29:28.712272 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:28.712227    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="23524c07-d2cf-410b-99c4-31e68f7dbce4" containerName="main"
Sep 17 14:29:28.717170 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:28.717140    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq"
Sep 17 14:29:28.720523 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:28.720498    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-d2d17aff-serving-cert\""
Sep 17 14:29:28.742537 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:28.742501    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b926020c-5e42-4411-894c-a071977e14a1-maas-api-tls\") pod \"maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq\" (UID: \"b926020c-5e42-4411-894c-a071977e14a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq"
Sep 17 14:29:28.742781 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:28.742562    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b926020c-5e42-4411-894c-a071977e14a1-metrics-certs\") pod \"maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq\" (UID: \"b926020c-5e42-4411-894c-a071977e14a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq"
Sep 17 14:29:28.742781 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:28.742606    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsk2m\" (UniqueName: \"kubernetes.io/projected/b926020c-5e42-4411-894c-a071977e14a1-kube-api-access-hsk2m\") pod \"maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq\" (UID: \"b926020c-5e42-4411-894c-a071977e14a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq"
Sep 17 14:29:28.742781 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:28.742641    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b926020c-5e42-4411-894c-a071977e14a1-openshift-service-ca\") pod \"maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq\" (UID: \"b926020c-5e42-4411-894c-a071977e14a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq"
Sep 17 14:29:28.747287 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:28.747254    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq"]
Sep 17 14:29:28.844273 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:28.844226    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b926020c-5e42-4411-894c-a071977e14a1-maas-api-tls\") pod \"maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq\" (UID: \"b926020c-5e42-4411-894c-a071977e14a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq"
Sep 17 14:29:28.844476 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:28.844288    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b926020c-5e42-4411-894c-a071977e14a1-metrics-certs\") pod \"maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq\" (UID: \"b926020c-5e42-4411-894c-a071977e14a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq"
Sep 17 14:29:28.844476 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:28.844318    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsk2m\" (UniqueName: \"kubernetes.io/projected/b926020c-5e42-4411-894c-a071977e14a1-kube-api-access-hsk2m\") pod \"maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq\" (UID: \"b926020c-5e42-4411-894c-a071977e14a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq"
Sep 17 14:29:28.844476 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:28.844356    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b926020c-5e42-4411-894c-a071977e14a1-openshift-service-ca\") pod \"maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq\" (UID: \"b926020c-5e42-4411-894c-a071977e14a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq"
Sep 17 14:29:28.844476 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:29:28.844407    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-serving-cert: secret "maas-api-e2e-mt-d2d17aff-serving-cert" not found
Sep 17 14:29:28.844696 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:29:28.844498    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b926020c-5e42-4411-894c-a071977e14a1-maas-api-tls podName:b926020c-5e42-4411-894c-a071977e14a1 nodeName:}" failed. No retries permitted until 2026-09-17 14:29:29.344477125 +0000 UTC m=+1356.788552690 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b926020c-5e42-4411-894c-a071977e14a1-maas-api-tls") pod "maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq" (UID: "b926020c-5e42-4411-894c-a071977e14a1") : secret "maas-api-e2e-mt-d2d17aff-serving-cert" not found
Sep 17 14:29:28.845347 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:28.845317    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b926020c-5e42-4411-894c-a071977e14a1-openshift-service-ca\") pod \"maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq\" (UID: \"b926020c-5e42-4411-894c-a071977e14a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq"
Sep 17 14:29:28.847014 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:28.846985    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b926020c-5e42-4411-894c-a071977e14a1-metrics-certs\") pod \"maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq\" (UID: \"b926020c-5e42-4411-894c-a071977e14a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq"
Sep 17 14:29:28.861930 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:28.861896    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsk2m\" (UniqueName: \"kubernetes.io/projected/b926020c-5e42-4411-894c-a071977e14a1-kube-api-access-hsk2m\") pod \"maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq\" (UID: \"b926020c-5e42-4411-894c-a071977e14a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq"
Sep 17 14:29:29.043690 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:29.043642    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"
Sep 17 14:29:29.043924 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:29.043704    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"
Sep 17 14:29:29.057651 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:29.057619    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"
Sep 17 14:29:29.349022 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:29.348917    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b926020c-5e42-4411-894c-a071977e14a1-maas-api-tls\") pod \"maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq\" (UID: \"b926020c-5e42-4411-894c-a071977e14a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq"
Sep 17 14:29:29.351492 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:29.351470    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b926020c-5e42-4411-894c-a071977e14a1-maas-api-tls\") pod \"maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq\" (UID: \"b926020c-5e42-4411-894c-a071977e14a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq"
Sep 17 14:29:29.458617 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:29.458581    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"
Sep 17 14:29:29.631374 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:29.631274    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq"
Sep 17 14:29:29.930606 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:29.930572    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq"]
Sep 17 14:29:29.931087 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:29:29.930685    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb926020c_5e42_4411_894c_a071977e14a1.slice/crio-add24612ad7d00dc8883fdc9204b7fa4b03f5083623ecce9f53468776f502d07 WatchSource:0}: Error finding container add24612ad7d00dc8883fdc9204b7fa4b03f5083623ecce9f53468776f502d07: Status 404 returned error can't find the container with id add24612ad7d00dc8883fdc9204b7fa4b03f5083623ecce9f53468776f502d07
Sep 17 14:29:30.246581 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:30.246538    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-28f011-d59dcb5b6-h9kwt"]
Sep 17 14:29:30.246843 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:30.246800    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-28f011-d59dcb5b6-h9kwt" podUID="36a32c2a-17f0-4966-8085-d01454eb88d5" containerName="payload-pre-processing" containerID="cri-o://5749046e04bd64b7bf8c7a69786c207e5a1b5199a36a92c292f044982842d30a" gracePeriod=30
Sep 17 14:29:30.451647 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:30.451617    2580 generic.go:356] "Generic (PLEG): container finished" podID="36a32c2a-17f0-4966-8085-d01454eb88d5" containerID="5749046e04bd64b7bf8c7a69786c207e5a1b5199a36a92c292f044982842d30a" exitCode=0
Sep 17 14:29:30.451836 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:30.451694    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-28f011-d59dcb5b6-h9kwt" event={"ID":"36a32c2a-17f0-4966-8085-d01454eb88d5","Type":"ContainerDied","Data":"5749046e04bd64b7bf8c7a69786c207e5a1b5199a36a92c292f044982842d30a"}
Sep 17 14:29:30.453446 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:30.453415    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq" event={"ID":"b926020c-5e42-4411-894c-a071977e14a1","Type":"ContainerStarted","Data":"add24612ad7d00dc8883fdc9204b7fa4b03f5083623ecce9f53468776f502d07"}
Sep 17 14:29:30.518628 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:30.518499    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-28f011-d59dcb5b6-h9kwt"
Sep 17 14:29:30.561629 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:30.561598    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vl9z5\" (UniqueName: \"kubernetes.io/projected/36a32c2a-17f0-4966-8085-d01454eb88d5-kube-api-access-vl9z5\") pod \"36a32c2a-17f0-4966-8085-d01454eb88d5\" (UID: \"36a32c2a-17f0-4966-8085-d01454eb88d5\") "
Sep 17 14:29:30.561824 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:30.561728    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36a32c2a-17f0-4966-8085-d01454eb88d5-plugins-config-volume\") pod \"36a32c2a-17f0-4966-8085-d01454eb88d5\" (UID: \"36a32c2a-17f0-4966-8085-d01454eb88d5\") "
Sep 17 14:29:30.562204 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:30.562172    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36a32c2a-17f0-4966-8085-d01454eb88d5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "36a32c2a-17f0-4966-8085-d01454eb88d5" (UID: "36a32c2a-17f0-4966-8085-d01454eb88d5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:29:30.564251 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:30.564221    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36a32c2a-17f0-4966-8085-d01454eb88d5-kube-api-access-vl9z5" (OuterVolumeSpecName: "kube-api-access-vl9z5") pod "36a32c2a-17f0-4966-8085-d01454eb88d5" (UID: "36a32c2a-17f0-4966-8085-d01454eb88d5"). InnerVolumeSpecName "kube-api-access-vl9z5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:29:30.663113 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:30.663071    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vl9z5\" (UniqueName: \"kubernetes.io/projected/36a32c2a-17f0-4966-8085-d01454eb88d5-kube-api-access-vl9z5\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:29:30.663113 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:30.663105    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36a32c2a-17f0-4966-8085-d01454eb88d5-plugins-config-volume\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:29:31.460922 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:31.460885    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-28f011-d59dcb5b6-h9kwt"
Sep 17 14:29:31.461383 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:31.460920    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-28f011-d59dcb5b6-h9kwt" event={"ID":"36a32c2a-17f0-4966-8085-d01454eb88d5","Type":"ContainerDied","Data":"35444a4b71df5a0a970664d46359838635b77dfaa13a6b80d15e6299730f4178"}
Sep 17 14:29:31.461383 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:31.460996    2580 scope.go:117] "RemoveContainer" containerID="5749046e04bd64b7bf8c7a69786c207e5a1b5199a36a92c292f044982842d30a"
Sep 17 14:29:31.462991 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:31.462960    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq" event={"ID":"b926020c-5e42-4411-894c-a071977e14a1","Type":"ContainerStarted","Data":"8c479c67e5fbdf3908b9f3b7657f5d95e01b61ffca7c8955e3ab033fc9f9c8a6"}
Sep 17 14:29:31.463136 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:31.463028    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq"
Sep 17 14:29:31.496058 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:31.496023    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-28f011-d59dcb5b6-h9kwt"]
Sep 17 14:29:31.501442 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:31.501409    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-28f011-d59dcb5b6-h9kwt"]
Sep 17 14:29:31.528020 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:31.527959    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq" podStartSLOduration=3.000676569 podStartE2EDuration="3.52793951s" totalImagesPullingTime="527.262941ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:29:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:29:31.527075457 +0000 UTC m=+1358.971151064" watchObservedRunningTime="2026-09-17 14:29:31.52793951 +0000 UTC m=+1358.972015096"
Sep 17 14:29:33.184738 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:33.184674    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36a32c2a-17f0-4966-8085-d01454eb88d5" path="/var/lib/kubelet/pods/36a32c2a-17f0-4966-8085-d01454eb88d5/volumes"
Sep 17 14:29:35.830662 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:35.830624    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"]
Sep 17 14:29:35.831096 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:35.831081    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36a32c2a-17f0-4966-8085-d01454eb88d5" containerName="payload-pre-processing"
Sep 17 14:29:35.831142 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:35.831097    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="36a32c2a-17f0-4966-8085-d01454eb88d5" containerName="payload-pre-processing"
Sep 17 14:29:35.831204 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:35.831195    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="36a32c2a-17f0-4966-8085-d01454eb88d5" containerName="payload-pre-processing"
Sep 17 14:29:35.835811 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:35.835781    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"
Sep 17 14:29:35.839242 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:35.839216    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-080801\"/\"distinct-2-w0-080801-kserve-self-signed-certs\""
Sep 17 14:29:35.848391 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:35.848362    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"]
Sep 17 14:29:35.912224 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:35.912187    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9451e47-6204-4dc2-996b-dfa47ea039b1-model-cache\") pod \"distinct-2-w0-080801-kserve-87f75455f-b4rb5\" (UID: \"b9451e47-6204-4dc2-996b-dfa47ea039b1\") " pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"
Sep 17 14:29:35.912224 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:35.912224    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9451e47-6204-4dc2-996b-dfa47ea039b1-tls-certs\") pod \"distinct-2-w0-080801-kserve-87f75455f-b4rb5\" (UID: \"b9451e47-6204-4dc2-996b-dfa47ea039b1\") " pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"
Sep 17 14:29:35.912445 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:35.912261    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9451e47-6204-4dc2-996b-dfa47ea039b1-dshm\") pod \"distinct-2-w0-080801-kserve-87f75455f-b4rb5\" (UID: \"b9451e47-6204-4dc2-996b-dfa47ea039b1\") " pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"
Sep 17 14:29:35.912445 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:35.912327    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4t6h\" (UniqueName: \"kubernetes.io/projected/b9451e47-6204-4dc2-996b-dfa47ea039b1-kube-api-access-x4t6h\") pod \"distinct-2-w0-080801-kserve-87f75455f-b4rb5\" (UID: \"b9451e47-6204-4dc2-996b-dfa47ea039b1\") " pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"
Sep 17 14:29:35.912445 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:35.912394    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9451e47-6204-4dc2-996b-dfa47ea039b1-home\") pod \"distinct-2-w0-080801-kserve-87f75455f-b4rb5\" (UID: \"b9451e47-6204-4dc2-996b-dfa47ea039b1\") " pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"
Sep 17 14:29:35.912445 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:35.912417    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9451e47-6204-4dc2-996b-dfa47ea039b1-tmp-dir\") pod \"distinct-2-w0-080801-kserve-87f75455f-b4rb5\" (UID: \"b9451e47-6204-4dc2-996b-dfa47ea039b1\") " pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"
Sep 17 14:29:36.013561 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:36.013521    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9451e47-6204-4dc2-996b-dfa47ea039b1-home\") pod \"distinct-2-w0-080801-kserve-87f75455f-b4rb5\" (UID: \"b9451e47-6204-4dc2-996b-dfa47ea039b1\") " pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"
Sep 17 14:29:36.013561 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:36.013562    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9451e47-6204-4dc2-996b-dfa47ea039b1-tmp-dir\") pod \"distinct-2-w0-080801-kserve-87f75455f-b4rb5\" (UID: \"b9451e47-6204-4dc2-996b-dfa47ea039b1\") " pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"
Sep 17 14:29:36.013928 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:36.013618    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9451e47-6204-4dc2-996b-dfa47ea039b1-model-cache\") pod \"distinct-2-w0-080801-kserve-87f75455f-b4rb5\" (UID: \"b9451e47-6204-4dc2-996b-dfa47ea039b1\") " pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"
Sep 17 14:29:36.013928 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:36.013637    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9451e47-6204-4dc2-996b-dfa47ea039b1-tls-certs\") pod \"distinct-2-w0-080801-kserve-87f75455f-b4rb5\" (UID: \"b9451e47-6204-4dc2-996b-dfa47ea039b1\") " pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"
Sep 17 14:29:36.013928 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:36.013768    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9451e47-6204-4dc2-996b-dfa47ea039b1-dshm\") pod \"distinct-2-w0-080801-kserve-87f75455f-b4rb5\" (UID: \"b9451e47-6204-4dc2-996b-dfa47ea039b1\") " pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"
Sep 17 14:29:36.013928 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:36.013828    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4t6h\" (UniqueName: \"kubernetes.io/projected/b9451e47-6204-4dc2-996b-dfa47ea039b1-kube-api-access-x4t6h\") pod \"distinct-2-w0-080801-kserve-87f75455f-b4rb5\" (UID: \"b9451e47-6204-4dc2-996b-dfa47ea039b1\") " pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"
Sep 17 14:29:36.014153 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:36.014042    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9451e47-6204-4dc2-996b-dfa47ea039b1-home\") pod \"distinct-2-w0-080801-kserve-87f75455f-b4rb5\" (UID: \"b9451e47-6204-4dc2-996b-dfa47ea039b1\") " pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"
Sep 17 14:29:36.014153 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:36.014091    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9451e47-6204-4dc2-996b-dfa47ea039b1-tmp-dir\") pod \"distinct-2-w0-080801-kserve-87f75455f-b4rb5\" (UID: \"b9451e47-6204-4dc2-996b-dfa47ea039b1\") " pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"
Sep 17 14:29:36.014153 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:36.014113    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9451e47-6204-4dc2-996b-dfa47ea039b1-model-cache\") pod \"distinct-2-w0-080801-kserve-87f75455f-b4rb5\" (UID: \"b9451e47-6204-4dc2-996b-dfa47ea039b1\") " pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"
Sep 17 14:29:36.016038 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:36.016017    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9451e47-6204-4dc2-996b-dfa47ea039b1-dshm\") pod \"distinct-2-w0-080801-kserve-87f75455f-b4rb5\" (UID: \"b9451e47-6204-4dc2-996b-dfa47ea039b1\") " pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"
Sep 17 14:29:36.016332 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:36.016312    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9451e47-6204-4dc2-996b-dfa47ea039b1-tls-certs\") pod \"distinct-2-w0-080801-kserve-87f75455f-b4rb5\" (UID: \"b9451e47-6204-4dc2-996b-dfa47ea039b1\") " pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"
Sep 17 14:29:36.032251 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:36.032214    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4t6h\" (UniqueName: \"kubernetes.io/projected/b9451e47-6204-4dc2-996b-dfa47ea039b1-kube-api-access-x4t6h\") pod \"distinct-2-w0-080801-kserve-87f75455f-b4rb5\" (UID: \"b9451e47-6204-4dc2-996b-dfa47ea039b1\") " pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"
Sep 17 14:29:36.145560 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:36.145463    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"
Sep 17 14:29:36.441305 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:29:36.441269    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9451e47_6204_4dc2_996b_dfa47ea039b1.slice/crio-c28106f5a8ace451633c86de0307747fd1baf46c88ce3d022335f6fa6ad8e4fa WatchSource:0}: Error finding container c28106f5a8ace451633c86de0307747fd1baf46c88ce3d022335f6fa6ad8e4fa: Status 404 returned error can't find the container with id c28106f5a8ace451633c86de0307747fd1baf46c88ce3d022335f6fa6ad8e4fa
Sep 17 14:29:36.442761 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:36.442737    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"]
Sep 17 14:29:36.495217 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:36.494944    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5" event={"ID":"b9451e47-6204-4dc2-996b-dfa47ea039b1","Type":"ContainerStarted","Data":"c28106f5a8ace451633c86de0307747fd1baf46c88ce3d022335f6fa6ad8e4fa"}
Sep 17 14:29:37.476079 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:37.476046    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq"
Sep 17 14:29:37.503563 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:37.503526    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5" event={"ID":"b9451e47-6204-4dc2-996b-dfa47ea039b1","Type":"ContainerStarted","Data":"c450e8975dab8eb29f7dbced17a0f0140b437a1b120d2c6b168ddfeabd420a8f"}
Sep 17 14:29:39.074876 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.074811    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5" podStartSLOduration=4.074792075 podStartE2EDuration="4.074792075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:29:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:29:37.540155462 +0000 UTC m=+1364.984231049" watchObservedRunningTime="2026-09-17 14:29:39.074792075 +0000 UTC m=+1366.518867690"
Sep 17 14:29:39.076377 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.076359    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"]
Sep 17 14:29:39.080053 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.080036    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:39.083943 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.083918    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 17 14:29:39.084065 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.083959    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-3da4be-openshift-default-dockercfg-m625k\""
Sep 17 14:29:39.105213 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.105181    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"]
Sep 17 14:29:39.144309 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.144275    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-workload-certs\") pod \"e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") " pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:39.144488 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.144315    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-istio-token\") pod \"e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") " pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:39.144488 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.144343    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-istio-podinfo\") pod \"e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") " pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:39.144488 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.144402    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-workload-socket\") pod \"e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") " pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:39.144488 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.144423    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-istio-envoy\") pod \"e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") " pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:39.144488 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.144452    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-istio-data\") pod \"e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") " pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:39.144658 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.144493    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-credential-socket\") pod \"e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") " pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:39.144658 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.144517    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-istiod-ca-cert\") pod \"e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") " pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:39.144658 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.144537    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v7s6\" (UniqueName: \"kubernetes.io/projected/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-kube-api-access-8v7s6\") pod \"e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") " pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:39.245751 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.245699    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-workload-certs\") pod \"e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") " pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:39.245751 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.245750    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-istio-token\") pod \"e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") " pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:39.245994 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.245775    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-istio-podinfo\") pod \"e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") " pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:39.245994 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.245799    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-workload-socket\") pod \"e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") " pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:39.245994 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.245816    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-istio-envoy\") pod \"e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") " pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:39.245994 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.245839    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-istio-data\") pod \"e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") " pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:39.245994 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.245879    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-credential-socket\") pod \"e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") " pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:39.245994 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.245910    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-istiod-ca-cert\") pod \"e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") " pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:39.245994 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.245942    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v7s6\" (UniqueName: \"kubernetes.io/projected/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-kube-api-access-8v7s6\") pod \"e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") " pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:39.246365 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.246206    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-workload-certs\") pod \"e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") " pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:39.246365 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.246341    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-istio-data\") pod \"e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") " pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:39.246502 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.246483    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-credential-socket\") pod \"e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") " pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:39.246737 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.246686    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-workload-socket\") pod \"e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") " pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:39.246962 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.246939    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-istiod-ca-cert\") pod \"e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") " pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:39.248343 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.248322    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-istio-envoy\") pod \"e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") " pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:39.248620 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.248604    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-istio-podinfo\") pod \"e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") " pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:39.258398 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.258367    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v7s6\" (UniqueName: \"kubernetes.io/projected/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-kube-api-access-8v7s6\") pod \"e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") " pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:39.258398 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.258384    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-istio-token\") pod \"e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") " pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:39.392235 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.392140    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:39.682567 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:39.682535    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"]
Sep 17 14:29:39.683084 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:29:39.683058    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod664e8c61_1b4d_4d4e_9ff2_5f88b4304fa9.slice/crio-a70cc78cfd125dcacf1dd589d666a6303c1269602e8000de27191fbabf1c331e WatchSource:0}: Error finding container a70cc78cfd125dcacf1dd589d666a6303c1269602e8000de27191fbabf1c331e: Status 404 returned error can't find the container with id a70cc78cfd125dcacf1dd589d666a6303c1269602e8000de27191fbabf1c331e
Sep 17 14:29:40.525423 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:40.525380    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5" event={"ID":"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9","Type":"ContainerStarted","Data":"a70cc78cfd125dcacf1dd589d666a6303c1269602e8000de27191fbabf1c331e"}
Sep 17 14:29:42.279436 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:42.279401    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 14:29:42.279756 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:42.279476    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 14:29:42.279756 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:42.279509    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 14:29:42.541529 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:42.541427    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5" event={"ID":"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9","Type":"ContainerStarted","Data":"4d673839c13d27439d3664796133e501071e03dc7a66b5632ff6f611191d6071"}
Sep 17 14:29:42.588556 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:42.588502    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5" podStartSLOduration=0.994694696 podStartE2EDuration="3.588481961s" totalImagesPullingTime="2.593787265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:29:42.58628672 +0000 UTC m=+1370.030362321" watchObservedRunningTime="2026-09-17 14:29:42.588481961 +0000 UTC m=+1370.032557546"
Sep 17 14:29:43.392754 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:43.392695    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:43.398348 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:43.398316    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:43.557448 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:43.557409    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:43.558412 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:43.558387    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:29:46.146619 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:46.146574    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"
Sep 17 14:29:46.147185 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:46.146637    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"
Sep 17 14:29:46.159411 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:46.159377    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"
Sep 17 14:29:46.591074 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:46.591042    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"
Sep 17 14:29:53.168868 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:29:53.168832    2580 scope.go:117] "RemoveContainer" containerID="97c56aaef2777e4b8636433424ce9be84c503cd62cdf432f78809d74dd7576c7"
Sep 17 14:30:00.239746 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:00.239698    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4009da-29827590-9tmls"]
Sep 17 14:30:00.247196 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:00.247170    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4009da-29827590-9tmls"
Sep 17 14:30:00.251895 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:00.251868    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mm5m6\""
Sep 17 14:30:00.260428 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:00.260398    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4009da-29827590-9tmls"
Sep 17 14:30:00.263580 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:00.263552    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4009da-29827590-9tmls"]
Sep 17 14:30:00.267448 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:00.267422    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3da4be-29827590-x2brn"]
Sep 17 14:30:00.272461 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:00.272434    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3da4be-29827590-x2brn"
Sep 17 14:30:00.281600 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:00.281520    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3da4be-29827590-x2brn"]
Sep 17 14:30:00.304873 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:00.304831    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3da4be-29827590-x2brn"
Sep 17 14:30:00.560083 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:30:00.560050    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77c10e41_5773_4749_accd_cbd71db955dc.slice/crio-0a99ce1953cd7a73af680aa569810cfeac05f8e3183c1a170beac4dff3f3c4a9 WatchSource:0}: Error finding container 0a99ce1953cd7a73af680aa569810cfeac05f8e3183c1a170beac4dff3f3c4a9: Status 404 returned error can't find the container with id 0a99ce1953cd7a73af680aa569810cfeac05f8e3183c1a170beac4dff3f3c4a9
Sep 17 14:30:00.561008 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:00.560984    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4009da-29827590-9tmls"]
Sep 17 14:30:00.622283 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:00.622255    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3da4be-29827590-x2brn"]
Sep 17 14:30:00.623341 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:30:00.623313    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98583f88_d2c5_41b5_9e55_5843ceef80b8.slice/crio-95389a3144d0bcb008152888091888f5ad028b31a4b31b08002ade3c3eaf348e WatchSource:0}: Error finding container 95389a3144d0bcb008152888091888f5ad028b31a4b31b08002ade3c3eaf348e: Status 404 returned error can't find the container with id 95389a3144d0bcb008152888091888f5ad028b31a4b31b08002ade3c3eaf348e
Sep 17 14:30:00.667075 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:00.667038    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4009da-29827590-9tmls" event={"ID":"77c10e41-5773-4749-accd-cbd71db955dc","Type":"ContainerStarted","Data":"0a99ce1953cd7a73af680aa569810cfeac05f8e3183c1a170beac4dff3f3c4a9"}
Sep 17 14:30:00.668298 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:00.668271    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3da4be-29827590-x2brn" event={"ID":"98583f88-d2c5-41b5-9e55-5843ceef80b8","Type":"ContainerStarted","Data":"95389a3144d0bcb008152888091888f5ad028b31a4b31b08002ade3c3eaf348e"}
Sep 17 14:30:03.689659 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:03.689570    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4009da-29827590-9tmls" event={"ID":"77c10e41-5773-4749-accd-cbd71db955dc","Type":"ContainerStarted","Data":"37b420d3174c21d502c3b5fdea763d4eb1fbbe9a27c21462c540995aaac3a7ec"}
Sep 17 14:30:03.707162 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:03.707083    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4009da-29827590-9tmls" podStartSLOduration=1.312215253 podStartE2EDuration="3.707063137s" totalImagesPullingTime="2.394847884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:30:03.706568416 +0000 UTC m=+1391.150644021" watchObservedRunningTime="2026-09-17 14:30:03.707063137 +0000 UTC m=+1391.151138725"
Sep 17 14:30:04.697163 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:04.697127    2580 generic.go:356] "Generic (PLEG): container finished" podID="77c10e41-5773-4749-accd-cbd71db955dc" containerID="37b420d3174c21d502c3b5fdea763d4eb1fbbe9a27c21462c540995aaac3a7ec" exitCode=0
Sep 17 14:30:04.697604 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:04.697210    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4009da-29827590-9tmls" event={"ID":"77c10e41-5773-4749-accd-cbd71db955dc","Type":"ContainerDied","Data":"37b420d3174c21d502c3b5fdea763d4eb1fbbe9a27c21462c540995aaac3a7ec"}
Sep 17 14:30:05.831145 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:05.831111    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4009da-29827590-9tmls"
Sep 17 14:30:06.713241 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:06.713204    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4009da-29827590-9tmls" event={"ID":"77c10e41-5773-4749-accd-cbd71db955dc","Type":"ContainerDied","Data":"0a99ce1953cd7a73af680aa569810cfeac05f8e3183c1a170beac4dff3f3c4a9"}
Sep 17 14:30:06.713454 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:06.713267    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a99ce1953cd7a73af680aa569810cfeac05f8e3183c1a170beac4dff3f3c4a9"
Sep 17 14:30:06.713454 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:06.713217    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4009da-29827590-9tmls"
Sep 17 14:30:09.037655 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:09.037610    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:30:15.295269 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.295231    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"]
Sep 17 14:30:15.296253 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.296224    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77c10e41-5773-4749-accd-cbd71db955dc" containerName="cleanup"
Sep 17 14:30:15.296253 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.296243    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="77c10e41-5773-4749-accd-cbd71db955dc" containerName="cleanup"
Sep 17 14:30:15.296390 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.296335    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="77c10e41-5773-4749-accd-cbd71db955dc" containerName="cleanup"
Sep 17 14:30:15.299569 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.299548    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:15.305633 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.305601    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-b48b7c-openshift-default-dockercfg-vnnr8\""
Sep 17 14:30:15.322596 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.322560    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-credential-socket\") pod \"e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") " pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:15.323194 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.322608    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-istio-podinfo\") pod \"e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") " pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:15.323194 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.322646    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-istio-data\") pod \"e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") " pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:15.323194 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.322681    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dz6c\" (UniqueName: \"kubernetes.io/projected/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-kube-api-access-2dz6c\") pod \"e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") " pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:15.323194 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.322900    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-workload-certs\") pod \"e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") " pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:15.323194 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.323042    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-istio-envoy\") pod \"e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") " pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:15.323194 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.323095    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-workload-socket\") pod \"e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") " pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:15.323961 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.323198    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-istio-token\") pod \"e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") " pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:15.323961 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.323281    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-istiod-ca-cert\") pod \"e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") " pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:15.327971 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.327936    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"]
Sep 17 14:30:15.423839 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.423798    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-workload-certs\") pod \"e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") " pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:15.423839 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.423845    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-istio-envoy\") pod \"e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") " pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:15.424110 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.423869    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-workload-socket\") pod \"e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") " pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:15.424110 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.423909    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-istio-token\") pod \"e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") " pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:15.424110 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.423931    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-istiod-ca-cert\") pod \"e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") " pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:15.424110 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.423971    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-credential-socket\") pod \"e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") " pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:15.424110 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.423999    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-istio-podinfo\") pod \"e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") " pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:15.424110 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.424046    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-istio-data\") pod \"e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") " pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:15.424110 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.424082    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dz6c\" (UniqueName: \"kubernetes.io/projected/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-kube-api-access-2dz6c\") pod \"e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") " pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:15.424536 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.424363    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-workload-certs\") pod \"e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") " pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:15.424536 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.424483    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-workload-socket\") pod \"e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") " pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:15.424672 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.424646    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-istio-data\") pod \"e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") " pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:15.424767 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.424746    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-credential-socket\") pod \"e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") " pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:15.424813 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.424779    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-istiod-ca-cert\") pod \"e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") " pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:15.426301 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.426279    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-istio-envoy\") pod \"e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") " pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:15.426492 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.426475    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-istio-podinfo\") pod \"e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") " pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:15.433991 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.433966    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-istio-token\") pod \"e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") " pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:15.435750 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.435705    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dz6c\" (UniqueName: \"kubernetes.io/projected/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-kube-api-access-2dz6c\") pod \"e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") " pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:15.610740 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:15.610673    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:16.018519 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:16.018483    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"]
Sep 17 14:30:16.019422 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:30:16.019392    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c059d46_ed55_4ff1_90a7_2c2f1c99ae30.slice/crio-44117863afb1c7f23a55627225959d6b1a08e7109b7bb427c1a378eaf40431ef WatchSource:0}: Error finding container 44117863afb1c7f23a55627225959d6b1a08e7109b7bb427c1a378eaf40431ef: Status 404 returned error can't find the container with id 44117863afb1c7f23a55627225959d6b1a08e7109b7bb427c1a378eaf40431ef
Sep 17 14:30:16.021868 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:16.021834    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 14:30:16.021978 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:16.021916    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 14:30:16.021978 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:16.021963    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 14:30:16.796968 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:16.796925    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j" event={"ID":"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30","Type":"ContainerStarted","Data":"dc1521c8dccec6f7ad4eb21519408b0cf0c2742ce8d128ab2bb356feb0751b50"}
Sep 17 14:30:16.797479 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:16.796993    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j" event={"ID":"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30","Type":"ContainerStarted","Data":"44117863afb1c7f23a55627225959d6b1a08e7109b7bb427c1a378eaf40431ef"}
Sep 17 14:30:16.798643 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:16.798616    2580 generic.go:356] "Generic (PLEG): container finished" podID="98583f88-d2c5-41b5-9e55-5843ceef80b8" containerID="3094b731a7df456cb1ded0196e69df1531e34e94b824438fc7c271253bc92aa2" exitCode=0
Sep 17 14:30:16.798790 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:16.798695    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3da4be-29827590-x2brn" event={"ID":"98583f88-d2c5-41b5-9e55-5843ceef80b8","Type":"ContainerDied","Data":"3094b731a7df456cb1ded0196e69df1531e34e94b824438fc7c271253bc92aa2"}
Sep 17 14:30:16.826923 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:16.826871    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j" podStartSLOduration=1.826852976 podStartE2EDuration="1.826852976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:30:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:30:16.826167368 +0000 UTC m=+1404.270242954" watchObservedRunningTime="2026-09-17 14:30:16.826852976 +0000 UTC m=+1404.270928634"
Sep 17 14:30:17.611203 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:17.611133    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:17.617155 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:17.617117    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:17.805432 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:17.805391    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:17.807347 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:17.807321    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:17.974760 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:17.974706    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3da4be-29827590-x2brn"
Sep 17 14:30:18.812515 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:18.812485    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3da4be-29827590-x2brn"
Sep 17 14:30:18.813000 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:18.812525    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3da4be-29827590-x2brn" event={"ID":"98583f88-d2c5-41b5-9e55-5843ceef80b8","Type":"ContainerDied","Data":"95389a3144d0bcb008152888091888f5ad028b31a4b31b08002ade3c3eaf348e"}
Sep 17 14:30:18.813000 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:18.812576    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95389a3144d0bcb008152888091888f5ad028b31a4b31b08002ade3c3eaf348e"
Sep 17 14:30:20.331342 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:20.331303    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5"]
Sep 17 14:30:20.332034 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:20.332013    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98583f88-d2c5-41b5-9e55-5843ceef80b8" containerName="cleanup"
Sep 17 14:30:20.332201 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:20.332181    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="98583f88-d2c5-41b5-9e55-5843ceef80b8" containerName="cleanup"
Sep 17 14:30:20.332547 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:20.332352    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="98583f88-d2c5-41b5-9e55-5843ceef80b8" containerName="cleanup"
Sep 17 14:30:20.338524 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:20.338497    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5"
Sep 17 14:30:20.342682 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:20.342657    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-b48b7c-serving-cert\""
Sep 17 14:30:20.357269 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:20.357238    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5"]
Sep 17 14:30:20.373319 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:20.373282    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/420d1704-ba0b-4c1e-a204-19584ad2087d-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5\" (UID: \"420d1704-ba0b-4c1e-a204-19584ad2087d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5"
Sep 17 14:30:20.373319 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:20.373322    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/420d1704-ba0b-4c1e-a204-19584ad2087d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5\" (UID: \"420d1704-ba0b-4c1e-a204-19584ad2087d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5"
Sep 17 14:30:20.373586 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:20.373427    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/420d1704-ba0b-4c1e-a204-19584ad2087d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5\" (UID: \"420d1704-ba0b-4c1e-a204-19584ad2087d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5"
Sep 17 14:30:20.373586 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:20.373498    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75mh5\" (UniqueName: \"kubernetes.io/projected/420d1704-ba0b-4c1e-a204-19584ad2087d-kube-api-access-75mh5\") pod \"maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5\" (UID: \"420d1704-ba0b-4c1e-a204-19584ad2087d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5"
Sep 17 14:30:20.474580 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:20.474531    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75mh5\" (UniqueName: \"kubernetes.io/projected/420d1704-ba0b-4c1e-a204-19584ad2087d-kube-api-access-75mh5\") pod \"maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5\" (UID: \"420d1704-ba0b-4c1e-a204-19584ad2087d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5"
Sep 17 14:30:20.474830 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:20.474640    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/420d1704-ba0b-4c1e-a204-19584ad2087d-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5\" (UID: \"420d1704-ba0b-4c1e-a204-19584ad2087d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5"
Sep 17 14:30:20.474830 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:20.474668    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/420d1704-ba0b-4c1e-a204-19584ad2087d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5\" (UID: \"420d1704-ba0b-4c1e-a204-19584ad2087d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5"
Sep 17 14:30:20.474830 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:20.474791    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/420d1704-ba0b-4c1e-a204-19584ad2087d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5\" (UID: \"420d1704-ba0b-4c1e-a204-19584ad2087d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5"
Sep 17 14:30:20.474999 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:30:20.474944    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-serving-cert: secret "maas-api-e2e-shared-b-w3-b48b7c-serving-cert" not found
Sep 17 14:30:20.475045 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:30:20.475031    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/420d1704-ba0b-4c1e-a204-19584ad2087d-maas-api-tls podName:420d1704-ba0b-4c1e-a204-19584ad2087d nodeName:}" failed. No retries permitted until 2026-09-17 14:30:20.975009844 +0000 UTC m=+1408.419085413 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/420d1704-ba0b-4c1e-a204-19584ad2087d-maas-api-tls") pod "maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5" (UID: "420d1704-ba0b-4c1e-a204-19584ad2087d") : secret "maas-api-e2e-shared-b-w3-b48b7c-serving-cert" not found
Sep 17 14:30:20.475557 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:20.475535    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/420d1704-ba0b-4c1e-a204-19584ad2087d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5\" (UID: \"420d1704-ba0b-4c1e-a204-19584ad2087d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5"
Sep 17 14:30:20.477189 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:20.477160    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/420d1704-ba0b-4c1e-a204-19584ad2087d-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5\" (UID: \"420d1704-ba0b-4c1e-a204-19584ad2087d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5"
Sep 17 14:30:20.485494 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:20.485462    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75mh5\" (UniqueName: \"kubernetes.io/projected/420d1704-ba0b-4c1e-a204-19584ad2087d-kube-api-access-75mh5\") pod \"maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5\" (UID: \"420d1704-ba0b-4c1e-a204-19584ad2087d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5"
Sep 17 14:30:20.828002 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:20.827968    2580 generic.go:356] "Generic (PLEG): container finished" podID="664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9" containerID="4d673839c13d27439d3664796133e501071e03dc7a66b5632ff6f611191d6071" exitCode=0
Sep 17 14:30:20.828182 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:20.828044    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5" event={"ID":"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9","Type":"ContainerDied","Data":"4d673839c13d27439d3664796133e501071e03dc7a66b5632ff6f611191d6071"}
Sep 17 14:30:20.828577 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:20.828560    2580 scope.go:117] "RemoveContainer" containerID="4d673839c13d27439d3664796133e501071e03dc7a66b5632ff6f611191d6071"
Sep 17 14:30:20.829801 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:20.829771    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 14:30:20.829855 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:20.829842    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 14:30:20.829890 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:20.829870    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 14:30:20.981112 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:20.981074    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/420d1704-ba0b-4c1e-a204-19584ad2087d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5\" (UID: \"420d1704-ba0b-4c1e-a204-19584ad2087d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5"
Sep 17 14:30:20.983606 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:20.983571    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/420d1704-ba0b-4c1e-a204-19584ad2087d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5\" (UID: \"420d1704-ba0b-4c1e-a204-19584ad2087d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5"
Sep 17 14:30:21.250581 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:21.250531    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5"
Sep 17 14:30:21.551418 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:21.551319    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5"]
Sep 17 14:30:21.554161 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:30:21.554119    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod420d1704_ba0b_4c1e_a204_19584ad2087d.slice/crio-30e0d40cca9774435f257aca8f01503a0d9b787fe758370991f1ebb520633023 WatchSource:0}: Error finding container 30e0d40cca9774435f257aca8f01503a0d9b787fe758370991f1ebb520633023: Status 404 returned error can't find the container with id 30e0d40cca9774435f257aca8f01503a0d9b787fe758370991f1ebb520633023
Sep 17 14:30:21.555652 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:21.555632    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 14:30:21.836132 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:21.836035    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5" event={"ID":"420d1704-ba0b-4c1e-a204-19584ad2087d","Type":"ContainerStarted","Data":"30e0d40cca9774435f257aca8f01503a0d9b787fe758370991f1ebb520633023"}
Sep 17 14:30:21.838206 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:21.838181    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5" event={"ID":"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9","Type":"ContainerStarted","Data":"59c9e2ae55a03b0701204f342717d0de301d3418cde79dd2d40ad1cb6f6867a8"}
Sep 17 14:30:22.393008 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:22.392968    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:30:22.393255 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:22.393231    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 17 14:30:22.393312 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:22.393281    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5" podUID="664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 17 14:30:22.846206 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:22.846170    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5" event={"ID":"420d1704-ba0b-4c1e-a204-19584ad2087d","Type":"ContainerStarted","Data":"a6f30913344f687b53652e5f951731630262dfd1bb701965b3ad9cf0170040a9"}
Sep 17 14:30:22.846613 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:22.846345    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5"
Sep 17 14:30:22.879543 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:22.879477    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5" podStartSLOduration=2.542216881 podStartE2EDuration="2.879457597s" totalImagesPullingTime="337.240716ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:30:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:30:22.876531723 +0000 UTC m=+1410.320607334" watchObservedRunningTime="2026-09-17 14:30:22.879457597 +0000 UTC m=+1410.323533182"
Sep 17 14:30:23.392613 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:23.392577    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 17 14:30:23.392843 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:23.392633    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5" podUID="664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 17 14:30:24.392583 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:24.392537    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 17 14:30:24.393026 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:24.392602    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5" podUID="664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 17 14:30:25.393148 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:25.393107    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 17 14:30:25.393652 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:25.393176    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5" podUID="664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 17 14:30:26.393342 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:26.393302    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 17 14:30:26.393847 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:26.393374    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5" podUID="664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 17 14:30:27.393339 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:27.393290    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 17 14:30:27.393529 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:27.393356    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5" podUID="664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 17 14:30:28.397420 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:28.397388    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:30:28.397897 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:28.397795    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:30:28.398577 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:28.398557    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:30:28.864492 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:28.864457    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5"
Sep 17 14:30:38.229605 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:38.229563    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"]
Sep 17 14:30:44.957132 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:44.957084    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:30:53.249758 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:53.249696    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927" podUID="cce1095c-b797-4f9d-869a-cc0ea0a59a49" containerName="main" containerID="cri-o://b73167b755c5cbb532e2ef0b349be761f532879fc4abfdd520f879fdf03873fa" gracePeriod=45
Sep 17 14:30:53.516740 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:53.516664    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"
Sep 17 14:30:53.623551 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:53.623505    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cce1095c-b797-4f9d-869a-cc0ea0a59a49-tls-certs\") pod \"cce1095c-b797-4f9d-869a-cc0ea0a59a49\" (UID: \"cce1095c-b797-4f9d-869a-cc0ea0a59a49\") "
Sep 17 14:30:53.623781 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:53.623566    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88nwx\" (UniqueName: \"kubernetes.io/projected/cce1095c-b797-4f9d-869a-cc0ea0a59a49-kube-api-access-88nwx\") pod \"cce1095c-b797-4f9d-869a-cc0ea0a59a49\" (UID: \"cce1095c-b797-4f9d-869a-cc0ea0a59a49\") "
Sep 17 14:30:53.623781 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:53.623608    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cce1095c-b797-4f9d-869a-cc0ea0a59a49-home\") pod \"cce1095c-b797-4f9d-869a-cc0ea0a59a49\" (UID: \"cce1095c-b797-4f9d-869a-cc0ea0a59a49\") "
Sep 17 14:30:53.623781 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:53.623733    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cce1095c-b797-4f9d-869a-cc0ea0a59a49-tmp-dir\") pod \"cce1095c-b797-4f9d-869a-cc0ea0a59a49\" (UID: \"cce1095c-b797-4f9d-869a-cc0ea0a59a49\") "
Sep 17 14:30:53.623944 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:53.623803    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cce1095c-b797-4f9d-869a-cc0ea0a59a49-dshm\") pod \"cce1095c-b797-4f9d-869a-cc0ea0a59a49\" (UID: \"cce1095c-b797-4f9d-869a-cc0ea0a59a49\") "
Sep 17 14:30:53.623944 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:53.623828    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cce1095c-b797-4f9d-869a-cc0ea0a59a49-model-cache\") pod \"cce1095c-b797-4f9d-869a-cc0ea0a59a49\" (UID: \"cce1095c-b797-4f9d-869a-cc0ea0a59a49\") "
Sep 17 14:30:53.623944 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:53.623883    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cce1095c-b797-4f9d-869a-cc0ea0a59a49-home" (OuterVolumeSpecName: "home") pod "cce1095c-b797-4f9d-869a-cc0ea0a59a49" (UID: "cce1095c-b797-4f9d-869a-cc0ea0a59a49"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:30:53.624086 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:53.623996    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cce1095c-b797-4f9d-869a-cc0ea0a59a49-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cce1095c-b797-4f9d-869a-cc0ea0a59a49" (UID: "cce1095c-b797-4f9d-869a-cc0ea0a59a49"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:30:53.624435 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:53.624242    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cce1095c-b797-4f9d-869a-cc0ea0a59a49-model-cache" (OuterVolumeSpecName: "model-cache") pod "cce1095c-b797-4f9d-869a-cc0ea0a59a49" (UID: "cce1095c-b797-4f9d-869a-cc0ea0a59a49"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:30:53.624435 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:53.624358    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cce1095c-b797-4f9d-869a-cc0ea0a59a49-home\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:30:53.624435 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:53.624375    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cce1095c-b797-4f9d-869a-cc0ea0a59a49-tmp-dir\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:30:53.624435 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:53.624390    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cce1095c-b797-4f9d-869a-cc0ea0a59a49-model-cache\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:30:53.626050 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:53.626022    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cce1095c-b797-4f9d-869a-cc0ea0a59a49-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cce1095c-b797-4f9d-869a-cc0ea0a59a49" (UID: "cce1095c-b797-4f9d-869a-cc0ea0a59a49"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:30:53.626266 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:53.626247    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cce1095c-b797-4f9d-869a-cc0ea0a59a49-dshm" (OuterVolumeSpecName: "dshm") pod "cce1095c-b797-4f9d-869a-cc0ea0a59a49" (UID: "cce1095c-b797-4f9d-869a-cc0ea0a59a49"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:30:53.626326 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:53.626279    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cce1095c-b797-4f9d-869a-cc0ea0a59a49-kube-api-access-88nwx" (OuterVolumeSpecName: "kube-api-access-88nwx") pod "cce1095c-b797-4f9d-869a-cc0ea0a59a49" (UID: "cce1095c-b797-4f9d-869a-cc0ea0a59a49"). InnerVolumeSpecName "kube-api-access-88nwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:30:53.725133 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:53.725091    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cce1095c-b797-4f9d-869a-cc0ea0a59a49-dshm\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:30:53.725133 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:53.725124    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cce1095c-b797-4f9d-869a-cc0ea0a59a49-tls-certs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:30:53.725133 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:53.725136    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88nwx\" (UniqueName: \"kubernetes.io/projected/cce1095c-b797-4f9d-869a-cc0ea0a59a49-kube-api-access-88nwx\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:30:54.064197 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:54.064165    2580 generic.go:356] "Generic (PLEG): container finished" podID="cce1095c-b797-4f9d-869a-cc0ea0a59a49" containerID="b73167b755c5cbb532e2ef0b349be761f532879fc4abfdd520f879fdf03873fa" exitCode=0
Sep 17 14:30:54.064376 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:54.064236    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"
Sep 17 14:30:54.064376 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:54.064255    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927" event={"ID":"cce1095c-b797-4f9d-869a-cc0ea0a59a49","Type":"ContainerDied","Data":"b73167b755c5cbb532e2ef0b349be761f532879fc4abfdd520f879fdf03873fa"}
Sep 17 14:30:54.064376 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:54.064309    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927" event={"ID":"cce1095c-b797-4f9d-869a-cc0ea0a59a49","Type":"ContainerDied","Data":"ed541881ff5baabe3b5e64478661ca7d501f5fddf30c27f3b4ab53ce25980141"}
Sep 17 14:30:54.064376 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:54.064332    2580 scope.go:117] "RemoveContainer" containerID="b73167b755c5cbb532e2ef0b349be761f532879fc4abfdd520f879fdf03873fa"
Sep 17 14:30:54.074924 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:54.074897    2580 scope.go:117] "RemoveContainer" containerID="b73167b755c5cbb532e2ef0b349be761f532879fc4abfdd520f879fdf03873fa"
Sep 17 14:30:54.075268 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:30:54.075246    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b73167b755c5cbb532e2ef0b349be761f532879fc4abfdd520f879fdf03873fa\": container with ID starting with b73167b755c5cbb532e2ef0b349be761f532879fc4abfdd520f879fdf03873fa not found: ID does not exist" containerID="b73167b755c5cbb532e2ef0b349be761f532879fc4abfdd520f879fdf03873fa"
Sep 17 14:30:54.075329 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:54.075279    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b73167b755c5cbb532e2ef0b349be761f532879fc4abfdd520f879fdf03873fa"} err="failed to get container status \"b73167b755c5cbb532e2ef0b349be761f532879fc4abfdd520f879fdf03873fa\": rpc error: code = NotFound desc = could not find container \"b73167b755c5cbb532e2ef0b349be761f532879fc4abfdd520f879fdf03873fa\": container with ID starting with b73167b755c5cbb532e2ef0b349be761f532879fc4abfdd520f879fdf03873fa not found: ID does not exist"
Sep 17 14:30:54.091365 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:54.091332    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"]
Sep 17 14:30:54.097281 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:54.097250    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-8b50f2/e2e-conflict-b-4102a62c-kserve-594c685f48-fz927"]
Sep 17 14:30:55.179802 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:55.179769    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cce1095c-b797-4f9d-869a-cc0ea0a59a49" path="/var/lib/kubelet/pods/cce1095c-b797-4f9d-869a-cc0ea0a59a49/volumes"
Sep 17 14:30:56.079653 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:56.079571    2580 generic.go:356] "Generic (PLEG): container finished" podID="5c059d46-ed55-4ff1-90a7-2c2f1c99ae30" containerID="dc1521c8dccec6f7ad4eb21519408b0cf0c2742ce8d128ab2bb356feb0751b50" exitCode=0
Sep 17 14:30:56.079653 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:56.079632    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j" event={"ID":"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30","Type":"ContainerDied","Data":"dc1521c8dccec6f7ad4eb21519408b0cf0c2742ce8d128ab2bb356feb0751b50"}
Sep 17 14:30:56.080089 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:56.080074    2580 scope.go:117] "RemoveContainer" containerID="dc1521c8dccec6f7ad4eb21519408b0cf0c2742ce8d128ab2bb356feb0751b50"
Sep 17 14:30:56.081255 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:56.081227    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 14:30:56.081347 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:56.081292    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 14:30:56.081347 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:56.081323    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 14:30:57.088287 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:57.088248    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j" event={"ID":"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30","Type":"ContainerStarted","Data":"6b42de1bb666b253159e21f8b9bfd2a89c045b9c912c8d86dbf152acf9ade6a3"}
Sep 17 14:30:57.611029 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:57.610994    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:30:57.611244 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:57.611221    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 17 14:30:57.611307 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:57.611284    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j" podUID="5c059d46-ed55-4ff1-90a7-2c2f1c99ae30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 17 14:30:58.612033 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:58.611991    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 17 14:30:58.612435 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:58.612050    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j" podUID="5c059d46-ed55-4ff1-90a7-2c2f1c99ae30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 17 14:30:59.611577 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:59.611530    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 17 14:30:59.611800 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:30:59.611600    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j" podUID="5c059d46-ed55-4ff1-90a7-2c2f1c99ae30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 17 14:31:00.611872 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:00.611824    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 17 14:31:00.612378 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:00.611894    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j" podUID="5c059d46-ed55-4ff1-90a7-2c2f1c99ae30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 17 14:31:01.611577 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:01.611532    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 17 14:31:01.611810 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:01.611614    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j" podUID="5c059d46-ed55-4ff1-90a7-2c2f1c99ae30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 17 14:31:02.615956 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:02.615921    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:31:02.616329 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:02.616202    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:31:02.616850 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:02.616833    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:31:26.217790 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:26.217752    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:31:28.359630 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:28.359594    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq"]
Sep 17 14:31:28.360100 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:28.359894    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq" podUID="b926020c-5e42-4411-894c-a071977e14a1" containerName="maas-api" containerID="cri-o://8c479c67e5fbdf3908b9f3b7657f5d95e01b61ffca7c8955e3ab033fc9f9c8a6" gracePeriod=30
Sep 17 14:31:28.602428 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:28.602402    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq"
Sep 17 14:31:28.679339 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:28.679242    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b926020c-5e42-4411-894c-a071977e14a1-openshift-service-ca\") pod \"b926020c-5e42-4411-894c-a071977e14a1\" (UID: \"b926020c-5e42-4411-894c-a071977e14a1\") "
Sep 17 14:31:28.679339 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:28.679318    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b926020c-5e42-4411-894c-a071977e14a1-maas-api-tls\") pod \"b926020c-5e42-4411-894c-a071977e14a1\" (UID: \"b926020c-5e42-4411-894c-a071977e14a1\") "
Sep 17 14:31:28.679524 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:28.679355    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b926020c-5e42-4411-894c-a071977e14a1-metrics-certs\") pod \"b926020c-5e42-4411-894c-a071977e14a1\" (UID: \"b926020c-5e42-4411-894c-a071977e14a1\") "
Sep 17 14:31:28.679524 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:28.679374    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsk2m\" (UniqueName: \"kubernetes.io/projected/b926020c-5e42-4411-894c-a071977e14a1-kube-api-access-hsk2m\") pod \"b926020c-5e42-4411-894c-a071977e14a1\" (UID: \"b926020c-5e42-4411-894c-a071977e14a1\") "
Sep 17 14:31:28.679760 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:28.679693    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b926020c-5e42-4411-894c-a071977e14a1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b926020c-5e42-4411-894c-a071977e14a1" (UID: "b926020c-5e42-4411-894c-a071977e14a1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:31:28.681557 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:28.681526    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b926020c-5e42-4411-894c-a071977e14a1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b926020c-5e42-4411-894c-a071977e14a1" (UID: "b926020c-5e42-4411-894c-a071977e14a1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:31:28.681648 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:28.681619    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b926020c-5e42-4411-894c-a071977e14a1-kube-api-access-hsk2m" (OuterVolumeSpecName: "kube-api-access-hsk2m") pod "b926020c-5e42-4411-894c-a071977e14a1" (UID: "b926020c-5e42-4411-894c-a071977e14a1"). InnerVolumeSpecName "kube-api-access-hsk2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:31:28.681687 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:28.681632    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b926020c-5e42-4411-894c-a071977e14a1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b926020c-5e42-4411-894c-a071977e14a1" (UID: "b926020c-5e42-4411-894c-a071977e14a1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:31:28.780346 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:28.780316    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b926020c-5e42-4411-894c-a071977e14a1-maas-api-tls\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:31:28.780346 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:28.780342    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b926020c-5e42-4411-894c-a071977e14a1-metrics-certs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:31:28.780346 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:28.780351    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsk2m\" (UniqueName: \"kubernetes.io/projected/b926020c-5e42-4411-894c-a071977e14a1-kube-api-access-hsk2m\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:31:28.780577 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:28.780360    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b926020c-5e42-4411-894c-a071977e14a1-openshift-service-ca\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:31:29.300907 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:29.300863    2580 generic.go:356] "Generic (PLEG): container finished" podID="b926020c-5e42-4411-894c-a071977e14a1" containerID="8c479c67e5fbdf3908b9f3b7657f5d95e01b61ffca7c8955e3ab033fc9f9c8a6" exitCode=0
Sep 17 14:31:29.301093 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:29.300927    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq"
Sep 17 14:31:29.301093 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:29.300929    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq" event={"ID":"b926020c-5e42-4411-894c-a071977e14a1","Type":"ContainerDied","Data":"8c479c67e5fbdf3908b9f3b7657f5d95e01b61ffca7c8955e3ab033fc9f9c8a6"}
Sep 17 14:31:29.301093 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:29.301042    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq" event={"ID":"b926020c-5e42-4411-894c-a071977e14a1","Type":"ContainerDied","Data":"add24612ad7d00dc8883fdc9204b7fa4b03f5083623ecce9f53468776f502d07"}
Sep 17 14:31:29.301093 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:29.301070    2580 scope.go:117] "RemoveContainer" containerID="8c479c67e5fbdf3908b9f3b7657f5d95e01b61ffca7c8955e3ab033fc9f9c8a6"
Sep 17 14:31:29.311325 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:29.311301    2580 scope.go:117] "RemoveContainer" containerID="8c479c67e5fbdf3908b9f3b7657f5d95e01b61ffca7c8955e3ab033fc9f9c8a6"
Sep 17 14:31:29.311625 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:31:29.311606    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c479c67e5fbdf3908b9f3b7657f5d95e01b61ffca7c8955e3ab033fc9f9c8a6\": container with ID starting with 8c479c67e5fbdf3908b9f3b7657f5d95e01b61ffca7c8955e3ab033fc9f9c8a6 not found: ID does not exist" containerID="8c479c67e5fbdf3908b9f3b7657f5d95e01b61ffca7c8955e3ab033fc9f9c8a6"
Sep 17 14:31:29.311702 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:29.311633    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c479c67e5fbdf3908b9f3b7657f5d95e01b61ffca7c8955e3ab033fc9f9c8a6"} err="failed to get container status \"8c479c67e5fbdf3908b9f3b7657f5d95e01b61ffca7c8955e3ab033fc9f9c8a6\": rpc error: code = NotFound desc = could not find container \"8c479c67e5fbdf3908b9f3b7657f5d95e01b61ffca7c8955e3ab033fc9f9c8a6\": container with ID starting with 8c479c67e5fbdf3908b9f3b7657f5d95e01b61ffca7c8955e3ab033fc9f9c8a6 not found: ID does not exist"
Sep 17 14:31:29.320382 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:29.320350    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq"]
Sep 17 14:31:29.326774 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:29.326740    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d2d17aff-cfd965cb9-rhdlq"]
Sep 17 14:31:31.178004 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:31.177971    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b926020c-5e42-4411-894c-a071977e14a1" path="/var/lib/kubelet/pods/b926020c-5e42-4411-894c-a071977e14a1/volumes"
Sep 17 14:31:55.430882 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:31:55.430845    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:32:28.751169 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:28.751074    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:32:31.305490 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:31.305449    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"]
Sep 17 14:32:31.305900 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:31.305887    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cce1095c-b797-4f9d-869a-cc0ea0a59a49" containerName="main"
Sep 17 14:32:31.305900 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:31.305901    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cce1095c-b797-4f9d-869a-cc0ea0a59a49" containerName="main"
Sep 17 14:32:31.305980 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:31.305920    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b926020c-5e42-4411-894c-a071977e14a1" containerName="maas-api"
Sep 17 14:32:31.305980 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:31.305925    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b926020c-5e42-4411-894c-a071977e14a1" containerName="maas-api"
Sep 17 14:32:31.306048 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:31.305995    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cce1095c-b797-4f9d-869a-cc0ea0a59a49" containerName="main"
Sep 17 14:32:31.306048 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:31.306003    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b926020c-5e42-4411-894c-a071977e14a1" containerName="maas-api"
Sep 17 14:32:31.308194 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:31.308177    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"
Sep 17 14:32:31.311025 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:31.310999    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-080801\"/\"embedding-w0-080801-kserve-self-signed-certs\""
Sep 17 14:32:31.320452 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:31.320415    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"]
Sep 17 14:32:31.403986 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:31.403945    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-tls-certs\") pod \"embedding-w0-080801-kserve-55558c4457-8ql67\" (UID: \"4c24cbb4-2904-4a2e-8482-96b1236d9ed7\") " pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"
Sep 17 14:32:31.403986 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:31.403988    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-home\") pod \"embedding-w0-080801-kserve-55558c4457-8ql67\" (UID: \"4c24cbb4-2904-4a2e-8482-96b1236d9ed7\") " pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"
Sep 17 14:32:31.404202 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:31.404064    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-dshm\") pod \"embedding-w0-080801-kserve-55558c4457-8ql67\" (UID: \"4c24cbb4-2904-4a2e-8482-96b1236d9ed7\") " pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"
Sep 17 14:32:31.404202 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:31.404143    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64ldr\" (UniqueName: \"kubernetes.io/projected/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-kube-api-access-64ldr\") pod \"embedding-w0-080801-kserve-55558c4457-8ql67\" (UID: \"4c24cbb4-2904-4a2e-8482-96b1236d9ed7\") " pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"
Sep 17 14:32:31.404281 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:31.404203    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-tmp-dir\") pod \"embedding-w0-080801-kserve-55558c4457-8ql67\" (UID: \"4c24cbb4-2904-4a2e-8482-96b1236d9ed7\") " pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"
Sep 17 14:32:31.404281 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:31.404230    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-model-cache\") pod \"embedding-w0-080801-kserve-55558c4457-8ql67\" (UID: \"4c24cbb4-2904-4a2e-8482-96b1236d9ed7\") " pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"
Sep 17 14:32:31.505366 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:31.505312    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-model-cache\") pod \"embedding-w0-080801-kserve-55558c4457-8ql67\" (UID: \"4c24cbb4-2904-4a2e-8482-96b1236d9ed7\") " pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"
Sep 17 14:32:31.505366 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:31.505379    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-tls-certs\") pod \"embedding-w0-080801-kserve-55558c4457-8ql67\" (UID: \"4c24cbb4-2904-4a2e-8482-96b1236d9ed7\") " pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"
Sep 17 14:32:31.505604 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:31.505399    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-home\") pod \"embedding-w0-080801-kserve-55558c4457-8ql67\" (UID: \"4c24cbb4-2904-4a2e-8482-96b1236d9ed7\") " pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"
Sep 17 14:32:31.505604 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:31.505428    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-dshm\") pod \"embedding-w0-080801-kserve-55558c4457-8ql67\" (UID: \"4c24cbb4-2904-4a2e-8482-96b1236d9ed7\") " pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"
Sep 17 14:32:31.505754 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:31.505598    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64ldr\" (UniqueName: \"kubernetes.io/projected/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-kube-api-access-64ldr\") pod \"embedding-w0-080801-kserve-55558c4457-8ql67\" (UID: \"4c24cbb4-2904-4a2e-8482-96b1236d9ed7\") " pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"
Sep 17 14:32:31.505754 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:31.505707    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-tmp-dir\") pod \"embedding-w0-080801-kserve-55558c4457-8ql67\" (UID: \"4c24cbb4-2904-4a2e-8482-96b1236d9ed7\") " pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"
Sep 17 14:32:31.505885 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:31.505837    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-model-cache\") pod \"embedding-w0-080801-kserve-55558c4457-8ql67\" (UID: \"4c24cbb4-2904-4a2e-8482-96b1236d9ed7\") " pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"
Sep 17 14:32:31.505948 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:31.505918    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-home\") pod \"embedding-w0-080801-kserve-55558c4457-8ql67\" (UID: \"4c24cbb4-2904-4a2e-8482-96b1236d9ed7\") " pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"
Sep 17 14:32:31.506086 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:31.506063    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-tmp-dir\") pod \"embedding-w0-080801-kserve-55558c4457-8ql67\" (UID: \"4c24cbb4-2904-4a2e-8482-96b1236d9ed7\") " pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"
Sep 17 14:32:31.507695 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:31.507673    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-dshm\") pod \"embedding-w0-080801-kserve-55558c4457-8ql67\" (UID: \"4c24cbb4-2904-4a2e-8482-96b1236d9ed7\") " pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"
Sep 17 14:32:31.508028 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:31.508009    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-tls-certs\") pod \"embedding-w0-080801-kserve-55558c4457-8ql67\" (UID: \"4c24cbb4-2904-4a2e-8482-96b1236d9ed7\") " pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"
Sep 17 14:32:31.515164 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:31.515143    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64ldr\" (UniqueName: \"kubernetes.io/projected/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-kube-api-access-64ldr\") pod \"embedding-w0-080801-kserve-55558c4457-8ql67\" (UID: \"4c24cbb4-2904-4a2e-8482-96b1236d9ed7\") " pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"
Sep 17 14:32:31.617266 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:31.617154    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"
Sep 17 14:32:31.903840 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:31.903803    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"]
Sep 17 14:32:31.904739 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:32:31.904688    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c24cbb4_2904_4a2e_8482_96b1236d9ed7.slice/crio-ff45b7e973f5f409427764e7696162e4ccb09cc03acc1f44d6aad7b87d3a8305 WatchSource:0}: Error finding container ff45b7e973f5f409427764e7696162e4ccb09cc03acc1f44d6aad7b87d3a8305: Status 404 returned error can't find the container with id ff45b7e973f5f409427764e7696162e4ccb09cc03acc1f44d6aad7b87d3a8305
Sep 17 14:32:32.719678 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:32.719639    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67" event={"ID":"4c24cbb4-2904-4a2e-8482-96b1236d9ed7","Type":"ContainerStarted","Data":"3ca55665bf9ff0641dd08d8531792efeabd66fb1ec14ce3b0b9ffa69b3b410c0"}
Sep 17 14:32:32.720204 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:32.719692    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67" event={"ID":"4c24cbb4-2904-4a2e-8482-96b1236d9ed7","Type":"ContainerStarted","Data":"ff45b7e973f5f409427764e7696162e4ccb09cc03acc1f44d6aad7b87d3a8305"}
Sep 17 14:32:32.743922 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:32.743859    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67" podStartSLOduration=1.7438418329999998 podStartE2EDuration="1.743841833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:32:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:32:32.742853542 +0000 UTC m=+1540.186929129" watchObservedRunningTime="2026-09-17 14:32:32.743841833 +0000 UTC m=+1540.187917419"
Sep 17 14:32:41.617938 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:41.617898    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"
Sep 17 14:32:41.618314 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:41.617977    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"
Sep 17 14:32:41.630621 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:41.630590    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"
Sep 17 14:32:41.785600 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:32:41.785567    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"
Sep 17 14:33:05.287051 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:05.287012    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:33:54.134774 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:54.134740    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:33:56.421867 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.421834    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"]
Sep 17 14:33:56.425104 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.425068    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:56.428031 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.428006    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-29d3c7-openshift-default-dockercfg-8g2qj\""
Sep 17 14:33:56.439279 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.439248    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"]
Sep 17 14:33:56.482008 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.481968    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aebd6b3a-1ed0-47d2-bdb4-20136237b893-istiod-ca-cert\") pod \"e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") " pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:56.482218 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.482015    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aebd6b3a-1ed0-47d2-bdb4-20136237b893-istio-envoy\") pod \"e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") " pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:56.482218 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.482083    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aebd6b3a-1ed0-47d2-bdb4-20136237b893-workload-socket\") pod \"e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") " pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:56.482218 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.482128    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aebd6b3a-1ed0-47d2-bdb4-20136237b893-workload-certs\") pod \"e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") " pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:56.482218 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.482146    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aebd6b3a-1ed0-47d2-bdb4-20136237b893-credential-socket\") pod \"e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") " pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:56.482218 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.482180    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aebd6b3a-1ed0-47d2-bdb4-20136237b893-istio-podinfo\") pod \"e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") " pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:56.482218 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.482198    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tll9j\" (UniqueName: \"kubernetes.io/projected/aebd6b3a-1ed0-47d2-bdb4-20136237b893-kube-api-access-tll9j\") pod \"e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") " pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:56.482567 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.482254    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aebd6b3a-1ed0-47d2-bdb4-20136237b893-istio-data\") pod \"e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") " pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:56.482567 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.482287    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aebd6b3a-1ed0-47d2-bdb4-20136237b893-istio-token\") pod \"e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") " pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:56.583380 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.583335    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aebd6b3a-1ed0-47d2-bdb4-20136237b893-istio-data\") pod \"e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") " pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:56.583562 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.583408    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aebd6b3a-1ed0-47d2-bdb4-20136237b893-istio-token\") pod \"e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") " pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:56.583562 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.583464    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aebd6b3a-1ed0-47d2-bdb4-20136237b893-istiod-ca-cert\") pod \"e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") " pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:56.583562 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.583503    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aebd6b3a-1ed0-47d2-bdb4-20136237b893-istio-envoy\") pod \"e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") " pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:56.583562 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.583536    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aebd6b3a-1ed0-47d2-bdb4-20136237b893-workload-socket\") pod \"e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") " pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:56.583808 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.583574    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aebd6b3a-1ed0-47d2-bdb4-20136237b893-workload-certs\") pod \"e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") " pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:56.583808 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.583745    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aebd6b3a-1ed0-47d2-bdb4-20136237b893-istio-data\") pod \"e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") " pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:56.584010 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.583982    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aebd6b3a-1ed0-47d2-bdb4-20136237b893-workload-socket\") pod \"e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") " pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:56.584151 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.584032    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aebd6b3a-1ed0-47d2-bdb4-20136237b893-credential-socket\") pod \"e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") " pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:56.584151 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.584077    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aebd6b3a-1ed0-47d2-bdb4-20136237b893-credential-socket\") pod \"e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") " pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:56.584151 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.584139    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aebd6b3a-1ed0-47d2-bdb4-20136237b893-istio-podinfo\") pod \"e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") " pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:56.584376 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.584169    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tll9j\" (UniqueName: \"kubernetes.io/projected/aebd6b3a-1ed0-47d2-bdb4-20136237b893-kube-api-access-tll9j\") pod \"e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") " pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:56.584376 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.584279    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aebd6b3a-1ed0-47d2-bdb4-20136237b893-istiod-ca-cert\") pod \"e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") " pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:56.584459 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.584435    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aebd6b3a-1ed0-47d2-bdb4-20136237b893-workload-certs\") pod \"e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") " pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:56.585971 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.585952    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aebd6b3a-1ed0-47d2-bdb4-20136237b893-istio-envoy\") pod \"e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") " pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:56.586520 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.586505    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aebd6b3a-1ed0-47d2-bdb4-20136237b893-istio-podinfo\") pod \"e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") " pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:56.593068 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.593039    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aebd6b3a-1ed0-47d2-bdb4-20136237b893-istio-token\") pod \"e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") " pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:56.593191 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.593148    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tll9j\" (UniqueName: \"kubernetes.io/projected/aebd6b3a-1ed0-47d2-bdb4-20136237b893-kube-api-access-tll9j\") pod \"e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") " pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:56.738395 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:56.738355    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:57.015493 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:57.015447    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"]
Sep 17 14:33:57.017535 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:33:57.017506    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaebd6b3a_1ed0_47d2_bdb4_20136237b893.slice/crio-bb7d80340ac3cde50ec96f26515d98d3d8090fa365166da2cc173f22a6318d99 WatchSource:0}: Error finding container bb7d80340ac3cde50ec96f26515d98d3d8090fa365166da2cc173f22a6318d99: Status 404 returned error can't find the container with id bb7d80340ac3cde50ec96f26515d98d3d8090fa365166da2cc173f22a6318d99
Sep 17 14:33:57.020042 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:57.020008    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 14:33:57.020119 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:57.020080    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 14:33:57.020119 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:57.020108    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 14:33:57.234991 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:57.234957    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd" event={"ID":"aebd6b3a-1ed0-47d2-bdb4-20136237b893","Type":"ContainerStarted","Data":"b62cf87c2b81f4f7b40a469177f5e8b3b46a4271300ffdb1efc73e9e6202fa55"}
Sep 17 14:33:57.235173 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:57.235018    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd" event={"ID":"aebd6b3a-1ed0-47d2-bdb4-20136237b893","Type":"ContainerStarted","Data":"bb7d80340ac3cde50ec96f26515d98d3d8090fa365166da2cc173f22a6318d99"}
Sep 17 14:33:57.255666 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:57.255597    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd" podStartSLOduration=1.25557699 podStartE2EDuration="1.25557699s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:33:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:33:57.255100578 +0000 UTC m=+1624.699176186" watchObservedRunningTime="2026-09-17 14:33:57.25557699 +0000 UTC m=+1624.699652577"
Sep 17 14:33:57.739067 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:57.739023    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:58.744820 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:58.744788    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:59.248142 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:59.248112    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:33:59.248999 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:33:59.248978    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:34:03.725378 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:03.725336    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn"]
Sep 17 14:34:03.729288 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:03.729260    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn"
Sep 17 14:34:03.732087 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:03.732063    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-29d3c7-serving-cert\""
Sep 17 14:34:03.741413 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:03.741380    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn"]
Sep 17 14:34:03.762935 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:03.762890    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr9x6\" (UniqueName: \"kubernetes.io/projected/e4bf7d41-bc62-4e18-8035-16cf5b805f29-kube-api-access-rr9x6\") pod \"maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn\" (UID: \"e4bf7d41-bc62-4e18-8035-16cf5b805f29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn"
Sep 17 14:34:03.763110 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:03.763045    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4bf7d41-bc62-4e18-8035-16cf5b805f29-openshift-service-ca\") pod \"maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn\" (UID: \"e4bf7d41-bc62-4e18-8035-16cf5b805f29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn"
Sep 17 14:34:03.763110 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:03.763073    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4bf7d41-bc62-4e18-8035-16cf5b805f29-maas-api-tls\") pod \"maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn\" (UID: \"e4bf7d41-bc62-4e18-8035-16cf5b805f29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn"
Sep 17 14:34:03.763197 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:03.763139    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4bf7d41-bc62-4e18-8035-16cf5b805f29-metrics-certs\") pod \"maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn\" (UID: \"e4bf7d41-bc62-4e18-8035-16cf5b805f29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn"
Sep 17 14:34:03.864491 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:03.864454    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4bf7d41-bc62-4e18-8035-16cf5b805f29-openshift-service-ca\") pod \"maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn\" (UID: \"e4bf7d41-bc62-4e18-8035-16cf5b805f29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn"
Sep 17 14:34:03.864491 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:03.864494    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4bf7d41-bc62-4e18-8035-16cf5b805f29-maas-api-tls\") pod \"maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn\" (UID: \"e4bf7d41-bc62-4e18-8035-16cf5b805f29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn"
Sep 17 14:34:03.864776 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:03.864537    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4bf7d41-bc62-4e18-8035-16cf5b805f29-metrics-certs\") pod \"maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn\" (UID: \"e4bf7d41-bc62-4e18-8035-16cf5b805f29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn"
Sep 17 14:34:03.864776 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:03.864576    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr9x6\" (UniqueName: \"kubernetes.io/projected/e4bf7d41-bc62-4e18-8035-16cf5b805f29-kube-api-access-rr9x6\") pod \"maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn\" (UID: \"e4bf7d41-bc62-4e18-8035-16cf5b805f29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn"
Sep 17 14:34:03.864776 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:34:03.864660    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-serving-cert: secret "maas-api-e2e-api-a-29d3c7-serving-cert" not found
Sep 17 14:34:03.864776 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:34:03.864750    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4bf7d41-bc62-4e18-8035-16cf5b805f29-maas-api-tls podName:e4bf7d41-bc62-4e18-8035-16cf5b805f29 nodeName:}" failed. No retries permitted until 2026-09-17 14:34:04.364727448 +0000 UTC m=+1631.808803027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e4bf7d41-bc62-4e18-8035-16cf5b805f29-maas-api-tls") pod "maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn" (UID: "e4bf7d41-bc62-4e18-8035-16cf5b805f29") : secret "maas-api-e2e-api-a-29d3c7-serving-cert" not found
Sep 17 14:34:03.865185 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:03.865166    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4bf7d41-bc62-4e18-8035-16cf5b805f29-openshift-service-ca\") pod \"maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn\" (UID: \"e4bf7d41-bc62-4e18-8035-16cf5b805f29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn"
Sep 17 14:34:03.867065 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:03.867041    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4bf7d41-bc62-4e18-8035-16cf5b805f29-metrics-certs\") pod \"maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn\" (UID: \"e4bf7d41-bc62-4e18-8035-16cf5b805f29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn"
Sep 17 14:34:03.873616 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:03.873591    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr9x6\" (UniqueName: \"kubernetes.io/projected/e4bf7d41-bc62-4e18-8035-16cf5b805f29-kube-api-access-rr9x6\") pod \"maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn\" (UID: \"e4bf7d41-bc62-4e18-8035-16cf5b805f29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn"
Sep 17 14:34:04.370320 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:04.370278    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4bf7d41-bc62-4e18-8035-16cf5b805f29-maas-api-tls\") pod \"maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn\" (UID: \"e4bf7d41-bc62-4e18-8035-16cf5b805f29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn"
Sep 17 14:34:04.372820 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:04.372796    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4bf7d41-bc62-4e18-8035-16cf5b805f29-maas-api-tls\") pod \"maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn\" (UID: \"e4bf7d41-bc62-4e18-8035-16cf5b805f29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn"
Sep 17 14:34:04.645031 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:04.644940    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn"
Sep 17 14:34:04.934045 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:04.934015    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn"]
Sep 17 14:34:04.935564 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:34:04.935535    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4bf7d41_bc62_4e18_8035_16cf5b805f29.slice/crio-b653c2609cff4a05984b884e6e14e02108751aa8ffe6d55069e550350e3389df WatchSource:0}: Error finding container b653c2609cff4a05984b884e6e14e02108751aa8ffe6d55069e550350e3389df: Status 404 returned error can't find the container with id b653c2609cff4a05984b884e6e14e02108751aa8ffe6d55069e550350e3389df
Sep 17 14:34:05.288979 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:05.288946    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn" event={"ID":"e4bf7d41-bc62-4e18-8035-16cf5b805f29","Type":"ContainerStarted","Data":"b653c2609cff4a05984b884e6e14e02108751aa8ffe6d55069e550350e3389df"}
Sep 17 14:34:06.296936 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:06.296901    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn" event={"ID":"e4bf7d41-bc62-4e18-8035-16cf5b805f29","Type":"ContainerStarted","Data":"d34e28f7a00c2cdbbf6270983d4b932c62f686199c164db404359466be37801f"}
Sep 17 14:34:06.297301 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:06.296979    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn"
Sep 17 14:34:06.321135 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:06.321078    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn" podStartSLOduration=2.9405628569999998 podStartE2EDuration="3.321058834s" totalImagesPullingTime="380.495977ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:34:06.318774991 +0000 UTC m=+1633.762850587" watchObservedRunningTime="2026-09-17 14:34:06.321058834 +0000 UTC m=+1633.765134419"
Sep 17 14:34:12.315124 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:12.315091    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn"
Sep 17 14:34:27.442779 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:27.442744    2580 generic.go:356] "Generic (PLEG): container finished" podID="aebd6b3a-1ed0-47d2-bdb4-20136237b893" containerID="b62cf87c2b81f4f7b40a469177f5e8b3b46a4271300ffdb1efc73e9e6202fa55" exitCode=0
Sep 17 14:34:27.443211 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:27.442800    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd" event={"ID":"aebd6b3a-1ed0-47d2-bdb4-20136237b893","Type":"ContainerDied","Data":"b62cf87c2b81f4f7b40a469177f5e8b3b46a4271300ffdb1efc73e9e6202fa55"}
Sep 17 14:34:27.443281 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:27.443266    2580 scope.go:117] "RemoveContainer" containerID="b62cf87c2b81f4f7b40a469177f5e8b3b46a4271300ffdb1efc73e9e6202fa55"
Sep 17 14:34:27.444466 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:27.444439    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 14:34:27.444548 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:27.444510    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 14:34:27.444586 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:27.444573    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 14:34:28.451032 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:28.450990    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd" event={"ID":"aebd6b3a-1ed0-47d2-bdb4-20136237b893","Type":"ContainerStarted","Data":"1dd0650d585c9bab8071fddb52a408cc11eb7dee1b1b8db4f1e160cebd881757"}
Sep 17 14:34:28.738792 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:28.738663    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:34:28.740058 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:28.740028    2580 patch_prober.go:28] interesting pod/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 17 14:34:28.740193 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:28.740084    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd" podUID="aebd6b3a-1ed0-47d2-bdb4-20136237b893" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 17 14:34:29.148113 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:29.148024    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"]
Sep 17 14:34:29.163740 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:29.163499    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"]
Sep 17 14:34:29.187910 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:29.185644    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"]
Sep 17 14:34:29.203010 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:29.202969    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"]
Sep 17 14:34:29.248182 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:29.248142    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:34:29.739342 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:29.739299    2580 patch_prober.go:28] interesting pod/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 17 14:34:29.739770 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:29.739363    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd" podUID="aebd6b3a-1ed0-47d2-bdb4-20136237b893" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 17 14:34:30.738908 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:30.738871    2580 patch_prober.go:28] interesting pod/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 17 14:34:30.739070 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:30.738930    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd" podUID="aebd6b3a-1ed0-47d2-bdb4-20136237b893" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 17 14:34:31.739731 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:31.739683    2580 patch_prober.go:28] interesting pod/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 17 14:34:31.740146 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:31.739789    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd" podUID="aebd6b3a-1ed0-47d2-bdb4-20136237b893" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 17 14:34:32.739484 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:32.739448    2580 patch_prober.go:28] interesting pod/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 17 14:34:32.739639 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:32.739504    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd" podUID="aebd6b3a-1ed0-47d2-bdb4-20136237b893" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 17 14:34:33.773050 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:33.773008    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:34:33.774286 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:33.774258    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:34:39.837425 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:39.837391    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:34:44.193769 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.193689    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5" podUID="b9451e47-6204-4dc2-996b-dfa47ea039b1" containerName="main" containerID="cri-o://c450e8975dab8eb29f7dbced17a0f0140b437a1b120d2c6b168ddfeabd420a8f" gracePeriod=45
Sep 17 14:34:44.197078 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.197026    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67" podUID="4c24cbb4-2904-4a2e-8482-96b1236d9ed7" containerName="main" containerID="cri-o://3ca55665bf9ff0641dd08d8531792efeabd66fb1ec14ce3b0b9ffa69b3b410c0" gracePeriod=45
Sep 17 14:34:44.206123 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.206057    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z" podUID="7cffa421-5a61-4eb0-ab22-49fdccc497bd" containerName="main" containerID="cri-o://1b5eb444739b37f2c975d00dfe5a84ed72169ee0ce0a92dba942731586942552" gracePeriod=45
Sep 17 14:34:44.223323 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.223257    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht" podUID="70983359-2033-4f9b-ba80-dffc4e33d303" containerName="main" containerID="cri-o://c4a5e0e0ced982a0bed3a6625ab9f8a892b2c63abf62671ada862c3530176fe9" gracePeriod=45
Sep 17 14:34:44.558540 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.556891    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"
Sep 17 14:34:44.580228 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.580069    2580 generic.go:356] "Generic (PLEG): container finished" podID="7cffa421-5a61-4eb0-ab22-49fdccc497bd" containerID="1b5eb444739b37f2c975d00dfe5a84ed72169ee0ce0a92dba942731586942552" exitCode=0
Sep 17 14:34:44.580300 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.580256    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z" event={"ID":"7cffa421-5a61-4eb0-ab22-49fdccc497bd","Type":"ContainerDied","Data":"1b5eb444739b37f2c975d00dfe5a84ed72169ee0ce0a92dba942731586942552"}
Sep 17 14:34:44.581349 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.581318    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"
Sep 17 14:34:44.582033 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.581961    2580 generic.go:356] "Generic (PLEG): container finished" podID="70983359-2033-4f9b-ba80-dffc4e33d303" containerID="c4a5e0e0ced982a0bed3a6625ab9f8a892b2c63abf62671ada862c3530176fe9" exitCode=0
Sep 17 14:34:44.582033 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.581990    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht" event={"ID":"70983359-2033-4f9b-ba80-dffc4e33d303","Type":"ContainerDied","Data":"c4a5e0e0ced982a0bed3a6625ab9f8a892b2c63abf62671ada862c3530176fe9"}
Sep 17 14:34:44.585411 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.584664    2580 generic.go:356] "Generic (PLEG): container finished" podID="4c24cbb4-2904-4a2e-8482-96b1236d9ed7" containerID="3ca55665bf9ff0641dd08d8531792efeabd66fb1ec14ce3b0b9ffa69b3b410c0" exitCode=0
Sep 17 14:34:44.585411 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.584743    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67" event={"ID":"4c24cbb4-2904-4a2e-8482-96b1236d9ed7","Type":"ContainerDied","Data":"3ca55665bf9ff0641dd08d8531792efeabd66fb1ec14ce3b0b9ffa69b3b410c0"}
Sep 17 14:34:44.585411 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.584776    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67" event={"ID":"4c24cbb4-2904-4a2e-8482-96b1236d9ed7","Type":"ContainerDied","Data":"ff45b7e973f5f409427764e7696162e4ccb09cc03acc1f44d6aad7b87d3a8305"}
Sep 17 14:34:44.585411 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.584796    2580 scope.go:117] "RemoveContainer" containerID="3ca55665bf9ff0641dd08d8531792efeabd66fb1ec14ce3b0b9ffa69b3b410c0"
Sep 17 14:34:44.585411 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.584908    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"
Sep 17 14:34:44.587123 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.587100    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"
Sep 17 14:34:44.587643 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.587619    2580 generic.go:356] "Generic (PLEG): container finished" podID="b9451e47-6204-4dc2-996b-dfa47ea039b1" containerID="c450e8975dab8eb29f7dbced17a0f0140b437a1b120d2c6b168ddfeabd420a8f" exitCode=0
Sep 17 14:34:44.587763 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.587679    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5" event={"ID":"b9451e47-6204-4dc2-996b-dfa47ea039b1","Type":"ContainerDied","Data":"c450e8975dab8eb29f7dbced17a0f0140b437a1b120d2c6b168ddfeabd420a8f"}
Sep 17 14:34:44.594425 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.594398    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"
Sep 17 14:34:44.599948 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.599913    2580 scope.go:117] "RemoveContainer" containerID="3ca55665bf9ff0641dd08d8531792efeabd66fb1ec14ce3b0b9ffa69b3b410c0"
Sep 17 14:34:44.600304 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:34:44.600278    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ca55665bf9ff0641dd08d8531792efeabd66fb1ec14ce3b0b9ffa69b3b410c0\": container with ID starting with 3ca55665bf9ff0641dd08d8531792efeabd66fb1ec14ce3b0b9ffa69b3b410c0 not found: ID does not exist" containerID="3ca55665bf9ff0641dd08d8531792efeabd66fb1ec14ce3b0b9ffa69b3b410c0"
Sep 17 14:34:44.600508 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.600314    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ca55665bf9ff0641dd08d8531792efeabd66fb1ec14ce3b0b9ffa69b3b410c0"} err="failed to get container status \"3ca55665bf9ff0641dd08d8531792efeabd66fb1ec14ce3b0b9ffa69b3b410c0\": rpc error: code = NotFound desc = could not find container \"3ca55665bf9ff0641dd08d8531792efeabd66fb1ec14ce3b0b9ffa69b3b410c0\": container with ID starting with 3ca55665bf9ff0641dd08d8531792efeabd66fb1ec14ce3b0b9ffa69b3b410c0 not found: ID does not exist"
Sep 17 14:34:44.600508 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.600333    2580 scope.go:117] "RemoveContainer" containerID="c450e8975dab8eb29f7dbced17a0f0140b437a1b120d2c6b168ddfeabd420a8f"
Sep 17 14:34:44.704772 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.704739    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70983359-2033-4f9b-ba80-dffc4e33d303-home\") pod \"70983359-2033-4f9b-ba80-dffc4e33d303\" (UID: \"70983359-2033-4f9b-ba80-dffc4e33d303\") "
Sep 17 14:34:44.704973 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.704789    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7cffa421-5a61-4eb0-ab22-49fdccc497bd-home\") pod \"7cffa421-5a61-4eb0-ab22-49fdccc497bd\" (UID: \"7cffa421-5a61-4eb0-ab22-49fdccc497bd\") "
Sep 17 14:34:44.704973 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.704811    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4t6h\" (UniqueName: \"kubernetes.io/projected/b9451e47-6204-4dc2-996b-dfa47ea039b1-kube-api-access-x4t6h\") pod \"b9451e47-6204-4dc2-996b-dfa47ea039b1\" (UID: \"b9451e47-6204-4dc2-996b-dfa47ea039b1\") "
Sep 17 14:34:44.704973 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.704828    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-dshm\") pod \"4c24cbb4-2904-4a2e-8482-96b1236d9ed7\" (UID: \"4c24cbb4-2904-4a2e-8482-96b1236d9ed7\") "
Sep 17 14:34:44.704973 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.704866    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nz6q9\" (UniqueName: \"kubernetes.io/projected/7cffa421-5a61-4eb0-ab22-49fdccc497bd-kube-api-access-nz6q9\") pod \"7cffa421-5a61-4eb0-ab22-49fdccc497bd\" (UID: \"7cffa421-5a61-4eb0-ab22-49fdccc497bd\") "
Sep 17 14:34:44.704973 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.704889    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9451e47-6204-4dc2-996b-dfa47ea039b1-home\") pod \"b9451e47-6204-4dc2-996b-dfa47ea039b1\" (UID: \"b9451e47-6204-4dc2-996b-dfa47ea039b1\") "
Sep 17 14:34:44.704973 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.704919    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-tmp-dir\") pod \"4c24cbb4-2904-4a2e-8482-96b1236d9ed7\" (UID: \"4c24cbb4-2904-4a2e-8482-96b1236d9ed7\") "
Sep 17 14:34:44.704973 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.704951    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64ldr\" (UniqueName: \"kubernetes.io/projected/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-kube-api-access-64ldr\") pod \"4c24cbb4-2904-4a2e-8482-96b1236d9ed7\" (UID: \"4c24cbb4-2904-4a2e-8482-96b1236d9ed7\") "
Sep 17 14:34:44.705358 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.704999    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9451e47-6204-4dc2-996b-dfa47ea039b1-model-cache\") pod \"b9451e47-6204-4dc2-996b-dfa47ea039b1\" (UID: \"b9451e47-6204-4dc2-996b-dfa47ea039b1\") "
Sep 17 14:34:44.705358 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.705025    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70983359-2033-4f9b-ba80-dffc4e33d303-tls-certs\") pod \"70983359-2033-4f9b-ba80-dffc4e33d303\" (UID: \"70983359-2033-4f9b-ba80-dffc4e33d303\") "
Sep 17 14:34:44.705358 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.705047    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-home\") pod \"4c24cbb4-2904-4a2e-8482-96b1236d9ed7\" (UID: \"4c24cbb4-2904-4a2e-8482-96b1236d9ed7\") "
Sep 17 14:34:44.705358 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.705076    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7cffa421-5a61-4eb0-ab22-49fdccc497bd-model-cache\") pod \"7cffa421-5a61-4eb0-ab22-49fdccc497bd\" (UID: \"7cffa421-5a61-4eb0-ab22-49fdccc497bd\") "
Sep 17 14:34:44.705358 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.705070    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70983359-2033-4f9b-ba80-dffc4e33d303-home" (OuterVolumeSpecName: "home") pod "70983359-2033-4f9b-ba80-dffc4e33d303" (UID: "70983359-2033-4f9b-ba80-dffc4e33d303"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:34:44.705358 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.705101    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70983359-2033-4f9b-ba80-dffc4e33d303-dshm\") pod \"70983359-2033-4f9b-ba80-dffc4e33d303\" (UID: \"70983359-2033-4f9b-ba80-dffc4e33d303\") "
Sep 17 14:34:44.705358 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.705177    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j46l2\" (UniqueName: \"kubernetes.io/projected/70983359-2033-4f9b-ba80-dffc4e33d303-kube-api-access-j46l2\") pod \"70983359-2033-4f9b-ba80-dffc4e33d303\" (UID: \"70983359-2033-4f9b-ba80-dffc4e33d303\") "
Sep 17 14:34:44.705358 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.705208    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cffa421-5a61-4eb0-ab22-49fdccc497bd-tls-certs\") pod \"7cffa421-5a61-4eb0-ab22-49fdccc497bd\" (UID: \"7cffa421-5a61-4eb0-ab22-49fdccc497bd\") "
Sep 17 14:34:44.705358 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.705237    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cffa421-5a61-4eb0-ab22-49fdccc497bd-tmp-dir\") pod \"7cffa421-5a61-4eb0-ab22-49fdccc497bd\" (UID: \"7cffa421-5a61-4eb0-ab22-49fdccc497bd\") "
Sep 17 14:34:44.705358 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.705317    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-model-cache\") pod \"4c24cbb4-2904-4a2e-8482-96b1236d9ed7\" (UID: \"4c24cbb4-2904-4a2e-8482-96b1236d9ed7\") "
Sep 17 14:34:44.705358 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.705343    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9451e47-6204-4dc2-996b-dfa47ea039b1-tls-certs\") pod \"b9451e47-6204-4dc2-996b-dfa47ea039b1\" (UID: \"b9451e47-6204-4dc2-996b-dfa47ea039b1\") "
Sep 17 14:34:44.705993 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.705373    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7cffa421-5a61-4eb0-ab22-49fdccc497bd-dshm\") pod \"7cffa421-5a61-4eb0-ab22-49fdccc497bd\" (UID: \"7cffa421-5a61-4eb0-ab22-49fdccc497bd\") "
Sep 17 14:34:44.705993 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.705411    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9451e47-6204-4dc2-996b-dfa47ea039b1-tmp-dir\") pod \"b9451e47-6204-4dc2-996b-dfa47ea039b1\" (UID: \"b9451e47-6204-4dc2-996b-dfa47ea039b1\") "
Sep 17 14:34:44.705993 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.705443    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70983359-2033-4f9b-ba80-dffc4e33d303-model-cache\") pod \"70983359-2033-4f9b-ba80-dffc4e33d303\" (UID: \"70983359-2033-4f9b-ba80-dffc4e33d303\") "
Sep 17 14:34:44.705993 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.705475    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70983359-2033-4f9b-ba80-dffc4e33d303-tmp-dir\") pod \"70983359-2033-4f9b-ba80-dffc4e33d303\" (UID: \"70983359-2033-4f9b-ba80-dffc4e33d303\") "
Sep 17 14:34:44.705993 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.705497    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-tls-certs\") pod \"4c24cbb4-2904-4a2e-8482-96b1236d9ed7\" (UID: \"4c24cbb4-2904-4a2e-8482-96b1236d9ed7\") "
Sep 17 14:34:44.705993 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.705542    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9451e47-6204-4dc2-996b-dfa47ea039b1-dshm\") pod \"b9451e47-6204-4dc2-996b-dfa47ea039b1\" (UID: \"b9451e47-6204-4dc2-996b-dfa47ea039b1\") "
Sep 17 14:34:44.706339 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.706011    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70983359-2033-4f9b-ba80-dffc4e33d303-home\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:34:44.707972 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.705071    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cffa421-5a61-4eb0-ab22-49fdccc497bd-home" (OuterVolumeSpecName: "home") pod "7cffa421-5a61-4eb0-ab22-49fdccc497bd" (UID: "7cffa421-5a61-4eb0-ab22-49fdccc497bd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:34:44.707972 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.705396    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9451e47-6204-4dc2-996b-dfa47ea039b1-model-cache" (OuterVolumeSpecName: "model-cache") pod "b9451e47-6204-4dc2-996b-dfa47ea039b1" (UID: "b9451e47-6204-4dc2-996b-dfa47ea039b1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:34:44.708171 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.705405    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4c24cbb4-2904-4a2e-8482-96b1236d9ed7" (UID: "4c24cbb4-2904-4a2e-8482-96b1236d9ed7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:34:44.708171 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.705610    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9451e47-6204-4dc2-996b-dfa47ea039b1-home" (OuterVolumeSpecName: "home") pod "b9451e47-6204-4dc2-996b-dfa47ea039b1" (UID: "b9451e47-6204-4dc2-996b-dfa47ea039b1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:34:44.708171 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.705787    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cffa421-5a61-4eb0-ab22-49fdccc497bd-model-cache" (OuterVolumeSpecName: "model-cache") pod "7cffa421-5a61-4eb0-ab22-49fdccc497bd" (UID: "7cffa421-5a61-4eb0-ab22-49fdccc497bd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:34:44.708171 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.706058    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-model-cache" (OuterVolumeSpecName: "model-cache") pod "4c24cbb4-2904-4a2e-8482-96b1236d9ed7" (UID: "4c24cbb4-2904-4a2e-8482-96b1236d9ed7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:34:44.708171 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.707856    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-kube-api-access-64ldr" (OuterVolumeSpecName: "kube-api-access-64ldr") pod "4c24cbb4-2904-4a2e-8482-96b1236d9ed7" (UID: "4c24cbb4-2904-4a2e-8482-96b1236d9ed7"). InnerVolumeSpecName "kube-api-access-64ldr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:34:44.708171 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.707877    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9451e47-6204-4dc2-996b-dfa47ea039b1-kube-api-access-x4t6h" (OuterVolumeSpecName: "kube-api-access-x4t6h") pod "b9451e47-6204-4dc2-996b-dfa47ea039b1" (UID: "b9451e47-6204-4dc2-996b-dfa47ea039b1"). InnerVolumeSpecName "kube-api-access-x4t6h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:34:44.708171 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.707939    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70983359-2033-4f9b-ba80-dffc4e33d303-kube-api-access-j46l2" (OuterVolumeSpecName: "kube-api-access-j46l2") pod "70983359-2033-4f9b-ba80-dffc4e33d303" (UID: "70983359-2033-4f9b-ba80-dffc4e33d303"). InnerVolumeSpecName "kube-api-access-j46l2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:34:44.708171 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.708099    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-home" (OuterVolumeSpecName: "home") pod "4c24cbb4-2904-4a2e-8482-96b1236d9ed7" (UID: "4c24cbb4-2904-4a2e-8482-96b1236d9ed7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:34:44.708605 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.708267    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cffa421-5a61-4eb0-ab22-49fdccc497bd-kube-api-access-nz6q9" (OuterVolumeSpecName: "kube-api-access-nz6q9") pod "7cffa421-5a61-4eb0-ab22-49fdccc497bd" (UID: "7cffa421-5a61-4eb0-ab22-49fdccc497bd"). InnerVolumeSpecName "kube-api-access-nz6q9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:34:44.708605 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.708273    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-dshm" (OuterVolumeSpecName: "dshm") pod "4c24cbb4-2904-4a2e-8482-96b1236d9ed7" (UID: "4c24cbb4-2904-4a2e-8482-96b1236d9ed7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:34:44.708605 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.708282    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cffa421-5a61-4eb0-ab22-49fdccc497bd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7cffa421-5a61-4eb0-ab22-49fdccc497bd" (UID: "7cffa421-5a61-4eb0-ab22-49fdccc497bd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:34:44.708605 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.708320    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9451e47-6204-4dc2-996b-dfa47ea039b1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b9451e47-6204-4dc2-996b-dfa47ea039b1" (UID: "b9451e47-6204-4dc2-996b-dfa47ea039b1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:34:44.708605 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.708464    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9451e47-6204-4dc2-996b-dfa47ea039b1-dshm" (OuterVolumeSpecName: "dshm") pod "b9451e47-6204-4dc2-996b-dfa47ea039b1" (UID: "b9451e47-6204-4dc2-996b-dfa47ea039b1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:34:44.708605 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.708490    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cffa421-5a61-4eb0-ab22-49fdccc497bd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7cffa421-5a61-4eb0-ab22-49fdccc497bd" (UID: "7cffa421-5a61-4eb0-ab22-49fdccc497bd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:34:44.708605 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.708507    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70983359-2033-4f9b-ba80-dffc4e33d303-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "70983359-2033-4f9b-ba80-dffc4e33d303" (UID: "70983359-2033-4f9b-ba80-dffc4e33d303"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:34:44.708605 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.708520    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70983359-2033-4f9b-ba80-dffc4e33d303-model-cache" (OuterVolumeSpecName: "model-cache") pod "70983359-2033-4f9b-ba80-dffc4e33d303" (UID: "70983359-2033-4f9b-ba80-dffc4e33d303"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:34:44.708972 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.708817    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70983359-2033-4f9b-ba80-dffc4e33d303-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "70983359-2033-4f9b-ba80-dffc4e33d303" (UID: "70983359-2033-4f9b-ba80-dffc4e33d303"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:34:44.709868 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.709844    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70983359-2033-4f9b-ba80-dffc4e33d303-dshm" (OuterVolumeSpecName: "dshm") pod "70983359-2033-4f9b-ba80-dffc4e33d303" (UID: "70983359-2033-4f9b-ba80-dffc4e33d303"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:34:44.710284 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.710265    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4c24cbb4-2904-4a2e-8482-96b1236d9ed7" (UID: "4c24cbb4-2904-4a2e-8482-96b1236d9ed7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:34:44.710578 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.710561    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cffa421-5a61-4eb0-ab22-49fdccc497bd-dshm" (OuterVolumeSpecName: "dshm") pod "7cffa421-5a61-4eb0-ab22-49fdccc497bd" (UID: "7cffa421-5a61-4eb0-ab22-49fdccc497bd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:34:44.710578 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.710565    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9451e47-6204-4dc2-996b-dfa47ea039b1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b9451e47-6204-4dc2-996b-dfa47ea039b1" (UID: "b9451e47-6204-4dc2-996b-dfa47ea039b1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:34:44.807478 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.807373    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nz6q9\" (UniqueName: \"kubernetes.io/projected/7cffa421-5a61-4eb0-ab22-49fdccc497bd-kube-api-access-nz6q9\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:34:44.807478 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.807406    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9451e47-6204-4dc2-996b-dfa47ea039b1-home\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:34:44.807478 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.807423    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-tmp-dir\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:34:44.807478 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.807434    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64ldr\" (UniqueName: \"kubernetes.io/projected/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-kube-api-access-64ldr\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:34:44.807478 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.807448    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9451e47-6204-4dc2-996b-dfa47ea039b1-model-cache\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:34:44.807478 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.807460    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70983359-2033-4f9b-ba80-dffc4e33d303-tls-certs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:34:44.807478 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.807471    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-home\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:34:44.807478 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.807482    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7cffa421-5a61-4eb0-ab22-49fdccc497bd-model-cache\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:34:44.807933 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.807494    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70983359-2033-4f9b-ba80-dffc4e33d303-dshm\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:34:44.807933 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.807505    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j46l2\" (UniqueName: \"kubernetes.io/projected/70983359-2033-4f9b-ba80-dffc4e33d303-kube-api-access-j46l2\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:34:44.807933 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.807516    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cffa421-5a61-4eb0-ab22-49fdccc497bd-tls-certs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:34:44.807933 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.807527    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cffa421-5a61-4eb0-ab22-49fdccc497bd-tmp-dir\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:34:44.807933 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.807537    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-model-cache\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:34:44.807933 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.807546    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9451e47-6204-4dc2-996b-dfa47ea039b1-tls-certs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:34:44.807933 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.807556    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7cffa421-5a61-4eb0-ab22-49fdccc497bd-dshm\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:34:44.807933 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.807566    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9451e47-6204-4dc2-996b-dfa47ea039b1-tmp-dir\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:34:44.807933 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.807576    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70983359-2033-4f9b-ba80-dffc4e33d303-model-cache\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:34:44.807933 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.807586    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70983359-2033-4f9b-ba80-dffc4e33d303-tmp-dir\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:34:44.807933 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.807597    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-tls-certs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:34:44.807933 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.807609    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9451e47-6204-4dc2-996b-dfa47ea039b1-dshm\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:34:44.807933 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.807619    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7cffa421-5a61-4eb0-ab22-49fdccc497bd-home\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:34:44.807933 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.807630    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4t6h\" (UniqueName: \"kubernetes.io/projected/b9451e47-6204-4dc2-996b-dfa47ea039b1-kube-api-access-x4t6h\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:34:44.807933 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.807639    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c24cbb4-2904-4a2e-8482-96b1236d9ed7-dshm\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:34:44.912827 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.912788    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"]
Sep 17 14:34:44.919782 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:44.919749    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-080801/embedding-w0-080801-kserve-55558c4457-8ql67"]
Sep 17 14:34:45.178314 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:45.178226    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c24cbb4-2904-4a2e-8482-96b1236d9ed7" path="/var/lib/kubelet/pods/4c24cbb4-2904-4a2e-8482-96b1236d9ed7/volumes"
Sep 17 14:34:45.596168 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:45.596098    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"
Sep 17 14:34:45.596592 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:45.596113    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5" event={"ID":"b9451e47-6204-4dc2-996b-dfa47ea039b1","Type":"ContainerDied","Data":"c28106f5a8ace451633c86de0307747fd1baf46c88ce3d022335f6fa6ad8e4fa"}
Sep 17 14:34:45.597553 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:45.597535    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"
Sep 17 14:34:45.597695 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:45.597569    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z" event={"ID":"7cffa421-5a61-4eb0-ab22-49fdccc497bd","Type":"ContainerDied","Data":"f175c09a2a38d891afcced622231ea4d35c0ae26e6de6e88a72f7460b7dbece9"}
Sep 17 14:34:45.597695 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:45.597614    2580 scope.go:117] "RemoveContainer" containerID="1b5eb444739b37f2c975d00dfe5a84ed72169ee0ce0a92dba942731586942552"
Sep 17 14:34:45.602697 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:45.602677    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht" event={"ID":"70983359-2033-4f9b-ba80-dffc4e33d303","Type":"ContainerDied","Data":"53d3f85dc4dbd7c4c6721a84f4af319fa8fce75f3356fc02e5e07ed47a1d0ada"}
Sep 17 14:34:45.602844 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:45.602779    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"
Sep 17 14:34:45.609648 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:45.609631    2580 scope.go:117] "RemoveContainer" containerID="c4a5e0e0ced982a0bed3a6625ab9f8a892b2c63abf62671ada862c3530176fe9"
Sep 17 14:34:45.628380 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:45.628349    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"]
Sep 17 14:34:45.631421 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:45.631395    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-080801/premium-w0-080801-kserve-865464ffb5-5hz5z"]
Sep 17 14:34:45.645908 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:45.645875    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"]
Sep 17 14:34:45.648842 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:45.648819    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-080801/simulator-w0-080801-kserve-85649f9f4d-4vtht"]
Sep 17 14:34:45.663579 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:45.663551    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"]
Sep 17 14:34:45.670465 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:45.670433    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-080801/distinct-2-w0-080801-kserve-87f75455f-b4rb5"]
Sep 17 14:34:47.180725 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:47.180661    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70983359-2033-4f9b-ba80-dffc4e33d303" path="/var/lib/kubelet/pods/70983359-2033-4f9b-ba80-dffc4e33d303/volumes"
Sep 17 14:34:47.181414 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:47.181386    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cffa421-5a61-4eb0-ab22-49fdccc497bd" path="/var/lib/kubelet/pods/7cffa421-5a61-4eb0-ab22-49fdccc497bd/volumes"
Sep 17 14:34:47.182074 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:34:47.182047    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9451e47-6204-4dc2-996b-dfa47ea039b1" path="/var/lib/kubelet/pods/b9451e47-6204-4dc2-996b-dfa47ea039b1/volumes"
Sep 17 14:35:08.403043 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:08.403006    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn"]
Sep 17 14:35:08.403506 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:08.403222    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn" podUID="e4bf7d41-bc62-4e18-8035-16cf5b805f29" containerName="maas-api" containerID="cri-o://d34e28f7a00c2cdbbf6270983d4b932c62f686199c164db404359466be37801f" gracePeriod=30
Sep 17 14:35:08.654010 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:08.653933    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn"
Sep 17 14:35:08.730382 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:08.730347    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4bf7d41-bc62-4e18-8035-16cf5b805f29-maas-api-tls\") pod \"e4bf7d41-bc62-4e18-8035-16cf5b805f29\" (UID: \"e4bf7d41-bc62-4e18-8035-16cf5b805f29\") "
Sep 17 14:35:08.730601 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:08.730427    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4bf7d41-bc62-4e18-8035-16cf5b805f29-openshift-service-ca\") pod \"e4bf7d41-bc62-4e18-8035-16cf5b805f29\" (UID: \"e4bf7d41-bc62-4e18-8035-16cf5b805f29\") "
Sep 17 14:35:08.730601 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:08.730536    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4bf7d41-bc62-4e18-8035-16cf5b805f29-metrics-certs\") pod \"e4bf7d41-bc62-4e18-8035-16cf5b805f29\" (UID: \"e4bf7d41-bc62-4e18-8035-16cf5b805f29\") "
Sep 17 14:35:08.730601 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:08.730566    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rr9x6\" (UniqueName: \"kubernetes.io/projected/e4bf7d41-bc62-4e18-8035-16cf5b805f29-kube-api-access-rr9x6\") pod \"e4bf7d41-bc62-4e18-8035-16cf5b805f29\" (UID: \"e4bf7d41-bc62-4e18-8035-16cf5b805f29\") "
Sep 17 14:35:08.730895 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:08.730864    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4bf7d41-bc62-4e18-8035-16cf5b805f29-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e4bf7d41-bc62-4e18-8035-16cf5b805f29" (UID: "e4bf7d41-bc62-4e18-8035-16cf5b805f29"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:35:08.732742 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:08.732675    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4bf7d41-bc62-4e18-8035-16cf5b805f29-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e4bf7d41-bc62-4e18-8035-16cf5b805f29" (UID: "e4bf7d41-bc62-4e18-8035-16cf5b805f29"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:35:08.732742 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:08.732681    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4bf7d41-bc62-4e18-8035-16cf5b805f29-kube-api-access-rr9x6" (OuterVolumeSpecName: "kube-api-access-rr9x6") pod "e4bf7d41-bc62-4e18-8035-16cf5b805f29" (UID: "e4bf7d41-bc62-4e18-8035-16cf5b805f29"). InnerVolumeSpecName "kube-api-access-rr9x6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:35:08.732742 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:08.732690    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4bf7d41-bc62-4e18-8035-16cf5b805f29-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e4bf7d41-bc62-4e18-8035-16cf5b805f29" (UID: "e4bf7d41-bc62-4e18-8035-16cf5b805f29"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:35:08.753047 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:08.753008    2580 generic.go:356] "Generic (PLEG): container finished" podID="e4bf7d41-bc62-4e18-8035-16cf5b805f29" containerID="d34e28f7a00c2cdbbf6270983d4b932c62f686199c164db404359466be37801f" exitCode=0
Sep 17 14:35:08.753221 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:08.753060    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn"
Sep 17 14:35:08.753221 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:08.753087    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn" event={"ID":"e4bf7d41-bc62-4e18-8035-16cf5b805f29","Type":"ContainerDied","Data":"d34e28f7a00c2cdbbf6270983d4b932c62f686199c164db404359466be37801f"}
Sep 17 14:35:08.753221 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:08.753149    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn" event={"ID":"e4bf7d41-bc62-4e18-8035-16cf5b805f29","Type":"ContainerDied","Data":"b653c2609cff4a05984b884e6e14e02108751aa8ffe6d55069e550350e3389df"}
Sep 17 14:35:08.753221 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:08.753175    2580 scope.go:117] "RemoveContainer" containerID="d34e28f7a00c2cdbbf6270983d4b932c62f686199c164db404359466be37801f"
Sep 17 14:35:08.763892 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:08.763871    2580 scope.go:117] "RemoveContainer" containerID="d34e28f7a00c2cdbbf6270983d4b932c62f686199c164db404359466be37801f"
Sep 17 14:35:08.764226 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:35:08.764206    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d34e28f7a00c2cdbbf6270983d4b932c62f686199c164db404359466be37801f\": container with ID starting with d34e28f7a00c2cdbbf6270983d4b932c62f686199c164db404359466be37801f not found: ID does not exist" containerID="d34e28f7a00c2cdbbf6270983d4b932c62f686199c164db404359466be37801f"
Sep 17 14:35:08.764279 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:08.764237    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d34e28f7a00c2cdbbf6270983d4b932c62f686199c164db404359466be37801f"} err="failed to get container status \"d34e28f7a00c2cdbbf6270983d4b932c62f686199c164db404359466be37801f\": rpc error: code = NotFound desc = could not find container \"d34e28f7a00c2cdbbf6270983d4b932c62f686199c164db404359466be37801f\": container with ID starting with d34e28f7a00c2cdbbf6270983d4b932c62f686199c164db404359466be37801f not found: ID does not exist"
Sep 17 14:35:08.779200 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:08.779161    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn"]
Sep 17 14:35:08.785743 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:08.785679    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-29d3c7-7c8bdc85b7-vmgnn"]
Sep 17 14:35:08.832165 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:08.832130    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e4bf7d41-bc62-4e18-8035-16cf5b805f29-metrics-certs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:35:08.832165 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:08.832159    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rr9x6\" (UniqueName: \"kubernetes.io/projected/e4bf7d41-bc62-4e18-8035-16cf5b805f29-kube-api-access-rr9x6\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:35:08.832165 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:08.832171    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4bf7d41-bc62-4e18-8035-16cf5b805f29-maas-api-tls\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:35:08.832404 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:08.832179    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4bf7d41-bc62-4e18-8035-16cf5b805f29-openshift-service-ca\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:35:09.178495 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:09.178450    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4bf7d41-bc62-4e18-8035-16cf5b805f29" path="/var/lib/kubelet/pods/e4bf7d41-bc62-4e18-8035-16cf5b805f29/volumes"
Sep 17 14:35:17.034869 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:17.034782    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"]
Sep 17 14:35:17.035343 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:17.035011    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd" podUID="aebd6b3a-1ed0-47d2-bdb4-20136237b893" containerName="istio-proxy" containerID="cri-o://1dd0650d585c9bab8071fddb52a408cc11eb7dee1b1b8db4f1e160cebd881757" gracePeriod=30
Sep 17 14:35:18.776451 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:18.776408    2580 patch_prober.go:28] interesting pod/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 14:35:18.776857 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:18.776472    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd" podUID="aebd6b3a-1ed0-47d2-bdb4-20136237b893" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 14:35:22.284094 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.284063    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:35:22.364779 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.364673    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aebd6b3a-1ed0-47d2-bdb4-20136237b893-istio-podinfo\") pod \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") "
Sep 17 14:35:22.364779 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.364740    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aebd6b3a-1ed0-47d2-bdb4-20136237b893-workload-certs\") pod \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") "
Sep 17 14:35:22.364779 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.364759    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aebd6b3a-1ed0-47d2-bdb4-20136237b893-istio-envoy\") pod \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") "
Sep 17 14:35:22.365056 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.364789    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aebd6b3a-1ed0-47d2-bdb4-20136237b893-istio-data\") pod \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") "
Sep 17 14:35:22.365056 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.364809    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aebd6b3a-1ed0-47d2-bdb4-20136237b893-credential-socket\") pod \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") "
Sep 17 14:35:22.365056 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.364862    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aebd6b3a-1ed0-47d2-bdb4-20136237b893-workload-socket\") pod \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") "
Sep 17 14:35:22.365056 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.364894    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aebd6b3a-1ed0-47d2-bdb4-20136237b893-istiod-ca-cert\") pod \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") "
Sep 17 14:35:22.365056 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.364938    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aebd6b3a-1ed0-47d2-bdb4-20136237b893-istio-token\") pod \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") "
Sep 17 14:35:22.365056 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.364968    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tll9j\" (UniqueName: \"kubernetes.io/projected/aebd6b3a-1ed0-47d2-bdb4-20136237b893-kube-api-access-tll9j\") pod \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\" (UID: \"aebd6b3a-1ed0-47d2-bdb4-20136237b893\") "
Sep 17 14:35:22.365801 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.365138    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aebd6b3a-1ed0-47d2-bdb4-20136237b893-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aebd6b3a-1ed0-47d2-bdb4-20136237b893" (UID: "aebd6b3a-1ed0-47d2-bdb4-20136237b893"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:35:22.365801 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.365153    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aebd6b3a-1ed0-47d2-bdb4-20136237b893-istio-data" (OuterVolumeSpecName: "istio-data") pod "aebd6b3a-1ed0-47d2-bdb4-20136237b893" (UID: "aebd6b3a-1ed0-47d2-bdb4-20136237b893"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:35:22.365801 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.365203    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aebd6b3a-1ed0-47d2-bdb4-20136237b893-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aebd6b3a-1ed0-47d2-bdb4-20136237b893" (UID: "aebd6b3a-1ed0-47d2-bdb4-20136237b893"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:35:22.365801 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.365409    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aebd6b3a-1ed0-47d2-bdb4-20136237b893-workload-certs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:35:22.365801 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.365427    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aebd6b3a-1ed0-47d2-bdb4-20136237b893-istio-data\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:35:22.365801 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.365429    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aebd6b3a-1ed0-47d2-bdb4-20136237b893-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aebd6b3a-1ed0-47d2-bdb4-20136237b893" (UID: "aebd6b3a-1ed0-47d2-bdb4-20136237b893"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:35:22.365801 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.365441    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aebd6b3a-1ed0-47d2-bdb4-20136237b893-credential-socket\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:35:22.365801 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.365499    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aebd6b3a-1ed0-47d2-bdb4-20136237b893-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aebd6b3a-1ed0-47d2-bdb4-20136237b893" (UID: "aebd6b3a-1ed0-47d2-bdb4-20136237b893"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:35:22.367454 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.367394    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aebd6b3a-1ed0-47d2-bdb4-20136237b893-kube-api-access-tll9j" (OuterVolumeSpecName: "kube-api-access-tll9j") pod "aebd6b3a-1ed0-47d2-bdb4-20136237b893" (UID: "aebd6b3a-1ed0-47d2-bdb4-20136237b893"). InnerVolumeSpecName "kube-api-access-tll9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:35:22.367592 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.367500    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aebd6b3a-1ed0-47d2-bdb4-20136237b893-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aebd6b3a-1ed0-47d2-bdb4-20136237b893" (UID: "aebd6b3a-1ed0-47d2-bdb4-20136237b893"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:35:22.367592 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.367503    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aebd6b3a-1ed0-47d2-bdb4-20136237b893-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aebd6b3a-1ed0-47d2-bdb4-20136237b893" (UID: "aebd6b3a-1ed0-47d2-bdb4-20136237b893"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 14:35:22.367729 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.367593    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aebd6b3a-1ed0-47d2-bdb4-20136237b893-istio-token" (OuterVolumeSpecName: "istio-token") pod "aebd6b3a-1ed0-47d2-bdb4-20136237b893" (UID: "aebd6b3a-1ed0-47d2-bdb4-20136237b893"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:35:22.466698 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.466656    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aebd6b3a-1ed0-47d2-bdb4-20136237b893-istio-podinfo\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:35:22.466698 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.466692    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aebd6b3a-1ed0-47d2-bdb4-20136237b893-istio-envoy\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:35:22.466698 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.466700    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aebd6b3a-1ed0-47d2-bdb4-20136237b893-workload-socket\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:35:22.467001 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.466743    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aebd6b3a-1ed0-47d2-bdb4-20136237b893-istiod-ca-cert\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:35:22.467001 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.466756    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aebd6b3a-1ed0-47d2-bdb4-20136237b893-istio-token\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:35:22.467001 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.466766    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tll9j\" (UniqueName: \"kubernetes.io/projected/aebd6b3a-1ed0-47d2-bdb4-20136237b893-kube-api-access-tll9j\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:35:22.839253 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.839215    2580 generic.go:356] "Generic (PLEG): container finished" podID="aebd6b3a-1ed0-47d2-bdb4-20136237b893" containerID="1dd0650d585c9bab8071fddb52a408cc11eb7dee1b1b8db4f1e160cebd881757" exitCode=0
Sep 17 14:35:22.839452 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.839261    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd" event={"ID":"aebd6b3a-1ed0-47d2-bdb4-20136237b893","Type":"ContainerDied","Data":"1dd0650d585c9bab8071fddb52a408cc11eb7dee1b1b8db4f1e160cebd881757"}
Sep 17 14:35:22.839452 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.839322    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd" event={"ID":"aebd6b3a-1ed0-47d2-bdb4-20136237b893","Type":"ContainerDied","Data":"bb7d80340ac3cde50ec96f26515d98d3d8090fa365166da2cc173f22a6318d99"}
Sep 17 14:35:22.839452 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.839345    2580 scope.go:117] "RemoveContainer" containerID="1dd0650d585c9bab8071fddb52a408cc11eb7dee1b1b8db4f1e160cebd881757"
Sep 17 14:35:22.839452 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.839273    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"
Sep 17 14:35:22.849904 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.849885    2580 scope.go:117] "RemoveContainer" containerID="b62cf87c2b81f4f7b40a469177f5e8b3b46a4271300ffdb1efc73e9e6202fa55"
Sep 17 14:35:22.861323 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.861291    2580 scope.go:117] "RemoveContainer" containerID="1dd0650d585c9bab8071fddb52a408cc11eb7dee1b1b8db4f1e160cebd881757"
Sep 17 14:35:22.861646 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:35:22.861622    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dd0650d585c9bab8071fddb52a408cc11eb7dee1b1b8db4f1e160cebd881757\": container with ID starting with 1dd0650d585c9bab8071fddb52a408cc11eb7dee1b1b8db4f1e160cebd881757 not found: ID does not exist" containerID="1dd0650d585c9bab8071fddb52a408cc11eb7dee1b1b8db4f1e160cebd881757"
Sep 17 14:35:22.861689 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.861656    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dd0650d585c9bab8071fddb52a408cc11eb7dee1b1b8db4f1e160cebd881757"} err="failed to get container status \"1dd0650d585c9bab8071fddb52a408cc11eb7dee1b1b8db4f1e160cebd881757\": rpc error: code = NotFound desc = could not find container \"1dd0650d585c9bab8071fddb52a408cc11eb7dee1b1b8db4f1e160cebd881757\": container with ID starting with 1dd0650d585c9bab8071fddb52a408cc11eb7dee1b1b8db4f1e160cebd881757 not found: ID does not exist"
Sep 17 14:35:22.861689 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.861676    2580 scope.go:117] "RemoveContainer" containerID="b62cf87c2b81f4f7b40a469177f5e8b3b46a4271300ffdb1efc73e9e6202fa55"
Sep 17 14:35:22.862020 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:35:22.861993    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b62cf87c2b81f4f7b40a469177f5e8b3b46a4271300ffdb1efc73e9e6202fa55\": container with ID starting with b62cf87c2b81f4f7b40a469177f5e8b3b46a4271300ffdb1efc73e9e6202fa55 not found: ID does not exist" containerID="b62cf87c2b81f4f7b40a469177f5e8b3b46a4271300ffdb1efc73e9e6202fa55"
Sep 17 14:35:22.862089 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.862050    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b62cf87c2b81f4f7b40a469177f5e8b3b46a4271300ffdb1efc73e9e6202fa55"} err="failed to get container status \"b62cf87c2b81f4f7b40a469177f5e8b3b46a4271300ffdb1efc73e9e6202fa55\": rpc error: code = NotFound desc = could not find container \"b62cf87c2b81f4f7b40a469177f5e8b3b46a4271300ffdb1efc73e9e6202fa55\": container with ID starting with b62cf87c2b81f4f7b40a469177f5e8b3b46a4271300ffdb1efc73e9e6202fa55 not found: ID does not exist"
Sep 17 14:35:22.863481 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.863456    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"]
Sep 17 14:35:22.869981 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:22.869956    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-29d3c7-openshift-default-77c5dd5fb8-k9dcd"]
Sep 17 14:35:23.182601 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:23.182517    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aebd6b3a-1ed0-47d2-bdb4-20136237b893" path="/var/lib/kubelet/pods/aebd6b3a-1ed0-47d2-bdb4-20136237b893/volumes"
Sep 17 14:35:25.024372 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:25.024334    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:35:50.623954 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:50.623919    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p"]
Sep 17 14:35:50.624537 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:50.624135    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p" podUID="cec4114f-83b9-4ee3-bca4-845498e1c57b" containerName="maas-api" containerID="cri-o://ed45304dac62a950ac3430817a4c8c840a0ad0b9dac8c0b300714d36b61fc09b" gracePeriod=30
Sep 17 14:35:50.650934 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:50.650898    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4009da-29827590-9tmls"]
Sep 17 14:35:50.653790 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:50.653764    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-4009da-29827590-9tmls"]
Sep 17 14:35:50.875022 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:50.874947    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p"
Sep 17 14:35:50.943303 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:50.943264    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cec4114f-83b9-4ee3-bca4-845498e1c57b-maas-api-tls\") pod \"cec4114f-83b9-4ee3-bca4-845498e1c57b\" (UID: \"cec4114f-83b9-4ee3-bca4-845498e1c57b\") "
Sep 17 14:35:50.943485 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:50.943325    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cec4114f-83b9-4ee3-bca4-845498e1c57b-openshift-service-ca\") pod \"cec4114f-83b9-4ee3-bca4-845498e1c57b\" (UID: \"cec4114f-83b9-4ee3-bca4-845498e1c57b\") "
Sep 17 14:35:50.943485 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:50.943356    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cec4114f-83b9-4ee3-bca4-845498e1c57b-metrics-certs\") pod \"cec4114f-83b9-4ee3-bca4-845498e1c57b\" (UID: \"cec4114f-83b9-4ee3-bca4-845498e1c57b\") "
Sep 17 14:35:50.943485 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:50.943379    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qj2n\" (UniqueName: \"kubernetes.io/projected/cec4114f-83b9-4ee3-bca4-845498e1c57b-kube-api-access-5qj2n\") pod \"cec4114f-83b9-4ee3-bca4-845498e1c57b\" (UID: \"cec4114f-83b9-4ee3-bca4-845498e1c57b\") "
Sep 17 14:35:50.943764 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:50.943695    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cec4114f-83b9-4ee3-bca4-845498e1c57b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cec4114f-83b9-4ee3-bca4-845498e1c57b" (UID: "cec4114f-83b9-4ee3-bca4-845498e1c57b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:35:50.945485 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:50.945456    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cec4114f-83b9-4ee3-bca4-845498e1c57b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "cec4114f-83b9-4ee3-bca4-845498e1c57b" (UID: "cec4114f-83b9-4ee3-bca4-845498e1c57b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:35:50.945579 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:50.945552    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cec4114f-83b9-4ee3-bca4-845498e1c57b-kube-api-access-5qj2n" (OuterVolumeSpecName: "kube-api-access-5qj2n") pod "cec4114f-83b9-4ee3-bca4-845498e1c57b" (UID: "cec4114f-83b9-4ee3-bca4-845498e1c57b"). InnerVolumeSpecName "kube-api-access-5qj2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:35:50.945620 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:50.945579    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cec4114f-83b9-4ee3-bca4-845498e1c57b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cec4114f-83b9-4ee3-bca4-845498e1c57b" (UID: "cec4114f-83b9-4ee3-bca4-845498e1c57b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:35:51.021616 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:51.021575    2580 generic.go:356] "Generic (PLEG): container finished" podID="cec4114f-83b9-4ee3-bca4-845498e1c57b" containerID="ed45304dac62a950ac3430817a4c8c840a0ad0b9dac8c0b300714d36b61fc09b" exitCode=0
Sep 17 14:35:51.021616 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:51.021624    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p"
Sep 17 14:35:51.022650 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:51.021663    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p" event={"ID":"cec4114f-83b9-4ee3-bca4-845498e1c57b","Type":"ContainerDied","Data":"ed45304dac62a950ac3430817a4c8c840a0ad0b9dac8c0b300714d36b61fc09b"}
Sep 17 14:35:51.022650 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:51.021770    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p" event={"ID":"cec4114f-83b9-4ee3-bca4-845498e1c57b","Type":"ContainerDied","Data":"c265ef1cab91fc28fcbc649d389a3eca62b38ba58df7440660c1726eac726e70"}
Sep 17 14:35:51.022650 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:51.021836    2580 scope.go:117] "RemoveContainer" containerID="ed45304dac62a950ac3430817a4c8c840a0ad0b9dac8c0b300714d36b61fc09b"
Sep 17 14:35:51.035980 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:51.035958    2580 scope.go:117] "RemoveContainer" containerID="ed45304dac62a950ac3430817a4c8c840a0ad0b9dac8c0b300714d36b61fc09b"
Sep 17 14:35:51.036319 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:35:51.036300    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed45304dac62a950ac3430817a4c8c840a0ad0b9dac8c0b300714d36b61fc09b\": container with ID starting with ed45304dac62a950ac3430817a4c8c840a0ad0b9dac8c0b300714d36b61fc09b not found: ID does not exist" containerID="ed45304dac62a950ac3430817a4c8c840a0ad0b9dac8c0b300714d36b61fc09b"
Sep 17 14:35:51.036391 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:51.036335    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed45304dac62a950ac3430817a4c8c840a0ad0b9dac8c0b300714d36b61fc09b"} err="failed to get container status \"ed45304dac62a950ac3430817a4c8c840a0ad0b9dac8c0b300714d36b61fc09b\": rpc error: code = NotFound desc = could not find container \"ed45304dac62a950ac3430817a4c8c840a0ad0b9dac8c0b300714d36b61fc09b\": container with ID starting with ed45304dac62a950ac3430817a4c8c840a0ad0b9dac8c0b300714d36b61fc09b not found: ID does not exist"
Sep 17 14:35:51.045089 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:51.045054    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qj2n\" (UniqueName: \"kubernetes.io/projected/cec4114f-83b9-4ee3-bca4-845498e1c57b-kube-api-access-5qj2n\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:35:51.045089 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:51.045088    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cec4114f-83b9-4ee3-bca4-845498e1c57b-maas-api-tls\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:35:51.045273 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:51.045098    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cec4114f-83b9-4ee3-bca4-845498e1c57b-openshift-service-ca\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:35:51.045273 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:51.045107    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cec4114f-83b9-4ee3-bca4-845498e1c57b-metrics-certs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:35:51.049552 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:51.049520    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p"]
Sep 17 14:35:51.054932 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:51.054903    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4009da-5fd57b8556-cmh6p"]
Sep 17 14:35:51.177128 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:51.177048    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77c10e41-5773-4749-accd-cbd71db955dc" path="/var/lib/kubelet/pods/77c10e41-5773-4749-accd-cbd71db955dc/volumes"
Sep 17 14:35:51.177442 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:51.177429    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cec4114f-83b9-4ee3-bca4-845498e1c57b" path="/var/lib/kubelet/pods/cec4114f-83b9-4ee3-bca4-845498e1c57b/volumes"
Sep 17 14:35:57.325287 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:35:57.325248    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:36:08.068995 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:08.068960    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc"]
Sep 17 14:36:08.069496 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:08.069224    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc" podUID="e0d020ed-36ab-48ea-8639-f25a50435b6c" containerName="maas-api" containerID="cri-o://e932f015abd3eca7e81d9d509568abe9a9329673d63dcf4e47ab0d68c37b3fc3" gracePeriod=30
Sep 17 14:36:08.320538 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:08.320478    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc"
Sep 17 14:36:08.409772 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:08.409699    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfp65\" (UniqueName: \"kubernetes.io/projected/e0d020ed-36ab-48ea-8639-f25a50435b6c-kube-api-access-mfp65\") pod \"e0d020ed-36ab-48ea-8639-f25a50435b6c\" (UID: \"e0d020ed-36ab-48ea-8639-f25a50435b6c\") "
Sep 17 14:36:08.409968 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:08.409799    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0d020ed-36ab-48ea-8639-f25a50435b6c-maas-api-tls\") pod \"e0d020ed-36ab-48ea-8639-f25a50435b6c\" (UID: \"e0d020ed-36ab-48ea-8639-f25a50435b6c\") "
Sep 17 14:36:08.409968 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:08.409865    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0d020ed-36ab-48ea-8639-f25a50435b6c-openshift-service-ca\") pod \"e0d020ed-36ab-48ea-8639-f25a50435b6c\" (UID: \"e0d020ed-36ab-48ea-8639-f25a50435b6c\") "
Sep 17 14:36:08.409968 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:08.409909    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0d020ed-36ab-48ea-8639-f25a50435b6c-metrics-certs\") pod \"e0d020ed-36ab-48ea-8639-f25a50435b6c\" (UID: \"e0d020ed-36ab-48ea-8639-f25a50435b6c\") "
Sep 17 14:36:08.410308 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:08.410275    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0d020ed-36ab-48ea-8639-f25a50435b6c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e0d020ed-36ab-48ea-8639-f25a50435b6c" (UID: "e0d020ed-36ab-48ea-8639-f25a50435b6c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:36:08.412111 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:08.412087    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0d020ed-36ab-48ea-8639-f25a50435b6c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e0d020ed-36ab-48ea-8639-f25a50435b6c" (UID: "e0d020ed-36ab-48ea-8639-f25a50435b6c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:36:08.412410 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:08.412388    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0d020ed-36ab-48ea-8639-f25a50435b6c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e0d020ed-36ab-48ea-8639-f25a50435b6c" (UID: "e0d020ed-36ab-48ea-8639-f25a50435b6c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:36:08.412473 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:08.412426    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0d020ed-36ab-48ea-8639-f25a50435b6c-kube-api-access-mfp65" (OuterVolumeSpecName: "kube-api-access-mfp65") pod "e0d020ed-36ab-48ea-8639-f25a50435b6c" (UID: "e0d020ed-36ab-48ea-8639-f25a50435b6c"). InnerVolumeSpecName "kube-api-access-mfp65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:36:08.511143 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:08.511102    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfp65\" (UniqueName: \"kubernetes.io/projected/e0d020ed-36ab-48ea-8639-f25a50435b6c-kube-api-access-mfp65\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:36:08.511143 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:08.511138    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0d020ed-36ab-48ea-8639-f25a50435b6c-maas-api-tls\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:36:08.511143 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:08.511149    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0d020ed-36ab-48ea-8639-f25a50435b6c-openshift-service-ca\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:36:08.511410 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:08.511158    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0d020ed-36ab-48ea-8639-f25a50435b6c-metrics-certs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:36:09.132893 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:09.132860    2580 generic.go:356] "Generic (PLEG): container finished" podID="e0d020ed-36ab-48ea-8639-f25a50435b6c" containerID="e932f015abd3eca7e81d9d509568abe9a9329673d63dcf4e47ab0d68c37b3fc3" exitCode=0
Sep 17 14:36:09.133290 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:09.132900    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc" event={"ID":"e0d020ed-36ab-48ea-8639-f25a50435b6c","Type":"ContainerDied","Data":"e932f015abd3eca7e81d9d509568abe9a9329673d63dcf4e47ab0d68c37b3fc3"}
Sep 17 14:36:09.133290 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:09.132914    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc"
Sep 17 14:36:09.133290 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:09.132975    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc" event={"ID":"e0d020ed-36ab-48ea-8639-f25a50435b6c","Type":"ContainerDied","Data":"7e6bc4a1a585dd6db11cd9cab6787855eb4111d1c1193bab6fdcd100bc5d659e"}
Sep 17 14:36:09.133290 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:09.132998    2580 scope.go:117] "RemoveContainer" containerID="e932f015abd3eca7e81d9d509568abe9a9329673d63dcf4e47ab0d68c37b3fc3"
Sep 17 14:36:09.143629 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:09.143607    2580 scope.go:117] "RemoveContainer" containerID="e932f015abd3eca7e81d9d509568abe9a9329673d63dcf4e47ab0d68c37b3fc3"
Sep 17 14:36:09.143967 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:36:09.143947    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e932f015abd3eca7e81d9d509568abe9a9329673d63dcf4e47ab0d68c37b3fc3\": container with ID starting with e932f015abd3eca7e81d9d509568abe9a9329673d63dcf4e47ab0d68c37b3fc3 not found: ID does not exist" containerID="e932f015abd3eca7e81d9d509568abe9a9329673d63dcf4e47ab0d68c37b3fc3"
Sep 17 14:36:09.144030 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:09.143979    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e932f015abd3eca7e81d9d509568abe9a9329673d63dcf4e47ab0d68c37b3fc3"} err="failed to get container status \"e932f015abd3eca7e81d9d509568abe9a9329673d63dcf4e47ab0d68c37b3fc3\": rpc error: code = NotFound desc = could not find container \"e932f015abd3eca7e81d9d509568abe9a9329673d63dcf4e47ab0d68c37b3fc3\": container with ID starting with e932f015abd3eca7e81d9d509568abe9a9329673d63dcf4e47ab0d68c37b3fc3 not found: ID does not exist"
Sep 17 14:36:09.158053 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:09.157995    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc"]
Sep 17 14:36:09.160442 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:09.160419    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-60bf73-7f7f4997ff-rqgkc"]
Sep 17 14:36:09.177431 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:09.177402    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0d020ed-36ab-48ea-8639-f25a50435b6c" path="/var/lib/kubelet/pods/e0d020ed-36ab-48ea-8639-f25a50435b6c/volumes"
Sep 17 14:36:20.809256 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:20.809220    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:36:42.021134 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:42.021094    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:36:42.502587 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:42.502556    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-8b50f2-77b8c4548f-9drjt"]
Sep 17 14:36:42.502827 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:42.502799    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-8b50f2-77b8c4548f-9drjt" podUID="f1058a4a-293f-4bb5-9046-85965ce053b5" containerName="payload-processing" containerID="cri-o://98735c3fb9322e53abbf4b4c867e43dcf27845d31b2fe20bad20bb1a7e7252b1" gracePeriod=30
Sep 17 14:36:42.768152 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:42.768086    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-8b50f2-77b8c4548f-9drjt"
Sep 17 14:36:42.829253 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:42.829220    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6b79b\" (UniqueName: \"kubernetes.io/projected/f1058a4a-293f-4bb5-9046-85965ce053b5-kube-api-access-6b79b\") pod \"f1058a4a-293f-4bb5-9046-85965ce053b5\" (UID: \"f1058a4a-293f-4bb5-9046-85965ce053b5\") "
Sep 17 14:36:42.829427 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:42.829287    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1058a4a-293f-4bb5-9046-85965ce053b5-plugins-config-volume\") pod \"f1058a4a-293f-4bb5-9046-85965ce053b5\" (UID: \"f1058a4a-293f-4bb5-9046-85965ce053b5\") "
Sep 17 14:36:42.829640 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:42.829617    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1058a4a-293f-4bb5-9046-85965ce053b5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f1058a4a-293f-4bb5-9046-85965ce053b5" (UID: "f1058a4a-293f-4bb5-9046-85965ce053b5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:36:42.831498 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:42.831474    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1058a4a-293f-4bb5-9046-85965ce053b5-kube-api-access-6b79b" (OuterVolumeSpecName: "kube-api-access-6b79b") pod "f1058a4a-293f-4bb5-9046-85965ce053b5" (UID: "f1058a4a-293f-4bb5-9046-85965ce053b5"). InnerVolumeSpecName "kube-api-access-6b79b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:36:42.930956 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:42.930918    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6b79b\" (UniqueName: \"kubernetes.io/projected/f1058a4a-293f-4bb5-9046-85965ce053b5-kube-api-access-6b79b\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:36:42.930956 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:42.930951    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1058a4a-293f-4bb5-9046-85965ce053b5-plugins-config-volume\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:36:43.335432 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:43.335399    2580 generic.go:356] "Generic (PLEG): container finished" podID="f1058a4a-293f-4bb5-9046-85965ce053b5" containerID="98735c3fb9322e53abbf4b4c867e43dcf27845d31b2fe20bad20bb1a7e7252b1" exitCode=0
Sep 17 14:36:43.335938 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:43.335442    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-8b50f2-77b8c4548f-9drjt"
Sep 17 14:36:43.335938 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:43.335475    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-8b50f2-77b8c4548f-9drjt" event={"ID":"f1058a4a-293f-4bb5-9046-85965ce053b5","Type":"ContainerDied","Data":"98735c3fb9322e53abbf4b4c867e43dcf27845d31b2fe20bad20bb1a7e7252b1"}
Sep 17 14:36:43.335938 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:43.335528    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-8b50f2-77b8c4548f-9drjt" event={"ID":"f1058a4a-293f-4bb5-9046-85965ce053b5","Type":"ContainerDied","Data":"5c0dd7984e912faf3a298657fadfb757e8f949dce61fda7b6371d1ebff9156e6"}
Sep 17 14:36:43.335938 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:43.335550    2580 scope.go:117] "RemoveContainer" containerID="98735c3fb9322e53abbf4b4c867e43dcf27845d31b2fe20bad20bb1a7e7252b1"
Sep 17 14:36:43.344762 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:43.344742    2580 scope.go:117] "RemoveContainer" containerID="98735c3fb9322e53abbf4b4c867e43dcf27845d31b2fe20bad20bb1a7e7252b1"
Sep 17 14:36:43.345067 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:36:43.345044    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98735c3fb9322e53abbf4b4c867e43dcf27845d31b2fe20bad20bb1a7e7252b1\": container with ID starting with 98735c3fb9322e53abbf4b4c867e43dcf27845d31b2fe20bad20bb1a7e7252b1 not found: ID does not exist" containerID="98735c3fb9322e53abbf4b4c867e43dcf27845d31b2fe20bad20bb1a7e7252b1"
Sep 17 14:36:43.345123 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:43.345077    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98735c3fb9322e53abbf4b4c867e43dcf27845d31b2fe20bad20bb1a7e7252b1"} err="failed to get container status \"98735c3fb9322e53abbf4b4c867e43dcf27845d31b2fe20bad20bb1a7e7252b1\": rpc error: code = NotFound desc = could not find container \"98735c3fb9322e53abbf4b4c867e43dcf27845d31b2fe20bad20bb1a7e7252b1\": container with ID starting with 98735c3fb9322e53abbf4b4c867e43dcf27845d31b2fe20bad20bb1a7e7252b1 not found: ID does not exist"
Sep 17 14:36:43.353008 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:43.352985    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-8b50f2-77b8c4548f-9drjt"]
Sep 17 14:36:43.357444 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:43.357423    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-8b50f2-77b8c4548f-9drjt"]
Sep 17 14:36:45.177635 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:45.177599    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1058a4a-293f-4bb5-9046-85965ce053b5" path="/var/lib/kubelet/pods/f1058a4a-293f-4bb5-9046-85965ce053b5/volumes"
Sep 17 14:36:53.346309 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:36:53.346273    2580 scope.go:117] "RemoveContainer" containerID="37b420d3174c21d502c3b5fdea763d4eb1fbbe9a27c21462c540995aaac3a7ec"
Sep 17 14:37:03.714409 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:03.714367    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:37:11.649586 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.649548    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7362-1f04c8"]
Sep 17 14:37:11.650001 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.649959    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9451e47-6204-4dc2-996b-dfa47ea039b1" containerName="main"
Sep 17 14:37:11.650001 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.649971    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9451e47-6204-4dc2-996b-dfa47ea039b1" containerName="main"
Sep 17 14:37:11.650001 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.649979    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70983359-2033-4f9b-ba80-dffc4e33d303" containerName="main"
Sep 17 14:37:11.650001 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.649984    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="70983359-2033-4f9b-ba80-dffc4e33d303" containerName="main"
Sep 17 14:37:11.650001 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.649991    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aebd6b3a-1ed0-47d2-bdb4-20136237b893" containerName="istio-proxy"
Sep 17 14:37:11.650001 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.649996    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="aebd6b3a-1ed0-47d2-bdb4-20136237b893" containerName="istio-proxy"
Sep 17 14:37:11.650198 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.650004    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1058a4a-293f-4bb5-9046-85965ce053b5" containerName="payload-processing"
Sep 17 14:37:11.650198 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.650012    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1058a4a-293f-4bb5-9046-85965ce053b5" containerName="payload-processing"
Sep 17 14:37:11.650198 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.650019    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cffa421-5a61-4eb0-ab22-49fdccc497bd" containerName="main"
Sep 17 14:37:11.650198 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.650024    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cffa421-5a61-4eb0-ab22-49fdccc497bd" containerName="main"
Sep 17 14:37:11.650198 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.650034    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cec4114f-83b9-4ee3-bca4-845498e1c57b" containerName="maas-api"
Sep 17 14:37:11.650198 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.650040    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cec4114f-83b9-4ee3-bca4-845498e1c57b" containerName="maas-api"
Sep 17 14:37:11.650198 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.650052    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aebd6b3a-1ed0-47d2-bdb4-20136237b893" containerName="istio-proxy"
Sep 17 14:37:11.650198 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.650057    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="aebd6b3a-1ed0-47d2-bdb4-20136237b893" containerName="istio-proxy"
Sep 17 14:37:11.650198 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.650065    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0d020ed-36ab-48ea-8639-f25a50435b6c" containerName="maas-api"
Sep 17 14:37:11.650198 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.650070    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0d020ed-36ab-48ea-8639-f25a50435b6c" containerName="maas-api"
Sep 17 14:37:11.650198 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.650076    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c24cbb4-2904-4a2e-8482-96b1236d9ed7" containerName="main"
Sep 17 14:37:11.650198 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.650081    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c24cbb4-2904-4a2e-8482-96b1236d9ed7" containerName="main"
Sep 17 14:37:11.650198 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.650089    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4bf7d41-bc62-4e18-8035-16cf5b805f29" containerName="maas-api"
Sep 17 14:37:11.650198 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.650096    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4bf7d41-bc62-4e18-8035-16cf5b805f29" containerName="maas-api"
Sep 17 14:37:11.650198 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.650155    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="70983359-2033-4f9b-ba80-dffc4e33d303" containerName="main"
Sep 17 14:37:11.650198 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.650163    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9451e47-6204-4dc2-996b-dfa47ea039b1" containerName="main"
Sep 17 14:37:11.650198 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.650167    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4bf7d41-bc62-4e18-8035-16cf5b805f29" containerName="maas-api"
Sep 17 14:37:11.650198 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.650173    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="aebd6b3a-1ed0-47d2-bdb4-20136237b893" containerName="istio-proxy"
Sep 17 14:37:11.650198 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.650179    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cffa421-5a61-4eb0-ab22-49fdccc497bd" containerName="main"
Sep 17 14:37:11.650198 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.650185    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c24cbb4-2904-4a2e-8482-96b1236d9ed7" containerName="main"
Sep 17 14:37:11.650198 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.650191    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="aebd6b3a-1ed0-47d2-bdb4-20136237b893" containerName="istio-proxy"
Sep 17 14:37:11.650198 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.650198    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cec4114f-83b9-4ee3-bca4-845498e1c57b" containerName="maas-api"
Sep 17 14:37:11.650198 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.650203    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0d020ed-36ab-48ea-8639-f25a50435b6c" containerName="maas-api"
Sep 17 14:37:11.650198 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.650209    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1058a4a-293f-4bb5-9046-85965ce053b5" containerName="payload-processing"
Sep 17 14:37:11.653402 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.653383    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7362-1f04c8"
Sep 17 14:37:11.656763 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.656738    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-cflzc\""
Sep 17 14:37:11.662251 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.661897    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7362-1f04c8"]
Sep 17 14:37:11.823579 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.823531    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tw5m\" (UniqueName: \"kubernetes.io/projected/763fd97c-84ac-461d-96db-09ce3c7c3676-kube-api-access-8tw5m\") pod \"test-curl-7362-1f04c8\" (UID: \"763fd97c-84ac-461d-96db-09ce3c7c3676\") " pod="opendatahub/test-curl-7362-1f04c8"
Sep 17 14:37:11.925229 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.925113    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tw5m\" (UniqueName: \"kubernetes.io/projected/763fd97c-84ac-461d-96db-09ce3c7c3676-kube-api-access-8tw5m\") pod \"test-curl-7362-1f04c8\" (UID: \"763fd97c-84ac-461d-96db-09ce3c7c3676\") " pod="opendatahub/test-curl-7362-1f04c8"
Sep 17 14:37:11.935201 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.935169    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tw5m\" (UniqueName: \"kubernetes.io/projected/763fd97c-84ac-461d-96db-09ce3c7c3676-kube-api-access-8tw5m\") pod \"test-curl-7362-1f04c8\" (UID: \"763fd97c-84ac-461d-96db-09ce3c7c3676\") " pod="opendatahub/test-curl-7362-1f04c8"
Sep 17 14:37:11.965303 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:11.965264    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7362-1f04c8"
Sep 17 14:37:12.239831 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:12.239795    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7362-1f04c8"]
Sep 17 14:37:12.242012 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:37:12.241977    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod763fd97c_84ac_461d_96db_09ce3c7c3676.slice/crio-a520deb4829484559b0d62eb32365113762d5efa3e9dd83d36071332a2f93ddb WatchSource:0}: Error finding container a520deb4829484559b0d62eb32365113762d5efa3e9dd83d36071332a2f93ddb: Status 404 returned error can't find the container with id a520deb4829484559b0d62eb32365113762d5efa3e9dd83d36071332a2f93ddb
Sep 17 14:37:12.525193 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:12.525096    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7362-1f04c8" event={"ID":"763fd97c-84ac-461d-96db-09ce3c7c3676","Type":"ContainerStarted","Data":"1b78346251947d4fabf442585d67cc6064fceb86b7e876b24a920825b2a5d2a8"}
Sep 17 14:37:12.525193 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:12.525147    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7362-1f04c8" event={"ID":"763fd97c-84ac-461d-96db-09ce3c7c3676","Type":"ContainerStarted","Data":"a520deb4829484559b0d62eb32365113762d5efa3e9dd83d36071332a2f93ddb"}
Sep 17 14:37:12.541539 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:12.541480    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7362-1f04c8" podStartSLOduration=1.5414612669999999 podStartE2EDuration="1.541461267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:37:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:37:12.539128478 +0000 UTC m=+1819.983204065" watchObservedRunningTime="2026-09-17 14:37:12.541461267 +0000 UTC m=+1819.985536849"
Sep 17 14:37:13.134941 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:13.134900    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7362-1f04c8"]
Sep 17 14:37:13.137410 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:13.137379    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7362-1f04c8"]
Sep 17 14:37:13.530516 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:37:13.530484    2580 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7362-1f04c8" container="test-curl-7362-1f04c8"
Sep 17 14:37:13.799350 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:13.799265    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:37:14.536061 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:14.536016    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7362-1f04c8" podUID="763fd97c-84ac-461d-96db-09ce3c7c3676" containerName="test-curl-7362-1f04c8" containerID="cri-o://1b78346251947d4fabf442585d67cc6064fceb86b7e876b24a920825b2a5d2a8" gracePeriod=2
Sep 17 14:37:16.713088 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:16.713058    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7362-1f04c8"
Sep 17 14:37:16.765309 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:16.765268    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tw5m\" (UniqueName: \"kubernetes.io/projected/763fd97c-84ac-461d-96db-09ce3c7c3676-kube-api-access-8tw5m\") pod \"763fd97c-84ac-461d-96db-09ce3c7c3676\" (UID: \"763fd97c-84ac-461d-96db-09ce3c7c3676\") "
Sep 17 14:37:16.767394 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:16.767366    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/763fd97c-84ac-461d-96db-09ce3c7c3676-kube-api-access-8tw5m" (OuterVolumeSpecName: "kube-api-access-8tw5m") pod "763fd97c-84ac-461d-96db-09ce3c7c3676" (UID: "763fd97c-84ac-461d-96db-09ce3c7c3676"). InnerVolumeSpecName "kube-api-access-8tw5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:37:16.866218 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:16.866128    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tw5m\" (UniqueName: \"kubernetes.io/projected/763fd97c-84ac-461d-96db-09ce3c7c3676-kube-api-access-8tw5m\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:37:17.177332 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:17.177254    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="763fd97c-84ac-461d-96db-09ce3c7c3676" path="/var/lib/kubelet/pods/763fd97c-84ac-461d-96db-09ce3c7c3676/volumes"
Sep 17 14:37:17.554481 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:17.554442    2580 generic.go:356] "Generic (PLEG): container finished" podID="763fd97c-84ac-461d-96db-09ce3c7c3676" containerID="1b78346251947d4fabf442585d67cc6064fceb86b7e876b24a920825b2a5d2a8" exitCode=137
Sep 17 14:37:17.554481 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:17.554485    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7362-1f04c8"
Sep 17 14:37:17.554723 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:17.554544    2580 scope.go:117] "RemoveContainer" containerID="1b78346251947d4fabf442585d67cc6064fceb86b7e876b24a920825b2a5d2a8"
Sep 17 14:37:17.564288 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:17.564264    2580 scope.go:117] "RemoveContainer" containerID="1b78346251947d4fabf442585d67cc6064fceb86b7e876b24a920825b2a5d2a8"
Sep 17 14:37:17.564681 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:37:17.564658    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b78346251947d4fabf442585d67cc6064fceb86b7e876b24a920825b2a5d2a8\": container with ID starting with 1b78346251947d4fabf442585d67cc6064fceb86b7e876b24a920825b2a5d2a8 not found: ID does not exist" containerID="1b78346251947d4fabf442585d67cc6064fceb86b7e876b24a920825b2a5d2a8"
Sep 17 14:37:17.564823 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:17.564696    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b78346251947d4fabf442585d67cc6064fceb86b7e876b24a920825b2a5d2a8"} err="failed to get container status \"1b78346251947d4fabf442585d67cc6064fceb86b7e876b24a920825b2a5d2a8\": rpc error: code = NotFound desc = could not find container \"1b78346251947d4fabf442585d67cc6064fceb86b7e876b24a920825b2a5d2a8\": container with ID starting with 1b78346251947d4fabf442585d67cc6064fceb86b7e876b24a920825b2a5d2a8 not found: ID does not exist"
Sep 17 14:37:22.023599 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:22.023558    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:37:37.925388 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:37:37.925347    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:38:00.418069 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:00.418024    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:38:13.332798 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:13.332761    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:38:26.512351 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:26.512269    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:38:29.956591 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:29.956555    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7362-0c371b"]
Sep 17 14:38:29.956986 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:29.956970    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="763fd97c-84ac-461d-96db-09ce3c7c3676" containerName="test-curl-7362-1f04c8"
Sep 17 14:38:29.956986 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:29.956982    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="763fd97c-84ac-461d-96db-09ce3c7c3676" containerName="test-curl-7362-1f04c8"
Sep 17 14:38:29.957058 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:29.957046    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="763fd97c-84ac-461d-96db-09ce3c7c3676" containerName="test-curl-7362-1f04c8"
Sep 17 14:38:29.960141 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:29.960124    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7362-0c371b"
Sep 17 14:38:29.963479 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:29.963447    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-cflzc\""
Sep 17 14:38:29.966987 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:29.966960    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7362-0c371b"]
Sep 17 14:38:30.041234 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:30.041188    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd4hw\" (UniqueName: \"kubernetes.io/projected/3cdb1ea9-951a-4b84-95c8-addf8bcc6cb6-kube-api-access-sd4hw\") pod \"test-curl-7362-0c371b\" (UID: \"3cdb1ea9-951a-4b84-95c8-addf8bcc6cb6\") " pod="opendatahub/test-curl-7362-0c371b"
Sep 17 14:38:30.142704 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:30.142659    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd4hw\" (UniqueName: \"kubernetes.io/projected/3cdb1ea9-951a-4b84-95c8-addf8bcc6cb6-kube-api-access-sd4hw\") pod \"test-curl-7362-0c371b\" (UID: \"3cdb1ea9-951a-4b84-95c8-addf8bcc6cb6\") " pod="opendatahub/test-curl-7362-0c371b"
Sep 17 14:38:30.152600 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:30.152563    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd4hw\" (UniqueName: \"kubernetes.io/projected/3cdb1ea9-951a-4b84-95c8-addf8bcc6cb6-kube-api-access-sd4hw\") pod \"test-curl-7362-0c371b\" (UID: \"3cdb1ea9-951a-4b84-95c8-addf8bcc6cb6\") " pod="opendatahub/test-curl-7362-0c371b"
Sep 17 14:38:30.271834 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:30.271702    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7362-0c371b"
Sep 17 14:38:30.547478 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:30.547450    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7362-0c371b"]
Sep 17 14:38:30.549125 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:38:30.549095    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3cdb1ea9_951a_4b84_95c8_addf8bcc6cb6.slice/crio-0a04e80662d373f0129c2b7384b5ea96de0c7e7fef13b7c1aa9756f8b2dc7bd7 WatchSource:0}: Error finding container 0a04e80662d373f0129c2b7384b5ea96de0c7e7fef13b7c1aa9756f8b2dc7bd7: Status 404 returned error can't find the container with id 0a04e80662d373f0129c2b7384b5ea96de0c7e7fef13b7c1aa9756f8b2dc7bd7
Sep 17 14:38:30.985073 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:30.983765    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7362-0c371b" event={"ID":"3cdb1ea9-951a-4b84-95c8-addf8bcc6cb6","Type":"ContainerStarted","Data":"08c907b17f5df31438d543d3d32559541630bdf2ff56cfd3b521a2abd42e5742"}
Sep 17 14:38:30.985073 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:30.983829    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7362-0c371b" event={"ID":"3cdb1ea9-951a-4b84-95c8-addf8bcc6cb6","Type":"ContainerStarted","Data":"0a04e80662d373f0129c2b7384b5ea96de0c7e7fef13b7c1aa9756f8b2dc7bd7"}
Sep 17 14:38:31.002263 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:31.002202    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7362-0c371b" podStartSLOduration=2.002186056 podStartE2EDuration="2.002186056s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:38:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:38:31.000196234 +0000 UTC m=+1898.444271843" watchObservedRunningTime="2026-09-17 14:38:31.002186056 +0000 UTC m=+1898.446261641"
Sep 17 14:38:31.586861 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:31.586820    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7362-0c371b"]
Sep 17 14:38:31.591139 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:31.591105    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7362-0c371b"]
Sep 17 14:38:31.711619 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:31.711584    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7362-fcca71"]
Sep 17 14:38:31.712013 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:31.712000    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cdb1ea9-951a-4b84-95c8-addf8bcc6cb6" containerName="test-curl-7362-0c371b"
Sep 17 14:38:31.712013 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:31.712014    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cdb1ea9-951a-4b84-95c8-addf8bcc6cb6" containerName="test-curl-7362-0c371b"
Sep 17 14:38:31.712106 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:31.712082    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cdb1ea9-951a-4b84-95c8-addf8bcc6cb6" containerName="test-curl-7362-0c371b"
Sep 17 14:38:31.714867 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:31.714845    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7362-fcca71"
Sep 17 14:38:31.721566 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:31.721535    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7362-fcca71"]
Sep 17 14:38:31.859950 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:31.859911    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft6db\" (UniqueName: \"kubernetes.io/projected/af0cbbf2-cbea-426b-91e0-bc64b57bfde4-kube-api-access-ft6db\") pod \"test-curl-7362-fcca71\" (UID: \"af0cbbf2-cbea-426b-91e0-bc64b57bfde4\") " pod="opendatahub/test-curl-7362-fcca71"
Sep 17 14:38:31.961384 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:31.961335    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft6db\" (UniqueName: \"kubernetes.io/projected/af0cbbf2-cbea-426b-91e0-bc64b57bfde4-kube-api-access-ft6db\") pod \"test-curl-7362-fcca71\" (UID: \"af0cbbf2-cbea-426b-91e0-bc64b57bfde4\") " pod="opendatahub/test-curl-7362-fcca71"
Sep 17 14:38:31.970474 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:31.970405    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft6db\" (UniqueName: \"kubernetes.io/projected/af0cbbf2-cbea-426b-91e0-bc64b57bfde4-kube-api-access-ft6db\") pod \"test-curl-7362-fcca71\" (UID: \"af0cbbf2-cbea-426b-91e0-bc64b57bfde4\") " pod="opendatahub/test-curl-7362-fcca71"
Sep 17 14:38:31.989603 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:38:31.989569    2580 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7362-0c371b" container="test-curl-7362-0c371b"
Sep 17 14:38:32.026014 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:32.025971    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7362-fcca71"
Sep 17 14:38:32.298189 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:32.298154    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7362-fcca71"]
Sep 17 14:38:32.299210 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:38:32.299179    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf0cbbf2_cbea_426b_91e0_bc64b57bfde4.slice/crio-512f92f194ef8b7debf5c443ab121950ab2ca855635bede66b90039d0cf84de9 WatchSource:0}: Error finding container 512f92f194ef8b7debf5c443ab121950ab2ca855635bede66b90039d0cf84de9: Status 404 returned error can't find the container with id 512f92f194ef8b7debf5c443ab121950ab2ca855635bede66b90039d0cf84de9
Sep 17 14:38:32.996902 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:32.996859    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7362-fcca71" event={"ID":"af0cbbf2-cbea-426b-91e0-bc64b57bfde4","Type":"ContainerStarted","Data":"de337c3ef7a7842e41e855f82de26495825d3df8626a320b0ca5f2d35103324d"}
Sep 17 14:38:32.997336 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:32.996909    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7362-fcca71" event={"ID":"af0cbbf2-cbea-426b-91e0-bc64b57bfde4","Type":"ContainerStarted","Data":"512f92f194ef8b7debf5c443ab121950ab2ca855635bede66b90039d0cf84de9"}
Sep 17 14:38:32.997336 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:32.996925    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7362-0c371b" podUID="3cdb1ea9-951a-4b84-95c8-addf8bcc6cb6" containerName="test-curl-7362-0c371b" containerID="cri-o://08c907b17f5df31438d543d3d32559541630bdf2ff56cfd3b521a2abd42e5742" gracePeriod=2
Sep 17 14:38:33.012047 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:33.011992    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7362-fcca71" podStartSLOduration=2.011976069 podStartE2EDuration="2.011976069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:38:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:38:33.011009151 +0000 UTC m=+1900.455084736" watchObservedRunningTime="2026-09-17 14:38:33.011976069 +0000 UTC m=+1900.456051654"
Sep 17 14:38:33.013351 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:38:33.013323    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7362-0c371b\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" podUID="3cdb1ea9-951a-4b84-95c8-addf8bcc6cb6" pod="opendatahub/test-curl-7362-0c371b"
Sep 17 14:38:33.015739 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:38:33.015690    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7362-0c371b\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" podUID="3cdb1ea9-951a-4b84-95c8-addf8bcc6cb6" pod="opendatahub/test-curl-7362-0c371b"
Sep 17 14:38:33.176880 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:38:33.176840    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7362-0c371b\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" podUID="3cdb1ea9-951a-4b84-95c8-addf8bcc6cb6" pod="opendatahub/test-curl-7362-0c371b"
Sep 17 14:38:33.603457 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:33.603421    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7362-fcca71"]
Sep 17 14:38:33.610528 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:33.610490    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7362-fcca71"]
Sep 17 14:38:34.002258 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:38:34.002218    2580 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7362-fcca71" container="test-curl-7362-fcca71"
Sep 17 14:38:35.009516 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:35.009448    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7362-fcca71" podUID="af0cbbf2-cbea-426b-91e0-bc64b57bfde4" containerName="test-curl-7362-fcca71" containerID="cri-o://de337c3ef7a7842e41e855f82de26495825d3df8626a320b0ca5f2d35103324d" gracePeriod=2
Sep 17 14:38:35.013241 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:38:35.013205    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7362-fcca71\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" podUID="af0cbbf2-cbea-426b-91e0-bc64b57bfde4" pod="opendatahub/test-curl-7362-fcca71"
Sep 17 14:38:35.174968 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:35.174941    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7362-0c371b"
Sep 17 14:38:35.177390 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:38:35.177363    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7362-fcca71\" is forbidden: User \"system:node:ip-10-0-142-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-22.ec2.internal' and this object" podUID="af0cbbf2-cbea-426b-91e0-bc64b57bfde4" pod="opendatahub/test-curl-7362-fcca71"
Sep 17 14:38:35.290477 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:35.290376    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sd4hw\" (UniqueName: \"kubernetes.io/projected/3cdb1ea9-951a-4b84-95c8-addf8bcc6cb6-kube-api-access-sd4hw\") pod \"3cdb1ea9-951a-4b84-95c8-addf8bcc6cb6\" (UID: \"3cdb1ea9-951a-4b84-95c8-addf8bcc6cb6\") "
Sep 17 14:38:35.292595 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:35.292559    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cdb1ea9-951a-4b84-95c8-addf8bcc6cb6-kube-api-access-sd4hw" (OuterVolumeSpecName: "kube-api-access-sd4hw") pod "3cdb1ea9-951a-4b84-95c8-addf8bcc6cb6" (UID: "3cdb1ea9-951a-4b84-95c8-addf8bcc6cb6"). InnerVolumeSpecName "kube-api-access-sd4hw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:38:35.391459 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:35.391422    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sd4hw\" (UniqueName: \"kubernetes.io/projected/3cdb1ea9-951a-4b84-95c8-addf8bcc6cb6-kube-api-access-sd4hw\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:38:36.015261 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:36.015222    2580 generic.go:356] "Generic (PLEG): container finished" podID="3cdb1ea9-951a-4b84-95c8-addf8bcc6cb6" containerID="08c907b17f5df31438d543d3d32559541630bdf2ff56cfd3b521a2abd42e5742" exitCode=137
Sep 17 14:38:36.015760 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:36.015268    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7362-0c371b"
Sep 17 14:38:36.015760 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:36.015333    2580 scope.go:117] "RemoveContainer" containerID="08c907b17f5df31438d543d3d32559541630bdf2ff56cfd3b521a2abd42e5742"
Sep 17 14:38:36.024589 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:36.024571    2580 scope.go:117] "RemoveContainer" containerID="08c907b17f5df31438d543d3d32559541630bdf2ff56cfd3b521a2abd42e5742"
Sep 17 14:38:36.024886 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:38:36.024860    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08c907b17f5df31438d543d3d32559541630bdf2ff56cfd3b521a2abd42e5742\": container with ID starting with 08c907b17f5df31438d543d3d32559541630bdf2ff56cfd3b521a2abd42e5742 not found: ID does not exist" containerID="08c907b17f5df31438d543d3d32559541630bdf2ff56cfd3b521a2abd42e5742"
Sep 17 14:38:36.024945 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:36.024899    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08c907b17f5df31438d543d3d32559541630bdf2ff56cfd3b521a2abd42e5742"} err="failed to get container status \"08c907b17f5df31438d543d3d32559541630bdf2ff56cfd3b521a2abd42e5742\": rpc error: code = NotFound desc = could not find container \"08c907b17f5df31438d543d3d32559541630bdf2ff56cfd3b521a2abd42e5742\": container with ID starting with 08c907b17f5df31438d543d3d32559541630bdf2ff56cfd3b521a2abd42e5742 not found: ID does not exist"
Sep 17 14:38:37.164466 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:37.164434    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7362-fcca71"
Sep 17 14:38:37.176765 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:37.176731    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cdb1ea9-951a-4b84-95c8-addf8bcc6cb6" path="/var/lib/kubelet/pods/3cdb1ea9-951a-4b84-95c8-addf8bcc6cb6/volumes"
Sep 17 14:38:37.316673 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:37.316571    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ft6db\" (UniqueName: \"kubernetes.io/projected/af0cbbf2-cbea-426b-91e0-bc64b57bfde4-kube-api-access-ft6db\") pod \"af0cbbf2-cbea-426b-91e0-bc64b57bfde4\" (UID: \"af0cbbf2-cbea-426b-91e0-bc64b57bfde4\") "
Sep 17 14:38:37.318782 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:37.318755    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af0cbbf2-cbea-426b-91e0-bc64b57bfde4-kube-api-access-ft6db" (OuterVolumeSpecName: "kube-api-access-ft6db") pod "af0cbbf2-cbea-426b-91e0-bc64b57bfde4" (UID: "af0cbbf2-cbea-426b-91e0-bc64b57bfde4"). InnerVolumeSpecName "kube-api-access-ft6db". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:38:37.418481 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:37.418442    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ft6db\" (UniqueName: \"kubernetes.io/projected/af0cbbf2-cbea-426b-91e0-bc64b57bfde4-kube-api-access-ft6db\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:38:38.030037 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:38.030000    2580 generic.go:356] "Generic (PLEG): container finished" podID="af0cbbf2-cbea-426b-91e0-bc64b57bfde4" containerID="de337c3ef7a7842e41e855f82de26495825d3df8626a320b0ca5f2d35103324d" exitCode=137
Sep 17 14:38:38.030237 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:38.030047    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7362-fcca71"
Sep 17 14:38:38.030237 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:38.030073    2580 scope.go:117] "RemoveContainer" containerID="de337c3ef7a7842e41e855f82de26495825d3df8626a320b0ca5f2d35103324d"
Sep 17 14:38:38.039500 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:38.039480    2580 scope.go:117] "RemoveContainer" containerID="de337c3ef7a7842e41e855f82de26495825d3df8626a320b0ca5f2d35103324d"
Sep 17 14:38:38.039798 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:38:38.039775    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de337c3ef7a7842e41e855f82de26495825d3df8626a320b0ca5f2d35103324d\": container with ID starting with de337c3ef7a7842e41e855f82de26495825d3df8626a320b0ca5f2d35103324d not found: ID does not exist" containerID="de337c3ef7a7842e41e855f82de26495825d3df8626a320b0ca5f2d35103324d"
Sep 17 14:38:38.039843 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:38.039806    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de337c3ef7a7842e41e855f82de26495825d3df8626a320b0ca5f2d35103324d"} err="failed to get container status \"de337c3ef7a7842e41e855f82de26495825d3df8626a320b0ca5f2d35103324d\": rpc error: code = NotFound desc = could not find container \"de337c3ef7a7842e41e855f82de26495825d3df8626a320b0ca5f2d35103324d\": container with ID starting with de337c3ef7a7842e41e855f82de26495825d3df8626a320b0ca5f2d35103324d not found: ID does not exist"
Sep 17 14:38:38.907300 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:38.907262    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:38:39.177736 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:38:39.177624    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af0cbbf2-cbea-426b-91e0-bc64b57bfde4" path="/var/lib/kubelet/pods/af0cbbf2-cbea-426b-91e0-bc64b57bfde4/volumes"
Sep 17 14:39:06.906641 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:39:06.906583    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:39:31.349798 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:39:31.349758    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:39:45.083369 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:39:45.083332    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:39:55.864769 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:39:55.864726    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:40:08.632114 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:40:08.632066    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:40:09.531902 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:40:09.531867    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv"]
Sep 17 14:40:09.532376 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:40:09.532358    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af0cbbf2-cbea-426b-91e0-bc64b57bfde4" containerName="test-curl-7362-fcca71"
Sep 17 14:40:09.532376 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:40:09.532377    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="af0cbbf2-cbea-426b-91e0-bc64b57bfde4" containerName="test-curl-7362-fcca71"
Sep 17 14:40:09.532522 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:40:09.532476    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="af0cbbf2-cbea-426b-91e0-bc64b57bfde4" containerName="test-curl-7362-fcca71"
Sep 17 14:40:09.535587 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:40:09.535567    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv"
Sep 17 14:40:09.538421 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:40:09.538401    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-c2db32-serving-cert\""
Sep 17 14:40:09.546107 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:40:09.546075    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv"]
Sep 17 14:40:09.595730 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:40:09.595677    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfd20d4b-0364-4526-9145-e19acf292037-metrics-certs\") pod \"maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv\" (UID: \"bfd20d4b-0364-4526-9145-e19acf292037\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv"
Sep 17 14:40:09.595895 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:40:09.595743    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfd20d4b-0364-4526-9145-e19acf292037-maas-api-tls\") pod \"maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv\" (UID: \"bfd20d4b-0364-4526-9145-e19acf292037\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv"
Sep 17 14:40:09.595895 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:40:09.595850    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnpdt\" (UniqueName: \"kubernetes.io/projected/bfd20d4b-0364-4526-9145-e19acf292037-kube-api-access-wnpdt\") pod \"maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv\" (UID: \"bfd20d4b-0364-4526-9145-e19acf292037\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv"
Sep 17 14:40:09.595971 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:40:09.595905    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfd20d4b-0364-4526-9145-e19acf292037-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv\" (UID: \"bfd20d4b-0364-4526-9145-e19acf292037\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv"
Sep 17 14:40:09.697223 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:40:09.697189    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnpdt\" (UniqueName: \"kubernetes.io/projected/bfd20d4b-0364-4526-9145-e19acf292037-kube-api-access-wnpdt\") pod \"maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv\" (UID: \"bfd20d4b-0364-4526-9145-e19acf292037\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv"
Sep 17 14:40:09.697622 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:40:09.697240    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfd20d4b-0364-4526-9145-e19acf292037-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv\" (UID: \"bfd20d4b-0364-4526-9145-e19acf292037\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv"
Sep 17 14:40:09.697622 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:40:09.697280    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfd20d4b-0364-4526-9145-e19acf292037-metrics-certs\") pod \"maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv\" (UID: \"bfd20d4b-0364-4526-9145-e19acf292037\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv"
Sep 17 14:40:09.697622 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:40:09.697316    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfd20d4b-0364-4526-9145-e19acf292037-maas-api-tls\") pod \"maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv\" (UID: \"bfd20d4b-0364-4526-9145-e19acf292037\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv"
Sep 17 14:40:09.698061 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:40:09.698039    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfd20d4b-0364-4526-9145-e19acf292037-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv\" (UID: \"bfd20d4b-0364-4526-9145-e19acf292037\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv"
Sep 17 14:40:09.699730 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:40:09.699685    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfd20d4b-0364-4526-9145-e19acf292037-maas-api-tls\") pod \"maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv\" (UID: \"bfd20d4b-0364-4526-9145-e19acf292037\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv"
Sep 17 14:40:09.699830 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:40:09.699730    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfd20d4b-0364-4526-9145-e19acf292037-metrics-certs\") pod \"maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv\" (UID: \"bfd20d4b-0364-4526-9145-e19acf292037\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv"
Sep 17 14:40:09.706325 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:40:09.706302    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnpdt\" (UniqueName: \"kubernetes.io/projected/bfd20d4b-0364-4526-9145-e19acf292037-kube-api-access-wnpdt\") pod \"maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv\" (UID: \"bfd20d4b-0364-4526-9145-e19acf292037\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv"
Sep 17 14:40:09.848003 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:40:09.847908    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv"
Sep 17 14:40:10.130200 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:40:10.130174    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv"]
Sep 17 14:40:10.132280 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:40:10.132243    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfd20d4b_0364_4526_9145_e19acf292037.slice/crio-54f88ddfabd177045bd97c70c6c6ebc9a51e1f34b1bcab99368363b64cfc0509 WatchSource:0}: Error finding container 54f88ddfabd177045bd97c70c6c6ebc9a51e1f34b1bcab99368363b64cfc0509: Status 404 returned error can't find the container with id 54f88ddfabd177045bd97c70c6c6ebc9a51e1f34b1bcab99368363b64cfc0509
Sep 17 14:40:10.133700 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:40:10.133680    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 14:40:10.564346 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:40:10.564311    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv" event={"ID":"bfd20d4b-0364-4526-9145-e19acf292037","Type":"ContainerStarted","Data":"54f88ddfabd177045bd97c70c6c6ebc9a51e1f34b1bcab99368363b64cfc0509"}
Sep 17 14:40:11.571935 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:40:11.571900    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv" event={"ID":"bfd20d4b-0364-4526-9145-e19acf292037","Type":"ContainerStarted","Data":"821aa3e3406a4124fa20dbc0cf0e23f7cfbe8a4ae80dc62906d287fc1a76f056"}
Sep 17 14:40:11.572373 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:40:11.572030    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv"
Sep 17 14:40:11.593555 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:40:11.593504    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv" podStartSLOduration=2.136168269 podStartE2EDuration="2.59348935s" totalImagesPullingTime="457.321081ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:40:11.590240807 +0000 UTC m=+1999.034316431" watchObservedRunningTime="2026-09-17 14:40:11.59348935 +0000 UTC m=+1999.037564950"
Sep 17 14:40:17.582398 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:40:17.582362    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv"
Sep 17 14:40:20.912404 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:40:20.912367    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:40:45.717070 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:40:45.717027    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:41:28.313331 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:28.313216    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:41:47.227723 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:47.227672    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:41:54.512726 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.512683    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"]
Sep 17 14:41:54.516265 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.516245    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:54.519842 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.519821    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-8fb478-openshift-default-dockercfg-8d4w4\""
Sep 17 14:41:54.539675 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.539649    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"]
Sep 17 14:41:54.662554 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.662517    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ebc6147-f67d-4fd8-af95-079235b1e89b-istio-podinfo\") pod \"e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") " pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:54.662752 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.662568    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ebc6147-f67d-4fd8-af95-079235b1e89b-workload-socket\") pod \"e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") " pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:54.662752 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.662665    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ebc6147-f67d-4fd8-af95-079235b1e89b-istiod-ca-cert\") pod \"e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") " pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:54.662752 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.662706    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvpgv\" (UniqueName: \"kubernetes.io/projected/1ebc6147-f67d-4fd8-af95-079235b1e89b-kube-api-access-kvpgv\") pod \"e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") " pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:54.662870 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.662782    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ebc6147-f67d-4fd8-af95-079235b1e89b-workload-certs\") pod \"e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") " pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:54.662870 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.662834    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ebc6147-f67d-4fd8-af95-079235b1e89b-istio-data\") pod \"e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") " pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:54.662943 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.662878    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ebc6147-f67d-4fd8-af95-079235b1e89b-credential-socket\") pod \"e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") " pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:54.662943 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.662918    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ebc6147-f67d-4fd8-af95-079235b1e89b-istio-envoy\") pod \"e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") " pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:54.662943 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.662933    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ebc6147-f67d-4fd8-af95-079235b1e89b-istio-token\") pod \"e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") " pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:54.763761 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.763623    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ebc6147-f67d-4fd8-af95-079235b1e89b-istio-podinfo\") pod \"e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") " pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:54.763761 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.763702    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ebc6147-f67d-4fd8-af95-079235b1e89b-workload-socket\") pod \"e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") " pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:54.764002 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.763788    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ebc6147-f67d-4fd8-af95-079235b1e89b-istiod-ca-cert\") pod \"e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") " pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:54.764002 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.763819    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvpgv\" (UniqueName: \"kubernetes.io/projected/1ebc6147-f67d-4fd8-af95-079235b1e89b-kube-api-access-kvpgv\") pod \"e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") " pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:54.764002 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.763848    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ebc6147-f67d-4fd8-af95-079235b1e89b-workload-certs\") pod \"e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") " pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:54.764002 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.763894    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ebc6147-f67d-4fd8-af95-079235b1e89b-istio-data\") pod \"e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") " pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:54.764002 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.763926    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ebc6147-f67d-4fd8-af95-079235b1e89b-credential-socket\") pod \"e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") " pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:54.764002 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.763984    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ebc6147-f67d-4fd8-af95-079235b1e89b-istio-envoy\") pod \"e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") " pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:54.764306 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.764008    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ebc6147-f67d-4fd8-af95-079235b1e89b-istio-token\") pod \"e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") " pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:54.764306 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.764135    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ebc6147-f67d-4fd8-af95-079235b1e89b-workload-socket\") pod \"e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") " pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:54.764306 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.764208    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ebc6147-f67d-4fd8-af95-079235b1e89b-workload-certs\") pod \"e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") " pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:54.764437 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.764374    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ebc6147-f67d-4fd8-af95-079235b1e89b-istio-data\") pod \"e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") " pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:54.764509 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.764488    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ebc6147-f67d-4fd8-af95-079235b1e89b-credential-socket\") pod \"e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") " pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:54.764600 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.764585    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ebc6147-f67d-4fd8-af95-079235b1e89b-istiod-ca-cert\") pod \"e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") " pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:54.766132 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.766110    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ebc6147-f67d-4fd8-af95-079235b1e89b-istio-envoy\") pod \"e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") " pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:54.766339 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.766307    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ebc6147-f67d-4fd8-af95-079235b1e89b-istio-podinfo\") pod \"e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") " pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:54.773914 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.773894    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvpgv\" (UniqueName: \"kubernetes.io/projected/1ebc6147-f67d-4fd8-af95-079235b1e89b-kube-api-access-kvpgv\") pod \"e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") " pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:54.774166 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.774144    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ebc6147-f67d-4fd8-af95-079235b1e89b-istio-token\") pod \"e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") " pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:54.826778 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:54.826743    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:55.121729 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:55.121692    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"]
Sep 17 14:41:55.122664 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:41:55.122639    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ebc6147_f67d_4fd8_af95_079235b1e89b.slice/crio-1242a09e791f6857e783cb73635cd4783e085b7c4bd60e75123caeac89ca56ae WatchSource:0}: Error finding container 1242a09e791f6857e783cb73635cd4783e085b7c4bd60e75123caeac89ca56ae: Status 404 returned error can't find the container with id 1242a09e791f6857e783cb73635cd4783e085b7c4bd60e75123caeac89ca56ae
Sep 17 14:41:55.125042 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:55.125010    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 14:41:55.125153 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:55.125072    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 14:41:55.125153 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:55.125099    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 14:41:55.168541 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:55.168515    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c" event={"ID":"1ebc6147-f67d-4fd8-af95-079235b1e89b","Type":"ContainerStarted","Data":"1242a09e791f6857e783cb73635cd4783e085b7c4bd60e75123caeac89ca56ae"}
Sep 17 14:41:56.175672 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:56.175634    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c" event={"ID":"1ebc6147-f67d-4fd8-af95-079235b1e89b","Type":"ContainerStarted","Data":"98083e2d0f329dc54173a786ce5914d6e183233119e103e95dde3436aaab77a1"}
Sep 17 14:41:56.203340 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:56.203284    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c" podStartSLOduration=2.203267962 podStartE2EDuration="2.203267962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:41:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:41:56.199954839 +0000 UTC m=+2103.644030446" watchObservedRunningTime="2026-09-17 14:41:56.203267962 +0000 UTC m=+2103.647343548"
Sep 17 14:41:56.827648 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:56.827612    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:56.833065 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:56.833037    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:57.180606 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:57.180521    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:41:57.181655 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:41:57.181633    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:42:08.023939 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:08.023909    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:42:18.316106 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:18.316067    2580 generic.go:356] "Generic (PLEG): container finished" podID="1ebc6147-f67d-4fd8-af95-079235b1e89b" containerID="98083e2d0f329dc54173a786ce5914d6e183233119e103e95dde3436aaab77a1" exitCode=0
Sep 17 14:42:18.316626 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:18.316120    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c" event={"ID":"1ebc6147-f67d-4fd8-af95-079235b1e89b","Type":"ContainerDied","Data":"98083e2d0f329dc54173a786ce5914d6e183233119e103e95dde3436aaab77a1"}
Sep 17 14:42:18.316700 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:18.316665    2580 scope.go:117] "RemoveContainer" containerID="98083e2d0f329dc54173a786ce5914d6e183233119e103e95dde3436aaab77a1"
Sep 17 14:42:18.317871 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:18.317837    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 14:42:18.317968 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:18.317905    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 14:42:18.317968 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:18.317953    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 14:42:19.323317 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:19.323282    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c" event={"ID":"1ebc6147-f67d-4fd8-af95-079235b1e89b","Type":"ContainerStarted","Data":"cc157453706d523a947f5d48e6242e3f92387d275edf8b9abd68b57dd463e550"}
Sep 17 14:42:19.827603 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:19.827547    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:42:19.827911 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:19.827889    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Sep 17 14:42:19.827959 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:19.827936    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c" podUID="1ebc6147-f67d-4fd8-af95-079235b1e89b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Sep 17 14:42:20.827919 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:20.827886    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Sep 17 14:42:20.828345 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:20.827943    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c" podUID="1ebc6147-f67d-4fd8-af95-079235b1e89b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Sep 17 14:42:21.827133 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:21.827095    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Sep 17 14:42:21.827329 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:21.827153    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c" podUID="1ebc6147-f67d-4fd8-af95-079235b1e89b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Sep 17 14:42:22.827233 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:22.827194    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Sep 17 14:42:22.827649 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:22.827258    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c" podUID="1ebc6147-f67d-4fd8-af95-079235b1e89b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Sep 17 14:42:23.827872 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:23.827836    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Sep 17 14:42:23.828251 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:23.827889    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c" podUID="1ebc6147-f67d-4fd8-af95-079235b1e89b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Sep 17 14:42:24.831978 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:24.831943    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:42:24.832462 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:24.832440    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:42:24.833175 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:24.833154    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:42:45.210215 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:45.210177    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:42:47.186747 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:47.186697    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"]
Sep 17 14:42:47.187223 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:47.187005    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c" podUID="1ebc6147-f67d-4fd8-af95-079235b1e89b" containerName="istio-proxy" containerID="cri-o://cc157453706d523a947f5d48e6242e3f92387d275edf8b9abd68b57dd463e550" gracePeriod=30
Sep 17 14:42:52.443503 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.443477    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:42:52.516586 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.516507    2580 generic.go:356] "Generic (PLEG): container finished" podID="1ebc6147-f67d-4fd8-af95-079235b1e89b" containerID="cc157453706d523a947f5d48e6242e3f92387d275edf8b9abd68b57dd463e550" exitCode=0
Sep 17 14:42:52.516586 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.516557    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"
Sep 17 14:42:52.516793 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.516595    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c" event={"ID":"1ebc6147-f67d-4fd8-af95-079235b1e89b","Type":"ContainerDied","Data":"cc157453706d523a947f5d48e6242e3f92387d275edf8b9abd68b57dd463e550"}
Sep 17 14:42:52.516793 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.516653    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c" event={"ID":"1ebc6147-f67d-4fd8-af95-079235b1e89b","Type":"ContainerDied","Data":"1242a09e791f6857e783cb73635cd4783e085b7c4bd60e75123caeac89ca56ae"}
Sep 17 14:42:52.516793 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.516684    2580 scope.go:117] "RemoveContainer" containerID="cc157453706d523a947f5d48e6242e3f92387d275edf8b9abd68b57dd463e550"
Sep 17 14:42:52.521785 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.521763    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ebc6147-f67d-4fd8-af95-079235b1e89b-credential-socket\") pod \"1ebc6147-f67d-4fd8-af95-079235b1e89b\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") "
Sep 17 14:42:52.521893 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.521795    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ebc6147-f67d-4fd8-af95-079235b1e89b-istio-token\") pod \"1ebc6147-f67d-4fd8-af95-079235b1e89b\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") "
Sep 17 14:42:52.521893 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.521822    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ebc6147-f67d-4fd8-af95-079235b1e89b-istio-podinfo\") pod \"1ebc6147-f67d-4fd8-af95-079235b1e89b\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") "
Sep 17 14:42:52.521893 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.521863    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ebc6147-f67d-4fd8-af95-079235b1e89b-istiod-ca-cert\") pod \"1ebc6147-f67d-4fd8-af95-079235b1e89b\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") "
Sep 17 14:42:52.522046 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.521896    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvpgv\" (UniqueName: \"kubernetes.io/projected/1ebc6147-f67d-4fd8-af95-079235b1e89b-kube-api-access-kvpgv\") pod \"1ebc6147-f67d-4fd8-af95-079235b1e89b\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") "
Sep 17 14:42:52.522046 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.521965    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ebc6147-f67d-4fd8-af95-079235b1e89b-istio-envoy\") pod \"1ebc6147-f67d-4fd8-af95-079235b1e89b\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") "
Sep 17 14:42:52.522046 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.521994    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ebc6147-f67d-4fd8-af95-079235b1e89b-workload-certs\") pod \"1ebc6147-f67d-4fd8-af95-079235b1e89b\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") "
Sep 17 14:42:52.522262 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.522056    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ebc6147-f67d-4fd8-af95-079235b1e89b-istio-data\") pod \"1ebc6147-f67d-4fd8-af95-079235b1e89b\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") "
Sep 17 14:42:52.522262 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.522057    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ebc6147-f67d-4fd8-af95-079235b1e89b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1ebc6147-f67d-4fd8-af95-079235b1e89b" (UID: "1ebc6147-f67d-4fd8-af95-079235b1e89b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:42:52.522262 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.522118    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ebc6147-f67d-4fd8-af95-079235b1e89b-workload-socket\") pod \"1ebc6147-f67d-4fd8-af95-079235b1e89b\" (UID: \"1ebc6147-f67d-4fd8-af95-079235b1e89b\") "
Sep 17 14:42:52.522437 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.522311    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ebc6147-f67d-4fd8-af95-079235b1e89b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1ebc6147-f67d-4fd8-af95-079235b1e89b" (UID: "1ebc6147-f67d-4fd8-af95-079235b1e89b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:42:52.522552 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.522452    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ebc6147-f67d-4fd8-af95-079235b1e89b-credential-socket\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:42:52.522552 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.522536    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ebc6147-f67d-4fd8-af95-079235b1e89b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1ebc6147-f67d-4fd8-af95-079235b1e89b" (UID: "1ebc6147-f67d-4fd8-af95-079235b1e89b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:42:52.522678 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.522552    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ebc6147-f67d-4fd8-af95-079235b1e89b-istiod-ca-cert\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:42:52.522678 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.522552    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ebc6147-f67d-4fd8-af95-079235b1e89b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1ebc6147-f67d-4fd8-af95-079235b1e89b" (UID: "1ebc6147-f67d-4fd8-af95-079235b1e89b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:42:52.522678 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.522618    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ebc6147-f67d-4fd8-af95-079235b1e89b-istio-data" (OuterVolumeSpecName: "istio-data") pod "1ebc6147-f67d-4fd8-af95-079235b1e89b" (UID: "1ebc6147-f67d-4fd8-af95-079235b1e89b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:42:52.524010 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.523989    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ebc6147-f67d-4fd8-af95-079235b1e89b-istio-token" (OuterVolumeSpecName: "istio-token") pod "1ebc6147-f67d-4fd8-af95-079235b1e89b" (UID: "1ebc6147-f67d-4fd8-af95-079235b1e89b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:42:52.524176 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.524161    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ebc6147-f67d-4fd8-af95-079235b1e89b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1ebc6147-f67d-4fd8-af95-079235b1e89b" (UID: "1ebc6147-f67d-4fd8-af95-079235b1e89b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:42:52.524398 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.524382    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ebc6147-f67d-4fd8-af95-079235b1e89b-kube-api-access-kvpgv" (OuterVolumeSpecName: "kube-api-access-kvpgv") pod "1ebc6147-f67d-4fd8-af95-079235b1e89b" (UID: "1ebc6147-f67d-4fd8-af95-079235b1e89b"). InnerVolumeSpecName "kube-api-access-kvpgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:42:52.524471 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.524450    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1ebc6147-f67d-4fd8-af95-079235b1e89b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1ebc6147-f67d-4fd8-af95-079235b1e89b" (UID: "1ebc6147-f67d-4fd8-af95-079235b1e89b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 14:42:52.526933 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.526910    2580 scope.go:117] "RemoveContainer" containerID="98083e2d0f329dc54173a786ce5914d6e183233119e103e95dde3436aaab77a1"
Sep 17 14:42:52.543576 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.543545    2580 scope.go:117] "RemoveContainer" containerID="cc157453706d523a947f5d48e6242e3f92387d275edf8b9abd68b57dd463e550"
Sep 17 14:42:52.543906 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:42:52.543882    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc157453706d523a947f5d48e6242e3f92387d275edf8b9abd68b57dd463e550\": container with ID starting with cc157453706d523a947f5d48e6242e3f92387d275edf8b9abd68b57dd463e550 not found: ID does not exist" containerID="cc157453706d523a947f5d48e6242e3f92387d275edf8b9abd68b57dd463e550"
Sep 17 14:42:52.543953 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.543916    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc157453706d523a947f5d48e6242e3f92387d275edf8b9abd68b57dd463e550"} err="failed to get container status \"cc157453706d523a947f5d48e6242e3f92387d275edf8b9abd68b57dd463e550\": rpc error: code = NotFound desc = could not find container \"cc157453706d523a947f5d48e6242e3f92387d275edf8b9abd68b57dd463e550\": container with ID starting with cc157453706d523a947f5d48e6242e3f92387d275edf8b9abd68b57dd463e550 not found: ID does not exist"
Sep 17 14:42:52.543953 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.543935    2580 scope.go:117] "RemoveContainer" containerID="98083e2d0f329dc54173a786ce5914d6e183233119e103e95dde3436aaab77a1"
Sep 17 14:42:52.544190 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:42:52.544172    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98083e2d0f329dc54173a786ce5914d6e183233119e103e95dde3436aaab77a1\": container with ID starting with 98083e2d0f329dc54173a786ce5914d6e183233119e103e95dde3436aaab77a1 not found: ID does not exist" containerID="98083e2d0f329dc54173a786ce5914d6e183233119e103e95dde3436aaab77a1"
Sep 17 14:42:52.544242 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.544195    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98083e2d0f329dc54173a786ce5914d6e183233119e103e95dde3436aaab77a1"} err="failed to get container status \"98083e2d0f329dc54173a786ce5914d6e183233119e103e95dde3436aaab77a1\": rpc error: code = NotFound desc = could not find container \"98083e2d0f329dc54173a786ce5914d6e183233119e103e95dde3436aaab77a1\": container with ID starting with 98083e2d0f329dc54173a786ce5914d6e183233119e103e95dde3436aaab77a1 not found: ID does not exist"
Sep 17 14:42:52.623264 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.623236    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ebc6147-f67d-4fd8-af95-079235b1e89b-istio-envoy\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:42:52.623264 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.623262    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ebc6147-f67d-4fd8-af95-079235b1e89b-workload-certs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:42:52.623264 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.623271    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ebc6147-f67d-4fd8-af95-079235b1e89b-istio-data\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:42:52.623490 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.623279    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ebc6147-f67d-4fd8-af95-079235b1e89b-workload-socket\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:42:52.623490 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.623287    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ebc6147-f67d-4fd8-af95-079235b1e89b-istio-token\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:42:52.623490 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.623296    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ebc6147-f67d-4fd8-af95-079235b1e89b-istio-podinfo\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:42:52.623490 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.623304    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvpgv\" (UniqueName: \"kubernetes.io/projected/1ebc6147-f67d-4fd8-af95-079235b1e89b-kube-api-access-kvpgv\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:42:52.852794 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.852765    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"]
Sep 17 14:42:52.865314 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:52.865288    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8fb478-openshift-default-85f99fbf4b-kmz6c"]
Sep 17 14:42:53.179044 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:42:53.178967    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ebc6147-f67d-4fd8-af95-079235b1e89b" path="/var/lib/kubelet/pods/1ebc6147-f67d-4fd8-af95-079235b1e89b/volumes"
Sep 17 14:43:04.823000 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:43:04.822959    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:43:07.139926 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:43:07.139896    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv"]
Sep 17 14:43:07.140348 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:43:07.140105    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv" podUID="bfd20d4b-0364-4526-9145-e19acf292037" containerName="maas-api" containerID="cri-o://821aa3e3406a4124fa20dbc0cf0e23f7cfbe8a4ae80dc62906d287fc1a76f056" gracePeriod=30
Sep 17 14:43:07.393560 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:43:07.393499    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv"
Sep 17 14:43:07.459636 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:43:07.459586    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnpdt\" (UniqueName: \"kubernetes.io/projected/bfd20d4b-0364-4526-9145-e19acf292037-kube-api-access-wnpdt\") pod \"bfd20d4b-0364-4526-9145-e19acf292037\" (UID: \"bfd20d4b-0364-4526-9145-e19acf292037\") "
Sep 17 14:43:07.459868 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:43:07.459647    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfd20d4b-0364-4526-9145-e19acf292037-maas-api-tls\") pod \"bfd20d4b-0364-4526-9145-e19acf292037\" (UID: \"bfd20d4b-0364-4526-9145-e19acf292037\") "
Sep 17 14:43:07.459868 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:43:07.459690    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfd20d4b-0364-4526-9145-e19acf292037-openshift-service-ca\") pod \"bfd20d4b-0364-4526-9145-e19acf292037\" (UID: \"bfd20d4b-0364-4526-9145-e19acf292037\") "
Sep 17 14:43:07.459868 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:43:07.459751    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfd20d4b-0364-4526-9145-e19acf292037-metrics-certs\") pod \"bfd20d4b-0364-4526-9145-e19acf292037\" (UID: \"bfd20d4b-0364-4526-9145-e19acf292037\") "
Sep 17 14:43:07.460077 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:43:07.460042    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfd20d4b-0364-4526-9145-e19acf292037-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bfd20d4b-0364-4526-9145-e19acf292037" (UID: "bfd20d4b-0364-4526-9145-e19acf292037"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:43:07.461797 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:43:07.461772    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfd20d4b-0364-4526-9145-e19acf292037-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "bfd20d4b-0364-4526-9145-e19acf292037" (UID: "bfd20d4b-0364-4526-9145-e19acf292037"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:43:07.461908 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:43:07.461886    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfd20d4b-0364-4526-9145-e19acf292037-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bfd20d4b-0364-4526-9145-e19acf292037" (UID: "bfd20d4b-0364-4526-9145-e19acf292037"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:43:07.461954 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:43:07.461935    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfd20d4b-0364-4526-9145-e19acf292037-kube-api-access-wnpdt" (OuterVolumeSpecName: "kube-api-access-wnpdt") pod "bfd20d4b-0364-4526-9145-e19acf292037" (UID: "bfd20d4b-0364-4526-9145-e19acf292037"). InnerVolumeSpecName "kube-api-access-wnpdt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:43:07.561214 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:43:07.561180    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnpdt\" (UniqueName: \"kubernetes.io/projected/bfd20d4b-0364-4526-9145-e19acf292037-kube-api-access-wnpdt\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:43:07.561214 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:43:07.561208    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfd20d4b-0364-4526-9145-e19acf292037-maas-api-tls\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:43:07.561214 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:43:07.561217    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfd20d4b-0364-4526-9145-e19acf292037-openshift-service-ca\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:43:07.561435 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:43:07.561227    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfd20d4b-0364-4526-9145-e19acf292037-metrics-certs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:43:07.603252 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:43:07.603216    2580 generic.go:356] "Generic (PLEG): container finished" podID="bfd20d4b-0364-4526-9145-e19acf292037" containerID="821aa3e3406a4124fa20dbc0cf0e23f7cfbe8a4ae80dc62906d287fc1a76f056" exitCode=0
Sep 17 14:43:07.603418 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:43:07.603266    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv"
Sep 17 14:43:07.603418 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:43:07.603304    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv" event={"ID":"bfd20d4b-0364-4526-9145-e19acf292037","Type":"ContainerDied","Data":"821aa3e3406a4124fa20dbc0cf0e23f7cfbe8a4ae80dc62906d287fc1a76f056"}
Sep 17 14:43:07.603418 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:43:07.603365    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv" event={"ID":"bfd20d4b-0364-4526-9145-e19acf292037","Type":"ContainerDied","Data":"54f88ddfabd177045bd97c70c6c6ebc9a51e1f34b1bcab99368363b64cfc0509"}
Sep 17 14:43:07.603418 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:43:07.603387    2580 scope.go:117] "RemoveContainer" containerID="821aa3e3406a4124fa20dbc0cf0e23f7cfbe8a4ae80dc62906d287fc1a76f056"
Sep 17 14:43:07.615245 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:43:07.615220    2580 scope.go:117] "RemoveContainer" containerID="821aa3e3406a4124fa20dbc0cf0e23f7cfbe8a4ae80dc62906d287fc1a76f056"
Sep 17 14:43:07.615853 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:43:07.615828    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"821aa3e3406a4124fa20dbc0cf0e23f7cfbe8a4ae80dc62906d287fc1a76f056\": container with ID starting with 821aa3e3406a4124fa20dbc0cf0e23f7cfbe8a4ae80dc62906d287fc1a76f056 not found: ID does not exist" containerID="821aa3e3406a4124fa20dbc0cf0e23f7cfbe8a4ae80dc62906d287fc1a76f056"
Sep 17 14:43:07.615944 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:43:07.615863    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"821aa3e3406a4124fa20dbc0cf0e23f7cfbe8a4ae80dc62906d287fc1a76f056"} err="failed to get container status \"821aa3e3406a4124fa20dbc0cf0e23f7cfbe8a4ae80dc62906d287fc1a76f056\": rpc error: code = NotFound desc = could not find container \"821aa3e3406a4124fa20dbc0cf0e23f7cfbe8a4ae80dc62906d287fc1a76f056\": container with ID starting with 821aa3e3406a4124fa20dbc0cf0e23f7cfbe8a4ae80dc62906d287fc1a76f056 not found: ID does not exist"
Sep 17 14:43:07.627282 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:43:07.627259    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv"]
Sep 17 14:43:07.630504 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:43:07.630483    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-c2db32-57b9758c96-wgtzv"]
Sep 17 14:43:09.176870 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:43:09.176835    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfd20d4b-0364-4526-9145-e19acf292037" path="/var/lib/kubelet/pods/bfd20d4b-0364-4526-9145-e19acf292037/volumes"
Sep 17 14:43:18.019931 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:43:18.019894    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:44:10.877363 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:10.877318    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:44:25.537811 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:25.537727    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3da4be-29827590-x2brn"]
Sep 17 14:44:25.540551 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:25.540525    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3da4be-29827590-x2brn"]
Sep 17 14:44:27.177376 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:27.177336    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98583f88-d2c5-41b5-9e55-5843ceef80b8" path="/var/lib/kubelet/pods/98583f88-d2c5-41b5-9e55-5843ceef80b8/volumes"
Sep 17 14:44:28.722167 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:28.722134    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:44:32.695405 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:32.695372    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"]
Sep 17 14:44:32.695928 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:32.695622    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5" podUID="664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9" containerName="istio-proxy" containerID="cri-o://59c9e2ae55a03b0701204f342717d0de301d3418cde79dd2d40ad1cb6f6867a8" gracePeriod=30
Sep 17 14:44:37.947972 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:37.947946    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:44:37.994003 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:37.993924    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-istio-envoy\") pod \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") "
Sep 17 14:44:37.994003 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:37.993971    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-credential-socket\") pod \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") "
Sep 17 14:44:37.994003 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:37.993998    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-istiod-ca-cert\") pod \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") "
Sep 17 14:44:37.994266 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:37.994025    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-istio-podinfo\") pod \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") "
Sep 17 14:44:37.994266 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:37.994097    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-workload-certs\") pod \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") "
Sep 17 14:44:37.994266 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:37.994141    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-istio-token\") pod \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") "
Sep 17 14:44:37.994266 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:37.994190    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-workload-socket\") pod \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") "
Sep 17 14:44:37.994266 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:37.994232    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-istio-data\") pod \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") "
Sep 17 14:44:37.994266 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:37.994227    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9" (UID: "664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:44:37.994266 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:37.994263    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8v7s6\" (UniqueName: \"kubernetes.io/projected/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-kube-api-access-8v7s6\") pod \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\" (UID: \"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9\") "
Sep 17 14:44:37.994641 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:37.994534    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9" (UID: "664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:44:37.994641 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:37.994530    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9" (UID: "664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:44:37.994789 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:37.994654    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-istiod-ca-cert\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:44:37.994789 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:37.994676    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9" (UID: "664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:44:37.994900 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:37.994814    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-istio-data" (OuterVolumeSpecName: "istio-data") pod "664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9" (UID: "664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:44:37.996421 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:37.996386    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9" (UID: "664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 14:44:37.996744 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:37.996699    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9" (UID: "664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:44:37.996984 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:37.996959    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-istio-token" (OuterVolumeSpecName: "istio-token") pod "664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9" (UID: "664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:44:37.997066 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:37.996990    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-kube-api-access-8v7s6" (OuterVolumeSpecName: "kube-api-access-8v7s6") pod "664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9" (UID: "664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9"). InnerVolumeSpecName "kube-api-access-8v7s6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:44:38.095356 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:38.095321    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-istio-envoy\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:44:38.095356 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:38.095350    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-credential-socket\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:44:38.095356 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:38.095359    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-istio-podinfo\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:44:38.095356 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:38.095368    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-workload-certs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:44:38.095634 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:38.095377    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-istio-token\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:44:38.095634 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:38.095385    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-workload-socket\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:44:38.095634 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:38.095392    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-istio-data\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:44:38.095634 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:38.095400    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8v7s6\" (UniqueName: \"kubernetes.io/projected/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9-kube-api-access-8v7s6\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:44:38.130462 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:38.130426    2580 generic.go:356] "Generic (PLEG): container finished" podID="664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9" containerID="59c9e2ae55a03b0701204f342717d0de301d3418cde79dd2d40ad1cb6f6867a8" exitCode=0
Sep 17 14:44:38.130641 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:38.130478    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"
Sep 17 14:44:38.130641 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:38.130515    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5" event={"ID":"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9","Type":"ContainerDied","Data":"59c9e2ae55a03b0701204f342717d0de301d3418cde79dd2d40ad1cb6f6867a8"}
Sep 17 14:44:38.130641 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:38.130577    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5" event={"ID":"664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9","Type":"ContainerDied","Data":"a70cc78cfd125dcacf1dd589d666a6303c1269602e8000de27191fbabf1c331e"}
Sep 17 14:44:38.130641 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:38.130607    2580 scope.go:117] "RemoveContainer" containerID="59c9e2ae55a03b0701204f342717d0de301d3418cde79dd2d40ad1cb6f6867a8"
Sep 17 14:44:38.140642 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:38.140626    2580 scope.go:117] "RemoveContainer" containerID="4d673839c13d27439d3664796133e501071e03dc7a66b5632ff6f611191d6071"
Sep 17 14:44:38.148919 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:38.148904    2580 scope.go:117] "RemoveContainer" containerID="59c9e2ae55a03b0701204f342717d0de301d3418cde79dd2d40ad1cb6f6867a8"
Sep 17 14:44:38.149173 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:44:38.149158    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59c9e2ae55a03b0701204f342717d0de301d3418cde79dd2d40ad1cb6f6867a8\": container with ID starting with 59c9e2ae55a03b0701204f342717d0de301d3418cde79dd2d40ad1cb6f6867a8 not found: ID does not exist" containerID="59c9e2ae55a03b0701204f342717d0de301d3418cde79dd2d40ad1cb6f6867a8"
Sep 17 14:44:38.149213 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:38.149182    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59c9e2ae55a03b0701204f342717d0de301d3418cde79dd2d40ad1cb6f6867a8"} err="failed to get container status \"59c9e2ae55a03b0701204f342717d0de301d3418cde79dd2d40ad1cb6f6867a8\": rpc error: code = NotFound desc = could not find container \"59c9e2ae55a03b0701204f342717d0de301d3418cde79dd2d40ad1cb6f6867a8\": container with ID starting with 59c9e2ae55a03b0701204f342717d0de301d3418cde79dd2d40ad1cb6f6867a8 not found: ID does not exist"
Sep 17 14:44:38.149213 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:38.149198    2580 scope.go:117] "RemoveContainer" containerID="4d673839c13d27439d3664796133e501071e03dc7a66b5632ff6f611191d6071"
Sep 17 14:44:38.149443 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:44:38.149430    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d673839c13d27439d3664796133e501071e03dc7a66b5632ff6f611191d6071\": container with ID starting with 4d673839c13d27439d3664796133e501071e03dc7a66b5632ff6f611191d6071 not found: ID does not exist" containerID="4d673839c13d27439d3664796133e501071e03dc7a66b5632ff6f611191d6071"
Sep 17 14:44:38.149478 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:38.149446    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d673839c13d27439d3664796133e501071e03dc7a66b5632ff6f611191d6071"} err="failed to get container status \"4d673839c13d27439d3664796133e501071e03dc7a66b5632ff6f611191d6071\": rpc error: code = NotFound desc = could not find container \"4d673839c13d27439d3664796133e501071e03dc7a66b5632ff6f611191d6071\": container with ID starting with 4d673839c13d27439d3664796133e501071e03dc7a66b5632ff6f611191d6071 not found: ID does not exist"
Sep 17 14:44:38.155604 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:38.155579    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"]
Sep 17 14:44:38.160025 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:38.160002    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-3da4be-openshift-default-74cd97987d-vxxp5"]
Sep 17 14:44:39.176620 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:39.176586    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9" path="/var/lib/kubelet/pods/664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9/volumes"
Sep 17 14:44:43.558447 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:43.558410    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5"]
Sep 17 14:44:43.558939 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:43.558689    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5" podUID="420d1704-ba0b-4c1e-a204-19584ad2087d" containerName="maas-api" containerID="cri-o://a6f30913344f687b53652e5f951731630262dfd1bb701965b3ad9cf0170040a9" gracePeriod=30
Sep 17 14:44:43.810547 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:43.810473    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5"
Sep 17 14:44:43.950983 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:43.950944    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75mh5\" (UniqueName: \"kubernetes.io/projected/420d1704-ba0b-4c1e-a204-19584ad2087d-kube-api-access-75mh5\") pod \"420d1704-ba0b-4c1e-a204-19584ad2087d\" (UID: \"420d1704-ba0b-4c1e-a204-19584ad2087d\") "
Sep 17 14:44:43.951162 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:43.951008    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/420d1704-ba0b-4c1e-a204-19584ad2087d-openshift-service-ca\") pod \"420d1704-ba0b-4c1e-a204-19584ad2087d\" (UID: \"420d1704-ba0b-4c1e-a204-19584ad2087d\") "
Sep 17 14:44:43.951162 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:43.951064    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/420d1704-ba0b-4c1e-a204-19584ad2087d-maas-api-tls\") pod \"420d1704-ba0b-4c1e-a204-19584ad2087d\" (UID: \"420d1704-ba0b-4c1e-a204-19584ad2087d\") "
Sep 17 14:44:43.951162 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:43.951131    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/420d1704-ba0b-4c1e-a204-19584ad2087d-metrics-certs\") pod \"420d1704-ba0b-4c1e-a204-19584ad2087d\" (UID: \"420d1704-ba0b-4c1e-a204-19584ad2087d\") "
Sep 17 14:44:43.951432 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:43.951403    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/420d1704-ba0b-4c1e-a204-19584ad2087d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "420d1704-ba0b-4c1e-a204-19584ad2087d" (UID: "420d1704-ba0b-4c1e-a204-19584ad2087d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:44:43.953340 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:43.953308    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/420d1704-ba0b-4c1e-a204-19584ad2087d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "420d1704-ba0b-4c1e-a204-19584ad2087d" (UID: "420d1704-ba0b-4c1e-a204-19584ad2087d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:44:43.953340 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:43.953312    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/420d1704-ba0b-4c1e-a204-19584ad2087d-kube-api-access-75mh5" (OuterVolumeSpecName: "kube-api-access-75mh5") pod "420d1704-ba0b-4c1e-a204-19584ad2087d" (UID: "420d1704-ba0b-4c1e-a204-19584ad2087d"). InnerVolumeSpecName "kube-api-access-75mh5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:44:43.953505 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:43.953351    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/420d1704-ba0b-4c1e-a204-19584ad2087d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "420d1704-ba0b-4c1e-a204-19584ad2087d" (UID: "420d1704-ba0b-4c1e-a204-19584ad2087d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:44:44.052033 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:44.051992    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/420d1704-ba0b-4c1e-a204-19584ad2087d-maas-api-tls\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:44:44.052033 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:44.052027    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/420d1704-ba0b-4c1e-a204-19584ad2087d-metrics-certs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:44:44.052033 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:44.052037    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75mh5\" (UniqueName: \"kubernetes.io/projected/420d1704-ba0b-4c1e-a204-19584ad2087d-kube-api-access-75mh5\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:44:44.052279 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:44.052047    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/420d1704-ba0b-4c1e-a204-19584ad2087d-openshift-service-ca\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:44:44.165568 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:44.165466    2580 generic.go:356] "Generic (PLEG): container finished" podID="420d1704-ba0b-4c1e-a204-19584ad2087d" containerID="a6f30913344f687b53652e5f951731630262dfd1bb701965b3ad9cf0170040a9" exitCode=0
Sep 17 14:44:44.165568 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:44.165520    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5"
Sep 17 14:44:44.165799 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:44.165560    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5" event={"ID":"420d1704-ba0b-4c1e-a204-19584ad2087d","Type":"ContainerDied","Data":"a6f30913344f687b53652e5f951731630262dfd1bb701965b3ad9cf0170040a9"}
Sep 17 14:44:44.165799 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:44.165625    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5" event={"ID":"420d1704-ba0b-4c1e-a204-19584ad2087d","Type":"ContainerDied","Data":"30e0d40cca9774435f257aca8f01503a0d9b787fe758370991f1ebb520633023"}
Sep 17 14:44:44.165799 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:44.165659    2580 scope.go:117] "RemoveContainer" containerID="a6f30913344f687b53652e5f951731630262dfd1bb701965b3ad9cf0170040a9"
Sep 17 14:44:44.175886 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:44.175849    2580 scope.go:117] "RemoveContainer" containerID="a6f30913344f687b53652e5f951731630262dfd1bb701965b3ad9cf0170040a9"
Sep 17 14:44:44.176160 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:44:44.176139    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6f30913344f687b53652e5f951731630262dfd1bb701965b3ad9cf0170040a9\": container with ID starting with a6f30913344f687b53652e5f951731630262dfd1bb701965b3ad9cf0170040a9 not found: ID does not exist" containerID="a6f30913344f687b53652e5f951731630262dfd1bb701965b3ad9cf0170040a9"
Sep 17 14:44:44.176207 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:44.176169    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6f30913344f687b53652e5f951731630262dfd1bb701965b3ad9cf0170040a9"} err="failed to get container status \"a6f30913344f687b53652e5f951731630262dfd1bb701965b3ad9cf0170040a9\": rpc error: code = NotFound desc = could not find container \"a6f30913344f687b53652e5f951731630262dfd1bb701965b3ad9cf0170040a9\": container with ID starting with a6f30913344f687b53652e5f951731630262dfd1bb701965b3ad9cf0170040a9 not found: ID does not exist"
Sep 17 14:44:44.201018 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:44.200995    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5"]
Sep 17 14:44:44.218366 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:44.218319    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b48b7c-69458dfffd-m8qp5"]
Sep 17 14:44:45.177793 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:45.177761    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="420d1704-ba0b-4c1e-a204-19584ad2087d" path="/var/lib/kubelet/pods/420d1704-ba0b-4c1e-a204-19584ad2087d/volumes"
Sep 17 14:44:46.149753 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:46.149721    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:44:51.861887 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:51.861851    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"]
Sep 17 14:44:51.862274 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:51.862043    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j" podUID="5c059d46-ed55-4ff1-90a7-2c2f1c99ae30" containerName="istio-proxy" containerID="cri-o://6b42de1bb666b253159e21f8b9bfd2a89c045b9c912c8d86dbf152acf9ade6a3" gracePeriod=30
Sep 17 14:44:53.463691 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:53.463655    2580 scope.go:117] "RemoveContainer" containerID="3094b731a7df456cb1ded0196e69df1531e34e94b824438fc7c271253bc92aa2"
Sep 17 14:44:57.115362 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.115331    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:44:57.240724 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.240679    2580 generic.go:356] "Generic (PLEG): container finished" podID="5c059d46-ed55-4ff1-90a7-2c2f1c99ae30" containerID="6b42de1bb666b253159e21f8b9bfd2a89c045b9c912c8d86dbf152acf9ade6a3" exitCode=0
Sep 17 14:44:57.240905 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.240741    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j" event={"ID":"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30","Type":"ContainerDied","Data":"6b42de1bb666b253159e21f8b9bfd2a89c045b9c912c8d86dbf152acf9ade6a3"}
Sep 17 14:44:57.240905 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.240747    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"
Sep 17 14:44:57.240905 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.240785    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j" event={"ID":"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30","Type":"ContainerDied","Data":"44117863afb1c7f23a55627225959d6b1a08e7109b7bb427c1a378eaf40431ef"}
Sep 17 14:44:57.240905 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.240807    2580 scope.go:117] "RemoveContainer" containerID="6b42de1bb666b253159e21f8b9bfd2a89c045b9c912c8d86dbf152acf9ade6a3"
Sep 17 14:44:57.250022 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.250006    2580 scope.go:117] "RemoveContainer" containerID="dc1521c8dccec6f7ad4eb21519408b0cf0c2742ce8d128ab2bb356feb0751b50"
Sep 17 14:44:57.258402 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.258359    2580 scope.go:117] "RemoveContainer" containerID="6b42de1bb666b253159e21f8b9bfd2a89c045b9c912c8d86dbf152acf9ade6a3"
Sep 17 14:44:57.258674 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:44:57.258656    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b42de1bb666b253159e21f8b9bfd2a89c045b9c912c8d86dbf152acf9ade6a3\": container with ID starting with 6b42de1bb666b253159e21f8b9bfd2a89c045b9c912c8d86dbf152acf9ade6a3 not found: ID does not exist" containerID="6b42de1bb666b253159e21f8b9bfd2a89c045b9c912c8d86dbf152acf9ade6a3"
Sep 17 14:44:57.258787 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.258688    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b42de1bb666b253159e21f8b9bfd2a89c045b9c912c8d86dbf152acf9ade6a3"} err="failed to get container status \"6b42de1bb666b253159e21f8b9bfd2a89c045b9c912c8d86dbf152acf9ade6a3\": rpc error: code = NotFound desc = could not find container \"6b42de1bb666b253159e21f8b9bfd2a89c045b9c912c8d86dbf152acf9ade6a3\": container with ID starting with 6b42de1bb666b253159e21f8b9bfd2a89c045b9c912c8d86dbf152acf9ade6a3 not found: ID does not exist"
Sep 17 14:44:57.258787 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.258733    2580 scope.go:117] "RemoveContainer" containerID="dc1521c8dccec6f7ad4eb21519408b0cf0c2742ce8d128ab2bb356feb0751b50"
Sep 17 14:44:57.258982 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:44:57.258967    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc1521c8dccec6f7ad4eb21519408b0cf0c2742ce8d128ab2bb356feb0751b50\": container with ID starting with dc1521c8dccec6f7ad4eb21519408b0cf0c2742ce8d128ab2bb356feb0751b50 not found: ID does not exist" containerID="dc1521c8dccec6f7ad4eb21519408b0cf0c2742ce8d128ab2bb356feb0751b50"
Sep 17 14:44:57.259029 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.258989    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc1521c8dccec6f7ad4eb21519408b0cf0c2742ce8d128ab2bb356feb0751b50"} err="failed to get container status \"dc1521c8dccec6f7ad4eb21519408b0cf0c2742ce8d128ab2bb356feb0751b50\": rpc error: code = NotFound desc = could not find container \"dc1521c8dccec6f7ad4eb21519408b0cf0c2742ce8d128ab2bb356feb0751b50\": container with ID starting with dc1521c8dccec6f7ad4eb21519408b0cf0c2742ce8d128ab2bb356feb0751b50 not found: ID does not exist"
Sep 17 14:44:57.274250 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.274226    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-workload-socket\") pod \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") "
Sep 17 14:44:57.274386 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.274263    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-istio-podinfo\") pod \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") "
Sep 17 14:44:57.274386 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.274294    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dz6c\" (UniqueName: \"kubernetes.io/projected/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-kube-api-access-2dz6c\") pod \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") "
Sep 17 14:44:57.274386 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.274348    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-credential-socket\") pod \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") "
Sep 17 14:44:57.274516 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.274406    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-istio-data\") pod \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") "
Sep 17 14:44:57.274516 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.274433    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-istio-token\") pod \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") "
Sep 17 14:44:57.274516 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.274493    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-istiod-ca-cert\") pod \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") "
Sep 17 14:44:57.274680 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.274512    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5c059d46-ed55-4ff1-90a7-2c2f1c99ae30" (UID: "5c059d46-ed55-4ff1-90a7-2c2f1c99ae30"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:44:57.274680 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.274548    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-workload-certs\") pod \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") "
Sep 17 14:44:57.274680 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.274582    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-istio-envoy\") pod \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\" (UID: \"5c059d46-ed55-4ff1-90a7-2c2f1c99ae30\") "
Sep 17 14:44:57.274680 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.274653    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-istio-data" (OuterVolumeSpecName: "istio-data") pod "5c059d46-ed55-4ff1-90a7-2c2f1c99ae30" (UID: "5c059d46-ed55-4ff1-90a7-2c2f1c99ae30"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:44:57.274923 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.274850    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5c059d46-ed55-4ff1-90a7-2c2f1c99ae30" (UID: "5c059d46-ed55-4ff1-90a7-2c2f1c99ae30"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:44:57.274923 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.274876    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5c059d46-ed55-4ff1-90a7-2c2f1c99ae30" (UID: "5c059d46-ed55-4ff1-90a7-2c2f1c99ae30"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:44:57.274923 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.274910    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5c059d46-ed55-4ff1-90a7-2c2f1c99ae30" (UID: "5c059d46-ed55-4ff1-90a7-2c2f1c99ae30"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:44:57.275087 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.274921    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-istio-data\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:44:57.275087 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.274941    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-workload-socket\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:44:57.276386 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.276363    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5c059d46-ed55-4ff1-90a7-2c2f1c99ae30" (UID: "5c059d46-ed55-4ff1-90a7-2c2f1c99ae30"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 14:44:57.276506 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.276489    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-istio-token" (OuterVolumeSpecName: "istio-token") pod "5c059d46-ed55-4ff1-90a7-2c2f1c99ae30" (UID: "5c059d46-ed55-4ff1-90a7-2c2f1c99ae30"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:44:57.276601 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.276574    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5c059d46-ed55-4ff1-90a7-2c2f1c99ae30" (UID: "5c059d46-ed55-4ff1-90a7-2c2f1c99ae30"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 14:44:57.276689 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.276615    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-kube-api-access-2dz6c" (OuterVolumeSpecName: "kube-api-access-2dz6c") pod "5c059d46-ed55-4ff1-90a7-2c2f1c99ae30" (UID: "5c059d46-ed55-4ff1-90a7-2c2f1c99ae30"). InnerVolumeSpecName "kube-api-access-2dz6c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:44:57.376086 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.376051    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dz6c\" (UniqueName: \"kubernetes.io/projected/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-kube-api-access-2dz6c\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:44:57.376086 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.376078    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-credential-socket\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:44:57.376086 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.376088    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-istio-token\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:44:57.376305 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.376097    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-istiod-ca-cert\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:44:57.376305 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.376105    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-workload-certs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:44:57.376305 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.376113    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-istio-envoy\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:44:57.376305 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.376120    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30-istio-podinfo\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:44:57.573339 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.573305    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"]
Sep 17 14:44:57.585858 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:57.585828    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b48b7c-openshift-default-644d8c64b-d8f5j"]
Sep 17 14:44:59.083521 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:59.083488    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:44:59.177420 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:44:59.177386    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c059d46-ed55-4ff1-90a7-2c2f1c99ae30" path="/var/lib/kubelet/pods/5c059d46-ed55-4ff1-90a7-2c2f1c99ae30/volumes"
Sep 17 14:46:19.219270 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:46:19.219236    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:47:06.207275 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:47:06.207231    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:47:14.430040 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:47:14.430003    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:47:20.708955 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:47:20.708913    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:47:27.511620 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:47:27.511586    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:47:43.115206 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:47:43.115167    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:47:49.526457 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:47:49.526424    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:49:17.897854 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:49:17.897823    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:49:24.924800 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:49:24.924766    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:49:31.026201 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:49:31.026164    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:49:50.722831 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:49:50.722793    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:50:43.913957 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:50:43.913922    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:50:51.833209 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:50:51.833172    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:50:58.841357 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:50:58.841324    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:51:06.337866 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.337829    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:51:06.820827 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.820795    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6c9b6644d-jdvps"]
Sep 17 14:51:06.821204 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.821191    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="420d1704-ba0b-4c1e-a204-19584ad2087d" containerName="maas-api"
Sep 17 14:51:06.821253 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.821207    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="420d1704-ba0b-4c1e-a204-19584ad2087d" containerName="maas-api"
Sep 17 14:51:06.821253 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.821223    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9" containerName="istio-proxy"
Sep 17 14:51:06.821253 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.821229    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9" containerName="istio-proxy"
Sep 17 14:51:06.821253 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.821235    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c059d46-ed55-4ff1-90a7-2c2f1c99ae30" containerName="istio-proxy"
Sep 17 14:51:06.821253 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.821240    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c059d46-ed55-4ff1-90a7-2c2f1c99ae30" containerName="istio-proxy"
Sep 17 14:51:06.821253 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.821246    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ebc6147-f67d-4fd8-af95-079235b1e89b" containerName="istio-proxy"
Sep 17 14:51:06.821253 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.821251    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ebc6147-f67d-4fd8-af95-079235b1e89b" containerName="istio-proxy"
Sep 17 14:51:06.821459 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.821262    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9" containerName="istio-proxy"
Sep 17 14:51:06.821459 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.821267    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9" containerName="istio-proxy"
Sep 17 14:51:06.821459 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.821275    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c059d46-ed55-4ff1-90a7-2c2f1c99ae30" containerName="istio-proxy"
Sep 17 14:51:06.821459 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.821280    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c059d46-ed55-4ff1-90a7-2c2f1c99ae30" containerName="istio-proxy"
Sep 17 14:51:06.821459 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.821295    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfd20d4b-0364-4526-9145-e19acf292037" containerName="maas-api"
Sep 17 14:51:06.821459 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.821301    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfd20d4b-0364-4526-9145-e19acf292037" containerName="maas-api"
Sep 17 14:51:06.821459 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.821357    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="420d1704-ba0b-4c1e-a204-19584ad2087d" containerName="maas-api"
Sep 17 14:51:06.821459 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.821366    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9" containerName="istio-proxy"
Sep 17 14:51:06.821459 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.821371    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c059d46-ed55-4ff1-90a7-2c2f1c99ae30" containerName="istio-proxy"
Sep 17 14:51:06.821459 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.821376    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c059d46-ed55-4ff1-90a7-2c2f1c99ae30" containerName="istio-proxy"
Sep 17 14:51:06.821459 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.821380    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfd20d4b-0364-4526-9145-e19acf292037" containerName="maas-api"
Sep 17 14:51:06.821459 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.821386    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ebc6147-f67d-4fd8-af95-079235b1e89b" containerName="istio-proxy"
Sep 17 14:51:06.821459 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.821393    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ebc6147-f67d-4fd8-af95-079235b1e89b" containerName="istio-proxy"
Sep 17 14:51:06.824439 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.824418    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c9b6644d-jdvps"
Sep 17 14:51:06.829336 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.829313    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 14:51:06.829336 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.829329    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 17 14:51:06.829532 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.829339    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 17 14:51:06.829532 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.829366    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 17 14:51:06.829532 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.829329    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2n86r\""
Sep 17 14:51:06.836890 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.836869    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c9b6644d-jdvps"]
Sep 17 14:51:06.926889 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.926855    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35361e49-f6e7-42ca-ab6b-0c645b774a5a-metrics-certs\") pod \"maas-api-6c9b6644d-jdvps\" (UID: \"35361e49-f6e7-42ca-ab6b-0c645b774a5a\") " pod="odh-ai-gateway-infra/maas-api-6c9b6644d-jdvps"
Sep 17 14:51:06.927065 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.926905    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkddh\" (UniqueName: \"kubernetes.io/projected/35361e49-f6e7-42ca-ab6b-0c645b774a5a-kube-api-access-bkddh\") pod \"maas-api-6c9b6644d-jdvps\" (UID: \"35361e49-f6e7-42ca-ab6b-0c645b774a5a\") " pod="odh-ai-gateway-infra/maas-api-6c9b6644d-jdvps"
Sep 17 14:51:06.927065 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.926986    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35361e49-f6e7-42ca-ab6b-0c645b774a5a-maas-api-tls\") pod \"maas-api-6c9b6644d-jdvps\" (UID: \"35361e49-f6e7-42ca-ab6b-0c645b774a5a\") " pod="odh-ai-gateway-infra/maas-api-6c9b6644d-jdvps"
Sep 17 14:51:06.927065 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:06.927011    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35361e49-f6e7-42ca-ab6b-0c645b774a5a-openshift-service-ca\") pod \"maas-api-6c9b6644d-jdvps\" (UID: \"35361e49-f6e7-42ca-ab6b-0c645b774a5a\") " pod="odh-ai-gateway-infra/maas-api-6c9b6644d-jdvps"
Sep 17 14:51:07.028166 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:07.028124    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35361e49-f6e7-42ca-ab6b-0c645b774a5a-metrics-certs\") pod \"maas-api-6c9b6644d-jdvps\" (UID: \"35361e49-f6e7-42ca-ab6b-0c645b774a5a\") " pod="odh-ai-gateway-infra/maas-api-6c9b6644d-jdvps"
Sep 17 14:51:07.028362 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:07.028189    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkddh\" (UniqueName: \"kubernetes.io/projected/35361e49-f6e7-42ca-ab6b-0c645b774a5a-kube-api-access-bkddh\") pod \"maas-api-6c9b6644d-jdvps\" (UID: \"35361e49-f6e7-42ca-ab6b-0c645b774a5a\") " pod="odh-ai-gateway-infra/maas-api-6c9b6644d-jdvps"
Sep 17 14:51:07.028362 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:07.028232    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35361e49-f6e7-42ca-ab6b-0c645b774a5a-maas-api-tls\") pod \"maas-api-6c9b6644d-jdvps\" (UID: \"35361e49-f6e7-42ca-ab6b-0c645b774a5a\") " pod="odh-ai-gateway-infra/maas-api-6c9b6644d-jdvps"
Sep 17 14:51:07.028362 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:07.028252    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35361e49-f6e7-42ca-ab6b-0c645b774a5a-openshift-service-ca\") pod \"maas-api-6c9b6644d-jdvps\" (UID: \"35361e49-f6e7-42ca-ab6b-0c645b774a5a\") " pod="odh-ai-gateway-infra/maas-api-6c9b6644d-jdvps"
Sep 17 14:51:07.028964 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:07.028938    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35361e49-f6e7-42ca-ab6b-0c645b774a5a-openshift-service-ca\") pod \"maas-api-6c9b6644d-jdvps\" (UID: \"35361e49-f6e7-42ca-ab6b-0c645b774a5a\") " pod="odh-ai-gateway-infra/maas-api-6c9b6644d-jdvps"
Sep 17 14:51:07.030688 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:07.030668    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35361e49-f6e7-42ca-ab6b-0c645b774a5a-metrics-certs\") pod \"maas-api-6c9b6644d-jdvps\" (UID: \"35361e49-f6e7-42ca-ab6b-0c645b774a5a\") " pod="odh-ai-gateway-infra/maas-api-6c9b6644d-jdvps"
Sep 17 14:51:07.030771 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:07.030705    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35361e49-f6e7-42ca-ab6b-0c645b774a5a-maas-api-tls\") pod \"maas-api-6c9b6644d-jdvps\" (UID: \"35361e49-f6e7-42ca-ab6b-0c645b774a5a\") " pod="odh-ai-gateway-infra/maas-api-6c9b6644d-jdvps"
Sep 17 14:51:07.036270 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:07.036249    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkddh\" (UniqueName: \"kubernetes.io/projected/35361e49-f6e7-42ca-ab6b-0c645b774a5a-kube-api-access-bkddh\") pod \"maas-api-6c9b6644d-jdvps\" (UID: \"35361e49-f6e7-42ca-ab6b-0c645b774a5a\") " pod="odh-ai-gateway-infra/maas-api-6c9b6644d-jdvps"
Sep 17 14:51:07.136218 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:07.136120    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c9b6644d-jdvps"
Sep 17 14:51:07.414157 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:07.414132    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c9b6644d-jdvps"]
Sep 17 14:51:07.416016 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:51:07.415989    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35361e49_f6e7_42ca_ab6b_0c645b774a5a.slice/crio-10f75b477941251a1ae8a79c39697b2ca4439b0cbc01c2c94d8d5335078560e5 WatchSource:0}: Error finding container 10f75b477941251a1ae8a79c39697b2ca4439b0cbc01c2c94d8d5335078560e5: Status 404 returned error can't find the container with id 10f75b477941251a1ae8a79c39697b2ca4439b0cbc01c2c94d8d5335078560e5
Sep 17 14:51:07.417819 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:07.417798    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 14:51:08.237337 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:08.237307    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c9b6644d-jdvps" event={"ID":"35361e49-f6e7-42ca-ab6b-0c645b774a5a","Type":"ContainerStarted","Data":"2f5845f856987a06385891aa477df92c1d0ed135764ddc006dc5d0d465fd746d"}
Sep 17 14:51:08.237495 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:08.237357    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c9b6644d-jdvps" event={"ID":"35361e49-f6e7-42ca-ab6b-0c645b774a5a","Type":"ContainerStarted","Data":"10f75b477941251a1ae8a79c39697b2ca4439b0cbc01c2c94d8d5335078560e5"}
Sep 17 14:51:08.237495 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:08.237421    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6c9b6644d-jdvps"
Sep 17 14:51:14.247596 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:14.247564    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6c9b6644d-jdvps"
Sep 17 14:51:14.267261 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:14.267196    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6c9b6644d-jdvps" podStartSLOduration=7.81449782 podStartE2EDuration="8.267172936s" totalImagesPullingTime="452.675116ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:51:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:51:08.269062648 +0000 UTC m=+2655.713138250" watchObservedRunningTime="2026-09-17 14:51:14.267172936 +0000 UTC m=+2661.711248523"
Sep 17 14:51:14.308624 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:14.308594    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:51:14.590148 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:14.590066    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6f6d65c644-5nxhr"]
Sep 17 14:51:14.590484 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:14.590471    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ebc6147-f67d-4fd8-af95-079235b1e89b" containerName="istio-proxy"
Sep 17 14:51:14.590530 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:14.590486    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ebc6147-f67d-4fd8-af95-079235b1e89b" containerName="istio-proxy"
Sep 17 14:51:14.590570 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:14.590548    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="664e8c61-1b4d-4d4e-9ff2-5f88b4304fa9" containerName="istio-proxy"
Sep 17 14:51:14.593782 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:14.593764    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6f6d65c644-5nxhr"
Sep 17 14:51:14.606683 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:14.606658    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6f6d65c644-5nxhr"]
Sep 17 14:51:14.689903 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:14.689862    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88eb8528-ddb1-41eb-aea5-30e727091531-openshift-service-ca\") pod \"maas-api-6f6d65c644-5nxhr\" (UID: \"88eb8528-ddb1-41eb-aea5-30e727091531\") " pod="odh-ai-gateway-infra/maas-api-6f6d65c644-5nxhr"
Sep 17 14:51:14.689903 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:14.689905    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88eb8528-ddb1-41eb-aea5-30e727091531-metrics-certs\") pod \"maas-api-6f6d65c644-5nxhr\" (UID: \"88eb8528-ddb1-41eb-aea5-30e727091531\") " pod="odh-ai-gateway-infra/maas-api-6f6d65c644-5nxhr"
Sep 17 14:51:14.690108 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:14.689986    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88eb8528-ddb1-41eb-aea5-30e727091531-maas-api-tls\") pod \"maas-api-6f6d65c644-5nxhr\" (UID: \"88eb8528-ddb1-41eb-aea5-30e727091531\") " pod="odh-ai-gateway-infra/maas-api-6f6d65c644-5nxhr"
Sep 17 14:51:14.690108 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:14.690037    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6d56\" (UniqueName: \"kubernetes.io/projected/88eb8528-ddb1-41eb-aea5-30e727091531-kube-api-access-q6d56\") pod \"maas-api-6f6d65c644-5nxhr\" (UID: \"88eb8528-ddb1-41eb-aea5-30e727091531\") " pod="odh-ai-gateway-infra/maas-api-6f6d65c644-5nxhr"
Sep 17 14:51:14.790647 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:14.790607    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6d56\" (UniqueName: \"kubernetes.io/projected/88eb8528-ddb1-41eb-aea5-30e727091531-kube-api-access-q6d56\") pod \"maas-api-6f6d65c644-5nxhr\" (UID: \"88eb8528-ddb1-41eb-aea5-30e727091531\") " pod="odh-ai-gateway-infra/maas-api-6f6d65c644-5nxhr"
Sep 17 14:51:14.790647 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:14.790649    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88eb8528-ddb1-41eb-aea5-30e727091531-openshift-service-ca\") pod \"maas-api-6f6d65c644-5nxhr\" (UID: \"88eb8528-ddb1-41eb-aea5-30e727091531\") " pod="odh-ai-gateway-infra/maas-api-6f6d65c644-5nxhr"
Sep 17 14:51:14.790924 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:14.790671    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88eb8528-ddb1-41eb-aea5-30e727091531-metrics-certs\") pod \"maas-api-6f6d65c644-5nxhr\" (UID: \"88eb8528-ddb1-41eb-aea5-30e727091531\") " pod="odh-ai-gateway-infra/maas-api-6f6d65c644-5nxhr"
Sep 17 14:51:14.790924 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:14.790749    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88eb8528-ddb1-41eb-aea5-30e727091531-maas-api-tls\") pod \"maas-api-6f6d65c644-5nxhr\" (UID: \"88eb8528-ddb1-41eb-aea5-30e727091531\") " pod="odh-ai-gateway-infra/maas-api-6f6d65c644-5nxhr"
Sep 17 14:51:14.791326 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:14.791301    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88eb8528-ddb1-41eb-aea5-30e727091531-openshift-service-ca\") pod \"maas-api-6f6d65c644-5nxhr\" (UID: \"88eb8528-ddb1-41eb-aea5-30e727091531\") " pod="odh-ai-gateway-infra/maas-api-6f6d65c644-5nxhr"
Sep 17 14:51:14.793192 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:14.793169    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88eb8528-ddb1-41eb-aea5-30e727091531-maas-api-tls\") pod \"maas-api-6f6d65c644-5nxhr\" (UID: \"88eb8528-ddb1-41eb-aea5-30e727091531\") " pod="odh-ai-gateway-infra/maas-api-6f6d65c644-5nxhr"
Sep 17 14:51:14.793278 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:14.793246    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88eb8528-ddb1-41eb-aea5-30e727091531-metrics-certs\") pod \"maas-api-6f6d65c644-5nxhr\" (UID: \"88eb8528-ddb1-41eb-aea5-30e727091531\") " pod="odh-ai-gateway-infra/maas-api-6f6d65c644-5nxhr"
Sep 17 14:51:14.799079 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:14.799055    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6d56\" (UniqueName: \"kubernetes.io/projected/88eb8528-ddb1-41eb-aea5-30e727091531-kube-api-access-q6d56\") pod \"maas-api-6f6d65c644-5nxhr\" (UID: \"88eb8528-ddb1-41eb-aea5-30e727091531\") " pod="odh-ai-gateway-infra/maas-api-6f6d65c644-5nxhr"
Sep 17 14:51:14.904693 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:14.904604    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6f6d65c644-5nxhr"
Sep 17 14:51:15.178011 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:51:15.177977    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88eb8528_ddb1_41eb_aea5_30e727091531.slice/crio-eca3b0b0e6732acb41db95681f302c72c62f06fbad8deeb25f8b3e79247b6f43 WatchSource:0}: Error finding container eca3b0b0e6732acb41db95681f302c72c62f06fbad8deeb25f8b3e79247b6f43: Status 404 returned error can't find the container with id eca3b0b0e6732acb41db95681f302c72c62f06fbad8deeb25f8b3e79247b6f43
Sep 17 14:51:15.178266 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:15.178244    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6f6d65c644-5nxhr"]
Sep 17 14:51:15.276475 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:15.276439    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6f6d65c644-5nxhr" event={"ID":"88eb8528-ddb1-41eb-aea5-30e727091531","Type":"ContainerStarted","Data":"eca3b0b0e6732acb41db95681f302c72c62f06fbad8deeb25f8b3e79247b6f43"}
Sep 17 14:51:16.284181 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:16.284151    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6f6d65c644-5nxhr" event={"ID":"88eb8528-ddb1-41eb-aea5-30e727091531","Type":"ContainerStarted","Data":"904f721b79dff2a90165ac5fe2c7d3663d98f597ff4ac99e9710bd418106757d"}
Sep 17 14:51:16.284539 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:16.284269    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6f6d65c644-5nxhr"
Sep 17 14:51:16.305620 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:16.305559    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6f6d65c644-5nxhr" podStartSLOduration=1.2720927340000001 podStartE2EDuration="2.305539492s" totalImagesPullingTime="1.033446758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:51:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:51:16.303413371 +0000 UTC m=+2663.747488969" watchObservedRunningTime="2026-09-17 14:51:16.305539492 +0000 UTC m=+2663.749615077"
Sep 17 14:51:20.718440 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:20.718399    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:51:22.295181 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:22.295150    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6f6d65c644-5nxhr"
Sep 17 14:51:22.348861 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:22.348828    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c9b6644d-jdvps"]
Sep 17 14:51:22.349081 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:22.349056    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6c9b6644d-jdvps" podUID="35361e49-f6e7-42ca-ab6b-0c645b774a5a" containerName="maas-api" containerID="cri-o://2f5845f856987a06385891aa477df92c1d0ed135764ddc006dc5d0d465fd746d" gracePeriod=30
Sep 17 14:51:23.589024 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:23.589001    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c9b6644d-jdvps"
Sep 17 14:51:23.672475 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:23.672392    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35361e49-f6e7-42ca-ab6b-0c645b774a5a-metrics-certs\") pod \"35361e49-f6e7-42ca-ab6b-0c645b774a5a\" (UID: \"35361e49-f6e7-42ca-ab6b-0c645b774a5a\") "
Sep 17 14:51:23.672475 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:23.672440    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35361e49-f6e7-42ca-ab6b-0c645b774a5a-openshift-service-ca\") pod \"35361e49-f6e7-42ca-ab6b-0c645b774a5a\" (UID: \"35361e49-f6e7-42ca-ab6b-0c645b774a5a\") "
Sep 17 14:51:23.672702 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:23.672562    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35361e49-f6e7-42ca-ab6b-0c645b774a5a-maas-api-tls\") pod \"35361e49-f6e7-42ca-ab6b-0c645b774a5a\" (UID: \"35361e49-f6e7-42ca-ab6b-0c645b774a5a\") "
Sep 17 14:51:23.672702 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:23.672627    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkddh\" (UniqueName: \"kubernetes.io/projected/35361e49-f6e7-42ca-ab6b-0c645b774a5a-kube-api-access-bkddh\") pod \"35361e49-f6e7-42ca-ab6b-0c645b774a5a\" (UID: \"35361e49-f6e7-42ca-ab6b-0c645b774a5a\") "
Sep 17 14:51:23.672847 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:23.672791    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35361e49-f6e7-42ca-ab6b-0c645b774a5a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "35361e49-f6e7-42ca-ab6b-0c645b774a5a" (UID: "35361e49-f6e7-42ca-ab6b-0c645b774a5a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 14:51:23.672931 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:23.672917    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35361e49-f6e7-42ca-ab6b-0c645b774a5a-openshift-service-ca\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:51:23.674616 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:23.674587    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35361e49-f6e7-42ca-ab6b-0c645b774a5a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "35361e49-f6e7-42ca-ab6b-0c645b774a5a" (UID: "35361e49-f6e7-42ca-ab6b-0c645b774a5a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:51:23.674616 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:23.674605    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35361e49-f6e7-42ca-ab6b-0c645b774a5a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "35361e49-f6e7-42ca-ab6b-0c645b774a5a" (UID: "35361e49-f6e7-42ca-ab6b-0c645b774a5a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 14:51:23.674845 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:23.674650    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35361e49-f6e7-42ca-ab6b-0c645b774a5a-kube-api-access-bkddh" (OuterVolumeSpecName: "kube-api-access-bkddh") pod "35361e49-f6e7-42ca-ab6b-0c645b774a5a" (UID: "35361e49-f6e7-42ca-ab6b-0c645b774a5a"). InnerVolumeSpecName "kube-api-access-bkddh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 14:51:23.773475 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:23.773439    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35361e49-f6e7-42ca-ab6b-0c645b774a5a-maas-api-tls\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:51:23.773475 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:23.773468    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkddh\" (UniqueName: \"kubernetes.io/projected/35361e49-f6e7-42ca-ab6b-0c645b774a5a-kube-api-access-bkddh\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:51:23.773475 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:23.773479    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35361e49-f6e7-42ca-ab6b-0c645b774a5a-metrics-certs\") on node \"ip-10-0-142-22.ec2.internal\" DevicePath \"\""
Sep 17 14:51:24.329790 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:24.329757    2580 generic.go:356] "Generic (PLEG): container finished" podID="35361e49-f6e7-42ca-ab6b-0c645b774a5a" containerID="2f5845f856987a06385891aa477df92c1d0ed135764ddc006dc5d0d465fd746d" exitCode=0
Sep 17 14:51:24.329970 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:24.329802    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c9b6644d-jdvps"
Sep 17 14:51:24.329970 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:24.329816    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c9b6644d-jdvps" event={"ID":"35361e49-f6e7-42ca-ab6b-0c645b774a5a","Type":"ContainerDied","Data":"2f5845f856987a06385891aa477df92c1d0ed135764ddc006dc5d0d465fd746d"}
Sep 17 14:51:24.329970 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:24.329862    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c9b6644d-jdvps" event={"ID":"35361e49-f6e7-42ca-ab6b-0c645b774a5a","Type":"ContainerDied","Data":"10f75b477941251a1ae8a79c39697b2ca4439b0cbc01c2c94d8d5335078560e5"}
Sep 17 14:51:24.329970 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:24.329885    2580 scope.go:117] "RemoveContainer" containerID="2f5845f856987a06385891aa477df92c1d0ed135764ddc006dc5d0d465fd746d"
Sep 17 14:51:24.339670 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:24.339655    2580 scope.go:117] "RemoveContainer" containerID="2f5845f856987a06385891aa477df92c1d0ed135764ddc006dc5d0d465fd746d"
Sep 17 14:51:24.339947 ip-10-0-142-22 kubenswrapper[2580]: E0917 14:51:24.339928    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f5845f856987a06385891aa477df92c1d0ed135764ddc006dc5d0d465fd746d\": container with ID starting with 2f5845f856987a06385891aa477df92c1d0ed135764ddc006dc5d0d465fd746d not found: ID does not exist" containerID="2f5845f856987a06385891aa477df92c1d0ed135764ddc006dc5d0d465fd746d"
Sep 17 14:51:24.340003 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:24.339955    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f5845f856987a06385891aa477df92c1d0ed135764ddc006dc5d0d465fd746d"} err="failed to get container status \"2f5845f856987a06385891aa477df92c1d0ed135764ddc006dc5d0d465fd746d\": rpc error: code = NotFound desc = could not find container \"2f5845f856987a06385891aa477df92c1d0ed135764ddc006dc5d0d465fd746d\": container with ID starting with 2f5845f856987a06385891aa477df92c1d0ed135764ddc006dc5d0d465fd746d not found: ID does not exist"
Sep 17 14:51:24.355802 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:24.355782    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c9b6644d-jdvps"]
Sep 17 14:51:24.362885 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:24.362860    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c9b6644d-jdvps"]
Sep 17 14:51:25.177590 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:25.177556    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35361e49-f6e7-42ca-ab6b-0c645b774a5a" path="/var/lib/kubelet/pods/35361e49-f6e7-42ca-ab6b-0c645b774a5a/volumes"
Sep 17 14:51:26.624909 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:26.624868    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:51:33.708678 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:33.708635    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vvdg5"]
Sep 17 14:51:36.462471 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:36.462437    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d6cbff976-tszfl_c68b2bee-0ac9-4a03-8792-64b7be955a1c/authorino/0.log"
Sep 17 14:51:42.249065 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:42.249032    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-569db487f9-4v4d8_ed27d2df-c7e1-438c-8c97-213b6c717b1d/manager/0.log"
Sep 17 14:51:42.263003 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:42.262976    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-569db487f9-4v4d8_ed27d2df-c7e1-438c-8c97-213b6c717b1d/copy-manifests/0.log"
Sep 17 14:51:42.818760 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:42.818700    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6f6d65c644-5nxhr_88eb8528-ddb1-41eb-aea5-30e727091531/maas-api/0.log"
Sep 17 14:51:44.011245 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:44.011206    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d6cbff976-tszfl_c68b2bee-0ac9-4a03-8792-64b7be955a1c/authorino/0.log"
Sep 17 14:51:44.558923 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:44.558889    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-vvdg5_4821f268-1865-4973-b814-a9e54e76cf50/limitador/0.log"
Sep 17 14:51:44.673206 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:44.673179    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-m8rdb_8ed509ed-db90-4be5-97d1-b9d0b0dd6927/manager/0.log"
Sep 17 14:51:45.350510 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:45.350428    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-549869464b-8trnz_4b3109f3-8292-43ba-aad9-815a04c0776f/kube-auth-proxy/0.log"
Sep 17 14:51:46.475548 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:46.475516    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-2trkm_e2b29a26-7f70-41d4-af32-09def28660cf/main/0.log"
Sep 17 14:51:52.538605 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:52.538567    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xrpqc/must-gather-j526z"]
Sep 17 14:51:52.539210 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:52.539020    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35361e49-f6e7-42ca-ab6b-0c645b774a5a" containerName="maas-api"
Sep 17 14:51:52.539210 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:52.539033    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="35361e49-f6e7-42ca-ab6b-0c645b774a5a" containerName="maas-api"
Sep 17 14:51:52.539210 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:52.539148    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="35361e49-f6e7-42ca-ab6b-0c645b774a5a" containerName="maas-api"
Sep 17 14:51:52.542640 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:52.542622    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xrpqc/must-gather-j526z"
Sep 17 14:51:52.548799 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:52.548774    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xrpqc\"/\"openshift-service-ca.crt\""
Sep 17 14:51:52.548799 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:52.548797    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xrpqc\"/\"kube-root-ca.crt\""
Sep 17 14:51:52.559484 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:52.559450    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xrpqc/must-gather-j526z"]
Sep 17 14:51:52.560665 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:52.560630    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xrpqc\"/\"default-dockercfg-vgnzx\""
Sep 17 14:51:52.639126 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:52.639092    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dng29\" (UniqueName: \"kubernetes.io/projected/4e2afc37-b90d-42df-bc77-be781c615135-kube-api-access-dng29\") pod \"must-gather-j526z\" (UID: \"4e2afc37-b90d-42df-bc77-be781c615135\") " pod="openshift-must-gather-xrpqc/must-gather-j526z"
Sep 17 14:51:52.639297 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:52.639169    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4e2afc37-b90d-42df-bc77-be781c615135-must-gather-output\") pod \"must-gather-j526z\" (UID: \"4e2afc37-b90d-42df-bc77-be781c615135\") " pod="openshift-must-gather-xrpqc/must-gather-j526z"
Sep 17 14:51:52.739981 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:52.739936    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4e2afc37-b90d-42df-bc77-be781c615135-must-gather-output\") pod \"must-gather-j526z\" (UID: \"4e2afc37-b90d-42df-bc77-be781c615135\") " pod="openshift-must-gather-xrpqc/must-gather-j526z"
Sep 17 14:51:52.740178 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:52.740035    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dng29\" (UniqueName: \"kubernetes.io/projected/4e2afc37-b90d-42df-bc77-be781c615135-kube-api-access-dng29\") pod \"must-gather-j526z\" (UID: \"4e2afc37-b90d-42df-bc77-be781c615135\") " pod="openshift-must-gather-xrpqc/must-gather-j526z"
Sep 17 14:51:52.740288 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:52.740265    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4e2afc37-b90d-42df-bc77-be781c615135-must-gather-output\") pod \"must-gather-j526z\" (UID: \"4e2afc37-b90d-42df-bc77-be781c615135\") " pod="openshift-must-gather-xrpqc/must-gather-j526z"
Sep 17 14:51:52.758243 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:52.758215    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dng29\" (UniqueName: \"kubernetes.io/projected/4e2afc37-b90d-42df-bc77-be781c615135-kube-api-access-dng29\") pod \"must-gather-j526z\" (UID: \"4e2afc37-b90d-42df-bc77-be781c615135\") " pod="openshift-must-gather-xrpqc/must-gather-j526z"
Sep 17 14:51:52.852391 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:52.852307    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xrpqc/must-gather-j526z"
Sep 17 14:51:53.124904 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:53.124881    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xrpqc/must-gather-j526z"]
Sep 17 14:51:53.126175 ip-10-0-142-22 kubenswrapper[2580]: W0917 14:51:53.126147    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e2afc37_b90d_42df_bc77_be781c615135.slice/crio-01b4cacd89a98ac6ccf7cf8c6131bc45a8b9b3de1d55c33fba051235d97ec45d WatchSource:0}: Error finding container 01b4cacd89a98ac6ccf7cf8c6131bc45a8b9b3de1d55c33fba051235d97ec45d: Status 404 returned error can't find the container with id 01b4cacd89a98ac6ccf7cf8c6131bc45a8b9b3de1d55c33fba051235d97ec45d
Sep 17 14:51:53.509436 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:53.509400    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xrpqc/must-gather-j526z" event={"ID":"4e2afc37-b90d-42df-bc77-be781c615135","Type":"ContainerStarted","Data":"01b4cacd89a98ac6ccf7cf8c6131bc45a8b9b3de1d55c33fba051235d97ec45d"}
Sep 17 14:51:54.519426 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:54.519384    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xrpqc/must-gather-j526z" event={"ID":"4e2afc37-b90d-42df-bc77-be781c615135","Type":"ContainerStarted","Data":"802601143f90c4268f6eeec66a7c94c2dc6d0004868e74a4c0d0e5e6d5d23771"}
Sep 17 14:51:54.519921 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:54.519441    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xrpqc/must-gather-j526z" event={"ID":"4e2afc37-b90d-42df-bc77-be781c615135","Type":"ContainerStarted","Data":"23b4aff2af2f8b3e7f5945867ed20f3ea6b13254ed487dfa447d4c78c44e1ef6"}
Sep 17 14:51:54.538644 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:54.538579    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xrpqc/must-gather-j526z" podStartSLOduration=1.861613534 podStartE2EDuration="2.538555469s" totalImagesPullingTime="676.941935ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 14:51:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:51:54.536278132 +0000 UTC m=+2701.980353717" watchObservedRunningTime="2026-09-17 14:51:54.538555469 +0000 UTC m=+2701.982631055"
Sep 17 14:51:55.450963 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:55.450924    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-g2wf7_2da17ddd-8912-4e47-af0f-dc90e7aef2e7/global-pull-secret-syncer/0.log"
Sep 17 14:51:55.579835 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:55.579794    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-j4k9b_50cd5129-5e4f-4063-b789-aa7477a7df41/konnectivity-agent/0.log"
Sep 17 14:51:55.648964 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:51:55.648907    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-22.ec2.internal_e37420b5f4f2cfdf85c1d60d1139054c/haproxy/0.log"
Sep 17 14:52:00.491737 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:00.490744    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d6cbff976-tszfl_c68b2bee-0ac9-4a03-8792-64b7be955a1c/authorino/0.log"
Sep 17 14:52:00.647994 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:00.647947    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-vvdg5_4821f268-1865-4973-b814-a9e54e76cf50/limitador/0.log"
Sep 17 14:52:00.729385 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:00.729277    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-m8rdb_8ed509ed-db90-4be5-97d1-b9d0b0dd6927/manager/0.log"
Sep 17 14:52:02.227217 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:02.227186    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f2863cb0-e9fa-4b1d-b49d-397470b79385/alertmanager/0.log"
Sep 17 14:52:02.255401 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:02.255314    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f2863cb0-e9fa-4b1d-b49d-397470b79385/config-reloader/0.log"
Sep 17 14:52:02.278912 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:02.278835    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f2863cb0-e9fa-4b1d-b49d-397470b79385/kube-rbac-proxy-web/0.log"
Sep 17 14:52:02.309868 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:02.309838    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f2863cb0-e9fa-4b1d-b49d-397470b79385/kube-rbac-proxy/0.log"
Sep 17 14:52:02.335278 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:02.335251    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f2863cb0-e9fa-4b1d-b49d-397470b79385/kube-rbac-proxy-metric/0.log"
Sep 17 14:52:02.357839 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:02.357812    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f2863cb0-e9fa-4b1d-b49d-397470b79385/prom-label-proxy/0.log"
Sep 17 14:52:02.386291 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:02.386261    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f2863cb0-e9fa-4b1d-b49d-397470b79385/init-config-reloader/0.log"
Sep 17 14:52:02.433464 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:02.433432    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-krk4h_92f8530c-23cc-4d9c-9d4b-564058a9b840/cluster-monitoring-operator/0.log"
Sep 17 14:52:02.541564 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:02.541482    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5679c6454f-9fcdl_462533fc-c268-4330-82c1-abfa086fa76c/metrics-server/0.log"
Sep 17 14:52:02.568370 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:02.568331    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-8jhkm_d39f4d8a-6fbc-4257-acfe-0f96d47cb369/monitoring-plugin/0.log"
Sep 17 14:52:02.680070 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:02.680035    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qf9s8_59d983dc-3c76-4025-9cf6-9085f232616c/node-exporter/0.log"
Sep 17 14:52:02.705309 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:02.704779    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qf9s8_59d983dc-3c76-4025-9cf6-9085f232616c/kube-rbac-proxy/0.log"
Sep 17 14:52:02.740232 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:02.738966    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qf9s8_59d983dc-3c76-4025-9cf6-9085f232616c/init-textfile/0.log"
Sep 17 14:52:02.883242 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:02.883154    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-stfjc_57e11ae8-25af-4625-8ce8-f36875e393a2/kube-rbac-proxy-main/0.log"
Sep 17 14:52:02.909480 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:02.909444    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-stfjc_57e11ae8-25af-4625-8ce8-f36875e393a2/kube-rbac-proxy-self/0.log"
Sep 17 14:52:02.929882 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:02.929856    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-stfjc_57e11ae8-25af-4625-8ce8-f36875e393a2/openshift-state-metrics/0.log"
Sep 17 14:52:03.164223 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:03.164148    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-rt8f6_e422892e-ae98-49b6-9faa-a7baf4b61fe1/prometheus-operator/0.log"
Sep 17 14:52:03.200308 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:03.200255    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-rt8f6_e422892e-ae98-49b6-9faa-a7baf4b61fe1/kube-rbac-proxy/0.log"
Sep 17 14:52:03.281117 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:03.281078    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68946bfd7f-467rt_7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3/telemeter-client/0.log"
Sep 17 14:52:03.310416 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:03.310375    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68946bfd7f-467rt_7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3/reload/0.log"
Sep 17 14:52:03.338814 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:03.338778    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-68946bfd7f-467rt_7c8e1daf-c93c-4eb2-a9cd-c0e3d9e7f8c3/kube-rbac-proxy/0.log"
Sep 17 14:52:05.493465 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:05.493422    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xrpqc/perf-node-gather-daemonset-575cf"]
Sep 17 14:52:05.499926 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:05.499890    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xrpqc/perf-node-gather-daemonset-575cf"
Sep 17 14:52:05.506963 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:05.506925    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xrpqc/perf-node-gather-daemonset-575cf"]
Sep 17 14:52:05.575739 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:05.572802    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ea0841b-28b8-4d3e-85ac-b3f56daaec4e-lib-modules\") pod \"perf-node-gather-daemonset-575cf\" (UID: \"0ea0841b-28b8-4d3e-85ac-b3f56daaec4e\") " pod="openshift-must-gather-xrpqc/perf-node-gather-daemonset-575cf"
Sep 17 14:52:05.575739 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:05.572898    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0ea0841b-28b8-4d3e-85ac-b3f56daaec4e-proc\") pod \"perf-node-gather-daemonset-575cf\" (UID: \"0ea0841b-28b8-4d3e-85ac-b3f56daaec4e\") " pod="openshift-must-gather-xrpqc/perf-node-gather-daemonset-575cf"
Sep 17 14:52:05.575739 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:05.572938    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n744v\" (UniqueName: \"kubernetes.io/projected/0ea0841b-28b8-4d3e-85ac-b3f56daaec4e-kube-api-access-n744v\") pod \"perf-node-gather-daemonset-575cf\" (UID: \"0ea0841b-28b8-4d3e-85ac-b3f56daaec4e\") " pod="openshift-must-gather-xrpqc/perf-node-gather-daemonset-575cf"
Sep 17 14:52:05.575739 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:05.572980    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0ea0841b-28b8-4d3e-85ac-b3f56daaec4e-podres\") pod \"perf-node-gather-daemonset-575cf\" (UID: \"0ea0841b-28b8-4d3e-85ac-b3f56daaec4e\") " pod="openshift-must-gather-xrpqc/perf-node-gather-daemonset-575cf"
Sep 17 14:52:05.575739 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:05.573022    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ea0841b-28b8-4d3e-85ac-b3f56daaec4e-sys\") pod \"perf-node-gather-daemonset-575cf\" (UID: \"0ea0841b-28b8-4d3e-85ac-b3f56daaec4e\") " pod="openshift-must-gather-xrpqc/perf-node-gather-daemonset-575cf"
Sep 17 14:52:05.673859 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:05.673823    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ea0841b-28b8-4d3e-85ac-b3f56daaec4e-lib-modules\") pod \"perf-node-gather-daemonset-575cf\" (UID: \"0ea0841b-28b8-4d3e-85ac-b3f56daaec4e\") " pod="openshift-must-gather-xrpqc/perf-node-gather-daemonset-575cf"
Sep 17 14:52:05.673859 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:05.673869    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0ea0841b-28b8-4d3e-85ac-b3f56daaec4e-proc\") pod \"perf-node-gather-daemonset-575cf\" (UID: \"0ea0841b-28b8-4d3e-85ac-b3f56daaec4e\") " pod="openshift-must-gather-xrpqc/perf-node-gather-daemonset-575cf"
Sep 17 14:52:05.674132 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:05.673896    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n744v\" (UniqueName: \"kubernetes.io/projected/0ea0841b-28b8-4d3e-85ac-b3f56daaec4e-kube-api-access-n744v\") pod \"perf-node-gather-daemonset-575cf\" (UID: \"0ea0841b-28b8-4d3e-85ac-b3f56daaec4e\") " pod="openshift-must-gather-xrpqc/perf-node-gather-daemonset-575cf"
Sep 17 14:52:05.674132 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:05.673937    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0ea0841b-28b8-4d3e-85ac-b3f56daaec4e-podres\") pod \"perf-node-gather-daemonset-575cf\" (UID: \"0ea0841b-28b8-4d3e-85ac-b3f56daaec4e\") " pod="openshift-must-gather-xrpqc/perf-node-gather-daemonset-575cf"
Sep 17 14:52:05.674132 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:05.673960    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ea0841b-28b8-4d3e-85ac-b3f56daaec4e-sys\") pod \"perf-node-gather-daemonset-575cf\" (UID: \"0ea0841b-28b8-4d3e-85ac-b3f56daaec4e\") " pod="openshift-must-gather-xrpqc/perf-node-gather-daemonset-575cf"
Sep 17 14:52:05.674132 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:05.674061    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ea0841b-28b8-4d3e-85ac-b3f56daaec4e-sys\") pod \"perf-node-gather-daemonset-575cf\" (UID: \"0ea0841b-28b8-4d3e-85ac-b3f56daaec4e\") " pod="openshift-must-gather-xrpqc/perf-node-gather-daemonset-575cf"
Sep 17 14:52:05.674132 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:05.674109    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0ea0841b-28b8-4d3e-85ac-b3f56daaec4e-podres\") pod \"perf-node-gather-daemonset-575cf\" (UID: \"0ea0841b-28b8-4d3e-85ac-b3f56daaec4e\") " pod="openshift-must-gather-xrpqc/perf-node-gather-daemonset-575cf"
Sep 17 14:52:05.674429 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:05.674191    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ea0841b-28b8-4d3e-85ac-b3f56daaec4e-lib-modules\") pod \"perf-node-gather-daemonset-575cf\" (UID: \"0ea0841b-28b8-4d3e-85ac-b3f56daaec4e\") " pod="openshift-must-gather-xrpqc/perf-node-gather-daemonset-575cf"
Sep 17 14:52:05.674429 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:05.674365    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0ea0841b-28b8-4d3e-85ac-b3f56daaec4e-proc\") pod \"perf-node-gather-daemonset-575cf\" (UID: \"0ea0841b-28b8-4d3e-85ac-b3f56daaec4e\") " pod="openshift-must-gather-xrpqc/perf-node-gather-daemonset-575cf"
Sep 17 14:52:05.682930 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:05.682902    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n744v\" (UniqueName: \"kubernetes.io/projected/0ea0841b-28b8-4d3e-85ac-b3f56daaec4e-kube-api-access-n744v\") pod \"perf-node-gather-daemonset-575cf\" (UID: \"0ea0841b-28b8-4d3e-85ac-b3f56daaec4e\") " pod="openshift-must-gather-xrpqc/perf-node-gather-daemonset-575cf"
Sep 17 14:52:05.821226 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:05.821128    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xrpqc/perf-node-gather-daemonset-575cf"
Sep 17 14:52:06.128367 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:06.126131    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xrpqc/perf-node-gather-daemonset-575cf"]
Sep 17 14:52:06.150491 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:06.150462    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-qq8f6_f32a3a50-14cd-4c4d-9c76-0b5513397f7a/download-server/0.log"
Sep 17 14:52:06.620529 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:06.620486    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xrpqc/perf-node-gather-daemonset-575cf" event={"ID":"0ea0841b-28b8-4d3e-85ac-b3f56daaec4e","Type":"ContainerStarted","Data":"63e25808d9f24bcbd2e2a833d2de5be4c45def4378d0b213f8130dbf9451a4a5"}
Sep 17 14:52:06.621064 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:06.620555    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xrpqc/perf-node-gather-daemonset-575cf" event={"ID":"0ea0841b-28b8-4d3e-85ac-b3f56daaec4e","Type":"ContainerStarted","Data":"279351412f040682c17a77d6142f49b79d216bce878075dfd3e6b3925f25e2ef"}
Sep 17 14:52:06.621064 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:06.620822    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xrpqc/perf-node-gather-daemonset-575cf"
Sep 17 14:52:06.649496 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:06.649435    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xrpqc/perf-node-gather-daemonset-575cf" podStartSLOduration=1.649413972 podStartE2EDuration="1.649413972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 14:52:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 14:52:06.649177099 +0000 UTC m=+2714.093252684" watchObservedRunningTime="2026-09-17 14:52:06.649413972 +0000 UTC m=+2714.093489555"
Sep 17 14:52:07.982989 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:07.982962    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6nv9q_b69e72f2-4449-4197-ac80-a0284247ac28/dns/0.log"
Sep 17 14:52:08.007511 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:08.007482    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6nv9q_b69e72f2-4449-4197-ac80-a0284247ac28/kube-rbac-proxy/0.log"
Sep 17 14:52:08.172480 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:08.172449    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cjdbx_1a72aa89-6ca0-47df-9fde-fb8dbc65c79f/dns-node-resolver/0.log"
Sep 17 14:52:08.771510 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:08.771479    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6cb9l_f68cb2de-9f71-4ee3-8c37-75f1c2918f66/node-ca/0.log"
Sep 17 14:52:10.605829 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:10.605803    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-549869464b-8trnz_4b3109f3-8292-43ba-aad9-815a04c0776f/kube-auth-proxy/0.log"
Sep 17 14:52:11.808659 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:11.808624    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mhzr8_85268ab9-968c-4231-85c2-e4bd619a31c5/serve-healthcheck-canary/0.log"
Sep 17 14:52:12.433459 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:12.433430    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8br75_5e34585f-eabb-49bc-ae58-5432490909e0/kube-rbac-proxy/0.log"
Sep 17 14:52:12.463462 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:12.463424    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8br75_5e34585f-eabb-49bc-ae58-5432490909e0/exporter/0.log"
Sep 17 14:52:12.485525 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:12.485490    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8br75_5e34585f-eabb-49bc-ae58-5432490909e0/extractor/0.log"
Sep 17 14:52:12.643292 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:12.643258    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xrpqc/perf-node-gather-daemonset-575cf"
Sep 17 14:52:15.616526 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:15.616492    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-569db487f9-4v4d8_ed27d2df-c7e1-438c-8c97-213b6c717b1d/manager/0.log"
Sep 17 14:52:15.635953 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:15.635928    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-569db487f9-4v4d8_ed27d2df-c7e1-438c-8c97-213b6c717b1d/copy-manifests/0.log"
Sep 17 14:52:16.932352 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:16.932316    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-77fdd77d78-b8jvn_5b8826d0-3e55-423e-a386-02741cdf07c9/manager/0.log"
Sep 17 14:52:16.937294 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:16.937266    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-549869464b-8trnz_4b3109f3-8292-43ba-aad9-815a04c0776f/kube-auth-proxy/0.log"
Sep 17 14:52:19.336090 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:19.336061    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-549869464b-8trnz_4b3109f3-8292-43ba-aad9-815a04c0776f/kube-auth-proxy/0.log"
Sep 17 14:52:21.972314 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:21.972287    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-hmpxg_34962ee4-4405-4b0a-b926-bc17926da9cd/migrator/0.log"
Sep 17 14:52:21.992065 ip-10-0-142-22 kubenswrapper[2580]: I0917 14:52:21.992032    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-hmpxg_34962ee4-4405-4b0a-b926-bc17926da9cd/graceful-termination/0.log"