Sep 16 02:11:12.092062 ip-10-0-139-191 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 16 02:11:12.092075 ip-10-0-139-191 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 16 02:11:12.092085 ip-10-0-139-191 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 16 02:11:12.092485 ip-10-0-139-191 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 16 02:11:22.218726 ip-10-0-139-191 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 16 02:11:22.218742 ip-10-0-139-191 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 5c31fc92e03d49549c5d0a292f0db63d --
Sep 16 02:13:13.682018 ip-10-0-139-191 systemd[1]: Starting Kubernetes Kubelet...
Sep 16 02:13:14.075717 ip-10-0-139-191 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 02:13:14.075717 ip-10-0-139-191 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 16 02:13:14.075717 ip-10-0-139-191 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 02:13:14.075717 ip-10-0-139-191 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 16 02:13:14.075717 ip-10-0-139-191 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 02:13:14.077264 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.077182    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 16 02:13:14.081945 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.081930    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 02:13:14.081945 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.081944    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 02:13:14.082010 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.081948    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 02:13:14.082010 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.081952    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 02:13:14.082010 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.081955    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 02:13:14.082010 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.081958    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 02:13:14.082010 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.081960    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 02:13:14.082010 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.081963    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 02:13:14.082010 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.081966    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 02:13:14.082010 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.081968    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 02:13:14.082010 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.081971    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 02:13:14.082010 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.081974    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 02:13:14.082010 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.081977    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 02:13:14.082010 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.081979    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 02:13:14.082010 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.081982    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 02:13:14.082010 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.081984    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 02:13:14.082010 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.081986    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 02:13:14.082010 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.081989    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 02:13:14.082010 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.081991    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 02:13:14.082010 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.081994    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 02:13:14.082010 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082000    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 02:13:14.082484 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082003    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 02:13:14.082484 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082005    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 02:13:14.082484 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082008    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 02:13:14.082484 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082010    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 02:13:14.082484 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082013    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 02:13:14.082484 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082016    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 02:13:14.082484 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082019    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 02:13:14.082484 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082023    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 02:13:14.082484 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082027    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 02:13:14.082484 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082030    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 02:13:14.082484 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082033    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 02:13:14.082484 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082036    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 02:13:14.082484 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082038    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 02:13:14.082484 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082041    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 02:13:14.082484 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082043    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 02:13:14.082484 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082046    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 02:13:14.082484 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082048    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 02:13:14.082484 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082051    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 02:13:14.082484 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082054    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 02:13:14.082484 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082056    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 02:13:14.083093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082059    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 02:13:14.083093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082061    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 02:13:14.083093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082064    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 02:13:14.083093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082066    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 02:13:14.083093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082069    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 02:13:14.083093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082071    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 02:13:14.083093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082073    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 02:13:14.083093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082077    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 02:13:14.083093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082079    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 02:13:14.083093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082082    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 02:13:14.083093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082084    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 02:13:14.083093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082086    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 02:13:14.083093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082089    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 02:13:14.083093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082093    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 02:13:14.083093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082096    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 02:13:14.083093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082098    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 02:13:14.083093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082101    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 02:13:14.083093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082103    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 02:13:14.083093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082106    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 02:13:14.083093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082109    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 02:13:14.083093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082111    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 02:13:14.083606 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082114    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 02:13:14.083606 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082116    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 02:13:14.083606 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082119    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 02:13:14.083606 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082121    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 02:13:14.083606 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082124    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 02:13:14.083606 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082126    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 02:13:14.083606 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082128    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 02:13:14.083606 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082131    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 02:13:14.083606 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082133    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 02:13:14.083606 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082136    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 02:13:14.083606 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082139    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 02:13:14.083606 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082142    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 02:13:14.083606 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082144    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 02:13:14.083606 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082146    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 02:13:14.083606 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082150    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 02:13:14.083606 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082155    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 02:13:14.083606 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082158    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 02:13:14.083606 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082160    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 02:13:14.083606 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082163    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 02:13:14.084093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082165    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 02:13:14.084093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082168    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 02:13:14.084093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082171    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 02:13:14.084093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082173    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 02:13:14.084093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082176    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 02:13:14.084093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082179    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 02:13:14.084093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082181    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 02:13:14.084093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082184    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 02:13:14.084093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082186    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 02:13:14.084093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082189    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 02:13:14.084093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082191    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 02:13:14.084093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082194    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 02:13:14.084093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082196    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 02:13:14.084093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082198    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 02:13:14.084093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082201    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 02:13:14.084093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082203    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 02:13:14.084093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082206    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 02:13:14.084093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082209    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 02:13:14.084093 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082908    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 02:13:14.084540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082916    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 02:13:14.084540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082919    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 02:13:14.084540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082923    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 02:13:14.084540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082926    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 02:13:14.084540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082929    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 02:13:14.084540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082932    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 02:13:14.084540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082934    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 02:13:14.084540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082937    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 02:13:14.084540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082940    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 02:13:14.084540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082942    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 02:13:14.084540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082945    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 02:13:14.084540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082947    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 02:13:14.084540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082950    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 02:13:14.084540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082952    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 02:13:14.084540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082956    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 02:13:14.084540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082959    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 02:13:14.084540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082961    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 02:13:14.084540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082964    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 02:13:14.084540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082966    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 02:13:14.084540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082969    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 02:13:14.085079 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082972    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 02:13:14.085079 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082974    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 02:13:14.085079 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082977    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 02:13:14.085079 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082979    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 02:13:14.085079 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082982    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 02:13:14.085079 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082984    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 02:13:14.085079 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082986    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 02:13:14.085079 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082989    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 02:13:14.085079 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082991    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 02:13:14.085079 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082994    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 02:13:14.085079 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082996    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 02:13:14.085079 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.082999    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 02:13:14.085079 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083001    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 02:13:14.085079 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083003    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 02:13:14.085079 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083007    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 02:13:14.085079 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083011    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 02:13:14.085079 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083014    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 02:13:14.085079 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083017    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 02:13:14.085079 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083019    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 02:13:14.085540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083022    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 02:13:14.085540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083024    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 02:13:14.085540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083027    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 02:13:14.085540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083029    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 02:13:14.085540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083032    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 02:13:14.085540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083034    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 02:13:14.085540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083037    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 02:13:14.085540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083040    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 02:13:14.085540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083042    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 02:13:14.085540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083045    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 02:13:14.085540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083047    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 02:13:14.085540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083050    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 02:13:14.085540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083053    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 02:13:14.085540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083055    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 02:13:14.085540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083058    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 02:13:14.085540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083060    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 02:13:14.085540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083063    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 02:13:14.085540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083065    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 02:13:14.085540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083068    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 02:13:14.085540 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083070    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 02:13:14.086097 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083072    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 02:13:14.086097 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083075    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 02:13:14.086097 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083077    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 02:13:14.086097 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083080    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 02:13:14.086097 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083082    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 02:13:14.086097 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083084    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 02:13:14.086097 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083087    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 02:13:14.086097 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083093    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 02:13:14.086097 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083097    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 02:13:14.086097 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083109    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 02:13:14.086097 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083113    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 02:13:14.086097 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083117    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 02:13:14.086097 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083120    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 02:13:14.086097 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083123    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 02:13:14.086097 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083125    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 02:13:14.086097 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083128    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 02:13:14.086097 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083131    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 02:13:14.086097 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083133    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 02:13:14.086097 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083136    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 02:13:14.086622 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083139    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 02:13:14.086622 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083141    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 02:13:14.086622 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083144    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 02:13:14.086622 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083146    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 02:13:14.086622 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083149    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 02:13:14.086622 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083151    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 02:13:14.086622 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083154    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 02:13:14.086622 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083157    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 02:13:14.086622 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083159    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 02:13:14.086622 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083162    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 02:13:14.086622 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083164    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 02:13:14.086622 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083167    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 02:13:14.086622 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083169    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 02:13:14.086622 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083171    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 02:13:14.086622 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083174    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 02:13:14.086622 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083176    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 02:13:14.086622 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083178    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 02:13:14.086622 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083181    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 02:13:14.086622 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083183    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 02:13:14.086622 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083185    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 02:13:14.087200 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083522    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 02:13:14.087200 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083526    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 02:13:14.087200 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083528    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 02:13:14.087200 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083533    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 02:13:14.087200 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083538    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 02:13:14.087200 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083541    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 02:13:14.087200 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083544    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 02:13:14.087200 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083548    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 02:13:14.087200 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083552    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 02:13:14.087200 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083555    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 02:13:14.087200 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083557    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 02:13:14.087200 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083560    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 02:13:14.087200 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083563    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 02:13:14.087200 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083566    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 02:13:14.087200 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083568    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 02:13:14.087200 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083571    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 02:13:14.087200 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083573    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 02:13:14.087200 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083576    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 02:13:14.087200 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083578    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 02:13:14.087723 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083581    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 02:13:14.087723 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083583    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 02:13:14.087723 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083585    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 02:13:14.087723 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083588    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 02:13:14.087723 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083590    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 02:13:14.087723 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083593    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 02:13:14.087723 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083595    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 02:13:14.087723 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083598    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 02:13:14.087723 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083600    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 02:13:14.087723 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083603    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 02:13:14.087723 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083605    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 02:13:14.087723 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083609    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 02:13:14.087723 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083611    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 02:13:14.087723 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083616    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 02:13:14.087723 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083618    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 02:13:14.087723 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083621    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 02:13:14.087723 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083624    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 02:13:14.087723 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083627    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 02:13:14.087723 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083630    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 02:13:14.087723 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083632    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 02:13:14.088297 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083635    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 02:13:14.088297 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083637    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 02:13:14.088297 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083640    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 02:13:14.088297 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083642    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 02:13:14.088297 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083645    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 02:13:14.088297 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083648    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 02:13:14.088297 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083650    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 02:13:14.088297 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083653    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 02:13:14.088297 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083656    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 02:13:14.088297 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083658    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 02:13:14.088297 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083661    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 02:13:14.088297 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083663    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 02:13:14.088297 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083666    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 02:13:14.088297 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083669    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 02:13:14.088297 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083671    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 02:13:14.088297 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083673    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 02:13:14.088297 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083676    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 02:13:14.088297 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083678    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 02:13:14.088297 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083681    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 02:13:14.088297 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083683    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 02:13:14.088868 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083685    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 02:13:14.088868 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083688    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 02:13:14.088868 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083690    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 02:13:14.088868 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083693    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 02:13:14.088868 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083695    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 02:13:14.088868 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083699    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 02:13:14.088868 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083701    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 02:13:14.088868 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083703    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 02:13:14.088868 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083706    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 02:13:14.088868 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083708    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 02:13:14.088868 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083711    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 02:13:14.088868 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083715    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 02:13:14.088868 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083717    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 02:13:14.088868 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083720    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 02:13:14.088868 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083722    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 02:13:14.088868 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083724    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 02:13:14.088868 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083727    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 02:13:14.088868 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083730    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 02:13:14.088868 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083732    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 02:13:14.088868 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083734    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 02:13:14.089416 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083737    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 02:13:14.089416 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083739    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 02:13:14.089416 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083742    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 02:13:14.089416 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083744    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 02:13:14.089416 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083747    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 02:13:14.089416 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083749    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 02:13:14.089416 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083751    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 02:13:14.089416 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083754    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 02:13:14.089416 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083756    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 02:13:14.089416 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083759    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 02:13:14.089416 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083777    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 02:13:14.089416 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083782    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 02:13:14.089416 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083785    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 02:13:14.089416 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083788    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 02:13:14.089416 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083791    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 02:13:14.089416 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083794    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 02:13:14.089416 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083796    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 02:13:14.089416 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083800    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 02:13:14.089416 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083803    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 02:13:14.089955 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.083805    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 02:13:14.089955 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.083875    2581 flags.go:64] FLAG: --address="0.0.0.0"
Sep 16 02:13:14.089955 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.083913    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 16 02:13:14.089955 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.083919    2581 flags.go:64] FLAG: --anonymous-auth="true"
Sep 16 02:13:14.089955 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.083923    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 16 02:13:14.089955 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.083928    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 16 02:13:14.089955 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.083931    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 16 02:13:14.089955 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.083934    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 16 02:13:14.089955 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.083941    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 16 02:13:14.089955 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.083944    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 16 02:13:14.089955 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.083947    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 16 02:13:14.089955 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.083951    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 16 02:13:14.089955 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.083954    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 16 02:13:14.089955 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.083957    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 16 02:13:14.089955 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.083960    2581 flags.go:64] FLAG: --cgroup-root=""
Sep 16 02:13:14.089955 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.083963    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 16 02:13:14.089955 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.083966    2581 flags.go:64] FLAG: --client-ca-file=""
Sep 16 02:13:14.089955 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.083969    2581 flags.go:64] FLAG: --cloud-provider="external"
Sep 16 02:13:14.089955 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.083971    2581 flags.go:64] FLAG: --cluster-dns="[]"
Sep 16 02:13:14.089955 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.083975    2581 flags.go:64] FLAG: --cluster-domain=""
Sep 16 02:13:14.089955 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.083978    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 16 02:13:14.089955 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.083981    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 16 02:13:14.089955 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.083984    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 16 02:13:14.089955 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.083987    2581 flags.go:64] FLAG: --container-log-max-files="5"
Sep 16 02:13:14.090601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.083991    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 16 02:13:14.090601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.083993    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 16 02:13:14.090601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.083996    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 16 02:13:14.090601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.083999    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 16 02:13:14.090601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084002    2581 flags.go:64] FLAG: --contention-profiling="false"
Sep 16 02:13:14.090601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084005    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 16 02:13:14.090601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084011    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 16 02:13:14.090601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084014    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 16 02:13:14.090601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084017    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 16 02:13:14.090601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084020    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 16 02:13:14.090601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084023    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 16 02:13:14.090601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084026    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 16 02:13:14.090601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084028    2581 flags.go:64] FLAG: --enable-load-reader="false"
Sep 16 02:13:14.090601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084031    2581 flags.go:64] FLAG: --enable-server="true"
Sep 16 02:13:14.090601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084034    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 16 02:13:14.090601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084038    2581 flags.go:64] FLAG: --event-burst="100"
Sep 16 02:13:14.090601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084042    2581 flags.go:64] FLAG: --event-qps="50"
Sep 16 02:13:14.090601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084045    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 16 02:13:14.090601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084047    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 16 02:13:14.090601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084050    2581 flags.go:64] FLAG: --eviction-hard=""
Sep 16 02:13:14.090601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084054    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 16 02:13:14.090601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084057    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 16 02:13:14.090601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084060    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 16 02:13:14.090601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084062    2581 flags.go:64] FLAG: --eviction-soft=""
Sep 16 02:13:14.090601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084065    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 16 02:13:14.091322 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084068    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 16 02:13:14.091322 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084070    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 16 02:13:14.091322 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084073    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 16 02:13:14.091322 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084076    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 16 02:13:14.091322 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084078    2581 flags.go:64] FLAG: --fail-swap-on="true"
Sep 16 02:13:14.091322 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084081    2581 flags.go:64] FLAG: --feature-gates=""
Sep 16 02:13:14.091322 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084084    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 16 02:13:14.091322 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084087    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 16 02:13:14.091322 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084090    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 16 02:13:14.091322 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084093    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 16 02:13:14.091322 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084096    2581 flags.go:64] FLAG: --healthz-port="10248"
Sep 16 02:13:14.091322 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084099    2581 flags.go:64] FLAG: --help="false"
Sep 16 02:13:14.091322 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084102    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-139-191.ec2.internal"
Sep 16 02:13:14.091322 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084105    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 16 02:13:14.091322 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084108    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 16 02:13:14.091322 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084111    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 16 02:13:14.091322 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084114    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 16 02:13:14.091322 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084117    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 16 02:13:14.091322 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084120    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 16 02:13:14.091322 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084123    2581 flags.go:64] FLAG: --image-service-endpoint=""
Sep 16 02:13:14.091322 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084125    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 16 02:13:14.091322 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084128    2581 flags.go:64] FLAG: --kube-api-burst="100"
Sep 16 02:13:14.091322 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084131    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 16 02:13:14.091935 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084135    2581 flags.go:64] FLAG: --kube-api-qps="50"
Sep 16 02:13:14.091935 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084138    2581 flags.go:64] FLAG: --kube-reserved=""
Sep 16 02:13:14.091935 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084141    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 16 02:13:14.091935 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084144    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 16 02:13:14.091935 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084146    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 16 02:13:14.091935 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084149    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 16 02:13:14.091935 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084152    2581 flags.go:64] FLAG: --lock-file=""
Sep 16 02:13:14.091935 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084155    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 16 02:13:14.091935 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084157    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 16 02:13:14.091935 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084160    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 16 02:13:14.091935 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084165    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 16 02:13:14.091935 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084168    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 16 02:13:14.091935 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084171    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 16 02:13:14.091935 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084173    2581 flags.go:64] FLAG: --logging-format="text"
Sep 16 02:13:14.091935 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084176    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 16 02:13:14.091935 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084179    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 16 02:13:14.091935 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084182    2581 flags.go:64] FLAG: --manifest-url=""
Sep 16 02:13:14.091935 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084184    2581 flags.go:64] FLAG: --manifest-url-header=""
Sep 16 02:13:14.091935 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084191    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 16 02:13:14.091935 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084194    2581 flags.go:64] FLAG: --max-open-files="1000000"
Sep 16 02:13:14.091935 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084197    2581 flags.go:64] FLAG: --max-pods="110"
Sep 16 02:13:14.091935 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084200    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 16 02:13:14.091935 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084203    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 16 02:13:14.091935 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084206    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 16 02:13:14.091935 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084208    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 16 02:13:14.092550 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084211    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 16 02:13:14.092550 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084214    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 16 02:13:14.092550 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084217    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 16 02:13:14.092550 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084223    2581 flags.go:64] FLAG: --node-status-max-images="50"
Sep 16 02:13:14.092550 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084226    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 16 02:13:14.092550 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084229    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 16 02:13:14.092550 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084232    2581 flags.go:64] FLAG: --pod-cidr=""
Sep 16 02:13:14.092550 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084236    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 16 02:13:14.092550 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084242    2581 flags.go:64] FLAG: --pod-manifest-path=""
Sep 16 02:13:14.092550 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084245    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 16 02:13:14.092550 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084247    2581 flags.go:64] FLAG: --pods-per-core="0"
Sep 16 02:13:14.092550 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084250    2581 flags.go:64] FLAG: --port="10250"
Sep 16 02:13:14.092550 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084253    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 16 02:13:14.092550 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084256    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-002f4ef79985d0f6c"
Sep 16 02:13:14.092550 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084259    2581 flags.go:64] FLAG: --qos-reserved=""
Sep 16 02:13:14.092550 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084261    2581 flags.go:64] FLAG: --read-only-port="10255"
Sep 16 02:13:14.092550 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084264    2581 flags.go:64] FLAG: --register-node="true"
Sep 16 02:13:14.092550 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084267    2581 flags.go:64] FLAG: --register-with-taints=""
Sep 16 02:13:14.092550 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084271    2581 flags.go:64] FLAG: --registry-burst="10"
Sep 16 02:13:14.092550 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084273    2581 flags.go:64] FLAG: --registry-qps="5"
Sep 16 02:13:14.092550 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084276    2581 flags.go:64] FLAG: --reserved-cpus=""
Sep 16 02:13:14.092550 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084279    2581 flags.go:64] FLAG: --reserved-memory=""
Sep 16 02:13:14.092550 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084282    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 16 02:13:14.092550 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084285    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 16 02:13:14.092550 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084288    2581 flags.go:64] FLAG: --rotate-certificates="false"
Sep 16 02:13:14.093437 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084290    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 16 02:13:14.093437 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084293    2581 flags.go:64] FLAG: --runonce="false"
Sep 16 02:13:14.093437 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084296    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 16 02:13:14.093437 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084299    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 16 02:13:14.093437 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084302    2581 flags.go:64] FLAG: --seccomp-default="false"
Sep 16 02:13:14.093437 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084305    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 16 02:13:14.093437 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084307    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 16 02:13:14.093437 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084310    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 16 02:13:14.093437 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084313    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 16 02:13:14.093437 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084315    2581 flags.go:64] FLAG: --storage-driver-password="root"
Sep 16 02:13:14.093437 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084318    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 16 02:13:14.093437 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084321    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 16 02:13:14.093437 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084323    2581 flags.go:64] FLAG: --storage-driver-user="root"
Sep 16 02:13:14.093437 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084326    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 16 02:13:14.093437 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084329    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 16 02:13:14.093437 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084334    2581 flags.go:64] FLAG: --system-cgroups=""
Sep 16 02:13:14.093437 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084336    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 16 02:13:14.093437 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084341    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 16 02:13:14.093437 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084344    2581 flags.go:64] FLAG: --tls-cert-file=""
Sep 16 02:13:14.093437 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084347    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 16 02:13:14.093437 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084350    2581 flags.go:64] FLAG: --tls-min-version=""
Sep 16 02:13:14.093437 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084353    2581 flags.go:64] FLAG: --tls-private-key-file=""
Sep 16 02:13:14.093437 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084356    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 16 02:13:14.093437 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084359    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 16 02:13:14.093437 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084361    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 16 02:13:14.094211 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084364    2581 flags.go:64] FLAG: --v="2"
Sep 16 02:13:14.094211 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084368    2581 flags.go:64] FLAG: --version="false"
Sep 16 02:13:14.094211 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084372    2581 flags.go:64] FLAG: --vmodule=""
Sep 16 02:13:14.094211 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084375    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 16 02:13:14.094211 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.084378    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 16 02:13:14.094211 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084485    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 02:13:14.094211 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084488    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 02:13:14.094211 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084491    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 02:13:14.094211 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084493    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 02:13:14.094211 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084496    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 02:13:14.094211 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084499    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 02:13:14.094211 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084501    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 02:13:14.094211 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084503    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 02:13:14.094211 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084506    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 02:13:14.094211 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084508    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 02:13:14.094211 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084511    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 02:13:14.094211 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084513    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 02:13:14.094211 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084516    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 02:13:14.094211 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084518    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 02:13:14.094211 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084521    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 02:13:14.094211 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084523    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 02:13:14.094716 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084526    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 02:13:14.094716 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084530    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 02:13:14.094716 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084533    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 02:13:14.094716 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084535    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 02:13:14.094716 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084538    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 02:13:14.094716 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084541    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 02:13:14.094716 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084543    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 02:13:14.094716 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084546    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 02:13:14.094716 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084549    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 02:13:14.094716 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084552    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 02:13:14.094716 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084555    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 02:13:14.094716 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084559    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 02:13:14.094716 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084563    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 02:13:14.094716 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084565    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 02:13:14.094716 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084568    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 02:13:14.094716 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084570    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 02:13:14.094716 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084572    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 02:13:14.094716 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084575    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 02:13:14.094716 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084578    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 02:13:14.094716 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084580    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 02:13:14.095296 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084583    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 02:13:14.095296 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084585    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 02:13:14.095296 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084588    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 02:13:14.095296 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084590    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 02:13:14.095296 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084593    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 02:13:14.095296 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084595    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 02:13:14.095296 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084598    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 02:13:14.095296 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084600    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 02:13:14.095296 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084602    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 02:13:14.095296 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084605    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 02:13:14.095296 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084607    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 02:13:14.095296 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084609    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 02:13:14.095296 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084612    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 02:13:14.095296 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084616    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 02:13:14.095296 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084618    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 02:13:14.095296 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084621    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 02:13:14.095296 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084624    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 02:13:14.095296 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084627    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 02:13:14.095296 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084629    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 02:13:14.095296 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084631    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 02:13:14.095804 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084635    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 02:13:14.095804 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084639    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 02:13:14.095804 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084642    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 02:13:14.095804 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084645    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 02:13:14.095804 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084648    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 02:13:14.095804 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084651    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 02:13:14.095804 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084654    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 02:13:14.095804 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084656    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 02:13:14.095804 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084659    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 02:13:14.095804 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084661    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 02:13:14.095804 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084666    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 02:13:14.095804 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084669    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 02:13:14.095804 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084672    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 02:13:14.095804 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084675    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 02:13:14.095804 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084677    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 02:13:14.095804 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084680    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 02:13:14.095804 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084682    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 02:13:14.095804 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084685    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 02:13:14.095804 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084687    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 02:13:14.096257 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084690    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 02:13:14.096257 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084693    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 02:13:14.096257 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084695    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 02:13:14.096257 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084698    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 02:13:14.096257 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084700    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 02:13:14.096257 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084703    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 02:13:14.096257 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084706    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 02:13:14.096257 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084709    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 02:13:14.096257 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084712    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 02:13:14.096257 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084714    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 02:13:14.096257 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084717    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 02:13:14.096257 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084719    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 02:13:14.096257 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084722    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 02:13:14.096257 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084726    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 02:13:14.096257 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084728    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 02:13:14.096257 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084731    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 02:13:14.096257 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084733    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 02:13:14.096257 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084735    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 02:13:14.096257 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084738    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 02:13:14.096257 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084741    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 02:13:14.096738 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084743    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 02:13:14.096738 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084745    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 02:13:14.096738 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084748    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 02:13:14.096738 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.084750    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 02:13:14.096738 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.085422    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 02:13:14.096738 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.093742    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 16 02:13:14.096738 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.094320    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 16 02:13:14.096738 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.094347    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 16 02:13:14.096738 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.094353    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 16 02:13:14.096738 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094436    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 02:13:14.096738 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094442    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 02:13:14.096738 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094445    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 02:13:14.096738 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094450    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 02:13:14.097085 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094455    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 02:13:14.097085 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094458    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 02:13:14.097085 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094461    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 02:13:14.097085 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094464    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 02:13:14.097085 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094467    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 02:13:14.097085 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094470    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 02:13:14.097085 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094473    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 02:13:14.097085 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094476    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 02:13:14.097085 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094478    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 02:13:14.097085 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094481    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 02:13:14.097085 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094484    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 02:13:14.097085 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094486    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 02:13:14.097085 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094488    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 02:13:14.097085 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094491    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 02:13:14.097085 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094493    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 02:13:14.097085 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094496    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 02:13:14.097085 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094498    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 02:13:14.097085 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094500    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 02:13:14.097085 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094503    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 02:13:14.097535 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094505    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 02:13:14.097535 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094508    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 02:13:14.097535 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094510    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 02:13:14.097535 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094512    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 02:13:14.097535 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094515    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 02:13:14.097535 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094517    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 02:13:14.097535 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094521    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 02:13:14.097535 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094524    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 02:13:14.097535 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094527    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 02:13:14.097535 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094530    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 02:13:14.097535 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094532    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 02:13:14.097535 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094535    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 02:13:14.097535 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094537    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 02:13:14.097535 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094540    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 02:13:14.097535 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094542    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 02:13:14.097535 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094544    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 02:13:14.097535 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094547    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 02:13:14.097535 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094549    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 02:13:14.097535 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094552    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 02:13:14.098028 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094554    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 02:13:14.098028 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094557    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 02:13:14.098028 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094559    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 02:13:14.098028 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094562    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 02:13:14.098028 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094564    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 02:13:14.098028 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094567    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 02:13:14.098028 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094569    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 02:13:14.098028 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094573    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 02:13:14.098028 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094576    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 02:13:14.098028 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094579    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 02:13:14.098028 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094582    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 02:13:14.098028 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094584    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 02:13:14.098028 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094587    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 02:13:14.098028 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094589    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 02:13:14.098028 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094592    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 02:13:14.098028 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094594    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 02:13:14.098028 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094597    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 02:13:14.098028 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094600    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 02:13:14.098028 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094602    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 02:13:14.098028 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094605    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 02:13:14.098526 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094608    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 02:13:14.098526 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094610    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 02:13:14.098526 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094613    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 02:13:14.098526 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094615    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 02:13:14.098526 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094618    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 02:13:14.098526 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094620    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 02:13:14.098526 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094623    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 02:13:14.098526 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094625    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 02:13:14.098526 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094627    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 02:13:14.098526 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094630    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 02:13:14.098526 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094632    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 02:13:14.098526 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094635    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 02:13:14.098526 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094637    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 02:13:14.098526 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094639    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 02:13:14.098526 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094642    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 02:13:14.098526 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094644    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 02:13:14.098526 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094647    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 02:13:14.098526 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094649    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 02:13:14.098526 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094652    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 02:13:14.098991 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094654    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 02:13:14.098991 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094657    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 02:13:14.098991 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094659    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 02:13:14.098991 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094661    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 02:13:14.098991 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094664    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 02:13:14.098991 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094667    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 02:13:14.098991 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094669    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 02:13:14.098991 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094672    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 02:13:14.098991 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094674    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 02:13:14.098991 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094677    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 02:13:14.098991 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094679    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 02:13:14.098991 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094682    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 02:13:14.098991 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094684    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 02:13:14.098991 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094687    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 02:13:14.098991 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094689    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 02:13:14.098991 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094692    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 02:13:14.098991 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094694    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 02:13:14.098991 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094697    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 02:13:14.099422 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.094702    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 02:13:14.099422 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094841    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 02:13:14.099422 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094849    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 02:13:14.099422 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094853    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 02:13:14.099422 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094857    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 02:13:14.099422 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094860    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 02:13:14.099422 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094862    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 02:13:14.099422 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094865    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 02:13:14.099422 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094868    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 02:13:14.099422 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094871    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 02:13:14.099422 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094873    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 02:13:14.099422 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094876    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 02:13:14.099422 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094879    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 02:13:14.099422 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094883    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 02:13:14.099781 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094886    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 02:13:14.099781 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094888    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 02:13:14.099781 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094891    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 02:13:14.099781 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094893    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 02:13:14.099781 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094896    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 02:13:14.099781 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094899    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 02:13:14.099781 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094901    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 02:13:14.099781 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094904    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 02:13:14.099781 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094906    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 02:13:14.099781 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094910    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 02:13:14.099781 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094913    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 02:13:14.099781 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094916    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 02:13:14.099781 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094918    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 02:13:14.099781 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094921    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 02:13:14.099781 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094923    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 02:13:14.099781 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094926    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 02:13:14.099781 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094928    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 02:13:14.099781 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094931    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 02:13:14.099781 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094934    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 02:13:14.099781 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094936    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 02:13:14.100272 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094938    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 02:13:14.100272 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094941    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 02:13:14.100272 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094943    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 02:13:14.100272 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094946    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 02:13:14.100272 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094948    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 02:13:14.100272 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094950    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 02:13:14.100272 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094953    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 02:13:14.100272 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094955    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 02:13:14.100272 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094957    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 02:13:14.100272 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094974    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 02:13:14.100272 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094977    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 02:13:14.100272 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094980    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 02:13:14.100272 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094984    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 02:13:14.100272 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094986    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 02:13:14.100272 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094989    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 02:13:14.100272 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094991    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 02:13:14.100272 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094994    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 02:13:14.100272 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.094997    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 02:13:14.100272 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095000    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 02:13:14.100272 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095003    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 02:13:14.100751 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095005    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 02:13:14.100751 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095008    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 02:13:14.100751 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095011    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 02:13:14.100751 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095014    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 02:13:14.100751 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095017    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 02:13:14.100751 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095019    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 02:13:14.100751 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095022    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 02:13:14.100751 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095025    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 02:13:14.100751 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095028    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 02:13:14.100751 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095031    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 02:13:14.100751 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095033    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 02:13:14.100751 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095036    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 02:13:14.100751 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095038    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 02:13:14.100751 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095041    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 02:13:14.100751 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095043    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 02:13:14.100751 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095046    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 02:13:14.100751 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095048    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 02:13:14.100751 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095051    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 02:13:14.100751 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095053    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 02:13:14.101249 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095055    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 02:13:14.101249 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095058    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 02:13:14.101249 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095060    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 02:13:14.101249 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095062    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 02:13:14.101249 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095065    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 02:13:14.101249 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095067    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 02:13:14.101249 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095070    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 02:13:14.101249 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095072    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 02:13:14.101249 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095075    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 02:13:14.101249 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095077    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 02:13:14.101249 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095079    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 02:13:14.101249 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095082    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 02:13:14.101249 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095084    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 02:13:14.101249 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095087    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 02:13:14.101249 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095091    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 02:13:14.101249 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095094    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 02:13:14.101249 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095097    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 02:13:14.101249 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095108    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 02:13:14.101249 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095112    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 02:13:14.101249 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095114    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 02:13:14.101731 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095117    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 02:13:14.101731 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095120    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 02:13:14.101731 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095122    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 02:13:14.101731 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095125    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 02:13:14.101731 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095127    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 02:13:14.101731 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095129    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 02:13:14.101731 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:14.095132    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 02:13:14.101731 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.095137    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 02:13:14.101731 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.095238    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 16 02:13:14.101731 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.097260    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 16 02:13:14.101731 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.098380    2581 server.go:1019] "Starting client certificate rotation"
Sep 16 02:13:14.101731 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.098482    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 02:13:14.101731 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.098520    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 02:13:14.102155 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.101006    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 02:13:14.102802 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.102787    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 02:13:14.121402 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.121383    2581 log.go:25] "Validated CRI v1 runtime API"
Sep 16 02:13:14.124142 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.124127    2581 log.go:25] "Validated CRI v1 image API"
Sep 16 02:13:14.124919 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.124905    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 16 02:13:14.126124 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.126110    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 02:13:14.127305 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.127284    2581 fs.go:135] Filesystem UUIDs: map[379022fe-80fc-49e0-bc0d-a2e7a41b654b:/dev/nvme0n1p3 4089ae23-ef29-4232-b87e-14acf94a4078:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Sep 16 02:13:14.127352 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.127305    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 16 02:13:14.133131 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.133031    2581 manager.go:216] Machine: {Timestamp:2026-09-16 02:13:14.13170186 +0000 UTC m=+0.335965954 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099829 MemoryCapacity:32812150784 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b8a60797e86cefc9ac30ec905b0af SystemUUID:ec2b8a60-797e-86ce-fc9a-c30ec905b0af BootID:5c31fc92-e03d-4954-9c5d-0a292f0db63d Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406073344 Type:vfs Inodes:4005389 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:fe:f1:8b:8d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:fe:f1:8b:8d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:f0:11:c5:65:f4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812150784 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 16 02:13:14.133131 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.133126    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 16 02:13:14.133234 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.133223    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 16 02:13:14.136344 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.136320    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 16 02:13:14.136471 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.136349    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-191.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 16 02:13:14.137104 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.137094    2581 topology_manager.go:138] "Creating topology manager with none policy"
Sep 16 02:13:14.137134 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.137107    2581 container_manager_linux.go:309] "Creating device plugin manager"
Sep 16 02:13:14.137134 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.137115    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 02:13:14.137787 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.137776    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 02:13:14.138584 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.138576    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 16 02:13:14.141259 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.141248    2581 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 02:13:14.141352 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.141344    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 16 02:13:14.141384 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.141370    2581 kubelet.go:486] "Attempting to sync node with API server"
Sep 16 02:13:14.141384 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.141379    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 16 02:13:14.141438 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.141392    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 16 02:13:14.141438 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.141403    2581 kubelet.go:398] "Adding apiserver pod source"
Sep 16 02:13:14.141438 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.141413    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 16 02:13:14.141719 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.141705    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 02:13:14.141801 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.141724    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 02:13:14.145231 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.145211    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 16 02:13:14.147358 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.147344    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 16 02:13:14.147410 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.147375    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 16 02:13:14.147789 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.147758    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2qltn"
Sep 16 02:13:14.148938 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.148926    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 16 02:13:14.148982 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.148945    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 16 02:13:14.148982 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.148951    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 16 02:13:14.148982 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.148957    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 16 02:13:14.148982 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.148965    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 16 02:13:14.148982 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.148970    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 16 02:13:14.148982 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.148983    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 16 02:13:14.149142 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.148988    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 16 02:13:14.149142 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.148995    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 16 02:13:14.149142 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.149000    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 16 02:13:14.149142 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.149008    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 16 02:13:14.149142 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.149013    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 16 02:13:14.149695 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.149682    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 16 02:13:14.149731 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.149698    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 16 02:13:14.150649 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:14.150630    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-191.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 16 02:13:14.150717 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:14.150629    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 16 02:13:14.152819 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.152802    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2qltn"
Sep 16 02:13:14.153754 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.153742    2581 server.go:1268] "Started kubelet"
Sep 16 02:13:14.153868 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.153819    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 16 02:13:14.153996 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.153938    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 16 02:13:14.154079 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.154021    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 16 02:13:14.154345 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.154328    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-191.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 16 02:13:14.154469 ip-10-0-139-191 systemd[1]: Started Kubernetes Kubelet.
Sep 16 02:13:14.155210 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.155195    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 16 02:13:14.156777 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.156750    2581 server.go:310] "Adding debug handlers to kubelet server"
Sep 16 02:13:14.159691 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:14.159673    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 16 02:13:14.160315 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.160299    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 16 02:13:14.160887 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.160867    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 16 02:13:14.161051 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:14.161037    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-191.ec2.internal\" not found"
Sep 16 02:13:14.161502 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.161486    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 16 02:13:14.161502 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.161491    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 16 02:13:14.161502 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.161505    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 16 02:13:14.161641 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.161539    2581 factory.go:55] Registering systemd factory
Sep 16 02:13:14.161641 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.161567    2581 factory.go:223] Registration of the systemd container factory successfully
Sep 16 02:13:14.161641 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.161573    2581 reconstruct.go:97] "Volume reconstruction finished"
Sep 16 02:13:14.161641 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.161580    2581 reconciler.go:29] "Reconciler: start to sync state"
Sep 16 02:13:14.161833 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.161821    2581 factory.go:153] Registering CRI-O factory
Sep 16 02:13:14.161884 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.161838    2581 factory.go:223] Registration of the crio container factory successfully
Sep 16 02:13:14.161930 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.161884    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 16 02:13:14.161930 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.161904    2581 factory.go:103] Registering Raw factory
Sep 16 02:13:14.161930 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.161919    2581 manager.go:1196] Started watching for new ooms in manager
Sep 16 02:13:14.162232 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.162219    2581 manager.go:349] Starting recovery of all containers
Sep 16 02:13:14.164470 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.164451    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 02:13:14.166943 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:14.166918    2581 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-191.ec2.internal\" not found" node="ip-10-0-139-191.ec2.internal"
Sep 16 02:13:14.172088 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.172069    2581 manager.go:354] Recovery completed
Sep 16 02:13:14.176590 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.176577    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 02:13:14.181459 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.181444    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-191.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 02:13:14.181524 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.181470    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-191.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 02:13:14.181524 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.181480    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-191.ec2.internal" event="NodeHasSufficientPID"
Sep 16 02:13:14.181987 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.181974    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 16 02:13:14.181987 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.181986    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 16 02:13:14.182089 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.182001    2581 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 02:13:14.182089 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.182041    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 02:13:14.183039 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.183021    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-191.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 02:13:14.183095 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.183056    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-191.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 02:13:14.183095 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.183069    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-191.ec2.internal" event="NodeHasSufficientPID"
Sep 16 02:13:14.183298 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.183287    2581 policy_none.go:49] "None policy: Start"
Sep 16 02:13:14.183329 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.183303    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 16 02:13:14.183329 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.183313    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 16 02:13:14.184300 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.184290    2581 policy_none.go:47] "Start"
Sep 16 02:13:14.217810 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.217789    2581 manager.go:337] "Starting Device Plugin manager"
Sep 16 02:13:14.217898 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:14.217839    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 16 02:13:14.217898 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.217856    2581 server.go:87] "Starting device plugin registration server"
Sep 16 02:13:14.218081 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.218068    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 16 02:13:14.218148 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.218083    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 16 02:13:14.218215 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.218194    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 16 02:13:14.218291 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.218279    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 16 02:13:14.218340 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.218292    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 16 02:13:14.218722 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:14.218702    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 16 02:13:14.218840 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:14.218756    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-191.ec2.internal\" not found"
Sep 16 02:13:14.262065 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.262044    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 16 02:13:14.263383 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.263366    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 16 02:13:14.263455 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.263423    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 16 02:13:14.263455 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.263447    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 16 02:13:14.263531 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:14.263488    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 16 02:13:14.265264 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.265250    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 02:13:14.318410 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.318383    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 02:13:14.319293 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.319279    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-191.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 02:13:14.319354 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.319307    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-191.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 02:13:14.319354 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.319318    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-191.ec2.internal" event="NodeHasSufficientPID"
Sep 16 02:13:14.319354 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.319339    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-191.ec2.internal"
Sep 16 02:13:14.327174 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.327137    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-191.ec2.internal"
Sep 16 02:13:14.327174 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:14.327156    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-191.ec2.internal\": node \"ip-10-0-139-191.ec2.internal\" not found"
Sep 16 02:13:14.339924 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:14.339903    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-191.ec2.internal\" not found"
Sep 16 02:13:14.363634 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.363613    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-191.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-191.ec2.internal"]
Sep 16 02:13:14.363690 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.363678    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 02:13:14.365018 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.365005    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-191.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 02:13:14.365074 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.365028    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-191.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 02:13:14.365074 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.365037    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-191.ec2.internal" event="NodeHasSufficientPID"
Sep 16 02:13:14.366207 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.366196    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 02:13:14.366328 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.366305    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-191.ec2.internal"
Sep 16 02:13:14.366374 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.366342    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 02:13:14.366868 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.366858    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-191.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 02:13:14.366868 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.366862    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-191.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 02:13:14.366990 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.366882    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-191.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 02:13:14.366990 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.366885    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-191.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 02:13:14.366990 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.366909    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-191.ec2.internal" event="NodeHasSufficientPID"
Sep 16 02:13:14.366990 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.366895    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-191.ec2.internal" event="NodeHasSufficientPID"
Sep 16 02:13:14.368081 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.368066    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-191.ec2.internal"
Sep 16 02:13:14.368131 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.368094    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 02:13:14.368808 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.368793    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-191.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 02:13:14.368871 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.368818    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-191.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 02:13:14.368871 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.368832    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-191.ec2.internal" event="NodeHasSufficientPID"
Sep 16 02:13:14.392335 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:14.392317    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-191.ec2.internal\" not found" node="ip-10-0-139-191.ec2.internal"
Sep 16 02:13:14.396692 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:14.396675    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-191.ec2.internal\" not found" node="ip-10-0-139-191.ec2.internal"
Sep 16 02:13:14.440030 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:14.440011    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-191.ec2.internal\" not found"
Sep 16 02:13:14.463267 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.463247    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dcc129ffe7ff05689defbf8c29a04ab8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-191.ec2.internal\" (UID: \"dcc129ffe7ff05689defbf8c29a04ab8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-191.ec2.internal"
Sep 16 02:13:14.463354 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.463275    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c33b9c404b3f92df51af027eb114ba62-config\") pod \"kube-apiserver-proxy-ip-10-0-139-191.ec2.internal\" (UID: \"c33b9c404b3f92df51af027eb114ba62\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-191.ec2.internal"
Sep 16 02:13:14.463354 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.463299    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dcc129ffe7ff05689defbf8c29a04ab8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-191.ec2.internal\" (UID: \"dcc129ffe7ff05689defbf8c29a04ab8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-191.ec2.internal"
Sep 16 02:13:14.540969 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:14.540949    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-191.ec2.internal\" not found"
Sep 16 02:13:14.564281 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.564260    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dcc129ffe7ff05689defbf8c29a04ab8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-191.ec2.internal\" (UID: \"dcc129ffe7ff05689defbf8c29a04ab8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-191.ec2.internal"
Sep 16 02:13:14.564353 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.564286    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dcc129ffe7ff05689defbf8c29a04ab8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-191.ec2.internal\" (UID: \"dcc129ffe7ff05689defbf8c29a04ab8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-191.ec2.internal"
Sep 16 02:13:14.564353 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.564319    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c33b9c404b3f92df51af027eb114ba62-config\") pod \"kube-apiserver-proxy-ip-10-0-139-191.ec2.internal\" (UID: \"c33b9c404b3f92df51af027eb114ba62\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-191.ec2.internal"
Sep 16 02:13:14.564454 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.564360    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dcc129ffe7ff05689defbf8c29a04ab8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-191.ec2.internal\" (UID: \"dcc129ffe7ff05689defbf8c29a04ab8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-191.ec2.internal"
Sep 16 02:13:14.564454 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.564364    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c33b9c404b3f92df51af027eb114ba62-config\") pod \"kube-apiserver-proxy-ip-10-0-139-191.ec2.internal\" (UID: \"c33b9c404b3f92df51af027eb114ba62\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-191.ec2.internal"
Sep 16 02:13:14.564454 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.564364    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dcc129ffe7ff05689defbf8c29a04ab8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-191.ec2.internal\" (UID: \"dcc129ffe7ff05689defbf8c29a04ab8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-191.ec2.internal"
Sep 16 02:13:14.641574 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:14.641517    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-191.ec2.internal\" not found"
Sep 16 02:13:14.695161 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.695143    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-191.ec2.internal"
Sep 16 02:13:14.699550 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:14.699162    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-191.ec2.internal"
Sep 16 02:13:14.742584 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:14.742563    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-191.ec2.internal\" not found"
Sep 16 02:13:14.843062 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:14.843033    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-191.ec2.internal\" not found"
Sep 16 02:13:14.943529 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:14.943474    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-191.ec2.internal\" not found"
Sep 16 02:13:15.043987 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:15.043960    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-191.ec2.internal\" not found"
Sep 16 02:13:15.095340 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.095317    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 02:13:15.097975 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.097961    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 16 02:13:15.098068 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.098052    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 02:13:15.098126 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.098080    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 02:13:15.098126 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.098112    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 02:13:15.142400 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.142262    2581 apiserver.go:52] "Watching apiserver"
Sep 16 02:13:15.156746 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.156719    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-15 02:08:15 +0000 UTC" deadline="2028-03-28 09:06:43.48154795 +0000 UTC"
Sep 16 02:13:15.156746 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.156746    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13422h53m28.324806557s"
Sep 16 02:13:15.156993 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.156976    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 16 02:13:15.157297 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.157279    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-d8z97","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82ssl","openshift-cluster-node-tuning-operator/tuned-9xppl","openshift-multus/multus-4wfvw","openshift-multus/network-metrics-daemon-2b8mm","kube-system/global-pull-secret-syncer-kpfqx","openshift-dns/node-resolver-bbcpb","openshift-image-registry/node-ca-8wndx","openshift-multus/multus-additional-cni-plugins-6tp4r","openshift-network-diagnostics/network-check-target-p2jj8","openshift-network-operator/iptables-alerter-5d9gv","openshift-ovn-kubernetes/ovnkube-node-g54gh"]
Sep 16 02:13:15.158482 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.158468    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d8z97"
Sep 16 02:13:15.159606 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.159587    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82ssl"
Sep 16 02:13:15.162611 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.160884    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9tckg\""
Sep 16 02:13:15.162611 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.160912    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 16 02:13:15.162611 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.160959    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 16 02:13:15.162611 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.161164    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-191.ec2.internal"
Sep 16 02:13:15.162611 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.161532    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 16 02:13:15.162611 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.161752    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 16 02:13:15.162611 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.161894    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 16 02:13:15.162611 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.162021    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 16 02:13:15.162611 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.162091    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9nb5k\""
Sep 16 02:13:15.163820 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.163805    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.164865 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.164843    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.166001 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.165981    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 16 02:13:15.166090 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.166044    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:13:15.166149 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.166048    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 16 02:13:15.166149 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.166133    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zffb4\""
Sep 16 02:13:15.166231 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:15.166118    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b8mm" podUID="df380f84-e4cf-477f-b44f-86c7f533ce9c"
Sep 16 02:13:15.166822 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.166806    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 16 02:13:15.167069 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.167049    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 16 02:13:15.167169 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.167076    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 16 02:13:15.167169 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.167077    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 16 02:13:15.167169 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.167098    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2fl9k\""
Sep 16 02:13:15.167169 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.167055    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:15.167363 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:15.167183    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpfqx" podUID="9360df26-7dcf-4632-b9b1-c3604a98a63e"
Sep 16 02:13:15.167420 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.167362    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7ee22301-74a6-440b-8e16-cab47ce7107c-registration-dir\") pod \"aws-ebs-csi-driver-node-82ssl\" (UID: \"7ee22301-74a6-440b-8e16-cab47ce7107c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82ssl"
Sep 16 02:13:15.167420 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.167381    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7ee22301-74a6-440b-8e16-cab47ce7107c-sys-fs\") pod \"aws-ebs-csi-driver-node-82ssl\" (UID: \"7ee22301-74a6-440b-8e16-cab47ce7107c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82ssl"
Sep 16 02:13:15.167420 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.167395    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-etc-modprobe-d\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.167529 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.167430    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-etc-sysctl-conf\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.167529 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.167453    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-host\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.167529 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.167486    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb4b6a80-8661-4a62-afb8-e616fadbae27-tmp\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.167529 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.167509    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-etc-sysconfig\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.167642 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.167551    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7ee22301-74a6-440b-8e16-cab47ce7107c-socket-dir\") pod \"aws-ebs-csi-driver-node-82ssl\" (UID: \"7ee22301-74a6-440b-8e16-cab47ce7107c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82ssl"
Sep 16 02:13:15.167642 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.167592    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7ee22301-74a6-440b-8e16-cab47ce7107c-device-dir\") pod \"aws-ebs-csi-driver-node-82ssl\" (UID: \"7ee22301-74a6-440b-8e16-cab47ce7107c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82ssl"
Sep 16 02:13:15.167642 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.167629    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld8g7\" (UniqueName: \"kubernetes.io/projected/7ee22301-74a6-440b-8e16-cab47ce7107c-kube-api-access-ld8g7\") pod \"aws-ebs-csi-driver-node-82ssl\" (UID: \"7ee22301-74a6-440b-8e16-cab47ce7107c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82ssl"
Sep 16 02:13:15.167750 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.167658    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-etc-systemd\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.167750 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.167690    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eb4b6a80-8661-4a62-afb8-e616fadbae27-etc-tuned\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.167750 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.167711    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ffcfd279-8633-452e-8c03-079e0618893d-agent-certs\") pod \"konnectivity-agent-d8z97\" (UID: \"ffcfd279-8633-452e-8c03-079e0618893d\") " pod="kube-system/konnectivity-agent-d8z97"
Sep 16 02:13:15.167750 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.167727    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ffcfd279-8633-452e-8c03-079e0618893d-konnectivity-ca\") pod \"konnectivity-agent-d8z97\" (UID: \"ffcfd279-8633-452e-8c03-079e0618893d\") " pod="kube-system/konnectivity-agent-d8z97"
Sep 16 02:13:15.167750 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.167744    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-etc-sysctl-d\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.167971 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.167756    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-sys\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.167971 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.167792    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-var-lib-kubelet\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.167971 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.167806    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjtkj\" (UniqueName: \"kubernetes.io/projected/eb4b6a80-8661-4a62-afb8-e616fadbae27-kube-api-access-gjtkj\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.167971 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.167835    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7ee22301-74a6-440b-8e16-cab47ce7107c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-82ssl\" (UID: \"7ee22301-74a6-440b-8e16-cab47ce7107c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82ssl"
Sep 16 02:13:15.167971 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.167867    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7ee22301-74a6-440b-8e16-cab47ce7107c-etc-selinux\") pod \"aws-ebs-csi-driver-node-82ssl\" (UID: \"7ee22301-74a6-440b-8e16-cab47ce7107c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82ssl"
Sep 16 02:13:15.167971 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.167940    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-etc-kubernetes\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.168185 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.167973    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-run\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.168185 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.168023    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-lib-modules\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.168440 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.168426    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bbcpb"
Sep 16 02:13:15.169494 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.169477    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8wndx"
Sep 16 02:13:15.170160 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.170140    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 16 02:13:15.170246 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.170233    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 16 02:13:15.170451 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.170432    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xv64h\""
Sep 16 02:13:15.170674 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.170657    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6tp4r"
Sep 16 02:13:15.171447 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.171424    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-djzp6\""
Sep 16 02:13:15.171540 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.171513    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 16 02:13:15.171540 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.171522    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 16 02:13:15.171647 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.171585    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 16 02:13:15.171935 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.171917    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2jj8"
Sep 16 02:13:15.172025 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:15.171988    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2jj8" podUID="cd020b20-feab-4fa9-9ca8-8daccf44b045"
Sep 16 02:13:15.172440 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.172423    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 02:13:15.172523 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.172511    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-191.ec2.internal"
Sep 16 02:13:15.172719 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.172708    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 16 02:13:15.173012 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.172980    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tjwdl\""
Sep 16 02:13:15.173191 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.173179    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 16 02:13:15.173239 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.173215    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5d9gv"
Sep 16 02:13:15.173837 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.173820    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 02:13:15.174483 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.174464    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-191.ec2.internal"]
Sep 16 02:13:15.174568 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.174556    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.175065 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.175048    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 16 02:13:15.175182 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.175166    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6hzhd\""
Sep 16 02:13:15.175182 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.175179    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 16 02:13:15.175288 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.175215    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 16 02:13:15.176728 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.176698    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 16 02:13:15.177064 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.177043    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 16 02:13:15.177064 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.177048    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 16 02:13:15.177233 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.177054    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 16 02:13:15.177233 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.177118    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 16 02:13:15.177233 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.177140    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 16 02:13:15.177233 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.177118    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2l64p\""
Sep 16 02:13:15.180136 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.180120    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 02:13:15.180364 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.180351    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-191.ec2.internal"]
Sep 16 02:13:15.198342 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.198288    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ds558"
Sep 16 02:13:15.206806 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.206787    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ds558"
Sep 16 02:13:15.263121 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.263095    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 16 02:13:15.268275 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.268254    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa055700-1ef3-45cc-84a5-a00cc3497637-tmp-dir\") pod \"node-resolver-bbcpb\" (UID: \"aa055700-1ef3-45cc-84a5-a00cc3497637\") " pod="openshift-dns/node-resolver-bbcpb"
Sep 16 02:13:15.268366 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.268288    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9360df26-7dcf-4632-b9b1-c3604a98a63e-dbus\") pod \"global-pull-secret-syncer-kpfqx\" (UID: \"9360df26-7dcf-4632-b9b1-c3604a98a63e\") " pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:15.268366 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.268310    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9360df26-7dcf-4632-b9b1-c3604a98a63e-original-pull-secret\") pod \"global-pull-secret-syncer-kpfqx\" (UID: \"9360df26-7dcf-4632-b9b1-c3604a98a63e\") " pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:15.268472 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.268370    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-sys\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.268472 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.268405    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c7cab88e-5476-42c4-9458-bbbfa5a6848b-system-cni-dir\") pod \"multus-additional-cni-plugins-6tp4r\" (UID: \"c7cab88e-5476-42c4-9458-bbbfa5a6848b\") " pod="openshift-multus/multus-additional-cni-plugins-6tp4r"
Sep 16 02:13:15.268472 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.268426    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-log-socket\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.268472 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.268431    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-sys\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.268472 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.268443    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c7cab88e-5476-42c4-9458-bbbfa5a6848b-cnibin\") pod \"multus-additional-cni-plugins-6tp4r\" (UID: \"c7cab88e-5476-42c4-9458-bbbfa5a6848b\") " pod="openshift-multus/multus-additional-cni-plugins-6tp4r"
Sep 16 02:13:15.268472 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.268467    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c7cab88e-5476-42c4-9458-bbbfa5a6848b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6tp4r\" (UID: \"c7cab88e-5476-42c4-9458-bbbfa5a6848b\") " pod="openshift-multus/multus-additional-cni-plugins-6tp4r"
Sep 16 02:13:15.268733 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.268488    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-host-kubelet\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.268733 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.268512    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-multus-socket-dir-parent\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.268733 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.268535    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1a264618-840c-4828-8f10-c07e91c9d4f0-multus-daemon-config\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.268733 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.268572    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-etc-modprobe-d\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.268733 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.268602    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-run-systemd\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.268733 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.268628    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-system-cni-dir\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.268733 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.268653    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-host-run-k8s-cni-cncf-io\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.268733 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.268684    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-hostroot\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.268733 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.268689    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-etc-modprobe-d\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.268733 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.268710    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7ee22301-74a6-440b-8e16-cab47ce7107c-device-dir\") pod \"aws-ebs-csi-driver-node-82ssl\" (UID: \"7ee22301-74a6-440b-8e16-cab47ce7107c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82ssl"
Sep 16 02:13:15.268733 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.268737    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eb4b6a80-8661-4a62-afb8-e616fadbae27-etc-tuned\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.269241 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.268752    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7ee22301-74a6-440b-8e16-cab47ce7107c-device-dir\") pod \"aws-ebs-csi-driver-node-82ssl\" (UID: \"7ee22301-74a6-440b-8e16-cab47ce7107c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82ssl"
Sep 16 02:13:15.269241 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.268758    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b935ea44-096a-45f1-90b6-f178099dac5f-host\") pod \"node-ca-8wndx\" (UID: \"b935ea44-096a-45f1-90b6-f178099dac5f\") " pod="openshift-image-registry/node-ca-8wndx"
Sep 16 02:13:15.269241 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.268806    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55hk2\" (UniqueName: \"kubernetes.io/projected/aa055700-1ef3-45cc-84a5-a00cc3497637-kube-api-access-55hk2\") pod \"node-resolver-bbcpb\" (UID: \"aa055700-1ef3-45cc-84a5-a00cc3497637\") " pod="openshift-dns/node-resolver-bbcpb"
Sep 16 02:13:15.269241 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.268830    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hglwv\" (UniqueName: \"kubernetes.io/projected/cd4dde1b-5e31-44c0-92d4-625820ec7969-kube-api-access-hglwv\") pod \"iptables-alerter-5d9gv\" (UID: \"cd4dde1b-5e31-44c0-92d4-625820ec7969\") " pod="openshift-network-operator/iptables-alerter-5d9gv"
Sep 16 02:13:15.269241 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.268856    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7ee22301-74a6-440b-8e16-cab47ce7107c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-82ssl\" (UID: \"7ee22301-74a6-440b-8e16-cab47ce7107c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82ssl"
Sep 16 02:13:15.269241 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.268879    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-etc-kubernetes\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.269241 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.268935    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7ee22301-74a6-440b-8e16-cab47ce7107c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-82ssl\" (UID: \"7ee22301-74a6-440b-8e16-cab47ce7107c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82ssl"
Sep 16 02:13:15.269241 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.268969    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-etc-kubernetes\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.269241 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.268971    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-run\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.269241 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269001    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-host-var-lib-kubelet\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.269241 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269025    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hzwk\" (UniqueName: \"kubernetes.io/projected/cd020b20-feab-4fa9-9ca8-8daccf44b045-kube-api-access-4hzwk\") pod \"network-check-target-p2jj8\" (UID: \"cd020b20-feab-4fa9-9ca8-8daccf44b045\") " pod="openshift-network-diagnostics/network-check-target-p2jj8"
Sep 16 02:13:15.269241 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269048    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 16 02:13:15.269241 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269052    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-run\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.269241 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269050    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7ee22301-74a6-440b-8e16-cab47ce7107c-sys-fs\") pod \"aws-ebs-csi-driver-node-82ssl\" (UID: \"7ee22301-74a6-440b-8e16-cab47ce7107c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82ssl"
Sep 16 02:13:15.269241 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269119    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7ee22301-74a6-440b-8e16-cab47ce7107c-sys-fs\") pod \"aws-ebs-csi-driver-node-82ssl\" (UID: \"7ee22301-74a6-440b-8e16-cab47ce7107c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82ssl"
Sep 16 02:13:15.269241 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269119    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-host\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.269241 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269157    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-host-run-ovn-kubernetes\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.269827 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269173    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-host\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.269827 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269216    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkdmx\" (UniqueName: \"kubernetes.io/projected/1a264618-840c-4828-8f10-c07e91c9d4f0-kube-api-access-lkdmx\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.269827 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269256    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld8g7\" (UniqueName: \"kubernetes.io/projected/7ee22301-74a6-440b-8e16-cab47ce7107c-kube-api-access-ld8g7\") pod \"aws-ebs-csi-driver-node-82ssl\" (UID: \"7ee22301-74a6-440b-8e16-cab47ce7107c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82ssl"
Sep 16 02:13:15.269827 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269291    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lpc9\" (UniqueName: \"kubernetes.io/projected/b935ea44-096a-45f1-90b6-f178099dac5f-kube-api-access-4lpc9\") pod \"node-ca-8wndx\" (UID: \"b935ea44-096a-45f1-90b6-f178099dac5f\") " pod="openshift-image-registry/node-ca-8wndx"
Sep 16 02:13:15.269827 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269369    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c7cab88e-5476-42c4-9458-bbbfa5a6848b-cni-binary-copy\") pod \"multus-additional-cni-plugins-6tp4r\" (UID: \"c7cab88e-5476-42c4-9458-bbbfa5a6848b\") " pod="openshift-multus/multus-additional-cni-plugins-6tp4r"
Sep 16 02:13:15.269827 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269390    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c7cab88e-5476-42c4-9458-bbbfa5a6848b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6tp4r\" (UID: \"c7cab88e-5476-42c4-9458-bbbfa5a6848b\") " pod="openshift-multus/multus-additional-cni-plugins-6tp4r"
Sep 16 02:13:15.269827 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269443    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cd4dde1b-5e31-44c0-92d4-625820ec7969-iptables-alerter-script\") pod \"iptables-alerter-5d9gv\" (UID: \"cd4dde1b-5e31-44c0-92d4-625820ec7969\") " pod="openshift-network-operator/iptables-alerter-5d9gv"
Sep 16 02:13:15.269827 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269476    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-run-ovn\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.269827 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269497    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9360df26-7dcf-4632-b9b1-c3604a98a63e-kubelet-config\") pod \"global-pull-secret-syncer-kpfqx\" (UID: \"9360df26-7dcf-4632-b9b1-c3604a98a63e\") " pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:15.269827 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269520    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ffcfd279-8633-452e-8c03-079e0618893d-konnectivity-ca\") pod \"konnectivity-agent-d8z97\" (UID: \"ffcfd279-8633-452e-8c03-079e0618893d\") " pod="kube-system/konnectivity-agent-d8z97"
Sep 16 02:13:15.269827 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269540    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-etc-sysctl-d\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.269827 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269564    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-var-lib-kubelet\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.269827 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269599    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px2hw\" (UniqueName: \"kubernetes.io/projected/c7cab88e-5476-42c4-9458-bbbfa5a6848b-kube-api-access-px2hw\") pod \"multus-additional-cni-plugins-6tp4r\" (UID: \"c7cab88e-5476-42c4-9458-bbbfa5a6848b\") " pod="openshift-multus/multus-additional-cni-plugins-6tp4r"
Sep 16 02:13:15.269827 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269621    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-run-openvswitch\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.269827 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269631    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-etc-sysctl-d\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.269827 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269640    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-cnibin\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.270651 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269673    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-multus-conf-dir\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.270651 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269649    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-var-lib-kubelet\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.270651 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269693    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs\") pod \"network-metrics-daemon-2b8mm\" (UID: \"df380f84-e4cf-477f-b44f-86c7f533ce9c\") " pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:13:15.270651 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269738    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-lib-modules\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.270651 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269758    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-systemd-units\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.270651 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269799    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-host-cni-bin\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.270651 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269831    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/308f30e2-2871-442a-ba30-54ada02ad832-env-overrides\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.270651 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269864    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-multus-cni-dir\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.270651 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269884    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa055700-1ef3-45cc-84a5-a00cc3497637-hosts-file\") pod \"node-resolver-bbcpb\" (UID: \"aa055700-1ef3-45cc-84a5-a00cc3497637\") " pod="openshift-dns/node-resolver-bbcpb"
Sep 16 02:13:15.270651 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269905    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7ee22301-74a6-440b-8e16-cab47ce7107c-registration-dir\") pod \"aws-ebs-csi-driver-node-82ssl\" (UID: \"7ee22301-74a6-440b-8e16-cab47ce7107c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82ssl"
Sep 16 02:13:15.270651 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269909    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-lib-modules\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.270651 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269925    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb4b6a80-8661-4a62-afb8-e616fadbae27-tmp\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.270651 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269956    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b935ea44-096a-45f1-90b6-f178099dac5f-serviceca\") pod \"node-ca-8wndx\" (UID: \"b935ea44-096a-45f1-90b6-f178099dac5f\") " pod="openshift-image-registry/node-ca-8wndx"
Sep 16 02:13:15.270651 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.269982    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-etc-openvswitch\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.270651 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270005    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-etc-kubernetes\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.270651 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270032    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-etc-sysconfig\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.270651 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270058    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7ee22301-74a6-440b-8e16-cab47ce7107c-socket-dir\") pod \"aws-ebs-csi-driver-node-82ssl\" (UID: \"7ee22301-74a6-440b-8e16-cab47ce7107c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82ssl"
Sep 16 02:13:15.271477 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270080    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-etc-systemd\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.271477 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270103    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjtkj\" (UniqueName: \"kubernetes.io/projected/eb4b6a80-8661-4a62-afb8-e616fadbae27-kube-api-access-gjtkj\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.271477 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270125    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-host-run-netns\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.271477 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270160    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.271477 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270174    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ffcfd279-8633-452e-8c03-079e0618893d-konnectivity-ca\") pod \"konnectivity-agent-d8z97\" (UID: \"ffcfd279-8633-452e-8c03-079e0618893d\") " pod="kube-system/konnectivity-agent-d8z97"
Sep 16 02:13:15.271477 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270221    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a264618-840c-4828-8f10-c07e91c9d4f0-cni-binary-copy\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.271477 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270251    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ffcfd279-8633-452e-8c03-079e0618893d-agent-certs\") pod \"konnectivity-agent-d8z97\" (UID: \"ffcfd279-8633-452e-8c03-079e0618893d\") " pod="kube-system/konnectivity-agent-d8z97"
Sep 16 02:13:15.271477 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270269    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7ee22301-74a6-440b-8e16-cab47ce7107c-socket-dir\") pod \"aws-ebs-csi-driver-node-82ssl\" (UID: \"7ee22301-74a6-440b-8e16-cab47ce7107c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82ssl"
Sep 16 02:13:15.271477 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270302    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-etc-systemd\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.271477 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270307    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c7cab88e-5476-42c4-9458-bbbfa5a6848b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6tp4r\" (UID: \"c7cab88e-5476-42c4-9458-bbbfa5a6848b\") " pod="openshift-multus/multus-additional-cni-plugins-6tp4r"
Sep 16 02:13:15.271477 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270325    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-etc-sysconfig\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.271477 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270332    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd4dde1b-5e31-44c0-92d4-625820ec7969-host-slash\") pod \"iptables-alerter-5d9gv\" (UID: \"cd4dde1b-5e31-44c0-92d4-625820ec7969\") " pod="openshift-network-operator/iptables-alerter-5d9gv"
Sep 16 02:13:15.271477 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270355    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-host-slash\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.271477 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270367    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7ee22301-74a6-440b-8e16-cab47ce7107c-registration-dir\") pod \"aws-ebs-csi-driver-node-82ssl\" (UID: \"7ee22301-74a6-440b-8e16-cab47ce7107c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82ssl"
Sep 16 02:13:15.271477 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270378    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-host-cni-netd\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.271477 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270402    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/308f30e2-2871-442a-ba30-54ada02ad832-ovnkube-script-lib\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.271477 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270426    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-host-run-multus-certs\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.272267 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270461    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzjx4\" (UniqueName: \"kubernetes.io/projected/df380f84-e4cf-477f-b44f-86c7f533ce9c-kube-api-access-kzjx4\") pod \"network-metrics-daemon-2b8mm\" (UID: \"df380f84-e4cf-477f-b44f-86c7f533ce9c\") " pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:13:15.272267 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270500    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7ee22301-74a6-440b-8e16-cab47ce7107c-etc-selinux\") pod \"aws-ebs-csi-driver-node-82ssl\" (UID: \"7ee22301-74a6-440b-8e16-cab47ce7107c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82ssl"
Sep 16 02:13:15.272267 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270530    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-node-log\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.272267 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270586    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7ee22301-74a6-440b-8e16-cab47ce7107c-etc-selinux\") pod \"aws-ebs-csi-driver-node-82ssl\" (UID: \"7ee22301-74a6-440b-8e16-cab47ce7107c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82ssl"
Sep 16 02:13:15.272267 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270621    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/308f30e2-2871-442a-ba30-54ada02ad832-ovnkube-config\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.272267 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270671    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/308f30e2-2871-442a-ba30-54ada02ad832-ovn-node-metrics-cert\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.272267 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270710    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-host-run-netns\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.272267 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270735    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-host-var-lib-cni-bin\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.272267 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270788    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-etc-sysctl-conf\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.272267 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270819    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-var-lib-openvswitch\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.272267 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270854    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkf4l\" (UniqueName: \"kubernetes.io/projected/308f30e2-2871-442a-ba30-54ada02ad832-kube-api-access-jkf4l\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.272267 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.270893    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-host-var-lib-cni-multus\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.272267 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.271031    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eb4b6a80-8661-4a62-afb8-e616fadbae27-etc-sysctl-conf\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.272834 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.272545    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eb4b6a80-8661-4a62-afb8-e616fadbae27-etc-tuned\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.272834 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.272624    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb4b6a80-8661-4a62-afb8-e616fadbae27-tmp\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.272902 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.272842    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ffcfd279-8633-452e-8c03-079e0618893d-agent-certs\") pod \"konnectivity-agent-d8z97\" (UID: \"ffcfd279-8633-452e-8c03-079e0618893d\") " pod="kube-system/konnectivity-agent-d8z97"
Sep 16 02:13:15.276129 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.276107    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld8g7\" (UniqueName: \"kubernetes.io/projected/7ee22301-74a6-440b-8e16-cab47ce7107c-kube-api-access-ld8g7\") pod \"aws-ebs-csi-driver-node-82ssl\" (UID: \"7ee22301-74a6-440b-8e16-cab47ce7107c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82ssl"
Sep 16 02:13:15.277025 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.277001    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjtkj\" (UniqueName: \"kubernetes.io/projected/eb4b6a80-8661-4a62-afb8-e616fadbae27-kube-api-access-gjtkj\") pod \"tuned-9xppl\" (UID: \"eb4b6a80-8661-4a62-afb8-e616fadbae27\") " pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.277779 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.277746    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 02:13:15.371981 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.371956    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b935ea44-096a-45f1-90b6-f178099dac5f-host\") pod \"node-ca-8wndx\" (UID: \"b935ea44-096a-45f1-90b6-f178099dac5f\") " pod="openshift-image-registry/node-ca-8wndx"
Sep 16 02:13:15.371981 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.371983    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55hk2\" (UniqueName: \"kubernetes.io/projected/aa055700-1ef3-45cc-84a5-a00cc3497637-kube-api-access-55hk2\") pod \"node-resolver-bbcpb\" (UID: \"aa055700-1ef3-45cc-84a5-a00cc3497637\") " pod="openshift-dns/node-resolver-bbcpb"
Sep 16 02:13:15.372152 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.371998    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hglwv\" (UniqueName: \"kubernetes.io/projected/cd4dde1b-5e31-44c0-92d4-625820ec7969-kube-api-access-hglwv\") pod \"iptables-alerter-5d9gv\" (UID: \"cd4dde1b-5e31-44c0-92d4-625820ec7969\") " pod="openshift-network-operator/iptables-alerter-5d9gv"
Sep 16 02:13:15.372152 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372014    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-host-var-lib-kubelet\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.372152 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372029    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hzwk\" (UniqueName: \"kubernetes.io/projected/cd020b20-feab-4fa9-9ca8-8daccf44b045-kube-api-access-4hzwk\") pod \"network-check-target-p2jj8\" (UID: \"cd020b20-feab-4fa9-9ca8-8daccf44b045\") " pod="openshift-network-diagnostics/network-check-target-p2jj8"
Sep 16 02:13:15.372152 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372044    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-host-run-ovn-kubernetes\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.372152 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372058    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkdmx\" (UniqueName: \"kubernetes.io/projected/1a264618-840c-4828-8f10-c07e91c9d4f0-kube-api-access-lkdmx\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.372152 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372079    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lpc9\" (UniqueName: \"kubernetes.io/projected/b935ea44-096a-45f1-90b6-f178099dac5f-kube-api-access-4lpc9\") pod \"node-ca-8wndx\" (UID: \"b935ea44-096a-45f1-90b6-f178099dac5f\") " pod="openshift-image-registry/node-ca-8wndx"
Sep 16 02:13:15.372152 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372102    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c7cab88e-5476-42c4-9458-bbbfa5a6848b-cni-binary-copy\") pod \"multus-additional-cni-plugins-6tp4r\" (UID: \"c7cab88e-5476-42c4-9458-bbbfa5a6848b\") " pod="openshift-multus/multus-additional-cni-plugins-6tp4r"
Sep 16 02:13:15.372152 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372118    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b935ea44-096a-45f1-90b6-f178099dac5f-host\") pod \"node-ca-8wndx\" (UID: \"b935ea44-096a-45f1-90b6-f178099dac5f\") " pod="openshift-image-registry/node-ca-8wndx"
Sep 16 02:13:15.372152 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372125    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c7cab88e-5476-42c4-9458-bbbfa5a6848b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6tp4r\" (UID: \"c7cab88e-5476-42c4-9458-bbbfa5a6848b\") " pod="openshift-multus/multus-additional-cni-plugins-6tp4r"
Sep 16 02:13:15.372152 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372099    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-host-var-lib-kubelet\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.372152 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372141    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-host-run-ovn-kubernetes\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.372657 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372149    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cd4dde1b-5e31-44c0-92d4-625820ec7969-iptables-alerter-script\") pod \"iptables-alerter-5d9gv\" (UID: \"cd4dde1b-5e31-44c0-92d4-625820ec7969\") " pod="openshift-network-operator/iptables-alerter-5d9gv"
Sep 16 02:13:15.372657 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372200    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-run-ovn\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.372657 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372227    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9360df26-7dcf-4632-b9b1-c3604a98a63e-kubelet-config\") pod \"global-pull-secret-syncer-kpfqx\" (UID: \"9360df26-7dcf-4632-b9b1-c3604a98a63e\") " pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:15.372657 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372256    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px2hw\" (UniqueName: \"kubernetes.io/projected/c7cab88e-5476-42c4-9458-bbbfa5a6848b-kube-api-access-px2hw\") pod \"multus-additional-cni-plugins-6tp4r\" (UID: \"c7cab88e-5476-42c4-9458-bbbfa5a6848b\") " pod="openshift-multus/multus-additional-cni-plugins-6tp4r"
Sep 16 02:13:15.372657 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372276    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-run-openvswitch\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.372657 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372282    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-run-ovn\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.372657 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372296    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-cnibin\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.372657 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372317    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-multus-conf-dir\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.372657 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372339    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs\") pod \"network-metrics-daemon-2b8mm\" (UID: \"df380f84-e4cf-477f-b44f-86c7f533ce9c\") " pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:13:15.372657 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372342    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9360df26-7dcf-4632-b9b1-c3604a98a63e-kubelet-config\") pod \"global-pull-secret-syncer-kpfqx\" (UID: \"9360df26-7dcf-4632-b9b1-c3604a98a63e\") " pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:15.372657 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372362    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-systemd-units\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.372657 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372385    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-host-cni-bin\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.372657 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372387    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-multus-conf-dir\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.372657 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:15.372431    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 02:13:15.372657 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372441    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/308f30e2-2871-442a-ba30-54ada02ad832-env-overrides\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.372657 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372466    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-multus-cni-dir\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.372657 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372471    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-cnibin\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.372657 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372511    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa055700-1ef3-45cc-84a5-a00cc3497637-hosts-file\") pod \"node-resolver-bbcpb\" (UID: \"aa055700-1ef3-45cc-84a5-a00cc3497637\") " pod="openshift-dns/node-resolver-bbcpb"
Sep 16 02:13:15.373494 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372538    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-multus-cni-dir\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.373494 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372432    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-run-openvswitch\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.373494 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:15.372557    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs podName:df380f84-e4cf-477f-b44f-86c7f533ce9c nodeName:}" failed. No retries permitted until 2026-09-16 02:13:15.872534496 +0000 UTC m=+2.076798589 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs") pod "network-metrics-daemon-2b8mm" (UID: "df380f84-e4cf-477f-b44f-86c7f533ce9c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 02:13:15.373494 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372566    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa055700-1ef3-45cc-84a5-a00cc3497637-hosts-file\") pod \"node-resolver-bbcpb\" (UID: \"aa055700-1ef3-45cc-84a5-a00cc3497637\") " pod="openshift-dns/node-resolver-bbcpb"
Sep 16 02:13:15.373494 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372575    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b935ea44-096a-45f1-90b6-f178099dac5f-serviceca\") pod \"node-ca-8wndx\" (UID: \"b935ea44-096a-45f1-90b6-f178099dac5f\") " pod="openshift-image-registry/node-ca-8wndx"
Sep 16 02:13:15.373494 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372581    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-host-cni-bin\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.373494 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372600    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-etc-openvswitch\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.373494 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372622    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-etc-kubernetes\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.373494 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372663    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-systemd-units\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.373494 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372680    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-host-run-netns\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.373494 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372694    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-etc-kubernetes\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.373494 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372709    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.373494 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372731    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-etc-openvswitch\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.373494 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372760    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-host-run-netns\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.373494 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372807    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a264618-840c-4828-8f10-c07e91c9d4f0-cni-binary-copy\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.373494 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372820    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cd4dde1b-5e31-44c0-92d4-625820ec7969-iptables-alerter-script\") pod \"iptables-alerter-5d9gv\" (UID: \"cd4dde1b-5e31-44c0-92d4-625820ec7969\") " pod="openshift-network-operator/iptables-alerter-5d9gv"
Sep 16 02:13:15.373494 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372823    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.374210 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372823    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c7cab88e-5476-42c4-9458-bbbfa5a6848b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6tp4r\" (UID: \"c7cab88e-5476-42c4-9458-bbbfa5a6848b\") " pod="openshift-multus/multus-additional-cni-plugins-6tp4r"
Sep 16 02:13:15.374210 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372840    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c7cab88e-5476-42c4-9458-bbbfa5a6848b-cni-binary-copy\") pod \"multus-additional-cni-plugins-6tp4r\" (UID: \"c7cab88e-5476-42c4-9458-bbbfa5a6848b\") " pod="openshift-multus/multus-additional-cni-plugins-6tp4r"
Sep 16 02:13:15.374210 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372879    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c7cab88e-5476-42c4-9458-bbbfa5a6848b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6tp4r\" (UID: \"c7cab88e-5476-42c4-9458-bbbfa5a6848b\") " pod="openshift-multus/multus-additional-cni-plugins-6tp4r"
Sep 16 02:13:15.374210 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372907    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd4dde1b-5e31-44c0-92d4-625820ec7969-host-slash\") pod \"iptables-alerter-5d9gv\" (UID: \"cd4dde1b-5e31-44c0-92d4-625820ec7969\") " pod="openshift-network-operator/iptables-alerter-5d9gv"
Sep 16 02:13:15.374210 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372928    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-host-slash\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.374210 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372967    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/308f30e2-2871-442a-ba30-54ada02ad832-env-overrides\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.374210 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372968    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-host-slash\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.374210 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372968    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd4dde1b-5e31-44c0-92d4-625820ec7969-host-slash\") pod \"iptables-alerter-5d9gv\" (UID: \"cd4dde1b-5e31-44c0-92d4-625820ec7969\") " pod="openshift-network-operator/iptables-alerter-5d9gv"
Sep 16 02:13:15.374210 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.372986    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-host-cni-netd\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.374210 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373006    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-host-cni-netd\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.374210 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373024    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/308f30e2-2871-442a-ba30-54ada02ad832-ovnkube-script-lib\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.374210 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373037    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c7cab88e-5476-42c4-9458-bbbfa5a6848b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6tp4r\" (UID: \"c7cab88e-5476-42c4-9458-bbbfa5a6848b\") " pod="openshift-multus/multus-additional-cni-plugins-6tp4r"
Sep 16 02:13:15.374210 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373055    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-host-run-multus-certs\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.374210 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373083    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-host-run-multus-certs\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.374210 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373106    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzjx4\" (UniqueName: \"kubernetes.io/projected/df380f84-e4cf-477f-b44f-86c7f533ce9c-kube-api-access-kzjx4\") pod \"network-metrics-daemon-2b8mm\" (UID: \"df380f84-e4cf-477f-b44f-86c7f533ce9c\") " pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:13:15.374210 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373122    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-node-log\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.374210 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373135    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/308f30e2-2871-442a-ba30-54ada02ad832-ovnkube-config\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.374678 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373156    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/308f30e2-2871-442a-ba30-54ada02ad832-ovn-node-metrics-cert\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.374678 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373171    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-host-run-netns\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.374678 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373173    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-node-log\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.374678 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373191    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-host-var-lib-cni-bin\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.374678 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373207    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-var-lib-openvswitch\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.374678 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373222    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkf4l\" (UniqueName: \"kubernetes.io/projected/308f30e2-2871-442a-ba30-54ada02ad832-kube-api-access-jkf4l\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.374678 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373243    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-host-var-lib-cni-multus\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.374678 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373263    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa055700-1ef3-45cc-84a5-a00cc3497637-tmp-dir\") pod \"node-resolver-bbcpb\" (UID: \"aa055700-1ef3-45cc-84a5-a00cc3497637\") " pod="openshift-dns/node-resolver-bbcpb"
Sep 16 02:13:15.374678 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373277    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9360df26-7dcf-4632-b9b1-c3604a98a63e-dbus\") pod \"global-pull-secret-syncer-kpfqx\" (UID: \"9360df26-7dcf-4632-b9b1-c3604a98a63e\") " pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:15.374678 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373277    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b935ea44-096a-45f1-90b6-f178099dac5f-serviceca\") pod \"node-ca-8wndx\" (UID: \"b935ea44-096a-45f1-90b6-f178099dac5f\") " pod="openshift-image-registry/node-ca-8wndx"
Sep 16 02:13:15.374678 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373294    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9360df26-7dcf-4632-b9b1-c3604a98a63e-original-pull-secret\") pod \"global-pull-secret-syncer-kpfqx\" (UID: \"9360df26-7dcf-4632-b9b1-c3604a98a63e\") " pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:15.374678 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373311    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c7cab88e-5476-42c4-9458-bbbfa5a6848b-system-cni-dir\") pod \"multus-additional-cni-plugins-6tp4r\" (UID: \"c7cab88e-5476-42c4-9458-bbbfa5a6848b\") " pod="openshift-multus/multus-additional-cni-plugins-6tp4r"
Sep 16 02:13:15.374678 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373326    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-log-socket\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.374678 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373345    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c7cab88e-5476-42c4-9458-bbbfa5a6848b-cnibin\") pod \"multus-additional-cni-plugins-6tp4r\" (UID: \"c7cab88e-5476-42c4-9458-bbbfa5a6848b\") " pod="openshift-multus/multus-additional-cni-plugins-6tp4r"
Sep 16 02:13:15.374678 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373360    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c7cab88e-5476-42c4-9458-bbbfa5a6848b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6tp4r\" (UID: \"c7cab88e-5476-42c4-9458-bbbfa5a6848b\") " pod="openshift-multus/multus-additional-cni-plugins-6tp4r"
Sep 16 02:13:15.374678 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373365    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-host-var-lib-cni-multus\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.374678 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373376    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-host-kubelet\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.375165 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373369    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a264618-840c-4828-8f10-c07e91c9d4f0-cni-binary-copy\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.375165 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373392    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-multus-socket-dir-parent\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.375165 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373416    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-host-var-lib-cni-bin\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.375165 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373424    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1a264618-840c-4828-8f10-c07e91c9d4f0-multus-daemon-config\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.375165 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373449    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9360df26-7dcf-4632-b9b1-c3604a98a63e-dbus\") pod \"global-pull-secret-syncer-kpfqx\" (UID: \"9360df26-7dcf-4632-b9b1-c3604a98a63e\") " pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:15.375165 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373453    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-run-systemd\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.375165 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373460    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-host-run-netns\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.375165 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373484    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-run-systemd\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.375165 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373505    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-var-lib-openvswitch\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.375165 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373505    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/308f30e2-2871-442a-ba30-54ada02ad832-ovnkube-script-lib\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.375165 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:15.373524    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 02:13:15.375165 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373573    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c7cab88e-5476-42c4-9458-bbbfa5a6848b-system-cni-dir\") pod \"multus-additional-cni-plugins-6tp4r\" (UID: \"c7cab88e-5476-42c4-9458-bbbfa5a6848b\") " pod="openshift-multus/multus-additional-cni-plugins-6tp4r"
Sep 16 02:13:15.375165 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:15.373578    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9360df26-7dcf-4632-b9b1-c3604a98a63e-original-pull-secret podName:9360df26-7dcf-4632-b9b1-c3604a98a63e nodeName:}" failed. No retries permitted until 2026-09-16 02:13:15.873559995 +0000 UTC m=+2.077824087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9360df26-7dcf-4632-b9b1-c3604a98a63e-original-pull-secret") pod "global-pull-secret-syncer-kpfqx" (UID: "9360df26-7dcf-4632-b9b1-c3604a98a63e") : object "kube-system"/"original-pull-secret" not registered
Sep 16 02:13:15.375165 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373623    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-log-socket\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.375165 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373665    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/308f30e2-2871-442a-ba30-54ada02ad832-host-kubelet\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.375165 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373690    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-system-cni-dir\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.375165 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373711    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-multus-socket-dir-parent\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.375636 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373718    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/308f30e2-2871-442a-ba30-54ada02ad832-ovnkube-config\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.375636 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373721    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-host-run-k8s-cni-cncf-io\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.375636 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373757    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-system-cni-dir\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.375636 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373820    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-hostroot\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.375636 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373832    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c7cab88e-5476-42c4-9458-bbbfa5a6848b-cnibin\") pod \"multus-additional-cni-plugins-6tp4r\" (UID: \"c7cab88e-5476-42c4-9458-bbbfa5a6848b\") " pod="openshift-multus/multus-additional-cni-plugins-6tp4r"
Sep 16 02:13:15.375636 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373829    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-host-run-k8s-cni-cncf-io\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.375636 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373891    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1a264618-840c-4828-8f10-c07e91c9d4f0-hostroot\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.375636 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.373916    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa055700-1ef3-45cc-84a5-a00cc3497637-tmp-dir\") pod \"node-resolver-bbcpb\" (UID: \"aa055700-1ef3-45cc-84a5-a00cc3497637\") " pod="openshift-dns/node-resolver-bbcpb"
Sep 16 02:13:15.375636 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.374014    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c7cab88e-5476-42c4-9458-bbbfa5a6848b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6tp4r\" (UID: \"c7cab88e-5476-42c4-9458-bbbfa5a6848b\") " pod="openshift-multus/multus-additional-cni-plugins-6tp4r"
Sep 16 02:13:15.375636 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.374038    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1a264618-840c-4828-8f10-c07e91c9d4f0-multus-daemon-config\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.375636 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.375297    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/308f30e2-2871-442a-ba30-54ada02ad832-ovn-node-metrics-cert\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.380260 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:15.380233    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 02:13:15.380260 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:15.380252    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 02:13:15.380260 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:15.380262    2581 projected.go:196] Error preparing data for projected volume kube-api-access-4hzwk for pod openshift-network-diagnostics/network-check-target-p2jj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 02:13:15.380462 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:15.380320    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd020b20-feab-4fa9-9ca8-8daccf44b045-kube-api-access-4hzwk podName:cd020b20-feab-4fa9-9ca8-8daccf44b045 nodeName:}" failed. No retries permitted until 2026-09-16 02:13:15.880304999 +0000 UTC m=+2.084569105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4hzwk" (UniqueName: "kubernetes.io/projected/cd020b20-feab-4fa9-9ca8-8daccf44b045-kube-api-access-4hzwk") pod "network-check-target-p2jj8" (UID: "cd020b20-feab-4fa9-9ca8-8daccf44b045") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 02:13:15.382372 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.382344    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hglwv\" (UniqueName: \"kubernetes.io/projected/cd4dde1b-5e31-44c0-92d4-625820ec7969-kube-api-access-hglwv\") pod \"iptables-alerter-5d9gv\" (UID: \"cd4dde1b-5e31-44c0-92d4-625820ec7969\") " pod="openshift-network-operator/iptables-alerter-5d9gv"
Sep 16 02:13:15.382966 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.382942    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55hk2\" (UniqueName: \"kubernetes.io/projected/aa055700-1ef3-45cc-84a5-a00cc3497637-kube-api-access-55hk2\") pod \"node-resolver-bbcpb\" (UID: \"aa055700-1ef3-45cc-84a5-a00cc3497637\") " pod="openshift-dns/node-resolver-bbcpb"
Sep 16 02:13:15.383166 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.383146    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lpc9\" (UniqueName: \"kubernetes.io/projected/b935ea44-096a-45f1-90b6-f178099dac5f-kube-api-access-4lpc9\") pod \"node-ca-8wndx\" (UID: \"b935ea44-096a-45f1-90b6-f178099dac5f\") " pod="openshift-image-registry/node-ca-8wndx"
Sep 16 02:13:15.383233 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.383218    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzjx4\" (UniqueName: \"kubernetes.io/projected/df380f84-e4cf-477f-b44f-86c7f533ce9c-kube-api-access-kzjx4\") pod \"network-metrics-daemon-2b8mm\" (UID: \"df380f84-e4cf-477f-b44f-86c7f533ce9c\") " pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:13:15.383276 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.383232    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-px2hw\" (UniqueName: \"kubernetes.io/projected/c7cab88e-5476-42c4-9458-bbbfa5a6848b-kube-api-access-px2hw\") pod \"multus-additional-cni-plugins-6tp4r\" (UID: \"c7cab88e-5476-42c4-9458-bbbfa5a6848b\") " pod="openshift-multus/multus-additional-cni-plugins-6tp4r"
Sep 16 02:13:15.383373 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.383358    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkdmx\" (UniqueName: \"kubernetes.io/projected/1a264618-840c-4828-8f10-c07e91c9d4f0-kube-api-access-lkdmx\") pod \"multus-4wfvw\" (UID: \"1a264618-840c-4828-8f10-c07e91c9d4f0\") " pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.383441 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.383427    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkf4l\" (UniqueName: \"kubernetes.io/projected/308f30e2-2871-442a-ba30-54ada02ad832-kube-api-access-jkf4l\") pod \"ovnkube-node-g54gh\" (UID: \"308f30e2-2871-442a-ba30-54ada02ad832\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.487113 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.487055    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d8z97"
Sep 16 02:13:15.496289 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:15.496266    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffcfd279_8633_452e_8c03_079e0618893d.slice/crio-7e0b3e46e6bb0678f9fa2d7ce3744fe3673fced3b86eb7087fd701a4a46a3c4d WatchSource:0}: Error finding container 7e0b3e46e6bb0678f9fa2d7ce3744fe3673fced3b86eb7087fd701a4a46a3c4d: Status 404 returned error can't find the container with id 7e0b3e46e6bb0678f9fa2d7ce3744fe3673fced3b86eb7087fd701a4a46a3c4d
Sep 16 02:13:15.500186 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.500169    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82ssl"
Sep 16 02:13:15.507131 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.507112    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9xppl"
Sep 16 02:13:15.507395 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:15.507379    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ee22301_74a6_440b_8e16_cab47ce7107c.slice/crio-d3b00c28de27f501c442fb9032bb03d582085e66091fdfc70132941d4bb00d10 WatchSource:0}: Error finding container d3b00c28de27f501c442fb9032bb03d582085e66091fdfc70132941d4bb00d10: Status 404 returned error can't find the container with id d3b00c28de27f501c442fb9032bb03d582085e66091fdfc70132941d4bb00d10
Sep 16 02:13:15.513806 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:15.513787    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb4b6a80_8661_4a62_afb8_e616fadbae27.slice/crio-d15ae47f6025916ddf0f4684190ed1ecce3ee29056d56224ac78df543dff7e4c WatchSource:0}: Error finding container d15ae47f6025916ddf0f4684190ed1ecce3ee29056d56224ac78df543dff7e4c: Status 404 returned error can't find the container with id d15ae47f6025916ddf0f4684190ed1ecce3ee29056d56224ac78df543dff7e4c
Sep 16 02:13:15.520196 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.520181    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4wfvw"
Sep 16 02:13:15.527754 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:15.527736    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a264618_840c_4828_8f10_c07e91c9d4f0.slice/crio-3390f72ee4dadb8120b141652c35444a3709be0df051d6c940f1e48351656366 WatchSource:0}: Error finding container 3390f72ee4dadb8120b141652c35444a3709be0df051d6c940f1e48351656366: Status 404 returned error can't find the container with id 3390f72ee4dadb8120b141652c35444a3709be0df051d6c940f1e48351656366
Sep 16 02:13:15.536930 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.536907    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bbcpb"
Sep 16 02:13:15.543756 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:15.543738    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa055700_1ef3_45cc_84a5_a00cc3497637.slice/crio-9322c97930b48901c0ef531f8166d6a997a9fc1f4b48326de5f995c6b788d682 WatchSource:0}: Error finding container 9322c97930b48901c0ef531f8166d6a997a9fc1f4b48326de5f995c6b788d682: Status 404 returned error can't find the container with id 9322c97930b48901c0ef531f8166d6a997a9fc1f4b48326de5f995c6b788d682
Sep 16 02:13:15.551358 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.551342    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8wndx"
Sep 16 02:13:15.557676 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:15.557652    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb935ea44_096a_45f1_90b6_f178099dac5f.slice/crio-3450752f24086a1fbe1325d283f70f2758dbdbadfc3af2539b4412fc1a724d22 WatchSource:0}: Error finding container 3450752f24086a1fbe1325d283f70f2758dbdbadfc3af2539b4412fc1a724d22: Status 404 returned error can't find the container with id 3450752f24086a1fbe1325d283f70f2758dbdbadfc3af2539b4412fc1a724d22
Sep 16 02:13:15.585190 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.585170    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6tp4r"
Sep 16 02:13:15.591096 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.591080    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5d9gv"
Sep 16 02:13:15.591349 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:15.591333    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7cab88e_5476_42c4_9458_bbbfa5a6848b.slice/crio-ddd221809a755c47bf6e80ec5d25b3f8802fbf23e4cfacc3cf93e8967bf28b4b WatchSource:0}: Error finding container ddd221809a755c47bf6e80ec5d25b3f8802fbf23e4cfacc3cf93e8967bf28b4b: Status 404 returned error can't find the container with id ddd221809a755c47bf6e80ec5d25b3f8802fbf23e4cfacc3cf93e8967bf28b4b
Sep 16 02:13:15.596222 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.596204    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:15.597675 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:15.597658    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd4dde1b_5e31_44c0_92d4_625820ec7969.slice/crio-5cead06c47c0703825e76a58827c19bed53fd2d1fdb9b63bc08d486be3da8d21 WatchSource:0}: Error finding container 5cead06c47c0703825e76a58827c19bed53fd2d1fdb9b63bc08d486be3da8d21: Status 404 returned error can't find the container with id 5cead06c47c0703825e76a58827c19bed53fd2d1fdb9b63bc08d486be3da8d21
Sep 16 02:13:15.603077 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:15.603060    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod308f30e2_2871_442a_ba30_54ada02ad832.slice/crio-c0ae693f6574ed228b5963b04eaeccab0a11c0d1337a9b1b1737ffa14719394e WatchSource:0}: Error finding container c0ae693f6574ed228b5963b04eaeccab0a11c0d1337a9b1b1737ffa14719394e: Status 404 returned error can't find the container with id c0ae693f6574ed228b5963b04eaeccab0a11c0d1337a9b1b1737ffa14719394e
Sep 16 02:13:15.653634 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:15.653615    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 02:13:16.989548 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:16.989513    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9360df26-7dcf-4632-b9b1-c3604a98a63e-original-pull-secret\") pod \"global-pull-secret-syncer-kpfqx\" (UID: \"9360df26-7dcf-4632-b9b1-c3604a98a63e\") " pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:16.989710 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:16.989580    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs\") pod \"network-metrics-daemon-2b8mm\" (UID: \"df380f84-e4cf-477f-b44f-86c7f533ce9c\") " pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:13:16.989710 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:16.989685    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 02:13:16.989821 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:16.989740    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs podName:df380f84-e4cf-477f-b44f-86c7f533ce9c nodeName:}" failed. No retries permitted until 2026-09-16 02:13:17.989723084 +0000 UTC m=+3.081905049 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs") pod "network-metrics-daemon-2b8mm" (UID: "df380f84-e4cf-477f-b44f-86c7f533ce9c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 02:13:16.990162 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:16.990139    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 02:13:16.990247 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:16.990192    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9360df26-7dcf-4632-b9b1-c3604a98a63e-original-pull-secret podName:9360df26-7dcf-4632-b9b1-c3604a98a63e nodeName:}" failed. No retries permitted until 2026-09-16 02:13:17.990178399 +0000 UTC m=+3.082360366 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9360df26-7dcf-4632-b9b1-c3604a98a63e-original-pull-secret") pod "global-pull-secret-syncer-kpfqx" (UID: "9360df26-7dcf-4632-b9b1-c3604a98a63e") : object "kube-system"/"original-pull-secret" not registered
Sep 16 02:13:17.090141 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:17.090110    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hzwk\" (UniqueName: \"kubernetes.io/projected/cd020b20-feab-4fa9-9ca8-8daccf44b045-kube-api-access-4hzwk\") pod \"network-check-target-p2jj8\" (UID: \"cd020b20-feab-4fa9-9ca8-8daccf44b045\") " pod="openshift-network-diagnostics/network-check-target-p2jj8"
Sep 16 02:13:17.090322 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:17.090303    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 02:13:17.090389 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:17.090330    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 02:13:17.090389 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:17.090342    2581 projected.go:196] Error preparing data for projected volume kube-api-access-4hzwk for pod openshift-network-diagnostics/network-check-target-p2jj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 02:13:17.090481 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:17.090397    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd020b20-feab-4fa9-9ca8-8daccf44b045-kube-api-access-4hzwk podName:cd020b20-feab-4fa9-9ca8-8daccf44b045 nodeName:}" failed. No retries permitted until 2026-09-16 02:13:18.090379416 +0000 UTC m=+3.182561382 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4hzwk" (UniqueName: "kubernetes.io/projected/cd020b20-feab-4fa9-9ca8-8daccf44b045-kube-api-access-4hzwk") pod "network-check-target-p2jj8" (UID: "cd020b20-feab-4fa9-9ca8-8daccf44b045") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 02:13:17.321445 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:17.321284    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 02:08:16 +0000 UTC" deadline="2028-05-05 05:46:03.363528945 +0000 UTC"
Sep 16 02:13:17.321445 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:17.321343    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14331h32m46.042192055s"
Sep 16 02:13:17.393321 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:17.393294    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 02:13:17.413589 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:17.413524    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-191.ec2.internal" event={"ID":"c33b9c404b3f92df51af027eb114ba62","Type":"ContainerStarted","Data":"c4eda9a14e0368f0202e601d0bf229803273207469cf9c77d58cf3ea96f75f6f"}
Sep 16 02:13:17.419649 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:17.419061    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5d9gv" event={"ID":"cd4dde1b-5e31-44c0-92d4-625820ec7969","Type":"ContainerStarted","Data":"5cead06c47c0703825e76a58827c19bed53fd2d1fdb9b63bc08d486be3da8d21"}
Sep 16 02:13:17.433877 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:17.433833    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6tp4r" event={"ID":"c7cab88e-5476-42c4-9458-bbbfa5a6848b","Type":"ContainerStarted","Data":"ddd221809a755c47bf6e80ec5d25b3f8802fbf23e4cfacc3cf93e8967bf28b4b"}
Sep 16 02:13:17.444743 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:17.444717    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4wfvw" event={"ID":"1a264618-840c-4828-8f10-c07e91c9d4f0","Type":"ContainerStarted","Data":"3390f72ee4dadb8120b141652c35444a3709be0df051d6c940f1e48351656366"}
Sep 16 02:13:17.450000 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:17.449971    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82ssl" event={"ID":"7ee22301-74a6-440b-8e16-cab47ce7107c","Type":"ContainerStarted","Data":"d3b00c28de27f501c442fb9032bb03d582085e66091fdfc70132941d4bb00d10"}
Sep 16 02:13:17.461004 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:17.460922    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d8z97" event={"ID":"ffcfd279-8633-452e-8c03-079e0618893d","Type":"ContainerStarted","Data":"7e0b3e46e6bb0678f9fa2d7ce3744fe3673fced3b86eb7087fd701a4a46a3c4d"}
Sep 16 02:13:17.472082 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:17.472059    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-191.ec2.internal" event={"ID":"dcc129ffe7ff05689defbf8c29a04ab8","Type":"ContainerStarted","Data":"cfec9db6d76ab73cde272d819b71341808ead4797715865aabfb84eb2c0ac92b"}
Sep 16 02:13:17.494505 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:17.494429    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g54gh" event={"ID":"308f30e2-2871-442a-ba30-54ada02ad832","Type":"ContainerStarted","Data":"c0ae693f6574ed228b5963b04eaeccab0a11c0d1337a9b1b1737ffa14719394e"}
Sep 16 02:13:17.497547 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:17.497521    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8wndx" event={"ID":"b935ea44-096a-45f1-90b6-f178099dac5f","Type":"ContainerStarted","Data":"3450752f24086a1fbe1325d283f70f2758dbdbadfc3af2539b4412fc1a724d22"}
Sep 16 02:13:17.504601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:17.504576    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bbcpb" event={"ID":"aa055700-1ef3-45cc-84a5-a00cc3497637","Type":"ContainerStarted","Data":"9322c97930b48901c0ef531f8166d6a997a9fc1f4b48326de5f995c6b788d682"}
Sep 16 02:13:17.518544 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:17.518513    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9xppl" event={"ID":"eb4b6a80-8661-4a62-afb8-e616fadbae27","Type":"ContainerStarted","Data":"d15ae47f6025916ddf0f4684190ed1ecce3ee29056d56224ac78df543dff7e4c"}
Sep 16 02:13:17.799294 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:17.799220    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 02:13:17.997414 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:17.997381    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs\") pod \"network-metrics-daemon-2b8mm\" (UID: \"df380f84-e4cf-477f-b44f-86c7f533ce9c\") " pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:13:17.997596 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:17.997449    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9360df26-7dcf-4632-b9b1-c3604a98a63e-original-pull-secret\") pod \"global-pull-secret-syncer-kpfqx\" (UID: \"9360df26-7dcf-4632-b9b1-c3604a98a63e\") " pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:17.997596 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:17.997589    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 02:13:17.997714 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:17.997648    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9360df26-7dcf-4632-b9b1-c3604a98a63e-original-pull-secret podName:9360df26-7dcf-4632-b9b1-c3604a98a63e nodeName:}" failed. No retries permitted until 2026-09-16 02:13:19.997630214 +0000 UTC m=+5.089812183 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9360df26-7dcf-4632-b9b1-c3604a98a63e-original-pull-secret") pod "global-pull-secret-syncer-kpfqx" (UID: "9360df26-7dcf-4632-b9b1-c3604a98a63e") : object "kube-system"/"original-pull-secret" not registered
Sep 16 02:13:17.997973 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:17.997955    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 02:13:17.998054 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:17.998008    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs podName:df380f84-e4cf-477f-b44f-86c7f533ce9c nodeName:}" failed. No retries permitted until 2026-09-16 02:13:19.997993449 +0000 UTC m=+5.090175405 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs") pod "network-metrics-daemon-2b8mm" (UID: "df380f84-e4cf-477f-b44f-86c7f533ce9c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 02:13:18.098618 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:18.098521    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hzwk\" (UniqueName: \"kubernetes.io/projected/cd020b20-feab-4fa9-9ca8-8daccf44b045-kube-api-access-4hzwk\") pod \"network-check-target-p2jj8\" (UID: \"cd020b20-feab-4fa9-9ca8-8daccf44b045\") " pod="openshift-network-diagnostics/network-check-target-p2jj8"
Sep 16 02:13:18.098772 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:18.098689    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 02:13:18.098772 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:18.098711    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 02:13:18.098772 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:18.098726    2581 projected.go:196] Error preparing data for projected volume kube-api-access-4hzwk for pod openshift-network-diagnostics/network-check-target-p2jj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 02:13:18.099017 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:18.098782    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd020b20-feab-4fa9-9ca8-8daccf44b045-kube-api-access-4hzwk podName:cd020b20-feab-4fa9-9ca8-8daccf44b045 nodeName:}" failed. No retries permitted until 2026-09-16 02:13:20.09876459 +0000 UTC m=+5.190946545 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4hzwk" (UniqueName: "kubernetes.io/projected/cd020b20-feab-4fa9-9ca8-8daccf44b045-kube-api-access-4hzwk") pod "network-check-target-p2jj8" (UID: "cd020b20-feab-4fa9-9ca8-8daccf44b045") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 02:13:18.322071 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:18.322008    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 02:08:16 +0000 UTC" deadline="2028-03-08 17:10:56.024616211 +0000 UTC"
Sep 16 02:13:18.322071 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:18.322066    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12950h57m37.702554301s"
Sep 16 02:13:18.376901 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:18.376811    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:18.377055 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:18.376928    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpfqx" podUID="9360df26-7dcf-4632-b9b1-c3604a98a63e"
Sep 16 02:13:18.377227 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:18.377212    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:13:18.377296 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:18.377282    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b8mm" podUID="df380f84-e4cf-477f-b44f-86c7f533ce9c"
Sep 16 02:13:18.377358 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:18.377327    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2jj8"
Sep 16 02:13:18.377404 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:18.377367    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2jj8" podUID="cd020b20-feab-4fa9-9ca8-8daccf44b045"
Sep 16 02:13:19.229064 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:19.229038    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 02:13:20.014754 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:20.014024    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs\") pod \"network-metrics-daemon-2b8mm\" (UID: \"df380f84-e4cf-477f-b44f-86c7f533ce9c\") " pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:13:20.014754 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:20.014100    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9360df26-7dcf-4632-b9b1-c3604a98a63e-original-pull-secret\") pod \"global-pull-secret-syncer-kpfqx\" (UID: \"9360df26-7dcf-4632-b9b1-c3604a98a63e\") " pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:20.014754 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:20.014224    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 02:13:20.014754 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:20.014283    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9360df26-7dcf-4632-b9b1-c3604a98a63e-original-pull-secret podName:9360df26-7dcf-4632-b9b1-c3604a98a63e nodeName:}" failed. No retries permitted until 2026-09-16 02:13:24.014265728 +0000 UTC m=+9.106447682 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9360df26-7dcf-4632-b9b1-c3604a98a63e-original-pull-secret") pod "global-pull-secret-syncer-kpfqx" (UID: "9360df26-7dcf-4632-b9b1-c3604a98a63e") : object "kube-system"/"original-pull-secret" not registered
Sep 16 02:13:20.014754 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:20.014345    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 02:13:20.014754 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:20.014376    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs podName:df380f84-e4cf-477f-b44f-86c7f533ce9c nodeName:}" failed. No retries permitted until 2026-09-16 02:13:24.014364851 +0000 UTC m=+9.106546809 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs") pod "network-metrics-daemon-2b8mm" (UID: "df380f84-e4cf-477f-b44f-86c7f533ce9c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 02:13:20.115474 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:20.114870    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hzwk\" (UniqueName: \"kubernetes.io/projected/cd020b20-feab-4fa9-9ca8-8daccf44b045-kube-api-access-4hzwk\") pod \"network-check-target-p2jj8\" (UID: \"cd020b20-feab-4fa9-9ca8-8daccf44b045\") " pod="openshift-network-diagnostics/network-check-target-p2jj8"
Sep 16 02:13:20.115474 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:20.115059    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 02:13:20.115474 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:20.115078    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 02:13:20.115474 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:20.115090    2581 projected.go:196] Error preparing data for projected volume kube-api-access-4hzwk for pod openshift-network-diagnostics/network-check-target-p2jj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 02:13:20.115474 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:20.115146    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd020b20-feab-4fa9-9ca8-8daccf44b045-kube-api-access-4hzwk podName:cd020b20-feab-4fa9-9ca8-8daccf44b045 nodeName:}" failed. No retries permitted until 2026-09-16 02:13:24.115128463 +0000 UTC m=+9.207310415 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4hzwk" (UniqueName: "kubernetes.io/projected/cd020b20-feab-4fa9-9ca8-8daccf44b045-kube-api-access-4hzwk") pod "network-check-target-p2jj8" (UID: "cd020b20-feab-4fa9-9ca8-8daccf44b045") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 02:13:20.376749 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:20.376667    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2jj8"
Sep 16 02:13:20.376928 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:20.376797    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2jj8" podUID="cd020b20-feab-4fa9-9ca8-8daccf44b045"
Sep 16 02:13:20.376928 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:20.376910    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:13:20.377051 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:20.377032    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b8mm" podUID="df380f84-e4cf-477f-b44f-86c7f533ce9c"
Sep 16 02:13:20.377102 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:20.377059    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:20.377181 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:20.377146    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpfqx" podUID="9360df26-7dcf-4632-b9b1-c3604a98a63e"
Sep 16 02:13:22.376648 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:22.376612    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:22.376648 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:22.376613    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:13:22.377157 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:22.376748    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpfqx" podUID="9360df26-7dcf-4632-b9b1-c3604a98a63e"
Sep 16 02:13:22.377157 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:22.376810    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b8mm" podUID="df380f84-e4cf-477f-b44f-86c7f533ce9c"
Sep 16 02:13:22.377157 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:22.376867    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2jj8"
Sep 16 02:13:22.377157 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:22.376954    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2jj8" podUID="cd020b20-feab-4fa9-9ca8-8daccf44b045"
Sep 16 02:13:24.044907 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:24.044485    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs\") pod \"network-metrics-daemon-2b8mm\" (UID: \"df380f84-e4cf-477f-b44f-86c7f533ce9c\") " pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:13:24.044907 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:24.044547    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9360df26-7dcf-4632-b9b1-c3604a98a63e-original-pull-secret\") pod \"global-pull-secret-syncer-kpfqx\" (UID: \"9360df26-7dcf-4632-b9b1-c3604a98a63e\") " pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:24.044907 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:24.044657    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 02:13:24.044907 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:24.044714    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs podName:df380f84-e4cf-477f-b44f-86c7f533ce9c nodeName:}" failed. No retries permitted until 2026-09-16 02:13:32.044698873 +0000 UTC m=+17.136880829 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs") pod "network-metrics-daemon-2b8mm" (UID: "df380f84-e4cf-477f-b44f-86c7f533ce9c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 02:13:24.044907 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:24.044807    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 02:13:24.044907 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:24.044882    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9360df26-7dcf-4632-b9b1-c3604a98a63e-original-pull-secret podName:9360df26-7dcf-4632-b9b1-c3604a98a63e nodeName:}" failed. No retries permitted until 2026-09-16 02:13:32.044865037 +0000 UTC m=+17.137047005 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9360df26-7dcf-4632-b9b1-c3604a98a63e-original-pull-secret") pod "global-pull-secret-syncer-kpfqx" (UID: "9360df26-7dcf-4632-b9b1-c3604a98a63e") : object "kube-system"/"original-pull-secret" not registered
Sep 16 02:13:24.145274 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:24.145239    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hzwk\" (UniqueName: \"kubernetes.io/projected/cd020b20-feab-4fa9-9ca8-8daccf44b045-kube-api-access-4hzwk\") pod \"network-check-target-p2jj8\" (UID: \"cd020b20-feab-4fa9-9ca8-8daccf44b045\") " pod="openshift-network-diagnostics/network-check-target-p2jj8"
Sep 16 02:13:24.145487 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:24.145398    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 02:13:24.145487 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:24.145413    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 02:13:24.145487 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:24.145426    2581 projected.go:196] Error preparing data for projected volume kube-api-access-4hzwk for pod openshift-network-diagnostics/network-check-target-p2jj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 02:13:24.145487 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:24.145469    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd020b20-feab-4fa9-9ca8-8daccf44b045-kube-api-access-4hzwk podName:cd020b20-feab-4fa9-9ca8-8daccf44b045 nodeName:}" failed. No retries permitted until 2026-09-16 02:13:32.145456849 +0000 UTC m=+17.237638801 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4hzwk" (UniqueName: "kubernetes.io/projected/cd020b20-feab-4fa9-9ca8-8daccf44b045-kube-api-access-4hzwk") pod "network-check-target-p2jj8" (UID: "cd020b20-feab-4fa9-9ca8-8daccf44b045") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 02:13:24.376398 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:24.376319    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:24.376559 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:24.376424    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpfqx" podUID="9360df26-7dcf-4632-b9b1-c3604a98a63e"
Sep 16 02:13:24.376763 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:24.376745    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:13:24.376907 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:24.376823    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b8mm" podUID="df380f84-e4cf-477f-b44f-86c7f533ce9c"
Sep 16 02:13:24.376907 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:24.376879    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2jj8"
Sep 16 02:13:24.376995 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:24.376921    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2jj8" podUID="cd020b20-feab-4fa9-9ca8-8daccf44b045"
Sep 16 02:13:26.376470 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:26.375975    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:13:26.376470 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:26.375993    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2jj8"
Sep 16 02:13:26.376470 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:26.376004    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:26.376470 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:26.376116    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b8mm" podUID="df380f84-e4cf-477f-b44f-86c7f533ce9c"
Sep 16 02:13:26.376470 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:26.376244    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2jj8" podUID="cd020b20-feab-4fa9-9ca8-8daccf44b045"
Sep 16 02:13:26.376470 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:26.376320    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpfqx" podUID="9360df26-7dcf-4632-b9b1-c3604a98a63e"
Sep 16 02:13:28.376515 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:28.376455    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:28.376912 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:28.376460    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2jj8"
Sep 16 02:13:28.376912 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:28.376567    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpfqx" podUID="9360df26-7dcf-4632-b9b1-c3604a98a63e"
Sep 16 02:13:28.376912 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:28.376577    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:13:28.376912 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:28.376686    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2jj8" podUID="cd020b20-feab-4fa9-9ca8-8daccf44b045"
Sep 16 02:13:28.376912 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:28.376771    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b8mm" podUID="df380f84-e4cf-477f-b44f-86c7f533ce9c"
Sep 16 02:13:30.376401 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:30.376362    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:30.377050 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:30.376468    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2jj8"
Sep 16 02:13:30.377050 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:30.376483    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpfqx" podUID="9360df26-7dcf-4632-b9b1-c3604a98a63e"
Sep 16 02:13:30.377050 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:30.376500    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:13:30.377050 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:30.376577    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2jj8" podUID="cd020b20-feab-4fa9-9ca8-8daccf44b045"
Sep 16 02:13:30.377050 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:30.376648    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b8mm" podUID="df380f84-e4cf-477f-b44f-86c7f533ce9c"
Sep 16 02:13:32.105530 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:32.105445    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9360df26-7dcf-4632-b9b1-c3604a98a63e-original-pull-secret\") pod \"global-pull-secret-syncer-kpfqx\" (UID: \"9360df26-7dcf-4632-b9b1-c3604a98a63e\") " pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:32.105530 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:32.105519    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs\") pod \"network-metrics-daemon-2b8mm\" (UID: \"df380f84-e4cf-477f-b44f-86c7f533ce9c\") " pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:13:32.106070 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:32.105613    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 02:13:32.106070 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:32.105632    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 02:13:32.106070 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:32.105688    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9360df26-7dcf-4632-b9b1-c3604a98a63e-original-pull-secret podName:9360df26-7dcf-4632-b9b1-c3604a98a63e nodeName:}" failed. No retries permitted until 2026-09-16 02:13:48.105667598 +0000 UTC m=+33.197849552 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9360df26-7dcf-4632-b9b1-c3604a98a63e-original-pull-secret") pod "global-pull-secret-syncer-kpfqx" (UID: "9360df26-7dcf-4632-b9b1-c3604a98a63e") : object "kube-system"/"original-pull-secret" not registered
Sep 16 02:13:32.106070 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:32.105708    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs podName:df380f84-e4cf-477f-b44f-86c7f533ce9c nodeName:}" failed. No retries permitted until 2026-09-16 02:13:48.105698287 +0000 UTC m=+33.197880243 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs") pod "network-metrics-daemon-2b8mm" (UID: "df380f84-e4cf-477f-b44f-86c7f533ce9c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 02:13:32.206220 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:32.206186    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hzwk\" (UniqueName: \"kubernetes.io/projected/cd020b20-feab-4fa9-9ca8-8daccf44b045-kube-api-access-4hzwk\") pod \"network-check-target-p2jj8\" (UID: \"cd020b20-feab-4fa9-9ca8-8daccf44b045\") " pod="openshift-network-diagnostics/network-check-target-p2jj8"
Sep 16 02:13:32.206368 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:32.206326    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 02:13:32.206368 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:32.206344    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 02:13:32.206368 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:32.206354    2581 projected.go:196] Error preparing data for projected volume kube-api-access-4hzwk for pod openshift-network-diagnostics/network-check-target-p2jj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 02:13:32.206464 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:32.206406    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd020b20-feab-4fa9-9ca8-8daccf44b045-kube-api-access-4hzwk podName:cd020b20-feab-4fa9-9ca8-8daccf44b045 nodeName:}" failed. No retries permitted until 2026-09-16 02:13:48.206389573 +0000 UTC m=+33.298571541 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4hzwk" (UniqueName: "kubernetes.io/projected/cd020b20-feab-4fa9-9ca8-8daccf44b045-kube-api-access-4hzwk") pod "network-check-target-p2jj8" (UID: "cd020b20-feab-4fa9-9ca8-8daccf44b045") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 02:13:32.375879 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:32.375792    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2jj8"
Sep 16 02:13:32.376030 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:32.375792    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:32.376030 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:32.375923    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2jj8" podUID="cd020b20-feab-4fa9-9ca8-8daccf44b045"
Sep 16 02:13:32.376030 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:32.375799    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:13:32.376030 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:32.376011    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpfqx" podUID="9360df26-7dcf-4632-b9b1-c3604a98a63e"
Sep 16 02:13:32.376233 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:32.376084    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b8mm" podUID="df380f84-e4cf-477f-b44f-86c7f533ce9c"
Sep 16 02:13:34.376782 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:34.376737    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:34.377239 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:34.376796    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:13:34.377239 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:34.376828    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2jj8"
Sep 16 02:13:34.377239 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:34.376944    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpfqx" podUID="9360df26-7dcf-4632-b9b1-c3604a98a63e"
Sep 16 02:13:34.377239 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:34.377078    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b8mm" podUID="df380f84-e4cf-477f-b44f-86c7f533ce9c"
Sep 16 02:13:34.377239 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:34.377152    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2jj8" podUID="cd020b20-feab-4fa9-9ca8-8daccf44b045"
Sep 16 02:13:36.376271 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:36.375943    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:36.376956 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:36.375978    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:13:36.376956 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:36.376363    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpfqx" podUID="9360df26-7dcf-4632-b9b1-c3604a98a63e"
Sep 16 02:13:36.376956 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:36.375978    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2jj8"
Sep 16 02:13:36.376956 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:36.376435    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b8mm" podUID="df380f84-e4cf-477f-b44f-86c7f533ce9c"
Sep 16 02:13:36.376956 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:36.376480    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2jj8" podUID="cd020b20-feab-4fa9-9ca8-8daccf44b045"
Sep 16 02:13:36.566415 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:36.566335    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8wndx" event={"ID":"b935ea44-096a-45f1-90b6-f178099dac5f","Type":"ContainerStarted","Data":"41345d7a607f57c3b5c90812dc58883a6892832f07d9820e197e1eefdd8af678"}
Sep 16 02:13:36.567908 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:36.567881    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bbcpb" event={"ID":"aa055700-1ef3-45cc-84a5-a00cc3497637","Type":"ContainerStarted","Data":"42cf120a86b5389eb6d8715a97fdbd2ef2e261f9b6c13bd0fe0d1d23470e7c38"}
Sep 16 02:13:36.569377 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:36.569335    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9xppl" event={"ID":"eb4b6a80-8661-4a62-afb8-e616fadbae27","Type":"ContainerStarted","Data":"63c13ad86853cf9090f566f5d0d293396e391ff5b906d532b155f00e301a2608"}
Sep 16 02:13:36.570728 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:36.570704    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-191.ec2.internal" event={"ID":"c33b9c404b3f92df51af027eb114ba62","Type":"ContainerStarted","Data":"5e7b8dc3117b7c3f52e7ce55bc48fced84a64a7247bcbeb8c6511c9702148955"}
Sep 16 02:13:36.572319 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:36.572296    2581 generic.go:356] "Generic (PLEG): container finished" podID="c7cab88e-5476-42c4-9458-bbbfa5a6848b" containerID="b6e4d7bd0c91184878d92200ebf5fd513da34c88c0e78d0194371ceee1d2284a" exitCode=0
Sep 16 02:13:36.572405 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:36.572374    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6tp4r" event={"ID":"c7cab88e-5476-42c4-9458-bbbfa5a6848b","Type":"ContainerDied","Data":"b6e4d7bd0c91184878d92200ebf5fd513da34c88c0e78d0194371ceee1d2284a"}
Sep 16 02:13:36.574007 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:36.573989    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4wfvw" event={"ID":"1a264618-840c-4828-8f10-c07e91c9d4f0","Type":"ContainerStarted","Data":"df3f51404551f0643404f23b2ee97f46b2fabf0323573043c48cb16cff5e2ec2"}
Sep 16 02:13:36.575886 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:36.575828    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82ssl" event={"ID":"7ee22301-74a6-440b-8e16-cab47ce7107c","Type":"ContainerStarted","Data":"0a80b376a638e91f8cd9416b369255e599f43522fad077d91f52190b9283950e"}
Sep 16 02:13:36.577182 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:36.577164    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d8z97" event={"ID":"ffcfd279-8633-452e-8c03-079e0618893d","Type":"ContainerStarted","Data":"294eccdc87336e06b84813eea7602a9a4a32c6e20288a9630d31d8e052368e05"}
Sep 16 02:13:36.578655 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:36.578635    2581 generic.go:356] "Generic (PLEG): container finished" podID="dcc129ffe7ff05689defbf8c29a04ab8" containerID="957c82e273f89c92c09cfa3e8f354fd4fbf612b87ecde524113d40d451aa83f5" exitCode=0
Sep 16 02:13:36.578748 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:36.578678    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-191.ec2.internal" event={"ID":"dcc129ffe7ff05689defbf8c29a04ab8","Type":"ContainerDied","Data":"957c82e273f89c92c09cfa3e8f354fd4fbf612b87ecde524113d40d451aa83f5"}
Sep 16 02:13:36.579726 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:36.579185    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8wndx" podStartSLOduration=2.661393158 podStartE2EDuration="21.579161837s" totalImagesPullingTime="18.917768679s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 02:13:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:13:36.578657564 +0000 UTC m=+21.670839540" watchObservedRunningTime="2026-09-16 02:13:36.579161837 +0000 UTC m=+21.671343811"
Sep 16 02:13:36.581475 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:36.581460    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g54gh_308f30e2-2871-442a-ba30-54ada02ad832/ovn-acl-logging/0.log"
Sep 16 02:13:36.581807 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:36.581791    2581 generic.go:356] "Generic (PLEG): container finished" podID="308f30e2-2871-442a-ba30-54ada02ad832" containerID="867b2c57efa6c429e1b896c65007fbae223fc13f86c98453616ee36eca3a0a2a" exitCode=1
Sep 16 02:13:36.581896 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:36.581819    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g54gh" event={"ID":"308f30e2-2871-442a-ba30-54ada02ad832","Type":"ContainerStarted","Data":"10ff555bb39f576e8fad2fdf2a5db2b27e831545aceccca647923fb4a13b13c3"}
Sep 16 02:13:36.581951 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:36.581909    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g54gh" event={"ID":"308f30e2-2871-442a-ba30-54ada02ad832","Type":"ContainerStarted","Data":"a2d9c9ba0a6e5e6bc873bba04c06af37b0c238bbd2ef186c9a78cbb4562a0c8b"}
Sep 16 02:13:36.582011 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:36.581964    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g54gh" event={"ID":"308f30e2-2871-442a-ba30-54ada02ad832","Type":"ContainerStarted","Data":"c2a8213d3cf81c66c74af1f13056aa717c71e1335f188270002cdcc35717bf98"}
Sep 16 02:13:36.582065 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:36.582012    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g54gh" event={"ID":"308f30e2-2871-442a-ba30-54ada02ad832","Type":"ContainerStarted","Data":"040152042e4e6b6a52ded5e9b08e191e59ef9f6b94d8675ea98097a6bd30cfb6"}
Sep 16 02:13:36.582065 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:36.582061    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g54gh" event={"ID":"308f30e2-2871-442a-ba30-54ada02ad832","Type":"ContainerDied","Data":"867b2c57efa6c429e1b896c65007fbae223fc13f86c98453616ee36eca3a0a2a"}
Sep 16 02:13:36.582157 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:36.582111    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g54gh" event={"ID":"308f30e2-2871-442a-ba30-54ada02ad832","Type":"ContainerStarted","Data":"dfdc860e44e399c81d884b1f9e0154db501627c4fd90fb5f7760d34f16a66409"}
Sep 16 02:13:36.594720 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:36.594687    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9xppl" podStartSLOduration=2.612587025 podStartE2EDuration="21.594675104s" totalImagesPullingTime="18.982088079s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 02:13:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:13:36.594501102 +0000 UTC m=+21.686683076" watchObservedRunningTime="2026-09-16 02:13:36.594675104 +0000 UTC m=+21.686857077"
Sep 16 02:13:36.611024 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:36.610989    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bbcpb" podStartSLOduration=2.659137722 podStartE2EDuration="21.610977433s" totalImagesPullingTime="18.951839711s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 02:13:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:13:36.610749028 +0000 UTC m=+21.702931003" watchObservedRunningTime="2026-09-16 02:13:36.610977433 +0000 UTC m=+21.703159408"
Sep 16 02:13:36.641349 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:36.641311    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-191.ec2.internal" podStartSLOduration=20.64129617 podStartE2EDuration="20.64129617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 02:13:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:13:36.641259747 +0000 UTC m=+21.733441723" watchObservedRunningTime="2026-09-16 02:13:36.64129617 +0000 UTC m=+21.733478145"
Sep 16 02:13:36.666658 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:36.666622    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-d8z97" podStartSLOduration=6.620713349 podStartE2EDuration="21.666608532s" totalImagesPullingTime="15.045895183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:13:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:13:36.666354867 +0000 UTC m=+21.758536840" watchObservedRunningTime="2026-09-16 02:13:36.666608532 +0000 UTC m=+21.758790505"
Sep 16 02:13:36.683412 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:36.683378    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4wfvw" podStartSLOduration=2.283553126 podStartE2EDuration="21.683366048s" totalImagesPullingTime="19.399812922s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 02:13:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:13:36.683093044 +0000 UTC m=+21.775275020" watchObservedRunningTime="2026-09-16 02:13:36.683366048 +0000 UTC m=+21.775548022"
Sep 16 02:13:37.140006 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:37.139860    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 16 02:13:37.342596 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:37.342446    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-16T02:13:37.14000272Z","UUID":"70f03c64-fff0-452a-bac4-bb3281647b18","Handler":null,"Name":"","Endpoint":""}
Sep 16 02:13:37.343883 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:37.343865    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 16 02:13:37.344005 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:37.343897    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 16 02:13:37.585816 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:37.585782    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82ssl" event={"ID":"7ee22301-74a6-440b-8e16-cab47ce7107c","Type":"ContainerStarted","Data":"0750aa14858ca625c9a06f4334841e4951831c71c1a688a0118ca8abf6528d6b"}
Sep 16 02:13:37.588034 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:37.588006    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-191.ec2.internal" event={"ID":"dcc129ffe7ff05689defbf8c29a04ab8","Type":"ContainerStarted","Data":"7d19ecabc449182e6c2cdea85cfa7a10858b7eb0cfa2eec48010bee310cd4412"}
Sep 16 02:13:37.589601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:37.589574    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5d9gv" event={"ID":"cd4dde1b-5e31-44c0-92d4-625820ec7969","Type":"ContainerStarted","Data":"7d0dddc79fd3eb7aec240f168d3ee92ab9e461d173bab11e67341c1019924ce9"}
Sep 16 02:13:37.603509 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:37.603436    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-191.ec2.internal" podStartSLOduration=21.603420207 podStartE2EDuration="21.603420207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 02:13:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:13:37.602998986 +0000 UTC m=+22.695180951" watchObservedRunningTime="2026-09-16 02:13:37.603420207 +0000 UTC m=+22.695602164"
Sep 16 02:13:37.615815 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:37.615776    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5d9gv" podStartSLOduration=3.739270104 podStartE2EDuration="22.615764451s" totalImagesPullingTime="18.876494347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 02:13:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:13:37.615762096 +0000 UTC m=+22.707944068" watchObservedRunningTime="2026-09-16 02:13:37.615764451 +0000 UTC m=+22.707946424"
Sep 16 02:13:38.376047 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:38.375981    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:38.376173 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:38.376069    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2jj8"
Sep 16 02:13:38.376173 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:38.376070    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpfqx" podUID="9360df26-7dcf-4632-b9b1-c3604a98a63e"
Sep 16 02:13:38.376173 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:38.376074    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:13:38.376173 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:38.376151    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2jj8" podUID="cd020b20-feab-4fa9-9ca8-8daccf44b045"
Sep 16 02:13:38.376296 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:38.376237    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b8mm" podUID="df380f84-e4cf-477f-b44f-86c7f533ce9c"
Sep 16 02:13:38.594356 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:38.594325    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82ssl" event={"ID":"7ee22301-74a6-440b-8e16-cab47ce7107c","Type":"ContainerStarted","Data":"ae878ed44efb41e36d6592c8cb5eba216808348b6c5dfd14b8451daa4c8e05fe"}
Sep 16 02:13:38.597469 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:38.597449    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g54gh_308f30e2-2871-442a-ba30-54ada02ad832/ovn-acl-logging/0.log"
Sep 16 02:13:38.597898 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:38.597878    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g54gh" event={"ID":"308f30e2-2871-442a-ba30-54ada02ad832","Type":"ContainerStarted","Data":"5ecbcc05d09e99533b70569f792a11fbd3f36993fa8454bdfe725fa5d7ede872"}
Sep 16 02:13:38.609524 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:38.609484    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-82ssl" podStartSLOduration=2.911733062 podStartE2EDuration="23.6094739s" totalImagesPullingTime="20.697740838s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 02:13:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:13:38.609371915 +0000 UTC m=+23.701553890" watchObservedRunningTime="2026-09-16 02:13:38.6094739 +0000 UTC m=+23.701655872"
Sep 16 02:13:40.376121 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:40.376086    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:13:40.376585 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:40.376086    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2jj8"
Sep 16 02:13:40.376585 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:40.376217    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b8mm" podUID="df380f84-e4cf-477f-b44f-86c7f533ce9c"
Sep 16 02:13:40.376585 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:40.376271    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2jj8" podUID="cd020b20-feab-4fa9-9ca8-8daccf44b045"
Sep 16 02:13:40.376585 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:40.376084    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:40.376585 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:40.376337    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpfqx" podUID="9360df26-7dcf-4632-b9b1-c3604a98a63e"
Sep 16 02:13:40.729873 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:40.729785    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-d8z97"
Sep 16 02:13:40.730389 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:40.730366    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-d8z97"
Sep 16 02:13:41.609291 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:41.609124    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g54gh_308f30e2-2871-442a-ba30-54ada02ad832/ovn-acl-logging/0.log"
Sep 16 02:13:41.610341 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:41.609650    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g54gh" event={"ID":"308f30e2-2871-442a-ba30-54ada02ad832","Type":"ContainerStarted","Data":"1ed2f9b94ca80b65256a289eb15c9cdba984a3b9ae97f7776304a7ea92c186a0"}
Sep 16 02:13:41.610341 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:41.610126    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-d8z97"
Sep 16 02:13:41.610341 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:41.610150    2581 scope.go:117] "RemoveContainer" containerID="867b2c57efa6c429e1b896c65007fbae223fc13f86c98453616ee36eca3a0a2a"
Sep 16 02:13:41.610341 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:41.610176    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:41.610341 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:41.610240    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:41.610341 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:41.610291    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:41.610955 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:41.610375    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-d8z97"
Sep 16 02:13:41.632474 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:41.631157    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:41.632474 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:41.632370    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:13:42.375974 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:42.375796    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:42.376129 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:42.375804    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:13:42.376129 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:42.376066    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpfqx" podUID="9360df26-7dcf-4632-b9b1-c3604a98a63e"
Sep 16 02:13:42.376129 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:42.375842    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2jj8"
Sep 16 02:13:42.376285 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:42.376124    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b8mm" podUID="df380f84-e4cf-477f-b44f-86c7f533ce9c"
Sep 16 02:13:42.376285 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:42.376211    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2jj8" podUID="cd020b20-feab-4fa9-9ca8-8daccf44b045"
Sep 16 02:13:42.615606 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:42.615557    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g54gh_308f30e2-2871-442a-ba30-54ada02ad832/ovn-acl-logging/0.log"
Sep 16 02:13:42.616046 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:42.615956    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g54gh" event={"ID":"308f30e2-2871-442a-ba30-54ada02ad832","Type":"ContainerStarted","Data":"791aa04f5ea3481aec679d8a5bb83df21e8c2b424e59f15a9a4b0b5fd0ff76e6"}
Sep 16 02:13:42.617744 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:42.617720    2581 generic.go:356] "Generic (PLEG): container finished" podID="c7cab88e-5476-42c4-9458-bbbfa5a6848b" containerID="b72d95b68ca2458cd002d4a815cdc02035f4bdb630b0dcfdf7d867e6dd55c0a7" exitCode=0
Sep 16 02:13:42.617842 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:42.617790    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6tp4r" event={"ID":"c7cab88e-5476-42c4-9458-bbbfa5a6848b","Type":"ContainerDied","Data":"b72d95b68ca2458cd002d4a815cdc02035f4bdb630b0dcfdf7d867e6dd55c0a7"}
Sep 16 02:13:42.639778 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:42.639704    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-g54gh" podStartSLOduration=8.742662462 podStartE2EDuration="27.639691057s" totalImagesPullingTime="18.897028595s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 02:13:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:13:42.638440345 +0000 UTC m=+27.730622320" watchObservedRunningTime="2026-09-16 02:13:42.639691057 +0000 UTC m=+27.731873031"
Sep 16 02:13:43.486102 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:43.486073    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p2jj8"]
Sep 16 02:13:43.486240 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:43.486181    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2jj8"
Sep 16 02:13:43.486278 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:43.486265    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2jj8" podUID="cd020b20-feab-4fa9-9ca8-8daccf44b045"
Sep 16 02:13:43.488783 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:43.488747    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2b8mm"]
Sep 16 02:13:43.488922 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:43.488880    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:13:43.488995 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:43.488979    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b8mm" podUID="df380f84-e4cf-477f-b44f-86c7f533ce9c"
Sep 16 02:13:43.489348 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:43.489318    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kpfqx"]
Sep 16 02:13:43.489414 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:43.489405    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:43.489503 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:43.489483    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpfqx" podUID="9360df26-7dcf-4632-b9b1-c3604a98a63e"
Sep 16 02:13:44.625052 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:44.624780    2581 generic.go:356] "Generic (PLEG): container finished" podID="c7cab88e-5476-42c4-9458-bbbfa5a6848b" containerID="84e31df84b0b785265fa241a2c1c1fc6d04d1d07022dbb289b0f181e34d9d25d" exitCode=0
Sep 16 02:13:44.625624 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:44.624842    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6tp4r" event={"ID":"c7cab88e-5476-42c4-9458-bbbfa5a6848b","Type":"ContainerDied","Data":"84e31df84b0b785265fa241a2c1c1fc6d04d1d07022dbb289b0f181e34d9d25d"}
Sep 16 02:13:45.377478 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:45.377449    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:13:45.377648 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:45.377543    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2jj8"
Sep 16 02:13:45.377648 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:45.377570    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:45.377648 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:45.377605    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b8mm" podUID="df380f84-e4cf-477f-b44f-86c7f533ce9c"
Sep 16 02:13:45.377792 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:45.377646    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpfqx" podUID="9360df26-7dcf-4632-b9b1-c3604a98a63e"
Sep 16 02:13:45.377792 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:45.377697    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2jj8" podUID="cd020b20-feab-4fa9-9ca8-8daccf44b045"
Sep 16 02:13:45.629304 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:45.629275    2581 generic.go:356] "Generic (PLEG): container finished" podID="c7cab88e-5476-42c4-9458-bbbfa5a6848b" containerID="c57a17a3e115287888e7db190fcfe5a11c0a1de4783838a28f92a083308dafe6" exitCode=0
Sep 16 02:13:45.629670 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:45.629312    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6tp4r" event={"ID":"c7cab88e-5476-42c4-9458-bbbfa5a6848b","Type":"ContainerDied","Data":"c57a17a3e115287888e7db190fcfe5a11c0a1de4783838a28f92a083308dafe6"}
Sep 16 02:13:47.376269 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:47.376240    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:13:47.376784 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:47.376288    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2jj8"
Sep 16 02:13:47.376784 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:47.376381    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b8mm" podUID="df380f84-e4cf-477f-b44f-86c7f533ce9c"
Sep 16 02:13:47.376784 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:47.376489    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2jj8" podUID="cd020b20-feab-4fa9-9ca8-8daccf44b045"
Sep 16 02:13:47.376784 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:47.376548    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:47.376784 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:47.376611    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpfqx" podUID="9360df26-7dcf-4632-b9b1-c3604a98a63e"
Sep 16 02:13:47.694145 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:47.694081    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-191.ec2.internal" event="NodeReady"
Sep 16 02:13:47.694326 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:47.694187    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 16 02:13:47.731719 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:47.731687    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qz6zp"]
Sep 16 02:13:47.814278 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:47.814210    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-65nfk"]
Sep 16 02:13:47.814546 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:47.814353    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qz6zp"
Sep 16 02:13:47.816832 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:47.816809    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 16 02:13:47.816961 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:47.816925    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h6q9g\""
Sep 16 02:13:47.817128 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:47.817105    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 16 02:13:47.822994 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:47.822974    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qz6zp"]
Sep 16 02:13:47.823114 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:47.823093    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-65nfk"
Sep 16 02:13:47.823199 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:47.823010    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-65nfk"]
Sep 16 02:13:47.825327 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:47.825308    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 16 02:13:47.825920 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:47.825693    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lfqpp\""
Sep 16 02:13:47.828835 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:47.826007    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 16 02:13:47.828835 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:47.826071    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 16 02:13:47.922552 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:47.922524    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcfd4\" (UniqueName: \"kubernetes.io/projected/d8b0c607-1644-4679-8b1d-be6926f44c81-kube-api-access-rcfd4\") pod \"dns-default-qz6zp\" (UID: \"d8b0c607-1644-4679-8b1d-be6926f44c81\") " pod="openshift-dns/dns-default-qz6zp"
Sep 16 02:13:47.922552 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:47.922559    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4fz9\" (UniqueName: \"kubernetes.io/projected/2178372a-7491-487a-881a-14567383f283-kube-api-access-f4fz9\") pod \"ingress-canary-65nfk\" (UID: \"2178372a-7491-487a-881a-14567383f283\") " pod="openshift-ingress-canary/ingress-canary-65nfk"
Sep 16 02:13:47.922727 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:47.922577    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2178372a-7491-487a-881a-14567383f283-cert\") pod \"ingress-canary-65nfk\" (UID: \"2178372a-7491-487a-881a-14567383f283\") " pod="openshift-ingress-canary/ingress-canary-65nfk"
Sep 16 02:13:47.922727 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:47.922604    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8b0c607-1644-4679-8b1d-be6926f44c81-metrics-tls\") pod \"dns-default-qz6zp\" (UID: \"d8b0c607-1644-4679-8b1d-be6926f44c81\") " pod="openshift-dns/dns-default-qz6zp"
Sep 16 02:13:47.922727 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:47.922668    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d8b0c607-1644-4679-8b1d-be6926f44c81-config-volume\") pod \"dns-default-qz6zp\" (UID: \"d8b0c607-1644-4679-8b1d-be6926f44c81\") " pod="openshift-dns/dns-default-qz6zp"
Sep 16 02:13:47.922727 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:47.922695    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8b0c607-1644-4679-8b1d-be6926f44c81-tmp-dir\") pod \"dns-default-qz6zp\" (UID: \"d8b0c607-1644-4679-8b1d-be6926f44c81\") " pod="openshift-dns/dns-default-qz6zp"
Sep 16 02:13:48.023893 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:48.023810    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcfd4\" (UniqueName: \"kubernetes.io/projected/d8b0c607-1644-4679-8b1d-be6926f44c81-kube-api-access-rcfd4\") pod \"dns-default-qz6zp\" (UID: \"d8b0c607-1644-4679-8b1d-be6926f44c81\") " pod="openshift-dns/dns-default-qz6zp"
Sep 16 02:13:48.023893 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:48.023860    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4fz9\" (UniqueName: \"kubernetes.io/projected/2178372a-7491-487a-881a-14567383f283-kube-api-access-f4fz9\") pod \"ingress-canary-65nfk\" (UID: \"2178372a-7491-487a-881a-14567383f283\") " pod="openshift-ingress-canary/ingress-canary-65nfk"
Sep 16 02:13:48.023893 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:48.023883    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2178372a-7491-487a-881a-14567383f283-cert\") pod \"ingress-canary-65nfk\" (UID: \"2178372a-7491-487a-881a-14567383f283\") " pod="openshift-ingress-canary/ingress-canary-65nfk"
Sep 16 02:13:48.024083 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:48.024024    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8b0c607-1644-4679-8b1d-be6926f44c81-metrics-tls\") pod \"dns-default-qz6zp\" (UID: \"d8b0c607-1644-4679-8b1d-be6926f44c81\") " pod="openshift-dns/dns-default-qz6zp"
Sep 16 02:13:48.024083 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:48.024074    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d8b0c607-1644-4679-8b1d-be6926f44c81-config-volume\") pod \"dns-default-qz6zp\" (UID: \"d8b0c607-1644-4679-8b1d-be6926f44c81\") " pod="openshift-dns/dns-default-qz6zp"
Sep 16 02:13:48.024177 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:48.024156    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 02:13:48.024231 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:48.024220    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8b0c607-1644-4679-8b1d-be6926f44c81-metrics-tls podName:d8b0c607-1644-4679-8b1d-be6926f44c81 nodeName:}" failed. No retries permitted until 2026-09-16 02:13:48.524204436 +0000 UTC m=+33.616386387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8b0c607-1644-4679-8b1d-be6926f44c81-metrics-tls") pod "dns-default-qz6zp" (UID: "d8b0c607-1644-4679-8b1d-be6926f44c81") : secret "dns-default-metrics-tls" not found
Sep 16 02:13:48.024276 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:48.024252    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8b0c607-1644-4679-8b1d-be6926f44c81-tmp-dir\") pod \"dns-default-qz6zp\" (UID: \"d8b0c607-1644-4679-8b1d-be6926f44c81\") " pod="openshift-dns/dns-default-qz6zp"
Sep 16 02:13:48.024532 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:48.024515    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8b0c607-1644-4679-8b1d-be6926f44c81-tmp-dir\") pod \"dns-default-qz6zp\" (UID: \"d8b0c607-1644-4679-8b1d-be6926f44c81\") " pod="openshift-dns/dns-default-qz6zp"
Sep 16 02:13:48.024645 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:48.024630    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d8b0c607-1644-4679-8b1d-be6926f44c81-config-volume\") pod \"dns-default-qz6zp\" (UID: \"d8b0c607-1644-4679-8b1d-be6926f44c81\") " pod="openshift-dns/dns-default-qz6zp"
Sep 16 02:13:48.028183 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:48.028165    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2178372a-7491-487a-881a-14567383f283-cert\") pod \"ingress-canary-65nfk\" (UID: \"2178372a-7491-487a-881a-14567383f283\") " pod="openshift-ingress-canary/ingress-canary-65nfk"
Sep 16 02:13:48.031502 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:48.031484    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcfd4\" (UniqueName: \"kubernetes.io/projected/d8b0c607-1644-4679-8b1d-be6926f44c81-kube-api-access-rcfd4\") pod \"dns-default-qz6zp\" (UID: \"d8b0c607-1644-4679-8b1d-be6926f44c81\") " pod="openshift-dns/dns-default-qz6zp"
Sep 16 02:13:48.031833 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:48.031817    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4fz9\" (UniqueName: \"kubernetes.io/projected/2178372a-7491-487a-881a-14567383f283-kube-api-access-f4fz9\") pod \"ingress-canary-65nfk\" (UID: \"2178372a-7491-487a-881a-14567383f283\") " pod="openshift-ingress-canary/ingress-canary-65nfk"
Sep 16 02:13:48.124896 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:48.124865    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9360df26-7dcf-4632-b9b1-c3604a98a63e-original-pull-secret\") pod \"global-pull-secret-syncer-kpfqx\" (UID: \"9360df26-7dcf-4632-b9b1-c3604a98a63e\") " pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:48.125053 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:48.124942    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs\") pod \"network-metrics-daemon-2b8mm\" (UID: \"df380f84-e4cf-477f-b44f-86c7f533ce9c\") " pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:13:48.125053 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:48.125044    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 02:13:48.125130 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:48.125091    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs podName:df380f84-e4cf-477f-b44f-86c7f533ce9c nodeName:}" failed. No retries permitted until 2026-09-16 02:14:20.125077145 +0000 UTC m=+65.217259097 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs") pod "network-metrics-daemon-2b8mm" (UID: "df380f84-e4cf-477f-b44f-86c7f533ce9c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 02:13:48.125282 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:48.125258    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 02:13:48.125394 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:48.125317    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9360df26-7dcf-4632-b9b1-c3604a98a63e-original-pull-secret podName:9360df26-7dcf-4632-b9b1-c3604a98a63e nodeName:}" failed. No retries permitted until 2026-09-16 02:14:20.125302866 +0000 UTC m=+65.217484818 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9360df26-7dcf-4632-b9b1-c3604a98a63e-original-pull-secret") pod "global-pull-secret-syncer-kpfqx" (UID: "9360df26-7dcf-4632-b9b1-c3604a98a63e") : object "kube-system"/"original-pull-secret" not registered
Sep 16 02:13:48.134056 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:48.134032    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-65nfk"
Sep 16 02:13:48.226111 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:48.226072    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hzwk\" (UniqueName: \"kubernetes.io/projected/cd020b20-feab-4fa9-9ca8-8daccf44b045-kube-api-access-4hzwk\") pod \"network-check-target-p2jj8\" (UID: \"cd020b20-feab-4fa9-9ca8-8daccf44b045\") " pod="openshift-network-diagnostics/network-check-target-p2jj8"
Sep 16 02:13:48.226274 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:48.226213    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 02:13:48.226274 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:48.226232    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 02:13:48.226274 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:48.226244    2581 projected.go:196] Error preparing data for projected volume kube-api-access-4hzwk for pod openshift-network-diagnostics/network-check-target-p2jj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 02:13:48.226395 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:48.226299    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd020b20-feab-4fa9-9ca8-8daccf44b045-kube-api-access-4hzwk podName:cd020b20-feab-4fa9-9ca8-8daccf44b045 nodeName:}" failed. No retries permitted until 2026-09-16 02:14:20.226284035 +0000 UTC m=+65.318465992 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4hzwk" (UniqueName: "kubernetes.io/projected/cd020b20-feab-4fa9-9ca8-8daccf44b045-kube-api-access-4hzwk") pod "network-check-target-p2jj8" (UID: "cd020b20-feab-4fa9-9ca8-8daccf44b045") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 02:13:48.460676 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:48.460603    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-65nfk"]
Sep 16 02:13:48.465034 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:13:48.464998    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2178372a_7491_487a_881a_14567383f283.slice/crio-61e01551b3d7241befe9c56f9a3c0ee030675bbf328de58d54756aae24d0dd2e WatchSource:0}: Error finding container 61e01551b3d7241befe9c56f9a3c0ee030675bbf328de58d54756aae24d0dd2e: Status 404 returned error can't find the container with id 61e01551b3d7241befe9c56f9a3c0ee030675bbf328de58d54756aae24d0dd2e
Sep 16 02:13:48.528140 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:48.527995    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8b0c607-1644-4679-8b1d-be6926f44c81-metrics-tls\") pod \"dns-default-qz6zp\" (UID: \"d8b0c607-1644-4679-8b1d-be6926f44c81\") " pod="openshift-dns/dns-default-qz6zp"
Sep 16 02:13:48.528140 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:48.528132    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 02:13:48.528250 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:48.528197    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8b0c607-1644-4679-8b1d-be6926f44c81-metrics-tls podName:d8b0c607-1644-4679-8b1d-be6926f44c81 nodeName:}" failed. No retries permitted until 2026-09-16 02:13:49.52818183 +0000 UTC m=+34.620363782 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8b0c607-1644-4679-8b1d-be6926f44c81-metrics-tls") pod "dns-default-qz6zp" (UID: "d8b0c607-1644-4679-8b1d-be6926f44c81") : secret "dns-default-metrics-tls" not found
Sep 16 02:13:48.638064 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:48.638031    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-65nfk" event={"ID":"2178372a-7491-487a-881a-14567383f283","Type":"ContainerStarted","Data":"61e01551b3d7241befe9c56f9a3c0ee030675bbf328de58d54756aae24d0dd2e"}
Sep 16 02:13:49.376297 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:49.376260    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:13:49.376467 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:49.376260    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:13:49.376540 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:49.376473    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2jj8"
Sep 16 02:13:49.379540 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:49.379520    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ksfsh\""
Sep 16 02:13:49.379822 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:49.379802    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 02:13:49.380033 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:49.380019    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 02:13:49.380192 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:49.380174    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 02:13:49.380368 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:49.380348    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 02:13:49.380541 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:49.380525    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2ht6m\""
Sep 16 02:13:49.535788 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:49.535754    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8b0c607-1644-4679-8b1d-be6926f44c81-metrics-tls\") pod \"dns-default-qz6zp\" (UID: \"d8b0c607-1644-4679-8b1d-be6926f44c81\") " pod="openshift-dns/dns-default-qz6zp"
Sep 16 02:13:49.536153 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:49.535884    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 02:13:49.536153 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:49.535947    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8b0c607-1644-4679-8b1d-be6926f44c81-metrics-tls podName:d8b0c607-1644-4679-8b1d-be6926f44c81 nodeName:}" failed. No retries permitted until 2026-09-16 02:13:51.535931289 +0000 UTC m=+36.628113241 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8b0c607-1644-4679-8b1d-be6926f44c81-metrics-tls") pod "dns-default-qz6zp" (UID: "d8b0c607-1644-4679-8b1d-be6926f44c81") : secret "dns-default-metrics-tls" not found
Sep 16 02:13:50.647054 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:50.647023    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6tp4r" event={"ID":"c7cab88e-5476-42c4-9458-bbbfa5a6848b","Type":"ContainerStarted","Data":"fbdd79ebc7723b204b9a073fd7fd850e9e9035993813ad7d473ba420269e8fd8"}
Sep 16 02:13:51.550472 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:51.550437    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8b0c607-1644-4679-8b1d-be6926f44c81-metrics-tls\") pod \"dns-default-qz6zp\" (UID: \"d8b0c607-1644-4679-8b1d-be6926f44c81\") " pod="openshift-dns/dns-default-qz6zp"
Sep 16 02:13:51.550652 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:51.550557    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 02:13:51.550652 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:51.550607    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8b0c607-1644-4679-8b1d-be6926f44c81-metrics-tls podName:d8b0c607-1644-4679-8b1d-be6926f44c81 nodeName:}" failed. No retries permitted until 2026-09-16 02:13:55.550594746 +0000 UTC m=+40.642776698 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8b0c607-1644-4679-8b1d-be6926f44c81-metrics-tls") pod "dns-default-qz6zp" (UID: "d8b0c607-1644-4679-8b1d-be6926f44c81") : secret "dns-default-metrics-tls" not found
Sep 16 02:13:51.657691 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:51.657655    2581 generic.go:356] "Generic (PLEG): container finished" podID="c7cab88e-5476-42c4-9458-bbbfa5a6848b" containerID="fbdd79ebc7723b204b9a073fd7fd850e9e9035993813ad7d473ba420269e8fd8" exitCode=0
Sep 16 02:13:51.658142 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:51.657721    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6tp4r" event={"ID":"c7cab88e-5476-42c4-9458-bbbfa5a6848b","Type":"ContainerDied","Data":"fbdd79ebc7723b204b9a073fd7fd850e9e9035993813ad7d473ba420269e8fd8"}
Sep 16 02:13:52.662602 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:52.662570    2581 generic.go:356] "Generic (PLEG): container finished" podID="c7cab88e-5476-42c4-9458-bbbfa5a6848b" containerID="a56bdc1896ab688edad0a6fe9a3d92edacbcaa70277e64564e397c9a7edbe9be" exitCode=0
Sep 16 02:13:52.663017 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:52.662626    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6tp4r" event={"ID":"c7cab88e-5476-42c4-9458-bbbfa5a6848b","Type":"ContainerDied","Data":"a56bdc1896ab688edad0a6fe9a3d92edacbcaa70277e64564e397c9a7edbe9be"}
Sep 16 02:13:53.666619 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:53.666585    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-65nfk" event={"ID":"2178372a-7491-487a-881a-14567383f283","Type":"ContainerStarted","Data":"e91b2efe8687c7fa1e0b1e05b8b09dcaaa0baedcb2170441a513d904e0c40192"}
Sep 16 02:13:53.670074 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:53.670046    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6tp4r" event={"ID":"c7cab88e-5476-42c4-9458-bbbfa5a6848b","Type":"ContainerStarted","Data":"a72147d2c7261d0e5f5f3424818bf6d63b16eb0bd06da22ca571aea0d47f046b"}
Sep 16 02:13:53.680230 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:53.680108    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-65nfk" podStartSLOduration=2.465118246 podStartE2EDuration="6.680090703s" totalImagesPullingTime="4.214972457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:13:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:13:53.679559321 +0000 UTC m=+38.771741311" watchObservedRunningTime="2026-09-16 02:13:53.680090703 +0000 UTC m=+38.772272674"
Sep 16 02:13:53.697441 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:53.697393    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6tp4r" podStartSLOduration=8.329917814 podStartE2EDuration="38.697375831s" totalImagesPullingTime="30.367458017s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 02:13:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:13:53.696224278 +0000 UTC m=+38.788406253" watchObservedRunningTime="2026-09-16 02:13:53.697375831 +0000 UTC m=+38.789557807"
Sep 16 02:13:55.578759 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:13:55.578725    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8b0c607-1644-4679-8b1d-be6926f44c81-metrics-tls\") pod \"dns-default-qz6zp\" (UID: \"d8b0c607-1644-4679-8b1d-be6926f44c81\") " pod="openshift-dns/dns-default-qz6zp"
Sep 16 02:13:55.579132 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:55.578878    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 02:13:55.579132 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:13:55.578935    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8b0c607-1644-4679-8b1d-be6926f44c81-metrics-tls podName:d8b0c607-1644-4679-8b1d-be6926f44c81 nodeName:}" failed. No retries permitted until 2026-09-16 02:14:03.578920135 +0000 UTC m=+48.671102088 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8b0c607-1644-4679-8b1d-be6926f44c81-metrics-tls") pod "dns-default-qz6zp" (UID: "d8b0c607-1644-4679-8b1d-be6926f44c81") : secret "dns-default-metrics-tls" not found
Sep 16 02:14:03.627063 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:03.627020    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8b0c607-1644-4679-8b1d-be6926f44c81-metrics-tls\") pod \"dns-default-qz6zp\" (UID: \"d8b0c607-1644-4679-8b1d-be6926f44c81\") " pod="openshift-dns/dns-default-qz6zp"
Sep 16 02:14:03.627489 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:14:03.627181    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 02:14:03.627489 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:14:03.627243    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8b0c607-1644-4679-8b1d-be6926f44c81-metrics-tls podName:d8b0c607-1644-4679-8b1d-be6926f44c81 nodeName:}" failed. No retries permitted until 2026-09-16 02:14:19.627228234 +0000 UTC m=+64.719410187 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8b0c607-1644-4679-8b1d-be6926f44c81-metrics-tls") pod "dns-default-qz6zp" (UID: "d8b0c607-1644-4679-8b1d-be6926f44c81") : secret "dns-default-metrics-tls" not found
Sep 16 02:14:13.630594 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:13.630566    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g54gh"
Sep 16 02:14:19.727078 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:19.727036    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8b0c607-1644-4679-8b1d-be6926f44c81-metrics-tls\") pod \"dns-default-qz6zp\" (UID: \"d8b0c607-1644-4679-8b1d-be6926f44c81\") " pod="openshift-dns/dns-default-qz6zp"
Sep 16 02:14:19.727576 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:14:19.727143    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 02:14:19.727576 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:14:19.727213    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8b0c607-1644-4679-8b1d-be6926f44c81-metrics-tls podName:d8b0c607-1644-4679-8b1d-be6926f44c81 nodeName:}" failed. No retries permitted until 2026-09-16 02:14:51.727197514 +0000 UTC m=+96.819379466 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8b0c607-1644-4679-8b1d-be6926f44c81-metrics-tls") pod "dns-default-qz6zp" (UID: "d8b0c607-1644-4679-8b1d-be6926f44c81") : secret "dns-default-metrics-tls" not found
Sep 16 02:14:20.130516 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:20.130476    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs\") pod \"network-metrics-daemon-2b8mm\" (UID: \"df380f84-e4cf-477f-b44f-86c7f533ce9c\") " pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:14:20.130683 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:20.130537    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9360df26-7dcf-4632-b9b1-c3604a98a63e-original-pull-secret\") pod \"global-pull-secret-syncer-kpfqx\" (UID: \"9360df26-7dcf-4632-b9b1-c3604a98a63e\") " pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:14:20.133224 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:20.133205    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 02:14:20.133318 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:20.133302    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 02:14:20.140887 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:14:20.140870    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 16 02:14:20.140938 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:14:20.140929    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs podName:df380f84-e4cf-477f-b44f-86c7f533ce9c nodeName:}" failed. No retries permitted until 2026-09-16 02:15:24.14091572 +0000 UTC m=+129.233097672 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs") pod "network-metrics-daemon-2b8mm" (UID: "df380f84-e4cf-477f-b44f-86c7f533ce9c") : secret "metrics-daemon-secret" not found
Sep 16 02:14:20.143997 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:20.143981    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9360df26-7dcf-4632-b9b1-c3604a98a63e-original-pull-secret\") pod \"global-pull-secret-syncer-kpfqx\" (UID: \"9360df26-7dcf-4632-b9b1-c3604a98a63e\") " pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:14:20.231750 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:20.231723    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hzwk\" (UniqueName: \"kubernetes.io/projected/cd020b20-feab-4fa9-9ca8-8daccf44b045-kube-api-access-4hzwk\") pod \"network-check-target-p2jj8\" (UID: \"cd020b20-feab-4fa9-9ca8-8daccf44b045\") " pod="openshift-network-diagnostics/network-check-target-p2jj8"
Sep 16 02:14:20.233686 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:20.233670    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 02:14:20.244129 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:20.244113    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 02:14:20.254993 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:20.254971    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hzwk\" (UniqueName: \"kubernetes.io/projected/cd020b20-feab-4fa9-9ca8-8daccf44b045-kube-api-access-4hzwk\") pod \"network-check-target-p2jj8\" (UID: \"cd020b20-feab-4fa9-9ca8-8daccf44b045\") " pod="openshift-network-diagnostics/network-check-target-p2jj8"
Sep 16 02:14:20.289842 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:20.289821    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpfqx"
Sep 16 02:14:20.304432 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:20.304415    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ksfsh\""
Sep 16 02:14:20.313057 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:20.313039    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2jj8"
Sep 16 02:14:20.557375 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:20.557347    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kpfqx"]
Sep 16 02:14:20.582484 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:20.582464    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p2jj8"]
Sep 16 02:14:20.584743 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:14:20.584718    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd020b20_feab_4fa9_9ca8_8daccf44b045.slice/crio-7a3409156236a26286589e6cd2b0e797c123df95cc3b63a516edd7ac0d40353a WatchSource:0}: Error finding container 7a3409156236a26286589e6cd2b0e797c123df95cc3b63a516edd7ac0d40353a: Status 404 returned error can't find the container with id 7a3409156236a26286589e6cd2b0e797c123df95cc3b63a516edd7ac0d40353a
Sep 16 02:14:20.732030 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:20.731992    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kpfqx" event={"ID":"9360df26-7dcf-4632-b9b1-c3604a98a63e","Type":"ContainerStarted","Data":"3c2dafd620f0d166a7154cc420181c5d77b5ee557f3a083134ccaffc6c5ab926"}
Sep 16 02:14:20.732900 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:20.732877    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p2jj8" event={"ID":"cd020b20-feab-4fa9-9ca8-8daccf44b045","Type":"ContainerStarted","Data":"7a3409156236a26286589e6cd2b0e797c123df95cc3b63a516edd7ac0d40353a"}
Sep 16 02:14:26.749921 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:26.749879    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p2jj8" event={"ID":"cd020b20-feab-4fa9-9ca8-8daccf44b045","Type":"ContainerStarted","Data":"c6d1bf940a4b284c17e8e057dbfa167416741126365736574331e79c7e5f785b"}
Sep 16 02:14:26.750409 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:26.749993    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-p2jj8"
Sep 16 02:14:26.751439 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:26.751416    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kpfqx" event={"ID":"9360df26-7dcf-4632-b9b1-c3604a98a63e","Type":"ContainerStarted","Data":"83fb7c433384b6bb0546afc4608ed4f404cc23bf195f3b2ecddf968268318d83"}
Sep 16 02:14:26.762972 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:26.762931    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-p2jj8" podStartSLOduration=66.462022484 podStartE2EDuration="1m11.762916425s" totalImagesPullingTime="5.300893941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:13:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:14:26.762539989 +0000 UTC m=+71.854721962" watchObservedRunningTime="2026-09-16 02:14:26.762916425 +0000 UTC m=+71.855098400"
Sep 16 02:14:26.774600 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:26.774563    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kpfqx" podStartSLOduration=66.458569154 podStartE2EDuration="1m11.774553725s" totalImagesPullingTime="5.315984571s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 02:13:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:14:26.774136237 +0000 UTC m=+71.866318211" watchObservedRunningTime="2026-09-16 02:14:26.774553725 +0000 UTC m=+71.866735699"
Sep 16 02:14:29.802466 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:29.802439    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69885c4c95-qcv2s"]
Sep 16 02:14:29.804337 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:29.804305    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69885c4c95-qcv2s"
Sep 16 02:14:29.807390 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:29.807365    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 16 02:14:29.808103 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:29.808084    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 16 02:14:29.808196 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:29.808105    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 16 02:14:29.808196 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:29.808092    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 16 02:14:29.830757 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:29.830735    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69885c4c95-qcv2s"]
Sep 16 02:14:29.894297 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:29.894269    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr5dc\" (UniqueName: \"kubernetes.io/projected/1c818b4d-5d0c-4906-90b3-1fa239df33d5-kube-api-access-rr5dc\") pod \"klusterlet-addon-workmgr-69885c4c95-qcv2s\" (UID: \"1c818b4d-5d0c-4906-90b3-1fa239df33d5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69885c4c95-qcv2s"
Sep 16 02:14:29.894392 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:29.894305    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1c818b4d-5d0c-4906-90b3-1fa239df33d5-klusterlet-config\") pod \"klusterlet-addon-workmgr-69885c4c95-qcv2s\" (UID: \"1c818b4d-5d0c-4906-90b3-1fa239df33d5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69885c4c95-qcv2s"
Sep 16 02:14:29.894437 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:29.894411    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c818b4d-5d0c-4906-90b3-1fa239df33d5-tmp\") pod \"klusterlet-addon-workmgr-69885c4c95-qcv2s\" (UID: \"1c818b4d-5d0c-4906-90b3-1fa239df33d5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69885c4c95-qcv2s"
Sep 16 02:14:29.994634 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:29.994613    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c818b4d-5d0c-4906-90b3-1fa239df33d5-tmp\") pod \"klusterlet-addon-workmgr-69885c4c95-qcv2s\" (UID: \"1c818b4d-5d0c-4906-90b3-1fa239df33d5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69885c4c95-qcv2s"
Sep 16 02:14:29.994694 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:29.994643    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr5dc\" (UniqueName: \"kubernetes.io/projected/1c818b4d-5d0c-4906-90b3-1fa239df33d5-kube-api-access-rr5dc\") pod \"klusterlet-addon-workmgr-69885c4c95-qcv2s\" (UID: \"1c818b4d-5d0c-4906-90b3-1fa239df33d5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69885c4c95-qcv2s"
Sep 16 02:14:29.994694 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:29.994661    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1c818b4d-5d0c-4906-90b3-1fa239df33d5-klusterlet-config\") pod \"klusterlet-addon-workmgr-69885c4c95-qcv2s\" (UID: \"1c818b4d-5d0c-4906-90b3-1fa239df33d5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69885c4c95-qcv2s"
Sep 16 02:14:29.994981 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:29.994963    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c818b4d-5d0c-4906-90b3-1fa239df33d5-tmp\") pod \"klusterlet-addon-workmgr-69885c4c95-qcv2s\" (UID: \"1c818b4d-5d0c-4906-90b3-1fa239df33d5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69885c4c95-qcv2s"
Sep 16 02:14:29.997278 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:29.997259    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1c818b4d-5d0c-4906-90b3-1fa239df33d5-klusterlet-config\") pod \"klusterlet-addon-workmgr-69885c4c95-qcv2s\" (UID: \"1c818b4d-5d0c-4906-90b3-1fa239df33d5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69885c4c95-qcv2s"
Sep 16 02:14:30.001430 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:30.001412    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr5dc\" (UniqueName: \"kubernetes.io/projected/1c818b4d-5d0c-4906-90b3-1fa239df33d5-kube-api-access-rr5dc\") pod \"klusterlet-addon-workmgr-69885c4c95-qcv2s\" (UID: \"1c818b4d-5d0c-4906-90b3-1fa239df33d5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69885c4c95-qcv2s"
Sep 16 02:14:30.113137 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:30.113078    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69885c4c95-qcv2s"
Sep 16 02:14:30.375523 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:30.375452    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69885c4c95-qcv2s"]
Sep 16 02:14:30.378727 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:14:30.378706    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c818b4d_5d0c_4906_90b3_1fa239df33d5.slice/crio-a3728fe7c24c567440752f67fa9259fbea33210522774c8ab3df7128ed8370de WatchSource:0}: Error finding container a3728fe7c24c567440752f67fa9259fbea33210522774c8ab3df7128ed8370de: Status 404 returned error can't find the container with id a3728fe7c24c567440752f67fa9259fbea33210522774c8ab3df7128ed8370de
Sep 16 02:14:30.761987 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:30.761909    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69885c4c95-qcv2s" event={"ID":"1c818b4d-5d0c-4906-90b3-1fa239df33d5","Type":"ContainerStarted","Data":"a3728fe7c24c567440752f67fa9259fbea33210522774c8ab3df7128ed8370de"}
Sep 16 02:14:34.774211 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:34.774173    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69885c4c95-qcv2s" event={"ID":"1c818b4d-5d0c-4906-90b3-1fa239df33d5","Type":"ContainerStarted","Data":"8ae25c75a8e13c8be251c7a2ee1070e6532da06513ea6b72e0255cd0486dfc85"}
Sep 16 02:14:34.774606 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:34.774367    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69885c4c95-qcv2s"
Sep 16 02:14:34.775516 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:34.775497    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69885c4c95-qcv2s"
Sep 16 02:14:34.789125 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:34.789086    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69885c4c95-qcv2s" podStartSLOduration=1.57096713 podStartE2EDuration="5.78907412s" totalImagesPullingTime="4.21810699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:14:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:14:34.788285848 +0000 UTC m=+79.880467824" watchObservedRunningTime="2026-09-16 02:14:34.78907412 +0000 UTC m=+79.881256093"
Sep 16 02:14:51.739485 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:51.739371    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8b0c607-1644-4679-8b1d-be6926f44c81-metrics-tls\") pod \"dns-default-qz6zp\" (UID: \"d8b0c607-1644-4679-8b1d-be6926f44c81\") " pod="openshift-dns/dns-default-qz6zp"
Sep 16 02:14:51.739869 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:14:51.739520    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 02:14:51.739869 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:14:51.739600    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8b0c607-1644-4679-8b1d-be6926f44c81-metrics-tls podName:d8b0c607-1644-4679-8b1d-be6926f44c81 nodeName:}" failed. No retries permitted until 2026-09-16 02:15:55.739581442 +0000 UTC m=+160.831763414 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8b0c607-1644-4679-8b1d-be6926f44c81-metrics-tls") pod "dns-default-qz6zp" (UID: "d8b0c607-1644-4679-8b1d-be6926f44c81") : secret "dns-default-metrics-tls" not found
Sep 16 02:14:57.756901 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:14:57.756873    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-p2jj8"
Sep 16 02:15:24.235234 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:15:24.235196    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs\") pod \"network-metrics-daemon-2b8mm\" (UID: \"df380f84-e4cf-477f-b44f-86c7f533ce9c\") " pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:15:24.235684 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:15:24.235330    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 16 02:15:24.235684 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:15:24.235395    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs podName:df380f84-e4cf-477f-b44f-86c7f533ce9c nodeName:}" failed. No retries permitted until 2026-09-16 02:17:26.235381335 +0000 UTC m=+251.327563287 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs") pod "network-metrics-daemon-2b8mm" (UID: "df380f84-e4cf-477f-b44f-86c7f533ce9c") : secret "metrics-daemon-secret" not found
Sep 16 02:15:50.825334 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:15:50.825275    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qz6zp" podUID="d8b0c607-1644-4679-8b1d-be6926f44c81"
Sep 16 02:15:50.951556 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:15:50.951527    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qz6zp"
Sep 16 02:15:52.395707 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:15:52.395672    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2b8mm" podUID="df380f84-e4cf-477f-b44f-86c7f533ce9c"
Sep 16 02:15:55.830009 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:15:55.829966    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8b0c607-1644-4679-8b1d-be6926f44c81-metrics-tls\") pod \"dns-default-qz6zp\" (UID: \"d8b0c607-1644-4679-8b1d-be6926f44c81\") " pod="openshift-dns/dns-default-qz6zp"
Sep 16 02:15:55.830397 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:15:55.830115    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 02:15:55.830397 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:15:55.830185    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8b0c607-1644-4679-8b1d-be6926f44c81-metrics-tls podName:d8b0c607-1644-4679-8b1d-be6926f44c81 nodeName:}" failed. No retries permitted until 2026-09-16 02:17:57.83016979 +0000 UTC m=+282.922351742 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d8b0c607-1644-4679-8b1d-be6926f44c81-metrics-tls") pod "dns-default-qz6zp" (UID: "d8b0c607-1644-4679-8b1d-be6926f44c81") : secret "dns-default-metrics-tls" not found
Sep 16 02:16:03.376150 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:16:03.376118    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:16:34.775537 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:16:34.775494    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69885c4c95-qcv2s" podUID="1c818b4d-5d0c-4906-90b3-1fa239df33d5" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused"
Sep 16 02:16:35.054213 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:16:35.054180    2581 generic.go:356] "Generic (PLEG): container finished" podID="1c818b4d-5d0c-4906-90b3-1fa239df33d5" containerID="8ae25c75a8e13c8be251c7a2ee1070e6532da06513ea6b72e0255cd0486dfc85" exitCode=1
Sep 16 02:16:35.054356 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:16:35.054241    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69885c4c95-qcv2s" event={"ID":"1c818b4d-5d0c-4906-90b3-1fa239df33d5","Type":"ContainerDied","Data":"8ae25c75a8e13c8be251c7a2ee1070e6532da06513ea6b72e0255cd0486dfc85"}
Sep 16 02:16:35.054569 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:16:35.054553    2581 scope.go:117] "RemoveContainer" containerID="8ae25c75a8e13c8be251c7a2ee1070e6532da06513ea6b72e0255cd0486dfc85"
Sep 16 02:16:36.059221 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:16:36.059182    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69885c4c95-qcv2s" event={"ID":"1c818b4d-5d0c-4906-90b3-1fa239df33d5","Type":"ContainerStarted","Data":"239b23aabacb490cdd9caa5c3c744c1ad40d6d558725b1e8830bdb56e255c7ea"}
Sep 16 02:16:36.059695 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:16:36.059438    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69885c4c95-qcv2s"
Sep 16 02:16:36.060003 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:16:36.059985    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69885c4c95-qcv2s"
Sep 16 02:17:10.910193 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:10.910163    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-845bcccddb-48xv4"]
Sep 16 02:17:10.912212 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:10.912197    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:10.914676 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:10.914652    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 16 02:17:10.914863 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:10.914829    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 16 02:17:10.914941 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:10.914895    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9j6zg\""
Sep 16 02:17:10.915001 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:10.914935    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 16 02:17:10.920658 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:10.920640    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 16 02:17:10.928945 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:10.928921    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-845bcccddb-48xv4"]
Sep 16 02:17:10.996666 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:10.996637    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-z4ct8"]
Sep 16 02:17:10.998677 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:10.998659    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-z4ct8"
Sep 16 02:17:10.999884 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:10.999866    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wn6td"]
Sep 16 02:17:11.000780 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.000756    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-ctcmb\""
Sep 16 02:17:11.000882 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.000782    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 16 02:17:11.001025 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.001009    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 16 02:17:11.001615 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.001599    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wn6td"
Sep 16 02:17:11.003532 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.003516    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 16 02:17:11.003621 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.003542    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 16 02:17:11.003621 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.003551    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 16 02:17:11.003822 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.003807    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 16 02:17:11.004051 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.004037    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-gxnqw\""
Sep 16 02:17:11.010722 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.010703    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-z4ct8"]
Sep 16 02:17:11.016035 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.016014    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wn6td"]
Sep 16 02:17:11.017116 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.017093    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93d3b8d1-9425-4f1a-814f-667145b386e4-ca-trust-extracted\") pod \"image-registry-845bcccddb-48xv4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") " pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:11.017302 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.017278    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93d3b8d1-9425-4f1a-814f-667145b386e4-trusted-ca\") pod \"image-registry-845bcccddb-48xv4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") " pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:11.017373 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.017316    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93d3b8d1-9425-4f1a-814f-667145b386e4-installation-pull-secrets\") pod \"image-registry-845bcccddb-48xv4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") " pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:11.017373 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.017364    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93d3b8d1-9425-4f1a-814f-667145b386e4-image-registry-private-configuration\") pod \"image-registry-845bcccddb-48xv4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") " pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:11.017476 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.017391    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-registry-tls\") pod \"image-registry-845bcccddb-48xv4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") " pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:11.017476 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.017419    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93d3b8d1-9425-4f1a-814f-667145b386e4-registry-certificates\") pod \"image-registry-845bcccddb-48xv4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") " pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:11.017476 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.017446    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-bound-sa-token\") pod \"image-registry-845bcccddb-48xv4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") " pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:11.017612 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.017473    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpz2w\" (UniqueName: \"kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-kube-api-access-tpz2w\") pod \"image-registry-845bcccddb-48xv4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") " pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:11.118632 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.118608    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93d3b8d1-9425-4f1a-814f-667145b386e4-ca-trust-extracted\") pod \"image-registry-845bcccddb-48xv4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") " pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:11.118740 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.118657    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93d3b8d1-9425-4f1a-814f-667145b386e4-trusted-ca\") pod \"image-registry-845bcccddb-48xv4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") " pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:11.118740 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.118687    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93d3b8d1-9425-4f1a-814f-667145b386e4-installation-pull-secrets\") pod \"image-registry-845bcccddb-48xv4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") " pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:11.118740 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.118728    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93d3b8d1-9425-4f1a-814f-667145b386e4-image-registry-private-configuration\") pod \"image-registry-845bcccddb-48xv4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") " pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:11.118874 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.118754    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-registry-tls\") pod \"image-registry-845bcccddb-48xv4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") " pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:11.118874 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.118775    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93d3b8d1-9425-4f1a-814f-667145b386e4-registry-certificates\") pod \"image-registry-845bcccddb-48xv4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") " pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:11.118978 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:11.118891    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 02:17:11.118978 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:11.118911    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-845bcccddb-48xv4: secret "image-registry-tls" not found
Sep 16 02:17:11.118978 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.118918    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/512baf29-25fe-4807-88bc-9ac46ae62b56-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-wn6td\" (UID: \"512baf29-25fe-4807-88bc-9ac46ae62b56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wn6td"
Sep 16 02:17:11.118978 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:11.118964    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-registry-tls podName:93d3b8d1-9425-4f1a-814f-667145b386e4 nodeName:}" failed. No retries permitted until 2026-09-16 02:17:11.618945756 +0000 UTC m=+236.711127721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-registry-tls") pod "image-registry-845bcccddb-48xv4" (UID: "93d3b8d1-9425-4f1a-814f-667145b386e4") : secret "image-registry-tls" not found
Sep 16 02:17:11.119342 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.118989    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-bound-sa-token\") pod \"image-registry-845bcccddb-48xv4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") " pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:11.119342 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.119020    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swqsn\" (UniqueName: \"kubernetes.io/projected/512baf29-25fe-4807-88bc-9ac46ae62b56-kube-api-access-swqsn\") pod \"kube-storage-version-migrator-operator-6c8f84f897-wn6td\" (UID: \"512baf29-25fe-4807-88bc-9ac46ae62b56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wn6td"
Sep 16 02:17:11.119342 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.119052    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpz2w\" (UniqueName: \"kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-kube-api-access-tpz2w\") pod \"image-registry-845bcccddb-48xv4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") " pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:11.119342 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.119053    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93d3b8d1-9425-4f1a-814f-667145b386e4-ca-trust-extracted\") pod \"image-registry-845bcccddb-48xv4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") " pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:11.119342 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.119088    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxk2q\" (UniqueName: \"kubernetes.io/projected/bc562e96-0bb8-4523-82a3-4aed0b991ad6-kube-api-access-sxk2q\") pod \"volume-data-source-validator-86695b7cc7-z4ct8\" (UID: \"bc562e96-0bb8-4523-82a3-4aed0b991ad6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-z4ct8"
Sep 16 02:17:11.119342 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.119117    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/512baf29-25fe-4807-88bc-9ac46ae62b56-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-wn6td\" (UID: \"512baf29-25fe-4807-88bc-9ac46ae62b56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wn6td"
Sep 16 02:17:11.119547 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.119370    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93d3b8d1-9425-4f1a-814f-667145b386e4-registry-certificates\") pod \"image-registry-845bcccddb-48xv4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") " pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:11.119581 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.119564    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93d3b8d1-9425-4f1a-814f-667145b386e4-trusted-ca\") pod \"image-registry-845bcccddb-48xv4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") " pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:11.121321 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.121303    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93d3b8d1-9425-4f1a-814f-667145b386e4-installation-pull-secrets\") pod \"image-registry-845bcccddb-48xv4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") " pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:11.121394 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.121337    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93d3b8d1-9425-4f1a-814f-667145b386e4-image-registry-private-configuration\") pod \"image-registry-845bcccddb-48xv4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") " pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:11.127341 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.127306    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-bound-sa-token\") pod \"image-registry-845bcccddb-48xv4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") " pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:11.127720 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.127705    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpz2w\" (UniqueName: \"kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-kube-api-access-tpz2w\") pod \"image-registry-845bcccddb-48xv4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") " pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:11.219653 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.219591    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/512baf29-25fe-4807-88bc-9ac46ae62b56-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-wn6td\" (UID: \"512baf29-25fe-4807-88bc-9ac46ae62b56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wn6td"
Sep 16 02:17:11.219653 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.219626    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swqsn\" (UniqueName: \"kubernetes.io/projected/512baf29-25fe-4807-88bc-9ac46ae62b56-kube-api-access-swqsn\") pod \"kube-storage-version-migrator-operator-6c8f84f897-wn6td\" (UID: \"512baf29-25fe-4807-88bc-9ac46ae62b56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wn6td"
Sep 16 02:17:11.219653 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.219646    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxk2q\" (UniqueName: \"kubernetes.io/projected/bc562e96-0bb8-4523-82a3-4aed0b991ad6-kube-api-access-sxk2q\") pod \"volume-data-source-validator-86695b7cc7-z4ct8\" (UID: \"bc562e96-0bb8-4523-82a3-4aed0b991ad6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-z4ct8"
Sep 16 02:17:11.219821 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.219662    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/512baf29-25fe-4807-88bc-9ac46ae62b56-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-wn6td\" (UID: \"512baf29-25fe-4807-88bc-9ac46ae62b56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wn6td"
Sep 16 02:17:11.220178 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.220161    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/512baf29-25fe-4807-88bc-9ac46ae62b56-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-wn6td\" (UID: \"512baf29-25fe-4807-88bc-9ac46ae62b56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wn6td"
Sep 16 02:17:11.221740 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.221723    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/512baf29-25fe-4807-88bc-9ac46ae62b56-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-wn6td\" (UID: \"512baf29-25fe-4807-88bc-9ac46ae62b56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wn6td"
Sep 16 02:17:11.226410 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.226391    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swqsn\" (UniqueName: \"kubernetes.io/projected/512baf29-25fe-4807-88bc-9ac46ae62b56-kube-api-access-swqsn\") pod \"kube-storage-version-migrator-operator-6c8f84f897-wn6td\" (UID: \"512baf29-25fe-4807-88bc-9ac46ae62b56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wn6td"
Sep 16 02:17:11.226767 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.226745    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxk2q\" (UniqueName: \"kubernetes.io/projected/bc562e96-0bb8-4523-82a3-4aed0b991ad6-kube-api-access-sxk2q\") pod \"volume-data-source-validator-86695b7cc7-z4ct8\" (UID: \"bc562e96-0bb8-4523-82a3-4aed0b991ad6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-z4ct8"
Sep 16 02:17:11.308781 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.308756    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-z4ct8"
Sep 16 02:17:11.313559 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.313542    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wn6td"
Sep 16 02:17:11.577130 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.577101    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-z4ct8"]
Sep 16 02:17:11.580140 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.580119    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wn6td"]
Sep 16 02:17:11.580470 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:17:11.580450    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc562e96_0bb8_4523_82a3_4aed0b991ad6.slice/crio-036f7007426f9ba194a9878e53045a9b566853257cd27e190c663200cbd2e9de WatchSource:0}: Error finding container 036f7007426f9ba194a9878e53045a9b566853257cd27e190c663200cbd2e9de: Status 404 returned error can't find the container with id 036f7007426f9ba194a9878e53045a9b566853257cd27e190c663200cbd2e9de
Sep 16 02:17:11.583049 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:17:11.583029    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod512baf29_25fe_4807_88bc_9ac46ae62b56.slice/crio-01115dc346225ff8bcef3fe4689bd0f8290a1a423d6ec2220fb2fd1e4660c4bc WatchSource:0}: Error finding container 01115dc346225ff8bcef3fe4689bd0f8290a1a423d6ec2220fb2fd1e4660c4bc: Status 404 returned error can't find the container with id 01115dc346225ff8bcef3fe4689bd0f8290a1a423d6ec2220fb2fd1e4660c4bc
Sep 16 02:17:11.623122 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:11.623098    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-registry-tls\") pod \"image-registry-845bcccddb-48xv4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") " pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:11.623220 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:11.623203    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 02:17:11.623220 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:11.623214    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-845bcccddb-48xv4: secret "image-registry-tls" not found
Sep 16 02:17:11.623296 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:11.623265    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-registry-tls podName:93d3b8d1-9425-4f1a-814f-667145b386e4 nodeName:}" failed. No retries permitted until 2026-09-16 02:17:12.623246437 +0000 UTC m=+237.715428389 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-registry-tls") pod "image-registry-845bcccddb-48xv4" (UID: "93d3b8d1-9425-4f1a-814f-667145b386e4") : secret "image-registry-tls" not found
Sep 16 02:17:12.160332 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:12.160295    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wn6td" event={"ID":"512baf29-25fe-4807-88bc-9ac46ae62b56","Type":"ContainerStarted","Data":"01115dc346225ff8bcef3fe4689bd0f8290a1a423d6ec2220fb2fd1e4660c4bc"}
Sep 16 02:17:12.161541 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:12.161498    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-z4ct8" event={"ID":"bc562e96-0bb8-4523-82a3-4aed0b991ad6","Type":"ContainerStarted","Data":"036f7007426f9ba194a9878e53045a9b566853257cd27e190c663200cbd2e9de"}
Sep 16 02:17:12.631909 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:12.631863    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-registry-tls\") pod \"image-registry-845bcccddb-48xv4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") " pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:12.632081 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:12.631989    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 02:17:12.632081 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:12.632007    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-845bcccddb-48xv4: secret "image-registry-tls" not found
Sep 16 02:17:12.632081 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:12.632068    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-registry-tls podName:93d3b8d1-9425-4f1a-814f-667145b386e4 nodeName:}" failed. No retries permitted until 2026-09-16 02:17:14.632053765 +0000 UTC m=+239.724235721 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-registry-tls") pod "image-registry-845bcccddb-48xv4" (UID: "93d3b8d1-9425-4f1a-814f-667145b386e4") : secret "image-registry-tls" not found
Sep 16 02:17:14.169198 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:14.169163    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-z4ct8" event={"ID":"bc562e96-0bb8-4523-82a3-4aed0b991ad6","Type":"ContainerStarted","Data":"e68c634c2aa28ac07de842aeec46082288a376dca47e2c3acf34cdd12d37de25"}
Sep 16 02:17:14.170638 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:14.170611    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wn6td" event={"ID":"512baf29-25fe-4807-88bc-9ac46ae62b56","Type":"ContainerStarted","Data":"834f5abadd7d6e03aa4d399ca048d8d0b0053f4373f597e6e77070f622cb3192"}
Sep 16 02:17:14.182126 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:14.182080    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-z4ct8" podStartSLOduration=2.07081658 podStartE2EDuration="4.18206422s" totalImagesPullingTime="2.11124764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:17:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:17:14.18167497 +0000 UTC m=+239.273856945" watchObservedRunningTime="2026-09-16 02:17:14.18206422 +0000 UTC m=+239.274246195"
Sep 16 02:17:14.196766 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:14.196709    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wn6td" podStartSLOduration=2.083132156 podStartE2EDuration="4.196695962s" totalImagesPullingTime="2.113563806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:17:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:17:14.195960241 +0000 UTC m=+239.288142214" watchObservedRunningTime="2026-09-16 02:17:14.196695962 +0000 UTC m=+239.288877935"
Sep 16 02:17:14.645495 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:14.645466    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-registry-tls\") pod \"image-registry-845bcccddb-48xv4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") " pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:14.645648 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:14.645580    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 02:17:14.645648 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:14.645591    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-845bcccddb-48xv4: secret "image-registry-tls" not found
Sep 16 02:17:14.645648 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:14.645637    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-registry-tls podName:93d3b8d1-9425-4f1a-814f-667145b386e4 nodeName:}" failed. No retries permitted until 2026-09-16 02:17:18.645623863 +0000 UTC m=+243.737805815 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-registry-tls") pod "image-registry-845bcccddb-48xv4" (UID: "93d3b8d1-9425-4f1a-814f-667145b386e4") : secret "image-registry-tls" not found
Sep 16 02:17:15.103573 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:15.103541    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-wb6s7"]
Sep 16 02:17:15.105573 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:15.105556    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-wb6s7"
Sep 16 02:17:15.107538 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:15.107510    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-2z4rt\""
Sep 16 02:17:15.107644 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:15.107626    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 16 02:17:15.108340 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:15.108320    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 16 02:17:15.116145 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:15.116124    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-wb6s7"]
Sep 16 02:17:15.248803 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:15.248776    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp6t4\" (UniqueName: \"kubernetes.io/projected/bd99b5e4-f2aa-4960-ac59-906648aa0aae-kube-api-access-bp6t4\") pod \"migrator-8b4d697c5-wb6s7\" (UID: \"bd99b5e4-f2aa-4960-ac59-906648aa0aae\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-wb6s7"
Sep 16 02:17:15.349318 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:15.349283    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp6t4\" (UniqueName: \"kubernetes.io/projected/bd99b5e4-f2aa-4960-ac59-906648aa0aae-kube-api-access-bp6t4\") pod \"migrator-8b4d697c5-wb6s7\" (UID: \"bd99b5e4-f2aa-4960-ac59-906648aa0aae\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-wb6s7"
Sep 16 02:17:15.355702 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:15.355653    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 16 02:17:15.365795 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:15.365775    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 16 02:17:15.376947 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:15.376921    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp6t4\" (UniqueName: \"kubernetes.io/projected/bd99b5e4-f2aa-4960-ac59-906648aa0aae-kube-api-access-bp6t4\") pod \"migrator-8b4d697c5-wb6s7\" (UID: \"bd99b5e4-f2aa-4960-ac59-906648aa0aae\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-wb6s7"
Sep 16 02:17:15.417665 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:15.417643    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-2z4rt\""
Sep 16 02:17:15.426444 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:15.426425    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-wb6s7"
Sep 16 02:17:15.690312 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:15.690237    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-wb6s7"]
Sep 16 02:17:15.692893 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:17:15.692863    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd99b5e4_f2aa_4960_ac59_906648aa0aae.slice/crio-6b92eebad77ab98ee0ad62a2ddf94396eacdbe9d53b794061fe5df51976d6f5e WatchSource:0}: Error finding container 6b92eebad77ab98ee0ad62a2ddf94396eacdbe9d53b794061fe5df51976d6f5e: Status 404 returned error can't find the container with id 6b92eebad77ab98ee0ad62a2ddf94396eacdbe9d53b794061fe5df51976d6f5e
Sep 16 02:17:16.177176 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:16.177143    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-wb6s7" event={"ID":"bd99b5e4-f2aa-4960-ac59-906648aa0aae","Type":"ContainerStarted","Data":"6b92eebad77ab98ee0ad62a2ddf94396eacdbe9d53b794061fe5df51976d6f5e"}
Sep 16 02:17:16.202376 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:16.202354    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-c5ng8"]
Sep 16 02:17:16.204966 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:16.204951    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c5ng8"
Sep 16 02:17:16.207130 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:16.207110    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 16 02:17:16.207220 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:16.207129    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 16 02:17:16.208030 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:16.208013    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 16 02:17:16.208136 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:16.208013    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8h898\""
Sep 16 02:17:16.208136 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:16.208047    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 16 02:17:16.264836 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:16.264815    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c5ng8"]
Sep 16 02:17:16.356285 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:16.356252    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a93280ba-e14e-4362-a36a-44d64d0591bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c5ng8\" (UID: \"a93280ba-e14e-4362-a36a-44d64d0591bd\") " pod="openshift-insights/insights-runtime-extractor-c5ng8"
Sep 16 02:17:16.356428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:16.356294    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xv54\" (UniqueName: \"kubernetes.io/projected/a93280ba-e14e-4362-a36a-44d64d0591bd-kube-api-access-7xv54\") pod \"insights-runtime-extractor-c5ng8\" (UID: \"a93280ba-e14e-4362-a36a-44d64d0591bd\") " pod="openshift-insights/insights-runtime-extractor-c5ng8"
Sep 16 02:17:16.356428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:16.356323    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a93280ba-e14e-4362-a36a-44d64d0591bd-crio-socket\") pod \"insights-runtime-extractor-c5ng8\" (UID: \"a93280ba-e14e-4362-a36a-44d64d0591bd\") " pod="openshift-insights/insights-runtime-extractor-c5ng8"
Sep 16 02:17:16.356546 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:16.356453    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a93280ba-e14e-4362-a36a-44d64d0591bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c5ng8\" (UID: \"a93280ba-e14e-4362-a36a-44d64d0591bd\") " pod="openshift-insights/insights-runtime-extractor-c5ng8"
Sep 16 02:17:16.356546 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:16.356481    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a93280ba-e14e-4362-a36a-44d64d0591bd-data-volume\") pod \"insights-runtime-extractor-c5ng8\" (UID: \"a93280ba-e14e-4362-a36a-44d64d0591bd\") " pod="openshift-insights/insights-runtime-extractor-c5ng8"
Sep 16 02:17:16.457045 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:16.456950    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a93280ba-e14e-4362-a36a-44d64d0591bd-data-volume\") pod \"insights-runtime-extractor-c5ng8\" (UID: \"a93280ba-e14e-4362-a36a-44d64d0591bd\") " pod="openshift-insights/insights-runtime-extractor-c5ng8"
Sep 16 02:17:16.457045 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:16.456996    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a93280ba-e14e-4362-a36a-44d64d0591bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c5ng8\" (UID: \"a93280ba-e14e-4362-a36a-44d64d0591bd\") " pod="openshift-insights/insights-runtime-extractor-c5ng8"
Sep 16 02:17:16.457253 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:16.457141    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 02:17:16.457253 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:16.457207    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xv54\" (UniqueName: \"kubernetes.io/projected/a93280ba-e14e-4362-a36a-44d64d0591bd-kube-api-access-7xv54\") pod \"insights-runtime-extractor-c5ng8\" (UID: \"a93280ba-e14e-4362-a36a-44d64d0591bd\") " pod="openshift-insights/insights-runtime-extractor-c5ng8"
Sep 16 02:17:16.457253 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:16.457223    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a93280ba-e14e-4362-a36a-44d64d0591bd-insights-runtime-extractor-tls podName:a93280ba-e14e-4362-a36a-44d64d0591bd nodeName:}" failed. No retries permitted until 2026-09-16 02:17:16.957200706 +0000 UTC m=+242.049382857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a93280ba-e14e-4362-a36a-44d64d0591bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c5ng8" (UID: "a93280ba-e14e-4362-a36a-44d64d0591bd") : secret "insights-runtime-extractor-tls" not found
Sep 16 02:17:16.457417 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:16.457263    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a93280ba-e14e-4362-a36a-44d64d0591bd-crio-socket\") pod \"insights-runtime-extractor-c5ng8\" (UID: \"a93280ba-e14e-4362-a36a-44d64d0591bd\") " pod="openshift-insights/insights-runtime-extractor-c5ng8"
Sep 16 02:17:16.457417 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:16.457306    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a93280ba-e14e-4362-a36a-44d64d0591bd-data-volume\") pod \"insights-runtime-extractor-c5ng8\" (UID: \"a93280ba-e14e-4362-a36a-44d64d0591bd\") " pod="openshift-insights/insights-runtime-extractor-c5ng8"
Sep 16 02:17:16.457417 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:16.457366    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a93280ba-e14e-4362-a36a-44d64d0591bd-crio-socket\") pod \"insights-runtime-extractor-c5ng8\" (UID: \"a93280ba-e14e-4362-a36a-44d64d0591bd\") " pod="openshift-insights/insights-runtime-extractor-c5ng8"
Sep 16 02:17:16.457417 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:16.457389    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a93280ba-e14e-4362-a36a-44d64d0591bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c5ng8\" (UID: \"a93280ba-e14e-4362-a36a-44d64d0591bd\") " pod="openshift-insights/insights-runtime-extractor-c5ng8"
Sep 16 02:17:16.457624 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:16.457454    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 02:17:16.457624 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:16.457499    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a93280ba-e14e-4362-a36a-44d64d0591bd-kube-rbac-proxy-cm podName:a93280ba-e14e-4362-a36a-44d64d0591bd nodeName:}" failed. No retries permitted until 2026-09-16 02:17:16.957486798 +0000 UTC m=+242.049668749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a93280ba-e14e-4362-a36a-44d64d0591bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c5ng8" (UID: "a93280ba-e14e-4362-a36a-44d64d0591bd") : configmap "kube-rbac-proxy" not found
Sep 16 02:17:16.465080 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:16.465056    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xv54\" (UniqueName: \"kubernetes.io/projected/a93280ba-e14e-4362-a36a-44d64d0591bd-kube-api-access-7xv54\") pod \"insights-runtime-extractor-c5ng8\" (UID: \"a93280ba-e14e-4362-a36a-44d64d0591bd\") " pod="openshift-insights/insights-runtime-extractor-c5ng8"
Sep 16 02:17:16.962297 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:16.962267    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a93280ba-e14e-4362-a36a-44d64d0591bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c5ng8\" (UID: \"a93280ba-e14e-4362-a36a-44d64d0591bd\") " pod="openshift-insights/insights-runtime-extractor-c5ng8"
Sep 16 02:17:16.962468 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:16.962316    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a93280ba-e14e-4362-a36a-44d64d0591bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c5ng8\" (UID: \"a93280ba-e14e-4362-a36a-44d64d0591bd\") " pod="openshift-insights/insights-runtime-extractor-c5ng8"
Sep 16 02:17:16.962468 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:16.962351    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 02:17:16.962468 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:16.962402    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a93280ba-e14e-4362-a36a-44d64d0591bd-kube-rbac-proxy-cm podName:a93280ba-e14e-4362-a36a-44d64d0591bd nodeName:}" failed. No retries permitted until 2026-09-16 02:17:17.962385621 +0000 UTC m=+243.054567574 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a93280ba-e14e-4362-a36a-44d64d0591bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c5ng8" (UID: "a93280ba-e14e-4362-a36a-44d64d0591bd") : configmap "kube-rbac-proxy" not found
Sep 16 02:17:16.962468 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:16.962462    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 02:17:16.962651 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:16.962516    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a93280ba-e14e-4362-a36a-44d64d0591bd-insights-runtime-extractor-tls podName:a93280ba-e14e-4362-a36a-44d64d0591bd nodeName:}" failed. No retries permitted until 2026-09-16 02:17:17.962499787 +0000 UTC m=+243.054681746 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a93280ba-e14e-4362-a36a-44d64d0591bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c5ng8" (UID: "a93280ba-e14e-4362-a36a-44d64d0591bd") : secret "insights-runtime-extractor-tls" not found
Sep 16 02:17:17.182153 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:17.182085    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-wb6s7" event={"ID":"bd99b5e4-f2aa-4960-ac59-906648aa0aae","Type":"ContainerStarted","Data":"36dddc3242ec29e9c98f943fd6a851a7e2d79d3fa24e28a107c4b8c493f92d85"}
Sep 16 02:17:17.182280 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:17.182174    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-wb6s7" event={"ID":"bd99b5e4-f2aa-4960-ac59-906648aa0aae","Type":"ContainerStarted","Data":"74cc793f400904026d3c2bc756418994931d22203b80055d60c5689e0c475cb4"}
Sep 16 02:17:17.194863 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:17.194803    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-wb6s7" podStartSLOduration=0.984087142 podStartE2EDuration="2.194788077s" totalImagesPullingTime="1.210700935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:17:17.194580243 +0000 UTC m=+242.286762218" watchObservedRunningTime="2026-09-16 02:17:17.194788077 +0000 UTC m=+242.286970059"
Sep 16 02:17:17.969381 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:17.969342    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a93280ba-e14e-4362-a36a-44d64d0591bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c5ng8\" (UID: \"a93280ba-e14e-4362-a36a-44d64d0591bd\") " pod="openshift-insights/insights-runtime-extractor-c5ng8"
Sep 16 02:17:17.969381 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:17.969378    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a93280ba-e14e-4362-a36a-44d64d0591bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c5ng8\" (UID: \"a93280ba-e14e-4362-a36a-44d64d0591bd\") " pod="openshift-insights/insights-runtime-extractor-c5ng8"
Sep 16 02:17:17.969793 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:17.969466    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 02:17:17.969793 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:17.969525    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 02:17:17.969793 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:17.969528    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a93280ba-e14e-4362-a36a-44d64d0591bd-kube-rbac-proxy-cm podName:a93280ba-e14e-4362-a36a-44d64d0591bd nodeName:}" failed. No retries permitted until 2026-09-16 02:17:19.969513674 +0000 UTC m=+245.061695644 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a93280ba-e14e-4362-a36a-44d64d0591bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c5ng8" (UID: "a93280ba-e14e-4362-a36a-44d64d0591bd") : configmap "kube-rbac-proxy" not found
Sep 16 02:17:17.969793 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:17.969572    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a93280ba-e14e-4362-a36a-44d64d0591bd-insights-runtime-extractor-tls podName:a93280ba-e14e-4362-a36a-44d64d0591bd nodeName:}" failed. No retries permitted until 2026-09-16 02:17:19.969560372 +0000 UTC m=+245.061742325 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a93280ba-e14e-4362-a36a-44d64d0591bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c5ng8" (UID: "a93280ba-e14e-4362-a36a-44d64d0591bd") : secret "insights-runtime-extractor-tls" not found
Sep 16 02:17:18.414443 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:18.414418    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-wfk8q"]
Sep 16 02:17:18.416869 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:18.416837    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-wfk8q"
Sep 16 02:17:18.418953 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:18.418934    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 16 02:17:18.419646 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:18.419626    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 16 02:17:18.419732 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:18.419663    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 16 02:17:18.419732 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:18.419636    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-hx2js\""
Sep 16 02:17:18.419864 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:18.419834    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 16 02:17:18.425981 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:18.425962    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-wfk8q"]
Sep 16 02:17:18.573684 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:18.573650    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a55fdfc5-293e-4009-b617-de6f12a6ec75-signing-cabundle\") pod \"service-ca-568869fdc5-wfk8q\" (UID: \"a55fdfc5-293e-4009-b617-de6f12a6ec75\") " pod="openshift-service-ca/service-ca-568869fdc5-wfk8q"
Sep 16 02:17:18.573832 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:18.573758    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhpk4\" (UniqueName: \"kubernetes.io/projected/a55fdfc5-293e-4009-b617-de6f12a6ec75-kube-api-access-jhpk4\") pod \"service-ca-568869fdc5-wfk8q\" (UID: \"a55fdfc5-293e-4009-b617-de6f12a6ec75\") " pod="openshift-service-ca/service-ca-568869fdc5-wfk8q"
Sep 16 02:17:18.573832 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:18.573786    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a55fdfc5-293e-4009-b617-de6f12a6ec75-signing-key\") pod \"service-ca-568869fdc5-wfk8q\" (UID: \"a55fdfc5-293e-4009-b617-de6f12a6ec75\") " pod="openshift-service-ca/service-ca-568869fdc5-wfk8q"
Sep 16 02:17:18.675103 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:18.675037    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhpk4\" (UniqueName: \"kubernetes.io/projected/a55fdfc5-293e-4009-b617-de6f12a6ec75-kube-api-access-jhpk4\") pod \"service-ca-568869fdc5-wfk8q\" (UID: \"a55fdfc5-293e-4009-b617-de6f12a6ec75\") " pod="openshift-service-ca/service-ca-568869fdc5-wfk8q"
Sep 16 02:17:18.675103 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:18.675079    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a55fdfc5-293e-4009-b617-de6f12a6ec75-signing-key\") pod \"service-ca-568869fdc5-wfk8q\" (UID: \"a55fdfc5-293e-4009-b617-de6f12a6ec75\") " pod="openshift-service-ca/service-ca-568869fdc5-wfk8q"
Sep 16 02:17:18.675247 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:18.675106    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a55fdfc5-293e-4009-b617-de6f12a6ec75-signing-cabundle\") pod \"service-ca-568869fdc5-wfk8q\" (UID: \"a55fdfc5-293e-4009-b617-de6f12a6ec75\") " pod="openshift-service-ca/service-ca-568869fdc5-wfk8q"
Sep 16 02:17:18.675247 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:18.675143    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-registry-tls\") pod \"image-registry-845bcccddb-48xv4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") " pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:18.675247 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:18.675222    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 02:17:18.675247 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:18.675232    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-845bcccddb-48xv4: secret "image-registry-tls" not found
Sep 16 02:17:18.675435 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:18.675277    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-registry-tls podName:93d3b8d1-9425-4f1a-814f-667145b386e4 nodeName:}" failed. No retries permitted until 2026-09-16 02:17:26.675263802 +0000 UTC m=+251.767445754 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-registry-tls") pod "image-registry-845bcccddb-48xv4" (UID: "93d3b8d1-9425-4f1a-814f-667145b386e4") : secret "image-registry-tls" not found
Sep 16 02:17:18.675785 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:18.675767    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a55fdfc5-293e-4009-b617-de6f12a6ec75-signing-cabundle\") pod \"service-ca-568869fdc5-wfk8q\" (UID: \"a55fdfc5-293e-4009-b617-de6f12a6ec75\") " pod="openshift-service-ca/service-ca-568869fdc5-wfk8q"
Sep 16 02:17:18.677529 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:18.677513    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a55fdfc5-293e-4009-b617-de6f12a6ec75-signing-key\") pod \"service-ca-568869fdc5-wfk8q\" (UID: \"a55fdfc5-293e-4009-b617-de6f12a6ec75\") " pod="openshift-service-ca/service-ca-568869fdc5-wfk8q"
Sep 16 02:17:18.682226 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:18.682204    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhpk4\" (UniqueName: \"kubernetes.io/projected/a55fdfc5-293e-4009-b617-de6f12a6ec75-kube-api-access-jhpk4\") pod \"service-ca-568869fdc5-wfk8q\" (UID: \"a55fdfc5-293e-4009-b617-de6f12a6ec75\") " pod="openshift-service-ca/service-ca-568869fdc5-wfk8q"
Sep 16 02:17:18.725719 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:18.725693    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-wfk8q"
Sep 16 02:17:18.964366 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:18.964301    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bbcpb_aa055700-1ef3-45cc-84a5-a00cc3497637/dns-node-resolver/0.log"
Sep 16 02:17:18.996808 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:18.996782    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-wfk8q"]
Sep 16 02:17:19.002721 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:17:19.002697    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda55fdfc5_293e_4009_b617_de6f12a6ec75.slice/crio-f98686edd21a15aab7d7a940d99e24de48a2bc1adb1483e8324448c4de586dbd WatchSource:0}: Error finding container f98686edd21a15aab7d7a940d99e24de48a2bc1adb1483e8324448c4de586dbd: Status 404 returned error can't find the container with id f98686edd21a15aab7d7a940d99e24de48a2bc1adb1483e8324448c4de586dbd
Sep 16 02:17:19.189134 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:19.189105    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-wfk8q" event={"ID":"a55fdfc5-293e-4009-b617-de6f12a6ec75","Type":"ContainerStarted","Data":"f98686edd21a15aab7d7a940d99e24de48a2bc1adb1483e8324448c4de586dbd"}
Sep 16 02:17:19.764384 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:19.764359    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8wndx_b935ea44-096a-45f1-90b6-f178099dac5f/node-ca/0.log"
Sep 16 02:17:19.984587 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:19.984552    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a93280ba-e14e-4362-a36a-44d64d0591bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c5ng8\" (UID: \"a93280ba-e14e-4362-a36a-44d64d0591bd\") " pod="openshift-insights/insights-runtime-extractor-c5ng8"
Sep 16 02:17:19.984764 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:19.984595    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a93280ba-e14e-4362-a36a-44d64d0591bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c5ng8\" (UID: \"a93280ba-e14e-4362-a36a-44d64d0591bd\") " pod="openshift-insights/insights-runtime-extractor-c5ng8"
Sep 16 02:17:19.984764 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:19.984691    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 02:17:19.984764 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:19.984712    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 02:17:19.984956 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:19.984767    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a93280ba-e14e-4362-a36a-44d64d0591bd-kube-rbac-proxy-cm podName:a93280ba-e14e-4362-a36a-44d64d0591bd nodeName:}" failed. No retries permitted until 2026-09-16 02:17:23.984745292 +0000 UTC m=+249.076927261 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a93280ba-e14e-4362-a36a-44d64d0591bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c5ng8" (UID: "a93280ba-e14e-4362-a36a-44d64d0591bd") : configmap "kube-rbac-proxy" not found
Sep 16 02:17:19.984956 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:19.984786    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a93280ba-e14e-4362-a36a-44d64d0591bd-insights-runtime-extractor-tls podName:a93280ba-e14e-4362-a36a-44d64d0591bd nodeName:}" failed. No retries permitted until 2026-09-16 02:17:23.984777 +0000 UTC m=+249.076958951 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a93280ba-e14e-4362-a36a-44d64d0591bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c5ng8" (UID: "a93280ba-e14e-4362-a36a-44d64d0591bd") : secret "insights-runtime-extractor-tls" not found
Sep 16 02:17:20.564894 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:20.564818    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-65nfk_2178372a-7491-487a-881a-14567383f283/serve-healthcheck-canary/0.log"
Sep 16 02:17:21.165364 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:21.165337    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-wb6s7_bd99b5e4-f2aa-4960-ac59-906648aa0aae/migrator/0.log"
Sep 16 02:17:21.198749 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:21.198685    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-wfk8q" event={"ID":"a55fdfc5-293e-4009-b617-de6f12a6ec75","Type":"ContainerStarted","Data":"eca9b4e0187ba7fd34d1565b66be3e42472c18532b15a11c85e6fbdcfd4c7261"}
Sep 16 02:17:21.212809 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:21.212764    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-wfk8q" podStartSLOduration=1.173409024 podStartE2EDuration="3.21274524s" totalImagesPullingTime="2.039336216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:17:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:17:21.212191692 +0000 UTC m=+246.304373666" watchObservedRunningTime="2026-09-16 02:17:21.21274524 +0000 UTC m=+246.304927213"
Sep 16 02:17:21.363795 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:21.363772    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-wb6s7_bd99b5e4-f2aa-4960-ac59-906648aa0aae/graceful-termination/0.log"
Sep 16 02:17:21.565771 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:21.565747    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-wn6td_512baf29-25fe-4807-88bc-9ac46ae62b56/kube-storage-version-migrator-operator/0.log"
Sep 16 02:17:24.018167 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:24.018128    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a93280ba-e14e-4362-a36a-44d64d0591bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c5ng8\" (UID: \"a93280ba-e14e-4362-a36a-44d64d0591bd\") " pod="openshift-insights/insights-runtime-extractor-c5ng8"
Sep 16 02:17:24.018588 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:24.018247    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a93280ba-e14e-4362-a36a-44d64d0591bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c5ng8\" (UID: \"a93280ba-e14e-4362-a36a-44d64d0591bd\") " pod="openshift-insights/insights-runtime-extractor-c5ng8"
Sep 16 02:17:24.018588 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:24.018293    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 02:17:24.018588 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:24.018339    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 02:17:24.018588 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:24.018377    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a93280ba-e14e-4362-a36a-44d64d0591bd-insights-runtime-extractor-tls podName:a93280ba-e14e-4362-a36a-44d64d0591bd nodeName:}" failed. No retries permitted until 2026-09-16 02:17:32.018356167 +0000 UTC m=+257.110538133 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a93280ba-e14e-4362-a36a-44d64d0591bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c5ng8" (UID: "a93280ba-e14e-4362-a36a-44d64d0591bd") : secret "insights-runtime-extractor-tls" not found
Sep 16 02:17:24.018588 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:24.018397    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a93280ba-e14e-4362-a36a-44d64d0591bd-kube-rbac-proxy-cm podName:a93280ba-e14e-4362-a36a-44d64d0591bd nodeName:}" failed. No retries permitted until 2026-09-16 02:17:32.018387296 +0000 UTC m=+257.110569253 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a93280ba-e14e-4362-a36a-44d64d0591bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c5ng8" (UID: "a93280ba-e14e-4362-a36a-44d64d0591bd") : configmap "kube-rbac-proxy" not found
Sep 16 02:17:26.236231 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:26.236197    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs\") pod \"network-metrics-daemon-2b8mm\" (UID: \"df380f84-e4cf-477f-b44f-86c7f533ce9c\") " pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:17:26.236617 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:26.236330    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 16 02:17:26.236617 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:26.236385    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs podName:df380f84-e4cf-477f-b44f-86c7f533ce9c nodeName:}" failed. No retries permitted until 2026-09-16 02:19:28.236370106 +0000 UTC m=+373.328552057 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs") pod "network-metrics-daemon-2b8mm" (UID: "df380f84-e4cf-477f-b44f-86c7f533ce9c") : secret "metrics-daemon-secret" not found
Sep 16 02:17:26.739124 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:26.739093    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-registry-tls\") pod \"image-registry-845bcccddb-48xv4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") " pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:26.741533 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:26.741504    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-registry-tls\") pod \"image-registry-845bcccddb-48xv4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") " pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:26.824127 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:26.824098    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9j6zg\""
Sep 16 02:17:26.831736 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:26.831719    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:27.100303 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:27.100267    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-845bcccddb-48xv4"]
Sep 16 02:17:27.103839 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:17:27.103814    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93d3b8d1_9425_4f1a_814f_667145b386e4.slice/crio-005c3b2f5d34785872d4424156227ac04c6ca67117a7bbc1c86e12ca8a59b963 WatchSource:0}: Error finding container 005c3b2f5d34785872d4424156227ac04c6ca67117a7bbc1c86e12ca8a59b963: Status 404 returned error can't find the container with id 005c3b2f5d34785872d4424156227ac04c6ca67117a7bbc1c86e12ca8a59b963
Sep 16 02:17:27.218902 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:27.218836    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-845bcccddb-48xv4" event={"ID":"93d3b8d1-9425-4f1a-814f-667145b386e4","Type":"ContainerStarted","Data":"dbae21ada2973f522a0981dc6a2da9bf08481258c7f6f93b80fc842df31b5dc1"}
Sep 16 02:17:27.219032 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:27.218920    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-845bcccddb-48xv4" event={"ID":"93d3b8d1-9425-4f1a-814f-667145b386e4","Type":"ContainerStarted","Data":"005c3b2f5d34785872d4424156227ac04c6ca67117a7bbc1c86e12ca8a59b963"}
Sep 16 02:17:27.219032 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:27.219009    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:17:27.235552 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:27.235497    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-845bcccddb-48xv4" podStartSLOduration=17.235478818 podStartE2EDuration="17.235478818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:17:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:17:27.235109324 +0000 UTC m=+252.327291299" watchObservedRunningTime="2026-09-16 02:17:27.235478818 +0000 UTC m=+252.327660798"
Sep 16 02:17:32.078976 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:32.078934    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a93280ba-e14e-4362-a36a-44d64d0591bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c5ng8\" (UID: \"a93280ba-e14e-4362-a36a-44d64d0591bd\") " pod="openshift-insights/insights-runtime-extractor-c5ng8"
Sep 16 02:17:32.078976 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:32.078989    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a93280ba-e14e-4362-a36a-44d64d0591bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c5ng8\" (UID: \"a93280ba-e14e-4362-a36a-44d64d0591bd\") " pod="openshift-insights/insights-runtime-extractor-c5ng8"
Sep 16 02:17:32.079387 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:32.079117    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 02:17:32.079387 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:32.079179    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a93280ba-e14e-4362-a36a-44d64d0591bd-insights-runtime-extractor-tls podName:a93280ba-e14e-4362-a36a-44d64d0591bd nodeName:}" failed. No retries permitted until 2026-09-16 02:17:48.079165662 +0000 UTC m=+273.171347614 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a93280ba-e14e-4362-a36a-44d64d0591bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c5ng8" (UID: "a93280ba-e14e-4362-a36a-44d64d0591bd") : secret "insights-runtime-extractor-tls" not found
Sep 16 02:17:32.079465 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:32.079399    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a93280ba-e14e-4362-a36a-44d64d0591bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c5ng8\" (UID: \"a93280ba-e14e-4362-a36a-44d64d0591bd\") " pod="openshift-insights/insights-runtime-extractor-c5ng8"
Sep 16 02:17:37.854502 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:37.854418    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-845bcccddb-48xv4"]
Sep 16 02:17:37.884346 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:37.884310    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-ff4fb7c64-l9ncd"]
Sep 16 02:17:37.913111 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:37.913081    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-ff4fb7c64-l9ncd"]
Sep 16 02:17:37.913237 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:37.913163    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd"
Sep 16 02:17:38.019799 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:38.019769    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2a51efbb-2aef-4c38-988c-14e67882d15b-image-registry-private-configuration\") pod \"image-registry-ff4fb7c64-l9ncd\" (UID: \"2a51efbb-2aef-4c38-988c-14e67882d15b\") " pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd"
Sep 16 02:17:38.019947 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:38.019813    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9gvl\" (UniqueName: \"kubernetes.io/projected/2a51efbb-2aef-4c38-988c-14e67882d15b-kube-api-access-d9gvl\") pod \"image-registry-ff4fb7c64-l9ncd\" (UID: \"2a51efbb-2aef-4c38-988c-14e67882d15b\") " pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd"
Sep 16 02:17:38.019947 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:38.019834    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2a51efbb-2aef-4c38-988c-14e67882d15b-ca-trust-extracted\") pod \"image-registry-ff4fb7c64-l9ncd\" (UID: \"2a51efbb-2aef-4c38-988c-14e67882d15b\") " pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd"
Sep 16 02:17:38.019947 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:38.019909    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2a51efbb-2aef-4c38-988c-14e67882d15b-bound-sa-token\") pod \"image-registry-ff4fb7c64-l9ncd\" (UID: \"2a51efbb-2aef-4c38-988c-14e67882d15b\") " pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd"
Sep 16 02:17:38.019947 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:38.019935    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2a51efbb-2aef-4c38-988c-14e67882d15b-installation-pull-secrets\") pod \"image-registry-ff4fb7c64-l9ncd\" (UID: \"2a51efbb-2aef-4c38-988c-14e67882d15b\") " pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd"
Sep 16 02:17:38.020103 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:38.019971    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2a51efbb-2aef-4c38-988c-14e67882d15b-registry-certificates\") pod \"image-registry-ff4fb7c64-l9ncd\" (UID: \"2a51efbb-2aef-4c38-988c-14e67882d15b\") " pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd"
Sep 16 02:17:38.020103 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:38.020000    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2a51efbb-2aef-4c38-988c-14e67882d15b-trusted-ca\") pod \"image-registry-ff4fb7c64-l9ncd\" (UID: \"2a51efbb-2aef-4c38-988c-14e67882d15b\") " pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd"
Sep 16 02:17:38.020103 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:38.020018    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2a51efbb-2aef-4c38-988c-14e67882d15b-registry-tls\") pod \"image-registry-ff4fb7c64-l9ncd\" (UID: \"2a51efbb-2aef-4c38-988c-14e67882d15b\") " pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd"
Sep 16 02:17:38.120812 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:38.120736    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2a51efbb-2aef-4c38-988c-14e67882d15b-bound-sa-token\") pod \"image-registry-ff4fb7c64-l9ncd\" (UID: \"2a51efbb-2aef-4c38-988c-14e67882d15b\") " pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd"
Sep 16 02:17:38.120812 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:38.120777    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2a51efbb-2aef-4c38-988c-14e67882d15b-installation-pull-secrets\") pod \"image-registry-ff4fb7c64-l9ncd\" (UID: \"2a51efbb-2aef-4c38-988c-14e67882d15b\") " pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd"
Sep 16 02:17:38.121002 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:38.120826    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2a51efbb-2aef-4c38-988c-14e67882d15b-registry-certificates\") pod \"image-registry-ff4fb7c64-l9ncd\" (UID: \"2a51efbb-2aef-4c38-988c-14e67882d15b\") " pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd"
Sep 16 02:17:38.121002 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:38.120873    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2a51efbb-2aef-4c38-988c-14e67882d15b-trusted-ca\") pod \"image-registry-ff4fb7c64-l9ncd\" (UID: \"2a51efbb-2aef-4c38-988c-14e67882d15b\") " pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd"
Sep 16 02:17:38.121002 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:38.120915    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2a51efbb-2aef-4c38-988c-14e67882d15b-registry-tls\") pod \"image-registry-ff4fb7c64-l9ncd\" (UID: \"2a51efbb-2aef-4c38-988c-14e67882d15b\") " pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd"
Sep 16 02:17:38.121002 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:38.120957    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2a51efbb-2aef-4c38-988c-14e67882d15b-image-registry-private-configuration\") pod \"image-registry-ff4fb7c64-l9ncd\" (UID: \"2a51efbb-2aef-4c38-988c-14e67882d15b\") " pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd"
Sep 16 02:17:38.121204 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:38.121008    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9gvl\" (UniqueName: \"kubernetes.io/projected/2a51efbb-2aef-4c38-988c-14e67882d15b-kube-api-access-d9gvl\") pod \"image-registry-ff4fb7c64-l9ncd\" (UID: \"2a51efbb-2aef-4c38-988c-14e67882d15b\") " pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd"
Sep 16 02:17:38.121204 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:38.121035    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2a51efbb-2aef-4c38-988c-14e67882d15b-ca-trust-extracted\") pod \"image-registry-ff4fb7c64-l9ncd\" (UID: \"2a51efbb-2aef-4c38-988c-14e67882d15b\") " pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd"
Sep 16 02:17:38.121449 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:38.121408    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2a51efbb-2aef-4c38-988c-14e67882d15b-ca-trust-extracted\") pod \"image-registry-ff4fb7c64-l9ncd\" (UID: \"2a51efbb-2aef-4c38-988c-14e67882d15b\") " pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd"
Sep 16 02:17:38.121942 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:38.121909    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2a51efbb-2aef-4c38-988c-14e67882d15b-registry-certificates\") pod \"image-registry-ff4fb7c64-l9ncd\" (UID: \"2a51efbb-2aef-4c38-988c-14e67882d15b\") " pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd"
Sep 16 02:17:38.122006 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:38.121987    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2a51efbb-2aef-4c38-988c-14e67882d15b-trusted-ca\") pod \"image-registry-ff4fb7c64-l9ncd\" (UID: \"2a51efbb-2aef-4c38-988c-14e67882d15b\") " pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd"
Sep 16 02:17:38.123465 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:38.123445    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2a51efbb-2aef-4c38-988c-14e67882d15b-image-registry-private-configuration\") pod \"image-registry-ff4fb7c64-l9ncd\" (UID: \"2a51efbb-2aef-4c38-988c-14e67882d15b\") " pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd"
Sep 16 02:17:38.123465 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:38.123460    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2a51efbb-2aef-4c38-988c-14e67882d15b-registry-tls\") pod \"image-registry-ff4fb7c64-l9ncd\" (UID: \"2a51efbb-2aef-4c38-988c-14e67882d15b\") " pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd"
Sep 16 02:17:38.123589 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:38.123558    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2a51efbb-2aef-4c38-988c-14e67882d15b-installation-pull-secrets\") pod \"image-registry-ff4fb7c64-l9ncd\" (UID: \"2a51efbb-2aef-4c38-988c-14e67882d15b\") " pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd"
Sep 16 02:17:38.128061 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:38.128040    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2a51efbb-2aef-4c38-988c-14e67882d15b-bound-sa-token\") pod \"image-registry-ff4fb7c64-l9ncd\" (UID: \"2a51efbb-2aef-4c38-988c-14e67882d15b\") " pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd"
Sep 16 02:17:38.128210 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:38.128191    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9gvl\" (UniqueName: \"kubernetes.io/projected/2a51efbb-2aef-4c38-988c-14e67882d15b-kube-api-access-d9gvl\") pod \"image-registry-ff4fb7c64-l9ncd\" (UID: \"2a51efbb-2aef-4c38-988c-14e67882d15b\") " pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd"
Sep 16 02:17:38.221556 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:38.221531    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd"
Sep 16 02:17:38.515356 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:38.515284    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-ff4fb7c64-l9ncd"]
Sep 16 02:17:38.518431 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:17:38.518405    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a51efbb_2aef_4c38_988c_14e67882d15b.slice/crio-6cedec4bc60e8a72c76d8586ebc5f8495b782f81fec0efab79d4ca0ed7e72f91 WatchSource:0}: Error finding container 6cedec4bc60e8a72c76d8586ebc5f8495b782f81fec0efab79d4ca0ed7e72f91: Status 404 returned error can't find the container with id 6cedec4bc60e8a72c76d8586ebc5f8495b782f81fec0efab79d4ca0ed7e72f91
Sep 16 02:17:39.261735 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:39.261700    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd" event={"ID":"2a51efbb-2aef-4c38-988c-14e67882d15b","Type":"ContainerStarted","Data":"eba93e8ed801291c50af744f0457536e3dfd9df342e195fecb5742cc25194ded"}
Sep 16 02:17:39.262222 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:39.261776    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd" event={"ID":"2a51efbb-2aef-4c38-988c-14e67882d15b","Type":"ContainerStarted","Data":"6cedec4bc60e8a72c76d8586ebc5f8495b782f81fec0efab79d4ca0ed7e72f91"}
Sep 16 02:17:39.262222 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:39.261811    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd"
Sep 16 02:17:39.278730 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:39.278590    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd" podStartSLOduration=2.278573411 podStartE2EDuration="2.278573411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:17:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:17:39.277926421 +0000 UTC m=+264.370108394" watchObservedRunningTime="2026-09-16 02:17:39.278573411 +0000 UTC m=+264.370755386"
Sep 16 02:17:47.859936 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:47.859904    2581 patch_prober.go:28] interesting pod/image-registry-845bcccddb-48xv4 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 16 02:17:47.860448 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:47.859968    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-845bcccddb-48xv4" podUID="93d3b8d1-9425-4f1a-814f-667145b386e4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 02:17:48.091353 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:48.091308    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a93280ba-e14e-4362-a36a-44d64d0591bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c5ng8\" (UID: \"a93280ba-e14e-4362-a36a-44d64d0591bd\") " pod="openshift-insights/insights-runtime-extractor-c5ng8"
Sep 16 02:17:48.093698 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:48.093668    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a93280ba-e14e-4362-a36a-44d64d0591bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c5ng8\" (UID: \"a93280ba-e14e-4362-a36a-44d64d0591bd\") " pod="openshift-insights/insights-runtime-extractor-c5ng8"
Sep 16 02:17:48.313977 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:48.313954    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c5ng8"
Sep 16 02:17:48.584303 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:48.584236    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c5ng8"]
Sep 16 02:17:48.587030 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:17:48.587005    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda93280ba_e14e_4362_a36a_44d64d0591bd.slice/crio-b209b79570bdf378d8736cbc7360ba7e69f04e74c06ae47452addaecdca6011b WatchSource:0}: Error finding container b209b79570bdf378d8736cbc7360ba7e69f04e74c06ae47452addaecdca6011b: Status 404 returned error can't find the container with id b209b79570bdf378d8736cbc7360ba7e69f04e74c06ae47452addaecdca6011b
Sep 16 02:17:49.294446 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:49.294413    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c5ng8" event={"ID":"a93280ba-e14e-4362-a36a-44d64d0591bd","Type":"ContainerStarted","Data":"24a62474983f4cc87a752587d4446ad8708e475e68c41378e2f9ed6dad89b6ec"}
Sep 16 02:17:49.294789 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:49.294471    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c5ng8" event={"ID":"a93280ba-e14e-4362-a36a-44d64d0591bd","Type":"ContainerStarted","Data":"b209b79570bdf378d8736cbc7360ba7e69f04e74c06ae47452addaecdca6011b"}
Sep 16 02:17:50.298803 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:50.298765    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c5ng8" event={"ID":"a93280ba-e14e-4362-a36a-44d64d0591bd","Type":"ContainerStarted","Data":"5da6019824a5a353f7721640aa6ba3aa10f29464608088d558af5e979b83f7bc"}
Sep 16 02:17:51.303652 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:51.303620    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c5ng8" event={"ID":"a93280ba-e14e-4362-a36a-44d64d0591bd","Type":"ContainerStarted","Data":"b30e4404a2fa9ab30b0c9b46fcd2596d278f982cdee323650f19813ef8056864"}
Sep 16 02:17:51.319292 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:51.319250    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-c5ng8" podStartSLOduration=33.067061997 podStartE2EDuration="35.319235942s" totalImagesPullingTime="2.252173945s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 02:17:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:17:51.318161936 +0000 UTC m=+276.410343923" watchObservedRunningTime="2026-09-16 02:17:51.319235942 +0000 UTC m=+276.411417916"
Sep 16 02:17:53.952979 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:17:53.952938    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qz6zp" podUID="d8b0c607-1644-4679-8b1d-be6926f44c81"
Sep 16 02:17:54.313100 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:54.313071    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qz6zp"
Sep 16 02:17:55.195908 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.195879    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bzfmv"]
Sep 16 02:17:55.199436 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.199412    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bzfmv"
Sep 16 02:17:55.202263 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.202242    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 16 02:17:55.202447 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.202320    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 16 02:17:55.202447 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.202240    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 16 02:17:55.202447 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.202430    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 16 02:17:55.203144 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.203126    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qfp9h\""
Sep 16 02:17:55.203233 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.203155    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 16 02:17:55.203233 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.203126    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 16 02:17:55.244063 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.244043    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbc96d3c-ca13-4725-b56b-ffb30e53d154-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bzfmv\" (UID: \"dbc96d3c-ca13-4725-b56b-ffb30e53d154\") " pod="openshift-monitoring/node-exporter-bzfmv"
Sep 16 02:17:55.244240 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.244223    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t4qn\" (UniqueName: \"kubernetes.io/projected/dbc96d3c-ca13-4725-b56b-ffb30e53d154-kube-api-access-5t4qn\") pod \"node-exporter-bzfmv\" (UID: \"dbc96d3c-ca13-4725-b56b-ffb30e53d154\") " pod="openshift-monitoring/node-exporter-bzfmv"
Sep 16 02:17:55.244363 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.244346    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dbc96d3c-ca13-4725-b56b-ffb30e53d154-root\") pod \"node-exporter-bzfmv\" (UID: \"dbc96d3c-ca13-4725-b56b-ffb30e53d154\") " pod="openshift-monitoring/node-exporter-bzfmv"
Sep 16 02:17:55.244451 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.244397    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbc96d3c-ca13-4725-b56b-ffb30e53d154-sys\") pod \"node-exporter-bzfmv\" (UID: \"dbc96d3c-ca13-4725-b56b-ffb30e53d154\") " pod="openshift-monitoring/node-exporter-bzfmv"
Sep 16 02:17:55.244451 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.244423    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dbc96d3c-ca13-4725-b56b-ffb30e53d154-node-exporter-wtmp\") pod \"node-exporter-bzfmv\" (UID: \"dbc96d3c-ca13-4725-b56b-ffb30e53d154\") " pod="openshift-monitoring/node-exporter-bzfmv"
Sep 16 02:17:55.244555 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.244454    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbc96d3c-ca13-4725-b56b-ffb30e53d154-metrics-client-ca\") pod \"node-exporter-bzfmv\" (UID: \"dbc96d3c-ca13-4725-b56b-ffb30e53d154\") " pod="openshift-monitoring/node-exporter-bzfmv"
Sep 16 02:17:55.244555 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.244480    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dbc96d3c-ca13-4725-b56b-ffb30e53d154-node-exporter-accelerators-collector-config\") pod \"node-exporter-bzfmv\" (UID: \"dbc96d3c-ca13-4725-b56b-ffb30e53d154\") " pod="openshift-monitoring/node-exporter-bzfmv"
Sep 16 02:17:55.244555 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.244514    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dbc96d3c-ca13-4725-b56b-ffb30e53d154-node-exporter-textfile\") pod \"node-exporter-bzfmv\" (UID: \"dbc96d3c-ca13-4725-b56b-ffb30e53d154\") " pod="openshift-monitoring/node-exporter-bzfmv"
Sep 16 02:17:55.244555 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.244537    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dbc96d3c-ca13-4725-b56b-ffb30e53d154-node-exporter-tls\") pod \"node-exporter-bzfmv\" (UID: \"dbc96d3c-ca13-4725-b56b-ffb30e53d154\") " pod="openshift-monitoring/node-exporter-bzfmv"
Sep 16 02:17:55.345636 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.345608    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dbc96d3c-ca13-4725-b56b-ffb30e53d154-root\") pod \"node-exporter-bzfmv\" (UID: \"dbc96d3c-ca13-4725-b56b-ffb30e53d154\") " pod="openshift-monitoring/node-exporter-bzfmv"
Sep 16 02:17:55.345768 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.345645    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbc96d3c-ca13-4725-b56b-ffb30e53d154-sys\") pod \"node-exporter-bzfmv\" (UID: \"dbc96d3c-ca13-4725-b56b-ffb30e53d154\") " pod="openshift-monitoring/node-exporter-bzfmv"
Sep 16 02:17:55.345768 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.345660    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dbc96d3c-ca13-4725-b56b-ffb30e53d154-node-exporter-wtmp\") pod \"node-exporter-bzfmv\" (UID: \"dbc96d3c-ca13-4725-b56b-ffb30e53d154\") " pod="openshift-monitoring/node-exporter-bzfmv"
Sep 16 02:17:55.345768 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.345675    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbc96d3c-ca13-4725-b56b-ffb30e53d154-metrics-client-ca\") pod \"node-exporter-bzfmv\" (UID: \"dbc96d3c-ca13-4725-b56b-ffb30e53d154\") " pod="openshift-monitoring/node-exporter-bzfmv"
Sep 16 02:17:55.345768 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.345723    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dbc96d3c-ca13-4725-b56b-ffb30e53d154-root\") pod \"node-exporter-bzfmv\" (UID: \"dbc96d3c-ca13-4725-b56b-ffb30e53d154\") " pod="openshift-monitoring/node-exporter-bzfmv"
Sep 16 02:17:55.345768 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.345732    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbc96d3c-ca13-4725-b56b-ffb30e53d154-sys\") pod \"node-exporter-bzfmv\" (UID: \"dbc96d3c-ca13-4725-b56b-ffb30e53d154\") " pod="openshift-monitoring/node-exporter-bzfmv"
Sep 16 02:17:55.345768 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.345752    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dbc96d3c-ca13-4725-b56b-ffb30e53d154-node-exporter-accelerators-collector-config\") pod \"node-exporter-bzfmv\" (UID: \"dbc96d3c-ca13-4725-b56b-ffb30e53d154\") " pod="openshift-monitoring/node-exporter-bzfmv"
Sep 16 02:17:55.346057 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.345782    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dbc96d3c-ca13-4725-b56b-ffb30e53d154-node-exporter-textfile\") pod \"node-exporter-bzfmv\" (UID: \"dbc96d3c-ca13-4725-b56b-ffb30e53d154\") " pod="openshift-monitoring/node-exporter-bzfmv"
Sep 16 02:17:55.346057 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.345798    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dbc96d3c-ca13-4725-b56b-ffb30e53d154-node-exporter-tls\") pod \"node-exporter-bzfmv\" (UID: \"dbc96d3c-ca13-4725-b56b-ffb30e53d154\") " pod="openshift-monitoring/node-exporter-bzfmv"
Sep 16 02:17:55.346057 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.345804    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dbc96d3c-ca13-4725-b56b-ffb30e53d154-node-exporter-wtmp\") pod \"node-exporter-bzfmv\" (UID: \"dbc96d3c-ca13-4725-b56b-ffb30e53d154\") " pod="openshift-monitoring/node-exporter-bzfmv"
Sep 16 02:17:55.346057 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.345893    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbc96d3c-ca13-4725-b56b-ffb30e53d154-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bzfmv\" (UID: \"dbc96d3c-ca13-4725-b56b-ffb30e53d154\") " pod="openshift-monitoring/node-exporter-bzfmv"
Sep 16 02:17:55.346057 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.345928    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t4qn\" (UniqueName: \"kubernetes.io/projected/dbc96d3c-ca13-4725-b56b-ffb30e53d154-kube-api-access-5t4qn\") pod \"node-exporter-bzfmv\" (UID: \"dbc96d3c-ca13-4725-b56b-ffb30e53d154\") " pod="openshift-monitoring/node-exporter-bzfmv"
Sep 16 02:17:55.346283 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.346190    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbc96d3c-ca13-4725-b56b-ffb30e53d154-metrics-client-ca\") pod \"node-exporter-bzfmv\" (UID: \"dbc96d3c-ca13-4725-b56b-ffb30e53d154\") " pod="openshift-monitoring/node-exporter-bzfmv"
Sep 16 02:17:55.346283 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.346190    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dbc96d3c-ca13-4725-b56b-ffb30e53d154-node-exporter-textfile\") pod \"node-exporter-bzfmv\" (UID: \"dbc96d3c-ca13-4725-b56b-ffb30e53d154\") " pod="openshift-monitoring/node-exporter-bzfmv"
Sep 16 02:17:55.346352 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.346322    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dbc96d3c-ca13-4725-b56b-ffb30e53d154-node-exporter-accelerators-collector-config\") pod \"node-exporter-bzfmv\" (UID: \"dbc96d3c-ca13-4725-b56b-ffb30e53d154\") " pod="openshift-monitoring/node-exporter-bzfmv"
Sep 16 02:17:55.348326 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.348302    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dbc96d3c-ca13-4725-b56b-ffb30e53d154-node-exporter-tls\") pod \"node-exporter-bzfmv\" (UID: \"dbc96d3c-ca13-4725-b56b-ffb30e53d154\") " pod="openshift-monitoring/node-exporter-bzfmv"
Sep 16 02:17:55.348443 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.348425    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbc96d3c-ca13-4725-b56b-ffb30e53d154-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bzfmv\" (UID: \"dbc96d3c-ca13-4725-b56b-ffb30e53d154\") " pod="openshift-monitoring/node-exporter-bzfmv"
Sep 16 02:17:55.356042 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.356022    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t4qn\" (UniqueName: \"kubernetes.io/projected/dbc96d3c-ca13-4725-b56b-ffb30e53d154-kube-api-access-5t4qn\") pod \"node-exporter-bzfmv\" (UID: \"dbc96d3c-ca13-4725-b56b-ffb30e53d154\") " pod="openshift-monitoring/node-exporter-bzfmv"
Sep 16 02:17:55.511321 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:55.511247    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bzfmv"
Sep 16 02:17:55.522546 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:17:55.522520    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbc96d3c_ca13_4725_b56b_ffb30e53d154.slice/crio-5080b873f45a08d9a7f82c9428daa9e14434a6c409307a61f873425c97927df5 WatchSource:0}: Error finding container 5080b873f45a08d9a7f82c9428daa9e14434a6c409307a61f873425c97927df5: Status 404 returned error can't find the container with id 5080b873f45a08d9a7f82c9428daa9e14434a6c409307a61f873425c97927df5
Sep 16 02:17:56.322363 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:56.322317    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bzfmv" event={"ID":"dbc96d3c-ca13-4725-b56b-ffb30e53d154","Type":"ContainerStarted","Data":"5080b873f45a08d9a7f82c9428daa9e14434a6c409307a61f873425c97927df5"}
Sep 16 02:17:57.326831 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:57.326794    2581 generic.go:356] "Generic (PLEG): container finished" podID="dbc96d3c-ca13-4725-b56b-ffb30e53d154" containerID="4cd7e24a3b578802d9d5c66eb1c9940ee0d7bd2c3687f3b186daf3c9c8d46fc9" exitCode=0
Sep 16 02:17:57.327181 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:57.326876    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bzfmv" event={"ID":"dbc96d3c-ca13-4725-b56b-ffb30e53d154","Type":"ContainerDied","Data":"4cd7e24a3b578802d9d5c66eb1c9940ee0d7bd2c3687f3b186daf3c9c8d46fc9"}
Sep 16 02:17:57.859349 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:57.859318    2581 patch_prober.go:28] interesting pod/image-registry-845bcccddb-48xv4 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 16 02:17:57.859494 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:57.859366    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-845bcccddb-48xv4" podUID="93d3b8d1-9425-4f1a-814f-667145b386e4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 02:17:57.863640 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:57.863611    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8b0c607-1644-4679-8b1d-be6926f44c81-metrics-tls\") pod \"dns-default-qz6zp\" (UID: \"d8b0c607-1644-4679-8b1d-be6926f44c81\") " pod="openshift-dns/dns-default-qz6zp"
Sep 16 02:17:57.865998 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:57.865983    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d8b0c607-1644-4679-8b1d-be6926f44c81-metrics-tls\") pod \"dns-default-qz6zp\" (UID: \"d8b0c607-1644-4679-8b1d-be6926f44c81\") " pod="openshift-dns/dns-default-qz6zp"
Sep 16 02:17:57.915686 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:57.915667    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h6q9g\""
Sep 16 02:17:57.924282 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:57.924265    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qz6zp"
Sep 16 02:17:58.190619 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:58.190545    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qz6zp"]
Sep 16 02:17:58.194621 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:17:58.194589    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8b0c607_1644_4679_8b1d_be6926f44c81.slice/crio-5608565ea60d0057565db2540c8f56158e4ba1d37151e12b17abc80f5c5adfff WatchSource:0}: Error finding container 5608565ea60d0057565db2540c8f56158e4ba1d37151e12b17abc80f5c5adfff: Status 404 returned error can't find the container with id 5608565ea60d0057565db2540c8f56158e4ba1d37151e12b17abc80f5c5adfff
Sep 16 02:17:58.226260 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:58.226237    2581 patch_prober.go:28] interesting pod/image-registry-ff4fb7c64-l9ncd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 16 02:17:58.226353 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:58.226279    2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd" podUID="2a51efbb-2aef-4c38-988c-14e67882d15b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 02:17:58.331158 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:58.331130    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qz6zp" event={"ID":"d8b0c607-1644-4679-8b1d-be6926f44c81","Type":"ContainerStarted","Data":"5608565ea60d0057565db2540c8f56158e4ba1d37151e12b17abc80f5c5adfff"}
Sep 16 02:17:58.333264 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:58.333239    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bzfmv" event={"ID":"dbc96d3c-ca13-4725-b56b-ffb30e53d154","Type":"ContainerStarted","Data":"b0dd580d4931f40cf37fd2a0d13a87b1f9e6e1cc624fa0f666d81ac07597cfd2"}
Sep 16 02:17:58.333358 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:58.333286    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bzfmv" event={"ID":"dbc96d3c-ca13-4725-b56b-ffb30e53d154","Type":"ContainerStarted","Data":"a5105de6302c8d5bc69fdc5f58c72a2c36d60fe822575bcd90d10ee35faf9a31"}
Sep 16 02:17:58.349625 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:58.349584    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bzfmv" podStartSLOduration=2.303743976 podStartE2EDuration="3.349565341s" totalImagesPullingTime="976.280102ms" totalInitContainerRuntime="69.541263ms" isStatefulPod=true podCreationTimestamp="2026-09-16 02:17:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:17:58.34907974 +0000 UTC m=+283.441261714" watchObservedRunningTime="2026-09-16 02:17:58.349565341 +0000 UTC m=+283.441747316"
Sep 16 02:17:59.140312 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.140280    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-f4d9954b6-6pbh5"]
Sep 16 02:17:59.143680 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.143663    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5"
Sep 16 02:17:59.145905 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.145872    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 16 02:17:59.146026 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.145912    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 16 02:17:59.146026 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.145924    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bqpltspr98mps\""
Sep 16 02:17:59.146026 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.145936    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 16 02:17:59.146026 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.145981    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-8dlst\""
Sep 16 02:17:59.146026 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.145995    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 16 02:17:59.146253 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.146238    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 16 02:17:59.153055 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.153035    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f4d9954b6-6pbh5"]
Sep 16 02:17:59.276003 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.275972    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/601b7f19-d5d9-459b-9306-549195b4ce10-metrics-client-ca\") pod \"thanos-querier-f4d9954b6-6pbh5\" (UID: \"601b7f19-d5d9-459b-9306-549195b4ce10\") " pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5"
Sep 16 02:17:59.276003 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.276001    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/601b7f19-d5d9-459b-9306-549195b4ce10-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f4d9954b6-6pbh5\" (UID: \"601b7f19-d5d9-459b-9306-549195b4ce10\") " pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5"
Sep 16 02:17:59.276177 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.276022    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/601b7f19-d5d9-459b-9306-549195b4ce10-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f4d9954b6-6pbh5\" (UID: \"601b7f19-d5d9-459b-9306-549195b4ce10\") " pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5"
Sep 16 02:17:59.276177 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.276043    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/601b7f19-d5d9-459b-9306-549195b4ce10-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f4d9954b6-6pbh5\" (UID: \"601b7f19-d5d9-459b-9306-549195b4ce10\") " pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5"
Sep 16 02:17:59.276177 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.276076    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/601b7f19-d5d9-459b-9306-549195b4ce10-secret-thanos-querier-tls\") pod \"thanos-querier-f4d9954b6-6pbh5\" (UID: \"601b7f19-d5d9-459b-9306-549195b4ce10\") " pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5"
Sep 16 02:17:59.276177 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.276109    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/601b7f19-d5d9-459b-9306-549195b4ce10-secret-grpc-tls\") pod \"thanos-querier-f4d9954b6-6pbh5\" (UID: \"601b7f19-d5d9-459b-9306-549195b4ce10\") " pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5"
Sep 16 02:17:59.276177 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.276142    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q28fr\" (UniqueName: \"kubernetes.io/projected/601b7f19-d5d9-459b-9306-549195b4ce10-kube-api-access-q28fr\") pod \"thanos-querier-f4d9954b6-6pbh5\" (UID: \"601b7f19-d5d9-459b-9306-549195b4ce10\") " pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5"
Sep 16 02:17:59.276177 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.276167    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/601b7f19-d5d9-459b-9306-549195b4ce10-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f4d9954b6-6pbh5\" (UID: \"601b7f19-d5d9-459b-9306-549195b4ce10\") " pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5"
Sep 16 02:17:59.376710 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.376677    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/601b7f19-d5d9-459b-9306-549195b4ce10-metrics-client-ca\") pod \"thanos-querier-f4d9954b6-6pbh5\" (UID: \"601b7f19-d5d9-459b-9306-549195b4ce10\") " pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5"
Sep 16 02:17:59.377155 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.376717    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/601b7f19-d5d9-459b-9306-549195b4ce10-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f4d9954b6-6pbh5\" (UID: \"601b7f19-d5d9-459b-9306-549195b4ce10\") " pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5"
Sep 16 02:17:59.377155 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.376747    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/601b7f19-d5d9-459b-9306-549195b4ce10-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f4d9954b6-6pbh5\" (UID: \"601b7f19-d5d9-459b-9306-549195b4ce10\") " pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5"
Sep 16 02:17:59.377155 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.376772    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/601b7f19-d5d9-459b-9306-549195b4ce10-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f4d9954b6-6pbh5\" (UID: \"601b7f19-d5d9-459b-9306-549195b4ce10\") " pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5"
Sep 16 02:17:59.377155 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.376802    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/601b7f19-d5d9-459b-9306-549195b4ce10-secret-thanos-querier-tls\") pod \"thanos-querier-f4d9954b6-6pbh5\" (UID: \"601b7f19-d5d9-459b-9306-549195b4ce10\") " pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5"
Sep 16 02:17:59.377155 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.376973    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/601b7f19-d5d9-459b-9306-549195b4ce10-secret-grpc-tls\") pod \"thanos-querier-f4d9954b6-6pbh5\" (UID: \"601b7f19-d5d9-459b-9306-549195b4ce10\") " pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5"
Sep 16 02:17:59.377155 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.377030    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q28fr\" (UniqueName: \"kubernetes.io/projected/601b7f19-d5d9-459b-9306-549195b4ce10-kube-api-access-q28fr\") pod \"thanos-querier-f4d9954b6-6pbh5\" (UID: \"601b7f19-d5d9-459b-9306-549195b4ce10\") " pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5"
Sep 16 02:17:59.377155 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.377082    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/601b7f19-d5d9-459b-9306-549195b4ce10-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f4d9954b6-6pbh5\" (UID: \"601b7f19-d5d9-459b-9306-549195b4ce10\") " pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5"
Sep 16 02:17:59.377759 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.377555    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/601b7f19-d5d9-459b-9306-549195b4ce10-metrics-client-ca\") pod \"thanos-querier-f4d9954b6-6pbh5\" (UID: \"601b7f19-d5d9-459b-9306-549195b4ce10\") " pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5"
Sep 16 02:17:59.379747 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.379722    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/601b7f19-d5d9-459b-9306-549195b4ce10-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f4d9954b6-6pbh5\" (UID: \"601b7f19-d5d9-459b-9306-549195b4ce10\") " pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5"
Sep 16 02:17:59.380169 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.380121    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/601b7f19-d5d9-459b-9306-549195b4ce10-secret-thanos-querier-tls\") pod \"thanos-querier-f4d9954b6-6pbh5\" (UID: \"601b7f19-d5d9-459b-9306-549195b4ce10\") " pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5"
Sep 16 02:17:59.380428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.380404    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/601b7f19-d5d9-459b-9306-549195b4ce10-secret-grpc-tls\") pod \"thanos-querier-f4d9954b6-6pbh5\" (UID: \"601b7f19-d5d9-459b-9306-549195b4ce10\") " pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5"
Sep 16 02:17:59.380511 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.380426    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/601b7f19-d5d9-459b-9306-549195b4ce10-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f4d9954b6-6pbh5\" (UID: \"601b7f19-d5d9-459b-9306-549195b4ce10\") " pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5"
Sep 16 02:17:59.380583 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.380521    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/601b7f19-d5d9-459b-9306-549195b4ce10-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f4d9954b6-6pbh5\" (UID: \"601b7f19-d5d9-459b-9306-549195b4ce10\") " pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5"
Sep 16 02:17:59.380747 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.380726    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/601b7f19-d5d9-459b-9306-549195b4ce10-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f4d9954b6-6pbh5\" (UID: \"601b7f19-d5d9-459b-9306-549195b4ce10\") " pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5"
Sep 16 02:17:59.384614 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.384590    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q28fr\" (UniqueName: \"kubernetes.io/projected/601b7f19-d5d9-459b-9306-549195b4ce10-kube-api-access-q28fr\") pod \"thanos-querier-f4d9954b6-6pbh5\" (UID: \"601b7f19-d5d9-459b-9306-549195b4ce10\") " pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5"
Sep 16 02:17:59.453244 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.453189    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5"
Sep 16 02:17:59.728584 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.728495    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f4d9954b6-6pbh5"]
Sep 16 02:17:59.933787 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.933757    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-d6jm7"]
Sep 16 02:17:59.937517 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.937497    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d6jm7"
Sep 16 02:17:59.939649 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.939628    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 16 02:17:59.939752 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.939633    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hzjcw\""
Sep 16 02:17:59.943134 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.943114    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-d6jm7"]
Sep 16 02:17:59.982746 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.982678    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7m89\" (UniqueName: \"kubernetes.io/projected/f4b263ed-2452-4743-a48c-3958f4231c96-kube-api-access-c7m89\") pod \"monitoring-plugin-5d85778b9d-d6jm7\" (UID: \"f4b263ed-2452-4743-a48c-3958f4231c96\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d6jm7"
Sep 16 02:17:59.982899 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:17:59.982743    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f4b263ed-2452-4743-a48c-3958f4231c96-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-d6jm7\" (UID: \"f4b263ed-2452-4743-a48c-3958f4231c96\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d6jm7"
Sep 16 02:18:00.083985 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:00.083947    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f4b263ed-2452-4743-a48c-3958f4231c96-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-d6jm7\" (UID: \"f4b263ed-2452-4743-a48c-3958f4231c96\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d6jm7"
Sep 16 02:18:00.084161 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:00.084050    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7m89\" (UniqueName: \"kubernetes.io/projected/f4b263ed-2452-4743-a48c-3958f4231c96-kube-api-access-c7m89\") pod \"monitoring-plugin-5d85778b9d-d6jm7\" (UID: \"f4b263ed-2452-4743-a48c-3958f4231c96\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d6jm7"
Sep 16 02:18:00.084161 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:18:00.084141    2581 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 16 02:18:00.084277 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:18:00.084222    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4b263ed-2452-4743-a48c-3958f4231c96-monitoring-plugin-cert podName:f4b263ed-2452-4743-a48c-3958f4231c96 nodeName:}" failed. No retries permitted until 2026-09-16 02:18:00.58420188 +0000 UTC m=+285.676383838 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/f4b263ed-2452-4743-a48c-3958f4231c96-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-d6jm7" (UID: "f4b263ed-2452-4743-a48c-3958f4231c96") : secret "monitoring-plugin-cert" not found
Sep 16 02:18:00.093938 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:00.093909    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7m89\" (UniqueName: \"kubernetes.io/projected/f4b263ed-2452-4743-a48c-3958f4231c96-kube-api-access-c7m89\") pod \"monitoring-plugin-5d85778b9d-d6jm7\" (UID: \"f4b263ed-2452-4743-a48c-3958f4231c96\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d6jm7"
Sep 16 02:18:00.105329 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:18:00.105301    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod601b7f19_d5d9_459b_9306_549195b4ce10.slice/crio-886b64b5e7afa3db114bc93b831a50c68316b805e804b791747b4ca9da5bdf99 WatchSource:0}: Error finding container 886b64b5e7afa3db114bc93b831a50c68316b805e804b791747b4ca9da5bdf99: Status 404 returned error can't find the container with id 886b64b5e7afa3db114bc93b831a50c68316b805e804b791747b4ca9da5bdf99
Sep 16 02:18:00.270941 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:00.270915    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-ff4fb7c64-l9ncd"
Sep 16 02:18:00.342113 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:00.342085    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qz6zp" event={"ID":"d8b0c607-1644-4679-8b1d-be6926f44c81","Type":"ContainerStarted","Data":"23e8a81da0cafdda581874c746a7ad2e30a32af06cc05c096650a0a2b84de3d9"}
Sep 16 02:18:00.343401 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:00.343376    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5" event={"ID":"601b7f19-d5d9-459b-9306-549195b4ce10","Type":"ContainerStarted","Data":"886b64b5e7afa3db114bc93b831a50c68316b805e804b791747b4ca9da5bdf99"}
Sep 16 02:18:00.588485 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:00.588454    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f4b263ed-2452-4743-a48c-3958f4231c96-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-d6jm7\" (UID: \"f4b263ed-2452-4743-a48c-3958f4231c96\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d6jm7"
Sep 16 02:18:00.588871 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:18:00.588578    2581 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 16 02:18:00.588871 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:18:00.588638    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4b263ed-2452-4743-a48c-3958f4231c96-monitoring-plugin-cert podName:f4b263ed-2452-4743-a48c-3958f4231c96 nodeName:}" failed. No retries permitted until 2026-09-16 02:18:01.588624129 +0000 UTC m=+286.680806081 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/f4b263ed-2452-4743-a48c-3958f4231c96-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-d6jm7" (UID: "f4b263ed-2452-4743-a48c-3958f4231c96") : secret "monitoring-plugin-cert" not found
Sep 16 02:18:01.349949 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:01.349914    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qz6zp" event={"ID":"d8b0c607-1644-4679-8b1d-be6926f44c81","Type":"ContainerStarted","Data":"966d65a4c66aea8e717386c46cd85090a3565b4749814d7269da6983dceeef55"}
Sep 16 02:18:01.350131 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:01.350029    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qz6zp"
Sep 16 02:18:01.372100 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:01.372052    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qz6zp" podStartSLOduration=252.417079603 podStartE2EDuration="4m14.372033315s" totalImagesPullingTime="1.954953712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:13:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:18:01.371169721 +0000 UTC m=+286.463351697" watchObservedRunningTime="2026-09-16 02:18:01.372033315 +0000 UTC m=+286.464215292"
Sep 16 02:18:01.594899 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:01.594865    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f4b263ed-2452-4743-a48c-3958f4231c96-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-d6jm7\" (UID: \"f4b263ed-2452-4743-a48c-3958f4231c96\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d6jm7"
Sep 16 02:18:01.597607 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:01.597582    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f4b263ed-2452-4743-a48c-3958f4231c96-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-d6jm7\" (UID: \"f4b263ed-2452-4743-a48c-3958f4231c96\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d6jm7"
Sep 16 02:18:01.749000 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:01.748920    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d6jm7"
Sep 16 02:18:02.022276 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:02.022208    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-d6jm7"]
Sep 16 02:18:02.515289 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:18:02.515260    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4b263ed_2452_4743_a48c_3958f4231c96.slice/crio-acecf481acb11341f65f0d4382a5c89d25d0470181ee6e3163a34cc49e46fb3f WatchSource:0}: Error finding container acecf481acb11341f65f0d4382a5c89d25d0470181ee6e3163a34cc49e46fb3f: Status 404 returned error can't find the container with id acecf481acb11341f65f0d4382a5c89d25d0470181ee6e3163a34cc49e46fb3f
Sep 16 02:18:02.873185 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:02.873146    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-845bcccddb-48xv4" podUID="93d3b8d1-9425-4f1a-814f-667145b386e4" containerName="registry" containerID="cri-o://dbae21ada2973f522a0981dc6a2da9bf08481258c7f6f93b80fc842df31b5dc1" gracePeriod=30
Sep 16 02:18:03.115398 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.115373    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:18:03.207830 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.207772    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-registry-tls\") pod \"93d3b8d1-9425-4f1a-814f-667145b386e4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") "
Sep 16 02:18:03.207951 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.207839    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93d3b8d1-9425-4f1a-814f-667145b386e4-trusted-ca\") pod \"93d3b8d1-9425-4f1a-814f-667145b386e4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") "
Sep 16 02:18:03.207951 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.207886    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93d3b8d1-9425-4f1a-814f-667145b386e4-installation-pull-secrets\") pod \"93d3b8d1-9425-4f1a-814f-667145b386e4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") "
Sep 16 02:18:03.207951 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.207917    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpz2w\" (UniqueName: \"kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-kube-api-access-tpz2w\") pod \"93d3b8d1-9425-4f1a-814f-667145b386e4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") "
Sep 16 02:18:03.208100 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.207954    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93d3b8d1-9425-4f1a-814f-667145b386e4-ca-trust-extracted\") pod \"93d3b8d1-9425-4f1a-814f-667145b386e4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") "
Sep 16 02:18:03.208100 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.208021    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93d3b8d1-9425-4f1a-814f-667145b386e4-registry-certificates\") pod \"93d3b8d1-9425-4f1a-814f-667145b386e4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") "
Sep 16 02:18:03.208100 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.208047    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-bound-sa-token\") pod \"93d3b8d1-9425-4f1a-814f-667145b386e4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") "
Sep 16 02:18:03.208100 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.208073    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93d3b8d1-9425-4f1a-814f-667145b386e4-image-registry-private-configuration\") pod \"93d3b8d1-9425-4f1a-814f-667145b386e4\" (UID: \"93d3b8d1-9425-4f1a-814f-667145b386e4\") "
Sep 16 02:18:03.208358 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.208333    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93d3b8d1-9425-4f1a-814f-667145b386e4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "93d3b8d1-9425-4f1a-814f-667145b386e4" (UID: "93d3b8d1-9425-4f1a-814f-667145b386e4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:18:03.208423 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.208365    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93d3b8d1-9425-4f1a-814f-667145b386e4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "93d3b8d1-9425-4f1a-814f-667145b386e4" (UID: "93d3b8d1-9425-4f1a-814f-667145b386e4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:18:03.210274 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.210245    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93d3b8d1-9425-4f1a-814f-667145b386e4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "93d3b8d1-9425-4f1a-814f-667145b386e4" (UID: "93d3b8d1-9425-4f1a-814f-667145b386e4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:18:03.210384 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.210307    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-kube-api-access-tpz2w" (OuterVolumeSpecName: "kube-api-access-tpz2w") pod "93d3b8d1-9425-4f1a-814f-667145b386e4" (UID: "93d3b8d1-9425-4f1a-814f-667145b386e4"). InnerVolumeSpecName "kube-api-access-tpz2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:18:03.210616 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.210600    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "93d3b8d1-9425-4f1a-814f-667145b386e4" (UID: "93d3b8d1-9425-4f1a-814f-667145b386e4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:18:03.210692 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.210673    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "93d3b8d1-9425-4f1a-814f-667145b386e4" (UID: "93d3b8d1-9425-4f1a-814f-667145b386e4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:18:03.210692 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.210681    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93d3b8d1-9425-4f1a-814f-667145b386e4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "93d3b8d1-9425-4f1a-814f-667145b386e4" (UID: "93d3b8d1-9425-4f1a-814f-667145b386e4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:18:03.216466 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.216444    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93d3b8d1-9425-4f1a-814f-667145b386e4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "93d3b8d1-9425-4f1a-814f-667145b386e4" (UID: "93d3b8d1-9425-4f1a-814f-667145b386e4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:18:03.309230 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.309199    2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93d3b8d1-9425-4f1a-814f-667145b386e4-registry-certificates\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:18:03.309230 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.309234    2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-bound-sa-token\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:18:03.309451 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.309249    2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93d3b8d1-9425-4f1a-814f-667145b386e4-image-registry-private-configuration\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:18:03.309451 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.309265    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-registry-tls\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:18:03.309451 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.309279    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93d3b8d1-9425-4f1a-814f-667145b386e4-trusted-ca\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:18:03.309451 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.309291    2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93d3b8d1-9425-4f1a-814f-667145b386e4-installation-pull-secrets\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:18:03.309451 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.309303    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpz2w\" (UniqueName: \"kubernetes.io/projected/93d3b8d1-9425-4f1a-814f-667145b386e4-kube-api-access-tpz2w\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:18:03.309451 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.309315    2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93d3b8d1-9425-4f1a-814f-667145b386e4-ca-trust-extracted\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:18:03.361085 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.361040    2581 generic.go:356] "Generic (PLEG): container finished" podID="93d3b8d1-9425-4f1a-814f-667145b386e4" containerID="dbae21ada2973f522a0981dc6a2da9bf08481258c7f6f93b80fc842df31b5dc1" exitCode=0
Sep 16 02:18:03.361243 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.361137    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-845bcccddb-48xv4" event={"ID":"93d3b8d1-9425-4f1a-814f-667145b386e4","Type":"ContainerDied","Data":"dbae21ada2973f522a0981dc6a2da9bf08481258c7f6f93b80fc842df31b5dc1"}
Sep 16 02:18:03.361243 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.361188    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-845bcccddb-48xv4" event={"ID":"93d3b8d1-9425-4f1a-814f-667145b386e4","Type":"ContainerDied","Data":"005c3b2f5d34785872d4424156227ac04c6ca67117a7bbc1c86e12ca8a59b963"}
Sep 16 02:18:03.361243 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.361216    2581 scope.go:117] "RemoveContainer" containerID="dbae21ada2973f522a0981dc6a2da9bf08481258c7f6f93b80fc842df31b5dc1"
Sep 16 02:18:03.361407 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.361359    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-845bcccddb-48xv4"
Sep 16 02:18:03.363835 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.363396    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d6jm7" event={"ID":"f4b263ed-2452-4743-a48c-3958f4231c96","Type":"ContainerStarted","Data":"acecf481acb11341f65f0d4382a5c89d25d0470181ee6e3163a34cc49e46fb3f"}
Sep 16 02:18:03.368129 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.368103    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5" event={"ID":"601b7f19-d5d9-459b-9306-549195b4ce10","Type":"ContainerStarted","Data":"b7df3fc055c390102b4e683721923f8f3c7ac1d1327d85e944021c7e37a80ec3"}
Sep 16 02:18:03.368214 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.368177    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5" event={"ID":"601b7f19-d5d9-459b-9306-549195b4ce10","Type":"ContainerStarted","Data":"3d9a2b4953e53317caabbf57d6f200a7d6f736171d141ea47b9eb74ba9cab4bb"}
Sep 16 02:18:03.368283 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.368220    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5" event={"ID":"601b7f19-d5d9-459b-9306-549195b4ce10","Type":"ContainerStarted","Data":"ded6e118efc3ae0d00c1ae760a331c98617e4fee90eed8bce0f7f8c879a703a9"}
Sep 16 02:18:03.375404 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.375174    2581 scope.go:117] "RemoveContainer" containerID="dbae21ada2973f522a0981dc6a2da9bf08481258c7f6f93b80fc842df31b5dc1"
Sep 16 02:18:03.376667 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:18:03.376634    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbae21ada2973f522a0981dc6a2da9bf08481258c7f6f93b80fc842df31b5dc1\": container with ID starting with dbae21ada2973f522a0981dc6a2da9bf08481258c7f6f93b80fc842df31b5dc1 not found: ID does not exist" containerID="dbae21ada2973f522a0981dc6a2da9bf08481258c7f6f93b80fc842df31b5dc1"
Sep 16 02:18:03.376765 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.376678    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbae21ada2973f522a0981dc6a2da9bf08481258c7f6f93b80fc842df31b5dc1"} err="failed to get container status \"dbae21ada2973f522a0981dc6a2da9bf08481258c7f6f93b80fc842df31b5dc1\": rpc error: code = NotFound desc = could not find container \"dbae21ada2973f522a0981dc6a2da9bf08481258c7f6f93b80fc842df31b5dc1\": container with ID starting with dbae21ada2973f522a0981dc6a2da9bf08481258c7f6f93b80fc842df31b5dc1 not found: ID does not exist"
Sep 16 02:18:03.388231 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.388208    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-845bcccddb-48xv4"]
Sep 16 02:18:03.394394 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:03.394373    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-845bcccddb-48xv4"]
Sep 16 02:18:04.374183 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:04.374143    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d6jm7" event={"ID":"f4b263ed-2452-4743-a48c-3958f4231c96","Type":"ContainerStarted","Data":"0acad05df4d8e8b411ac2312965dd35300a01d5ca24a3762df45abdc81140f94"}
Sep 16 02:18:04.374611 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:04.374259    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d6jm7"
Sep 16 02:18:04.377537 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:04.377510    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5" event={"ID":"601b7f19-d5d9-459b-9306-549195b4ce10","Type":"ContainerStarted","Data":"fbc3e6e8a2ec23c2b818b6228a5cfd66b39cbaca0da0e9dcf86564923a7a682a"}
Sep 16 02:18:04.377668 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:04.377560    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5" event={"ID":"601b7f19-d5d9-459b-9306-549195b4ce10","Type":"ContainerStarted","Data":"a948b259bcf01ac738b7ca9005f1d3e951dba0d432914d142500674837bb9d99"}
Sep 16 02:18:04.377668 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:04.377588    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5" event={"ID":"601b7f19-d5d9-459b-9306-549195b4ce10","Type":"ContainerStarted","Data":"83e36fdfc19694074e06e368011b9ebf63a5cf0f2da7c1c7d07ee4e2fa092039"}
Sep 16 02:18:04.377802 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:04.377673    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5"
Sep 16 02:18:04.379388 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:04.379372    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d6jm7"
Sep 16 02:18:04.388061 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:04.388024    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d6jm7" podStartSLOduration=3.871164116 podStartE2EDuration="5.388011788s" totalImagesPullingTime="1.516847672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:17:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:18:04.38653637 +0000 UTC m=+289.478718341" watchObservedRunningTime="2026-09-16 02:18:04.388011788 +0000 UTC m=+289.480193811"
Sep 16 02:18:04.405300 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:04.405270    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5" podStartSLOduration=2.11605477 podStartE2EDuration="5.405259028s" totalImagesPullingTime="3.289204258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:17:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:18:04.404074039 +0000 UTC m=+289.496256012" watchObservedRunningTime="2026-09-16 02:18:04.405259028 +0000 UTC m=+289.497441001"
Sep 16 02:18:05.381795 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:05.381758    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93d3b8d1-9425-4f1a-814f-667145b386e4" path="/var/lib/kubelet/pods/93d3b8d1-9425-4f1a-814f-667145b386e4/volumes"
Sep 16 02:18:06.377234 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:18:06.377196    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2b8mm" podUID="df380f84-e4cf-477f-b44f-86c7f533ce9c"
Sep 16 02:18:10.387949 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:10.387922    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-f4d9954b6-6pbh5"
Sep 16 02:18:11.356976 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:11.356948    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qz6zp"
Sep 16 02:18:15.294626 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:15.294606    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g54gh_308f30e2-2871-442a-ba30-54ada02ad832/ovn-acl-logging/0.log"
Sep 16 02:18:15.295717 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:15.295700    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g54gh_308f30e2-2871-442a-ba30-54ada02ad832/ovn-acl-logging/0.log"
Sep 16 02:18:15.301895 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:15.301879    2581 kubelet.go:1648] "Image garbage collection succeeded"
Sep 16 02:18:17.815211 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:17.815184    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f4d95dbf5-4g4nr"]
Sep 16 02:18:17.816708 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:17.815454    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93d3b8d1-9425-4f1a-814f-667145b386e4" containerName="registry"
Sep 16 02:18:17.816708 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:17.815463    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="93d3b8d1-9425-4f1a-814f-667145b386e4" containerName="registry"
Sep 16 02:18:17.816708 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:17.815521    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="93d3b8d1-9425-4f1a-814f-667145b386e4" containerName="registry"
Sep 16 02:18:17.817303 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:17.817288    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4d95dbf5-4g4nr"
Sep 16 02:18:17.819393 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:17.819373    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wrs7f\""
Sep 16 02:18:17.819543 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:17.819527    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 16 02:18:17.820338 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:17.820322    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 16 02:18:17.820439 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:17.820328    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 16 02:18:17.820439 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:17.820411    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 16 02:18:17.820551 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:17.820449    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 16 02:18:17.820551 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:17.820411    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 16 02:18:17.820551 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:17.820340    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 16 02:18:17.829507 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:17.829487    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f4d95dbf5-4g4nr"]
Sep 16 02:18:17.914778 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:17.914750    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11d7db7b-696d-4781-82ff-31bb37a568dc-console-serving-cert\") pod \"console-6f4d95dbf5-4g4nr\" (UID: \"11d7db7b-696d-4781-82ff-31bb37a568dc\") " pod="openshift-console/console-6f4d95dbf5-4g4nr"
Sep 16 02:18:17.914926 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:17.914791    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11d7db7b-696d-4781-82ff-31bb37a568dc-service-ca\") pod \"console-6f4d95dbf5-4g4nr\" (UID: \"11d7db7b-696d-4781-82ff-31bb37a568dc\") " pod="openshift-console/console-6f4d95dbf5-4g4nr"
Sep 16 02:18:17.914926 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:17.914824    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11d7db7b-696d-4781-82ff-31bb37a568dc-console-config\") pod \"console-6f4d95dbf5-4g4nr\" (UID: \"11d7db7b-696d-4781-82ff-31bb37a568dc\") " pod="openshift-console/console-6f4d95dbf5-4g4nr"
Sep 16 02:18:17.914926 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:17.914877    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11d7db7b-696d-4781-82ff-31bb37a568dc-console-oauth-config\") pod \"console-6f4d95dbf5-4g4nr\" (UID: \"11d7db7b-696d-4781-82ff-31bb37a568dc\") " pod="openshift-console/console-6f4d95dbf5-4g4nr"
Sep 16 02:18:17.914926 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:17.914917    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzj9p\" (UniqueName: \"kubernetes.io/projected/11d7db7b-696d-4781-82ff-31bb37a568dc-kube-api-access-xzj9p\") pod \"console-6f4d95dbf5-4g4nr\" (UID: \"11d7db7b-696d-4781-82ff-31bb37a568dc\") " pod="openshift-console/console-6f4d95dbf5-4g4nr"
Sep 16 02:18:17.915054 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:17.914948    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11d7db7b-696d-4781-82ff-31bb37a568dc-oauth-serving-cert\") pod \"console-6f4d95dbf5-4g4nr\" (UID: \"11d7db7b-696d-4781-82ff-31bb37a568dc\") " pod="openshift-console/console-6f4d95dbf5-4g4nr"
Sep 16 02:18:18.016140 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:18.016114    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11d7db7b-696d-4781-82ff-31bb37a568dc-service-ca\") pod \"console-6f4d95dbf5-4g4nr\" (UID: \"11d7db7b-696d-4781-82ff-31bb37a568dc\") " pod="openshift-console/console-6f4d95dbf5-4g4nr"
Sep 16 02:18:18.016233 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:18.016144    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11d7db7b-696d-4781-82ff-31bb37a568dc-console-config\") pod \"console-6f4d95dbf5-4g4nr\" (UID: \"11d7db7b-696d-4781-82ff-31bb37a568dc\") " pod="openshift-console/console-6f4d95dbf5-4g4nr"
Sep 16 02:18:18.016233 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:18.016161    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11d7db7b-696d-4781-82ff-31bb37a568dc-console-oauth-config\") pod \"console-6f4d95dbf5-4g4nr\" (UID: \"11d7db7b-696d-4781-82ff-31bb37a568dc\") " pod="openshift-console/console-6f4d95dbf5-4g4nr"
Sep 16 02:18:18.016233 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:18.016193    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzj9p\" (UniqueName: \"kubernetes.io/projected/11d7db7b-696d-4781-82ff-31bb37a568dc-kube-api-access-xzj9p\") pod \"console-6f4d95dbf5-4g4nr\" (UID: \"11d7db7b-696d-4781-82ff-31bb37a568dc\") " pod="openshift-console/console-6f4d95dbf5-4g4nr"
Sep 16 02:18:18.016233 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:18.016213    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11d7db7b-696d-4781-82ff-31bb37a568dc-oauth-serving-cert\") pod \"console-6f4d95dbf5-4g4nr\" (UID: \"11d7db7b-696d-4781-82ff-31bb37a568dc\") " pod="openshift-console/console-6f4d95dbf5-4g4nr"
Sep 16 02:18:18.016463 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:18.016246    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11d7db7b-696d-4781-82ff-31bb37a568dc-console-serving-cert\") pod \"console-6f4d95dbf5-4g4nr\" (UID: \"11d7db7b-696d-4781-82ff-31bb37a568dc\") " pod="openshift-console/console-6f4d95dbf5-4g4nr"
Sep 16 02:18:18.016867 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:18.016821    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11d7db7b-696d-4781-82ff-31bb37a568dc-console-config\") pod \"console-6f4d95dbf5-4g4nr\" (UID: \"11d7db7b-696d-4781-82ff-31bb37a568dc\") " pod="openshift-console/console-6f4d95dbf5-4g4nr"
Sep 16 02:18:18.017136 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:18.016899    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11d7db7b-696d-4781-82ff-31bb37a568dc-service-ca\") pod \"console-6f4d95dbf5-4g4nr\" (UID: \"11d7db7b-696d-4781-82ff-31bb37a568dc\") " pod="openshift-console/console-6f4d95dbf5-4g4nr"
Sep 16 02:18:18.017203 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:18.017151    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11d7db7b-696d-4781-82ff-31bb37a568dc-oauth-serving-cert\") pod \"console-6f4d95dbf5-4g4nr\" (UID: \"11d7db7b-696d-4781-82ff-31bb37a568dc\") " pod="openshift-console/console-6f4d95dbf5-4g4nr"
Sep 16 02:18:18.018759 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:18.018734    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11d7db7b-696d-4781-82ff-31bb37a568dc-console-serving-cert\") pod \"console-6f4d95dbf5-4g4nr\" (UID: \"11d7db7b-696d-4781-82ff-31bb37a568dc\") " pod="openshift-console/console-6f4d95dbf5-4g4nr"
Sep 16 02:18:18.018820 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:18.018738    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11d7db7b-696d-4781-82ff-31bb37a568dc-console-oauth-config\") pod \"console-6f4d95dbf5-4g4nr\" (UID: \"11d7db7b-696d-4781-82ff-31bb37a568dc\") " pod="openshift-console/console-6f4d95dbf5-4g4nr"
Sep 16 02:18:18.026976 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:18.026955    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzj9p\" (UniqueName: \"kubernetes.io/projected/11d7db7b-696d-4781-82ff-31bb37a568dc-kube-api-access-xzj9p\") pod \"console-6f4d95dbf5-4g4nr\" (UID: \"11d7db7b-696d-4781-82ff-31bb37a568dc\") " pod="openshift-console/console-6f4d95dbf5-4g4nr"
Sep 16 02:18:18.126037 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:18.125983    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4d95dbf5-4g4nr"
Sep 16 02:18:18.394966 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:18.394889    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f4d95dbf5-4g4nr"]
Sep 16 02:18:18.397473 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:18:18.397443    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11d7db7b_696d_4781_82ff_31bb37a568dc.slice/crio-15b608bcf93b273a58c6b5622eeac113c9d8adcf81894f0e1af5cb491891bf6e WatchSource:0}: Error finding container 15b608bcf93b273a58c6b5622eeac113c9d8adcf81894f0e1af5cb491891bf6e: Status 404 returned error can't find the container with id 15b608bcf93b273a58c6b5622eeac113c9d8adcf81894f0e1af5cb491891bf6e
Sep 16 02:18:18.399413 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:18.399396    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 02:18:18.427997 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:18.427968    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4d95dbf5-4g4nr" event={"ID":"11d7db7b-696d-4781-82ff-31bb37a568dc","Type":"ContainerStarted","Data":"15b608bcf93b273a58c6b5622eeac113c9d8adcf81894f0e1af5cb491891bf6e"}
Sep 16 02:18:20.376493 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:20.376458    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:18:22.443002 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:22.442961    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4d95dbf5-4g4nr" event={"ID":"11d7db7b-696d-4781-82ff-31bb37a568dc","Type":"ContainerStarted","Data":"c9adb41099ac238b722f1b9c38f0c5eabdc57c35f735b856708df05a1f93c9be"}
Sep 16 02:18:22.458442 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:22.458392    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f4d95dbf5-4g4nr" podStartSLOduration=2.141224312 podStartE2EDuration="5.45837695s" totalImagesPullingTime="3.317152638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:18:22.457397414 +0000 UTC m=+307.549579387" watchObservedRunningTime="2026-09-16 02:18:22.45837695 +0000 UTC m=+307.550558924"
Sep 16 02:18:28.126631 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:28.126593    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f4d95dbf5-4g4nr"
Sep 16 02:18:28.127051 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:28.126681    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f4d95dbf5-4g4nr"
Sep 16 02:18:28.131619 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:28.131595    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f4d95dbf5-4g4nr"
Sep 16 02:18:28.466138 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:28.466060    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f4d95dbf5-4g4nr"
Sep 16 02:18:37.282754 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:37.282722    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f4d95dbf5-4g4nr"]
Sep 16 02:18:39.498222 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:39.498191    2581 generic.go:356] "Generic (PLEG): container finished" podID="512baf29-25fe-4807-88bc-9ac46ae62b56" containerID="834f5abadd7d6e03aa4d399ca048d8d0b0053f4373f597e6e77070f622cb3192" exitCode=0
Sep 16 02:18:39.498599 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:39.498252    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wn6td" event={"ID":"512baf29-25fe-4807-88bc-9ac46ae62b56","Type":"ContainerDied","Data":"834f5abadd7d6e03aa4d399ca048d8d0b0053f4373f597e6e77070f622cb3192"}
Sep 16 02:18:39.498599 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:39.498512    2581 scope.go:117] "RemoveContainer" containerID="834f5abadd7d6e03aa4d399ca048d8d0b0053f4373f597e6e77070f622cb3192"
Sep 16 02:18:40.503330 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:18:40.503295    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wn6td" event={"ID":"512baf29-25fe-4807-88bc-9ac46ae62b56","Type":"ContainerStarted","Data":"b46049e35963327a02e59068a0b69acba6b35ed887bc63fdbde0b10ecd131309"}
Sep 16 02:19:02.305515 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:02.305471    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f4d95dbf5-4g4nr" podUID="11d7db7b-696d-4781-82ff-31bb37a568dc" containerName="console" containerID="cri-o://c9adb41099ac238b722f1b9c38f0c5eabdc57c35f735b856708df05a1f93c9be" gracePeriod=15
Sep 16 02:19:02.539097 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:02.539074    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4d95dbf5-4g4nr"
Sep 16 02:19:02.592376 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:02.592300    2581 generic.go:356] "Generic (PLEG): container finished" podID="11d7db7b-696d-4781-82ff-31bb37a568dc" containerID="c9adb41099ac238b722f1b9c38f0c5eabdc57c35f735b856708df05a1f93c9be" exitCode=0
Sep 16 02:19:02.592376 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:02.592361    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4d95dbf5-4g4nr" event={"ID":"11d7db7b-696d-4781-82ff-31bb37a568dc","Type":"ContainerDied","Data":"c9adb41099ac238b722f1b9c38f0c5eabdc57c35f735b856708df05a1f93c9be"}
Sep 16 02:19:02.592376 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:02.592368    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4d95dbf5-4g4nr"
Sep 16 02:19:02.592587 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:02.592420    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4d95dbf5-4g4nr" event={"ID":"11d7db7b-696d-4781-82ff-31bb37a568dc","Type":"ContainerDied","Data":"15b608bcf93b273a58c6b5622eeac113c9d8adcf81894f0e1af5cb491891bf6e"}
Sep 16 02:19:02.592587 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:02.592438    2581 scope.go:117] "RemoveContainer" containerID="c9adb41099ac238b722f1b9c38f0c5eabdc57c35f735b856708df05a1f93c9be"
Sep 16 02:19:02.600250 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:02.600233    2581 scope.go:117] "RemoveContainer" containerID="c9adb41099ac238b722f1b9c38f0c5eabdc57c35f735b856708df05a1f93c9be"
Sep 16 02:19:02.600505 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:19:02.600485    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9adb41099ac238b722f1b9c38f0c5eabdc57c35f735b856708df05a1f93c9be\": container with ID starting with c9adb41099ac238b722f1b9c38f0c5eabdc57c35f735b856708df05a1f93c9be not found: ID does not exist" containerID="c9adb41099ac238b722f1b9c38f0c5eabdc57c35f735b856708df05a1f93c9be"
Sep 16 02:19:02.600549 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:02.600513    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9adb41099ac238b722f1b9c38f0c5eabdc57c35f735b856708df05a1f93c9be"} err="failed to get container status \"c9adb41099ac238b722f1b9c38f0c5eabdc57c35f735b856708df05a1f93c9be\": rpc error: code = NotFound desc = could not find container \"c9adb41099ac238b722f1b9c38f0c5eabdc57c35f735b856708df05a1f93c9be\": container with ID starting with c9adb41099ac238b722f1b9c38f0c5eabdc57c35f735b856708df05a1f93c9be not found: ID does not exist"
Sep 16 02:19:02.647004 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:02.646988    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11d7db7b-696d-4781-82ff-31bb37a568dc-oauth-serving-cert\") pod \"11d7db7b-696d-4781-82ff-31bb37a568dc\" (UID: \"11d7db7b-696d-4781-82ff-31bb37a568dc\") "
Sep 16 02:19:02.647096 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:02.647014    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11d7db7b-696d-4781-82ff-31bb37a568dc-console-config\") pod \"11d7db7b-696d-4781-82ff-31bb37a568dc\" (UID: \"11d7db7b-696d-4781-82ff-31bb37a568dc\") "
Sep 16 02:19:02.647096 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:02.647034    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11d7db7b-696d-4781-82ff-31bb37a568dc-console-serving-cert\") pod \"11d7db7b-696d-4781-82ff-31bb37a568dc\" (UID: \"11d7db7b-696d-4781-82ff-31bb37a568dc\") "
Sep 16 02:19:02.647096 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:02.647074    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11d7db7b-696d-4781-82ff-31bb37a568dc-console-oauth-config\") pod \"11d7db7b-696d-4781-82ff-31bb37a568dc\" (UID: \"11d7db7b-696d-4781-82ff-31bb37a568dc\") "
Sep 16 02:19:02.647225 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:02.647105    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11d7db7b-696d-4781-82ff-31bb37a568dc-service-ca\") pod \"11d7db7b-696d-4781-82ff-31bb37a568dc\" (UID: \"11d7db7b-696d-4781-82ff-31bb37a568dc\") "
Sep 16 02:19:02.647225 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:02.647171    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzj9p\" (UniqueName: \"kubernetes.io/projected/11d7db7b-696d-4781-82ff-31bb37a568dc-kube-api-access-xzj9p\") pod \"11d7db7b-696d-4781-82ff-31bb37a568dc\" (UID: \"11d7db7b-696d-4781-82ff-31bb37a568dc\") "
Sep 16 02:19:02.647495 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:02.647468    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11d7db7b-696d-4781-82ff-31bb37a568dc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "11d7db7b-696d-4781-82ff-31bb37a568dc" (UID: "11d7db7b-696d-4781-82ff-31bb37a568dc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:19:02.647495 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:02.647471    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11d7db7b-696d-4781-82ff-31bb37a568dc-console-config" (OuterVolumeSpecName: "console-config") pod "11d7db7b-696d-4781-82ff-31bb37a568dc" (UID: "11d7db7b-696d-4781-82ff-31bb37a568dc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:19:02.647648 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:02.647528    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11d7db7b-696d-4781-82ff-31bb37a568dc-service-ca" (OuterVolumeSpecName: "service-ca") pod "11d7db7b-696d-4781-82ff-31bb37a568dc" (UID: "11d7db7b-696d-4781-82ff-31bb37a568dc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:19:02.649400 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:02.649379    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11d7db7b-696d-4781-82ff-31bb37a568dc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "11d7db7b-696d-4781-82ff-31bb37a568dc" (UID: "11d7db7b-696d-4781-82ff-31bb37a568dc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:19:02.649473 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:02.649374    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11d7db7b-696d-4781-82ff-31bb37a568dc-kube-api-access-xzj9p" (OuterVolumeSpecName: "kube-api-access-xzj9p") pod "11d7db7b-696d-4781-82ff-31bb37a568dc" (UID: "11d7db7b-696d-4781-82ff-31bb37a568dc"). InnerVolumeSpecName "kube-api-access-xzj9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:19:02.649473 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:02.649445    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11d7db7b-696d-4781-82ff-31bb37a568dc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "11d7db7b-696d-4781-82ff-31bb37a568dc" (UID: "11d7db7b-696d-4781-82ff-31bb37a568dc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:19:02.747966 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:02.747940    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11d7db7b-696d-4781-82ff-31bb37a568dc-console-oauth-config\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:19:02.747966 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:02.747965    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11d7db7b-696d-4781-82ff-31bb37a568dc-service-ca\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:19:02.748109 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:02.747978    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzj9p\" (UniqueName: \"kubernetes.io/projected/11d7db7b-696d-4781-82ff-31bb37a568dc-kube-api-access-xzj9p\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:19:02.748109 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:02.747991    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11d7db7b-696d-4781-82ff-31bb37a568dc-oauth-serving-cert\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:19:02.748109 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:02.748002    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11d7db7b-696d-4781-82ff-31bb37a568dc-console-config\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:19:02.748109 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:02.748014    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11d7db7b-696d-4781-82ff-31bb37a568dc-console-serving-cert\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:19:02.910521 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:02.910493    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f4d95dbf5-4g4nr"]
Sep 16 02:19:02.913822 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:02.913805    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f4d95dbf5-4g4nr"]
Sep 16 02:19:03.380690 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:03.380658    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11d7db7b-696d-4781-82ff-31bb37a568dc" path="/var/lib/kubelet/pods/11d7db7b-696d-4781-82ff-31bb37a568dc/volumes"
Sep 16 02:19:19.409498 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.409465    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm"]
Sep 16 02:19:19.410030 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.409821    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11d7db7b-696d-4781-82ff-31bb37a568dc" containerName="console"
Sep 16 02:19:19.410030 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.409838    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="11d7db7b-696d-4781-82ff-31bb37a568dc" containerName="console"
Sep 16 02:19:19.410030 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.409955    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="11d7db7b-696d-4781-82ff-31bb37a568dc" containerName="console"
Sep 16 02:19:19.412689 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.412670    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm"
Sep 16 02:19:19.414767 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.414744    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 16 02:19:19.414894 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.414763    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 16 02:19:19.414965 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.414918    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 16 02:19:19.415024 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.414963    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 16 02:19:19.415121 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.415107    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 16 02:19:19.415214 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.415197    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qsflw\""
Sep 16 02:19:19.420220 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.420200    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 16 02:19:19.423924 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.423905    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm"]
Sep 16 02:19:19.469260 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.469237    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f438988-8046-4e10-a3ac-4db6511b218c-metrics-client-ca\") pod \"telemeter-client-75ddbf8bc9-ttmzm\" (UID: \"5f438988-8046-4e10-a3ac-4db6511b218c\") " pod="openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm"
Sep 16 02:19:19.469365 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.469297    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5f438988-8046-4e10-a3ac-4db6511b218c-federate-client-tls\") pod \"telemeter-client-75ddbf8bc9-ttmzm\" (UID: \"5f438988-8046-4e10-a3ac-4db6511b218c\") " pod="openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm"
Sep 16 02:19:19.469365 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.469337    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f438988-8046-4e10-a3ac-4db6511b218c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75ddbf8bc9-ttmzm\" (UID: \"5f438988-8046-4e10-a3ac-4db6511b218c\") " pod="openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm"
Sep 16 02:19:19.469452 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.469390    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5f438988-8046-4e10-a3ac-4db6511b218c-secret-telemeter-client\") pod \"telemeter-client-75ddbf8bc9-ttmzm\" (UID: \"5f438988-8046-4e10-a3ac-4db6511b218c\") " pod="openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm"
Sep 16 02:19:19.469452 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.469409    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f438988-8046-4e10-a3ac-4db6511b218c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75ddbf8bc9-ttmzm\" (UID: \"5f438988-8046-4e10-a3ac-4db6511b218c\") " pod="openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm"
Sep 16 02:19:19.469452 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.469429    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj2l8\" (UniqueName: \"kubernetes.io/projected/5f438988-8046-4e10-a3ac-4db6511b218c-kube-api-access-qj2l8\") pod \"telemeter-client-75ddbf8bc9-ttmzm\" (UID: \"5f438988-8046-4e10-a3ac-4db6511b218c\") " pod="openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm"
Sep 16 02:19:19.469554 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.469503    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f438988-8046-4e10-a3ac-4db6511b218c-serving-certs-ca-bundle\") pod \"telemeter-client-75ddbf8bc9-ttmzm\" (UID: \"5f438988-8046-4e10-a3ac-4db6511b218c\") " pod="openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm"
Sep 16 02:19:19.469554 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.469523    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5f438988-8046-4e10-a3ac-4db6511b218c-telemeter-client-tls\") pod \"telemeter-client-75ddbf8bc9-ttmzm\" (UID: \"5f438988-8046-4e10-a3ac-4db6511b218c\") " pod="openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm"
Sep 16 02:19:19.569806 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.569783    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f438988-8046-4e10-a3ac-4db6511b218c-serving-certs-ca-bundle\") pod \"telemeter-client-75ddbf8bc9-ttmzm\" (UID: \"5f438988-8046-4e10-a3ac-4db6511b218c\") " pod="openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm"
Sep 16 02:19:19.569918 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.569811    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5f438988-8046-4e10-a3ac-4db6511b218c-telemeter-client-tls\") pod \"telemeter-client-75ddbf8bc9-ttmzm\" (UID: \"5f438988-8046-4e10-a3ac-4db6511b218c\") " pod="openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm"
Sep 16 02:19:19.569918 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.569840    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f438988-8046-4e10-a3ac-4db6511b218c-metrics-client-ca\") pod \"telemeter-client-75ddbf8bc9-ttmzm\" (UID: \"5f438988-8046-4e10-a3ac-4db6511b218c\") " pod="openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm"
Sep 16 02:19:19.569995 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.569938    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5f438988-8046-4e10-a3ac-4db6511b218c-federate-client-tls\") pod \"telemeter-client-75ddbf8bc9-ttmzm\" (UID: \"5f438988-8046-4e10-a3ac-4db6511b218c\") " pod="openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm"
Sep 16 02:19:19.569995 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.569963    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f438988-8046-4e10-a3ac-4db6511b218c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75ddbf8bc9-ttmzm\" (UID: \"5f438988-8046-4e10-a3ac-4db6511b218c\") " pod="openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm"
Sep 16 02:19:19.569995 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.569982    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5f438988-8046-4e10-a3ac-4db6511b218c-secret-telemeter-client\") pod \"telemeter-client-75ddbf8bc9-ttmzm\" (UID: \"5f438988-8046-4e10-a3ac-4db6511b218c\") " pod="openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm"
Sep 16 02:19:19.570133 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.570004    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f438988-8046-4e10-a3ac-4db6511b218c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75ddbf8bc9-ttmzm\" (UID: \"5f438988-8046-4e10-a3ac-4db6511b218c\") " pod="openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm"
Sep 16 02:19:19.570133 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.570025    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj2l8\" (UniqueName: \"kubernetes.io/projected/5f438988-8046-4e10-a3ac-4db6511b218c-kube-api-access-qj2l8\") pod \"telemeter-client-75ddbf8bc9-ttmzm\" (UID: \"5f438988-8046-4e10-a3ac-4db6511b218c\") " pod="openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm"
Sep 16 02:19:19.570626 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.570550    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f438988-8046-4e10-a3ac-4db6511b218c-serving-certs-ca-bundle\") pod \"telemeter-client-75ddbf8bc9-ttmzm\" (UID: \"5f438988-8046-4e10-a3ac-4db6511b218c\") " pod="openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm"
Sep 16 02:19:19.570626 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.570577    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f438988-8046-4e10-a3ac-4db6511b218c-metrics-client-ca\") pod \"telemeter-client-75ddbf8bc9-ttmzm\" (UID: \"5f438988-8046-4e10-a3ac-4db6511b218c\") " pod="openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm"
Sep 16 02:19:19.571038 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.570960    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f438988-8046-4e10-a3ac-4db6511b218c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75ddbf8bc9-ttmzm\" (UID: \"5f438988-8046-4e10-a3ac-4db6511b218c\") " pod="openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm"
Sep 16 02:19:19.572489 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.572466    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5f438988-8046-4e10-a3ac-4db6511b218c-federate-client-tls\") pod \"telemeter-client-75ddbf8bc9-ttmzm\" (UID: \"5f438988-8046-4e10-a3ac-4db6511b218c\") " pod="openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm"
Sep 16 02:19:19.572744 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.572722    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5f438988-8046-4e10-a3ac-4db6511b218c-secret-telemeter-client\") pod \"telemeter-client-75ddbf8bc9-ttmzm\" (UID: \"5f438988-8046-4e10-a3ac-4db6511b218c\") " pod="openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm"
Sep 16 02:19:19.573000 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.572985    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f438988-8046-4e10-a3ac-4db6511b218c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75ddbf8bc9-ttmzm\" (UID: \"5f438988-8046-4e10-a3ac-4db6511b218c\") " pod="openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm"
Sep 16 02:19:19.573061 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.573042    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5f438988-8046-4e10-a3ac-4db6511b218c-telemeter-client-tls\") pod \"telemeter-client-75ddbf8bc9-ttmzm\" (UID: \"5f438988-8046-4e10-a3ac-4db6511b218c\") " pod="openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm"
Sep 16 02:19:19.577917 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.577895    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj2l8\" (UniqueName: \"kubernetes.io/projected/5f438988-8046-4e10-a3ac-4db6511b218c-kube-api-access-qj2l8\") pod \"telemeter-client-75ddbf8bc9-ttmzm\" (UID: \"5f438988-8046-4e10-a3ac-4db6511b218c\") " pod="openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm"
Sep 16 02:19:19.722204 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.722133    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm"
Sep 16 02:19:19.995929 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:19.995842    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm"]
Sep 16 02:19:19.999332 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:19:19.999304    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f438988_8046_4e10_a3ac_4db6511b218c.slice/crio-72bbbd0440a7fec7e9822af52492594a4fcb8bc12a398df65da64982cc7efd28 WatchSource:0}: Error finding container 72bbbd0440a7fec7e9822af52492594a4fcb8bc12a398df65da64982cc7efd28: Status 404 returned error can't find the container with id 72bbbd0440a7fec7e9822af52492594a4fcb8bc12a398df65da64982cc7efd28
Sep 16 02:19:20.662236 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:20.662196    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm" event={"ID":"5f438988-8046-4e10-a3ac-4db6511b218c","Type":"ContainerStarted","Data":"72bbbd0440a7fec7e9822af52492594a4fcb8bc12a398df65da64982cc7efd28"}
Sep 16 02:19:22.671186 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:22.671143    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm" event={"ID":"5f438988-8046-4e10-a3ac-4db6511b218c","Type":"ContainerStarted","Data":"7a543e23b7b08b48b1c9496b97ba2a06ee67e13678554e3a2df50c80063e7a72"}
Sep 16 02:19:23.676464 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:23.676376    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm" event={"ID":"5f438988-8046-4e10-a3ac-4db6511b218c","Type":"ContainerStarted","Data":"0010430db2e2d9455e11534423de954c177d6c75bccb8ab0b559640ec16aeb24"}
Sep 16 02:19:23.676464 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:23.676444    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm" event={"ID":"5f438988-8046-4e10-a3ac-4db6511b218c","Type":"ContainerStarted","Data":"43d26c45cae0f13e5b394f3c2fa4fb0e2a8a3de2e50b3e0f0faa7c4e2e9ac466"}
Sep 16 02:19:23.696081 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:23.696033    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-75ddbf8bc9-ttmzm" podStartSLOduration=1.39910397 podStartE2EDuration="4.696020274s" totalImagesPullingTime="3.296916304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:19:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:19:23.694824699 +0000 UTC m=+368.787006673" watchObservedRunningTime="2026-09-16 02:19:23.696020274 +0000 UTC m=+368.788202246"
Sep 16 02:19:23.767397 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:23.767360    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-867d5fcb47-rqz9v"]
Sep 16 02:19:23.769765 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:23.769748    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-867d5fcb47-rqz9v"
Sep 16 02:19:23.771899 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:23.771875    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 16 02:19:23.772055 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:23.772036    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wrs7f\""
Sep 16 02:19:23.772150 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:23.772061    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 16 02:19:23.772150 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:23.772089    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 16 02:19:23.772388 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:23.772371    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 16 02:19:23.772471 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:23.772377    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 16 02:19:23.772570 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:23.772553    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 16 02:19:23.772711 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:23.772697    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 16 02:19:23.777643 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:23.777620    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 16 02:19:23.779011 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:23.778989    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-867d5fcb47-rqz9v"]
Sep 16 02:19:23.905620 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:23.905598    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a11aadc9-4004-45b9-b5bc-32daf5f50d79-service-ca\") pod \"console-867d5fcb47-rqz9v\" (UID: \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\") " pod="openshift-console/console-867d5fcb47-rqz9v"
Sep 16 02:19:23.905736 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:23.905634    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a11aadc9-4004-45b9-b5bc-32daf5f50d79-console-serving-cert\") pod \"console-867d5fcb47-rqz9v\" (UID: \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\") " pod="openshift-console/console-867d5fcb47-rqz9v"
Sep 16 02:19:23.905736 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:23.905663    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8gzm\" (UniqueName: \"kubernetes.io/projected/a11aadc9-4004-45b9-b5bc-32daf5f50d79-kube-api-access-z8gzm\") pod \"console-867d5fcb47-rqz9v\" (UID: \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\") " pod="openshift-console/console-867d5fcb47-rqz9v"
Sep 16 02:19:23.905736 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:23.905682    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a11aadc9-4004-45b9-b5bc-32daf5f50d79-trusted-ca-bundle\") pod \"console-867d5fcb47-rqz9v\" (UID: \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\") " pod="openshift-console/console-867d5fcb47-rqz9v"
Sep 16 02:19:23.905736 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:23.905703    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a11aadc9-4004-45b9-b5bc-32daf5f50d79-oauth-serving-cert\") pod \"console-867d5fcb47-rqz9v\" (UID: \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\") " pod="openshift-console/console-867d5fcb47-rqz9v"
Sep 16 02:19:23.905885 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:23.905776    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a11aadc9-4004-45b9-b5bc-32daf5f50d79-console-oauth-config\") pod \"console-867d5fcb47-rqz9v\" (UID: \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\") " pod="openshift-console/console-867d5fcb47-rqz9v"
Sep 16 02:19:23.905885 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:23.905830    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a11aadc9-4004-45b9-b5bc-32daf5f50d79-console-config\") pod \"console-867d5fcb47-rqz9v\" (UID: \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\") " pod="openshift-console/console-867d5fcb47-rqz9v"
Sep 16 02:19:24.006232 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:24.006174    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a11aadc9-4004-45b9-b5bc-32daf5f50d79-trusted-ca-bundle\") pod \"console-867d5fcb47-rqz9v\" (UID: \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\") " pod="openshift-console/console-867d5fcb47-rqz9v"
Sep 16 02:19:24.006232 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:24.006200    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a11aadc9-4004-45b9-b5bc-32daf5f50d79-oauth-serving-cert\") pod \"console-867d5fcb47-rqz9v\" (UID: \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\") " pod="openshift-console/console-867d5fcb47-rqz9v"
Sep 16 02:19:24.006232 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:24.006221    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a11aadc9-4004-45b9-b5bc-32daf5f50d79-console-oauth-config\") pod \"console-867d5fcb47-rqz9v\" (UID: \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\") " pod="openshift-console/console-867d5fcb47-rqz9v"
Sep 16 02:19:24.006393 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:24.006373    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a11aadc9-4004-45b9-b5bc-32daf5f50d79-console-config\") pod \"console-867d5fcb47-rqz9v\" (UID: \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\") " pod="openshift-console/console-867d5fcb47-rqz9v"
Sep 16 02:19:24.006436 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:24.006422    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a11aadc9-4004-45b9-b5bc-32daf5f50d79-service-ca\") pod \"console-867d5fcb47-rqz9v\" (UID: \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\") " pod="openshift-console/console-867d5fcb47-rqz9v"
Sep 16 02:19:24.006476 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:24.006465    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a11aadc9-4004-45b9-b5bc-32daf5f50d79-console-serving-cert\") pod \"console-867d5fcb47-rqz9v\" (UID: \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\") " pod="openshift-console/console-867d5fcb47-rqz9v"
Sep 16 02:19:24.006526 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:24.006507    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8gzm\" (UniqueName: \"kubernetes.io/projected/a11aadc9-4004-45b9-b5bc-32daf5f50d79-kube-api-access-z8gzm\") pod \"console-867d5fcb47-rqz9v\" (UID: \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\") " pod="openshift-console/console-867d5fcb47-rqz9v"
Sep 16 02:19:24.007077 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:24.007054    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a11aadc9-4004-45b9-b5bc-32daf5f50d79-oauth-serving-cert\") pod \"console-867d5fcb47-rqz9v\" (UID: \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\") " pod="openshift-console/console-867d5fcb47-rqz9v"
Sep 16 02:19:24.007181 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:24.007091    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a11aadc9-4004-45b9-b5bc-32daf5f50d79-console-config\") pod \"console-867d5fcb47-rqz9v\" (UID: \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\") " pod="openshift-console/console-867d5fcb47-rqz9v"
Sep 16 02:19:24.007181 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:24.007128    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a11aadc9-4004-45b9-b5bc-32daf5f50d79-trusted-ca-bundle\") pod \"console-867d5fcb47-rqz9v\" (UID: \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\") " pod="openshift-console/console-867d5fcb47-rqz9v"
Sep 16 02:19:24.007329 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:24.007307    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a11aadc9-4004-45b9-b5bc-32daf5f50d79-service-ca\") pod \"console-867d5fcb47-rqz9v\" (UID: \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\") " pod="openshift-console/console-867d5fcb47-rqz9v"
Sep 16 02:19:24.008765 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:24.008745    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a11aadc9-4004-45b9-b5bc-32daf5f50d79-console-oauth-config\") pod \"console-867d5fcb47-rqz9v\" (UID: \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\") " pod="openshift-console/console-867d5fcb47-rqz9v"
Sep 16 02:19:24.008985 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:24.008969    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a11aadc9-4004-45b9-b5bc-32daf5f50d79-console-serving-cert\") pod \"console-867d5fcb47-rqz9v\" (UID: \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\") " pod="openshift-console/console-867d5fcb47-rqz9v"
Sep 16 02:19:24.014146 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:24.014127    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8gzm\" (UniqueName: \"kubernetes.io/projected/a11aadc9-4004-45b9-b5bc-32daf5f50d79-kube-api-access-z8gzm\") pod \"console-867d5fcb47-rqz9v\" (UID: \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\") " pod="openshift-console/console-867d5fcb47-rqz9v"
Sep 16 02:19:24.080031 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:24.080003    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-867d5fcb47-rqz9v"
Sep 16 02:19:24.347397 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:24.347352    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-867d5fcb47-rqz9v"]
Sep 16 02:19:24.351003 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:19:24.350980    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda11aadc9_4004_45b9_b5bc_32daf5f50d79.slice/crio-44c0d1931edd6ced17b4fb6a303e56f9debe2ddef2bc404f2b93677e5819b1d2 WatchSource:0}: Error finding container 44c0d1931edd6ced17b4fb6a303e56f9debe2ddef2bc404f2b93677e5819b1d2: Status 404 returned error can't find the container with id 44c0d1931edd6ced17b4fb6a303e56f9debe2ddef2bc404f2b93677e5819b1d2
Sep 16 02:19:24.681256 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:24.681165    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-867d5fcb47-rqz9v" event={"ID":"a11aadc9-4004-45b9-b5bc-32daf5f50d79","Type":"ContainerStarted","Data":"0ee0c0f5c322ddd9a18eecd5691f577dc580505dbe6d1e60633091702efb8a0c"}
Sep 16 02:19:24.681256 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:24.681226    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-867d5fcb47-rqz9v" event={"ID":"a11aadc9-4004-45b9-b5bc-32daf5f50d79","Type":"ContainerStarted","Data":"44c0d1931edd6ced17b4fb6a303e56f9debe2ddef2bc404f2b93677e5819b1d2"}
Sep 16 02:19:24.697200 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:24.697154    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-867d5fcb47-rqz9v" podStartSLOduration=1.697137737 podStartE2EDuration="1.697137737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:19:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:19:24.69629296 +0000 UTC m=+369.788474935" watchObservedRunningTime="2026-09-16 02:19:24.697137737 +0000 UTC m=+369.789319713"
Sep 16 02:19:28.336730 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:28.336693    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs\") pod \"network-metrics-daemon-2b8mm\" (UID: \"df380f84-e4cf-477f-b44f-86c7f533ce9c\") " pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:19:28.339094 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:28.339076    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df380f84-e4cf-477f-b44f-86c7f533ce9c-metrics-certs\") pod \"network-metrics-daemon-2b8mm\" (UID: \"df380f84-e4cf-477f-b44f-86c7f533ce9c\") " pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:19:28.479532 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:28.479499    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2ht6m\""
Sep 16 02:19:28.487544 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:28.487525    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b8mm"
Sep 16 02:19:28.752896 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:28.752873    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2b8mm"]
Sep 16 02:19:28.756976 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:19:28.756946    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf380f84_e4cf_477f_b44f_86c7f533ce9c.slice/crio-31f091421678764358e9d65c78f0de482dc65bedc3e26c9aacba1be209c5c85b WatchSource:0}: Error finding container 31f091421678764358e9d65c78f0de482dc65bedc3e26c9aacba1be209c5c85b: Status 404 returned error can't find the container with id 31f091421678764358e9d65c78f0de482dc65bedc3e26c9aacba1be209c5c85b
Sep 16 02:19:29.702960 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:29.702930    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2b8mm" event={"ID":"df380f84-e4cf-477f-b44f-86c7f533ce9c","Type":"ContainerStarted","Data":"6403b3478723c776dc7b8e54c1d61b592ffc8e66f9ab45c5175df3564da85b64"}
Sep 16 02:19:29.703394 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:29.702983    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2b8mm" event={"ID":"df380f84-e4cf-477f-b44f-86c7f533ce9c","Type":"ContainerStarted","Data":"31f091421678764358e9d65c78f0de482dc65bedc3e26c9aacba1be209c5c85b"}
Sep 16 02:19:30.708311 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:30.708277    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2b8mm" event={"ID":"df380f84-e4cf-477f-b44f-86c7f533ce9c","Type":"ContainerStarted","Data":"12d41b4bb48c89318e55a67cba4967de5f50ab1f2ccc8acc377e423c30221713"}
Sep 16 02:19:30.722866 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:30.722808    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2b8mm" podStartSLOduration=374.89242133 podStartE2EDuration="6m15.722795183s" totalImagesPullingTime="830.373853ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:13:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:19:30.721680477 +0000 UTC m=+375.813862452" watchObservedRunningTime="2026-09-16 02:19:30.722795183 +0000 UTC m=+375.814977156"
Sep 16 02:19:34.080610 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:34.080581    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-867d5fcb47-rqz9v"
Sep 16 02:19:34.081001 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:34.080628    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-867d5fcb47-rqz9v"
Sep 16 02:19:34.085151 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:34.085130    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-867d5fcb47-rqz9v"
Sep 16 02:19:34.725643 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:19:34.725611    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-867d5fcb47-rqz9v"
Sep 16 02:20:44.779142 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:20:44.779066    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-867d5fcb47-rqz9v"]
Sep 16 02:21:09.797972 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:09.797933    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-867d5fcb47-rqz9v" podUID="a11aadc9-4004-45b9-b5bc-32daf5f50d79" containerName="console" containerID="cri-o://0ee0c0f5c322ddd9a18eecd5691f577dc580505dbe6d1e60633091702efb8a0c" gracePeriod=15
Sep 16 02:21:10.029129 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:10.029103    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-867d5fcb47-rqz9v"
Sep 16 02:21:10.065619 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:10.065554    2581 generic.go:356] "Generic (PLEG): container finished" podID="a11aadc9-4004-45b9-b5bc-32daf5f50d79" containerID="0ee0c0f5c322ddd9a18eecd5691f577dc580505dbe6d1e60633091702efb8a0c" exitCode=0
Sep 16 02:21:10.065619 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:10.065599    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-867d5fcb47-rqz9v"
Sep 16 02:21:10.065619 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:10.065617    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-867d5fcb47-rqz9v" event={"ID":"a11aadc9-4004-45b9-b5bc-32daf5f50d79","Type":"ContainerDied","Data":"0ee0c0f5c322ddd9a18eecd5691f577dc580505dbe6d1e60633091702efb8a0c"}
Sep 16 02:21:10.065866 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:10.065654    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-867d5fcb47-rqz9v" event={"ID":"a11aadc9-4004-45b9-b5bc-32daf5f50d79","Type":"ContainerDied","Data":"44c0d1931edd6ced17b4fb6a303e56f9debe2ddef2bc404f2b93677e5819b1d2"}
Sep 16 02:21:10.065866 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:10.065672    2581 scope.go:117] "RemoveContainer" containerID="0ee0c0f5c322ddd9a18eecd5691f577dc580505dbe6d1e60633091702efb8a0c"
Sep 16 02:21:10.073386 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:10.073368    2581 scope.go:117] "RemoveContainer" containerID="0ee0c0f5c322ddd9a18eecd5691f577dc580505dbe6d1e60633091702efb8a0c"
Sep 16 02:21:10.073647 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:21:10.073629    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ee0c0f5c322ddd9a18eecd5691f577dc580505dbe6d1e60633091702efb8a0c\": container with ID starting with 0ee0c0f5c322ddd9a18eecd5691f577dc580505dbe6d1e60633091702efb8a0c not found: ID does not exist" containerID="0ee0c0f5c322ddd9a18eecd5691f577dc580505dbe6d1e60633091702efb8a0c"
Sep 16 02:21:10.073691 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:10.073655    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ee0c0f5c322ddd9a18eecd5691f577dc580505dbe6d1e60633091702efb8a0c"} err="failed to get container status \"0ee0c0f5c322ddd9a18eecd5691f577dc580505dbe6d1e60633091702efb8a0c\": rpc error: code = NotFound desc = could not find container \"0ee0c0f5c322ddd9a18eecd5691f577dc580505dbe6d1e60633091702efb8a0c\": container with ID starting with 0ee0c0f5c322ddd9a18eecd5691f577dc580505dbe6d1e60633091702efb8a0c not found: ID does not exist"
Sep 16 02:21:10.153804 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:10.153775    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a11aadc9-4004-45b9-b5bc-32daf5f50d79-service-ca\") pod \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\" (UID: \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\") "
Sep 16 02:21:10.153950 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:10.153818    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a11aadc9-4004-45b9-b5bc-32daf5f50d79-console-oauth-config\") pod \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\" (UID: \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\") "
Sep 16 02:21:10.154018 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:10.153968    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a11aadc9-4004-45b9-b5bc-32daf5f50d79-oauth-serving-cert\") pod \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\" (UID: \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\") "
Sep 16 02:21:10.154018 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:10.153997    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8gzm\" (UniqueName: \"kubernetes.io/projected/a11aadc9-4004-45b9-b5bc-32daf5f50d79-kube-api-access-z8gzm\") pod \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\" (UID: \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\") "
Sep 16 02:21:10.154122 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:10.154035    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a11aadc9-4004-45b9-b5bc-32daf5f50d79-trusted-ca-bundle\") pod \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\" (UID: \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\") "
Sep 16 02:21:10.154122 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:10.154062    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a11aadc9-4004-45b9-b5bc-32daf5f50d79-console-config\") pod \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\" (UID: \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\") "
Sep 16 02:21:10.154122 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:10.154107    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a11aadc9-4004-45b9-b5bc-32daf5f50d79-service-ca" (OuterVolumeSpecName: "service-ca") pod "a11aadc9-4004-45b9-b5bc-32daf5f50d79" (UID: "a11aadc9-4004-45b9-b5bc-32daf5f50d79"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:21:10.154273 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:10.154121    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a11aadc9-4004-45b9-b5bc-32daf5f50d79-console-serving-cert\") pod \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\" (UID: \"a11aadc9-4004-45b9-b5bc-32daf5f50d79\") "
Sep 16 02:21:10.154355 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:10.154335    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a11aadc9-4004-45b9-b5bc-32daf5f50d79-service-ca\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:21:10.154459 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:10.154389    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a11aadc9-4004-45b9-b5bc-32daf5f50d79-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a11aadc9-4004-45b9-b5bc-32daf5f50d79" (UID: "a11aadc9-4004-45b9-b5bc-32daf5f50d79"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:21:10.154459 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:10.154399    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a11aadc9-4004-45b9-b5bc-32daf5f50d79-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a11aadc9-4004-45b9-b5bc-32daf5f50d79" (UID: "a11aadc9-4004-45b9-b5bc-32daf5f50d79"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:21:10.154533 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:10.154480    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a11aadc9-4004-45b9-b5bc-32daf5f50d79-console-config" (OuterVolumeSpecName: "console-config") pod "a11aadc9-4004-45b9-b5bc-32daf5f50d79" (UID: "a11aadc9-4004-45b9-b5bc-32daf5f50d79"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:21:10.156272 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:10.156251    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a11aadc9-4004-45b9-b5bc-32daf5f50d79-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a11aadc9-4004-45b9-b5bc-32daf5f50d79" (UID: "a11aadc9-4004-45b9-b5bc-32daf5f50d79"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:21:10.156359 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:10.156294    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a11aadc9-4004-45b9-b5bc-32daf5f50d79-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a11aadc9-4004-45b9-b5bc-32daf5f50d79" (UID: "a11aadc9-4004-45b9-b5bc-32daf5f50d79"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:21:10.156359 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:10.156316    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a11aadc9-4004-45b9-b5bc-32daf5f50d79-kube-api-access-z8gzm" (OuterVolumeSpecName: "kube-api-access-z8gzm") pod "a11aadc9-4004-45b9-b5bc-32daf5f50d79" (UID: "a11aadc9-4004-45b9-b5bc-32daf5f50d79"). InnerVolumeSpecName "kube-api-access-z8gzm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:21:10.255107 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:10.255075    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a11aadc9-4004-45b9-b5bc-32daf5f50d79-console-serving-cert\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:21:10.255107 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:10.255104    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a11aadc9-4004-45b9-b5bc-32daf5f50d79-console-oauth-config\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:21:10.255266 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:10.255116    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a11aadc9-4004-45b9-b5bc-32daf5f50d79-oauth-serving-cert\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:21:10.255266 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:10.255128    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8gzm\" (UniqueName: \"kubernetes.io/projected/a11aadc9-4004-45b9-b5bc-32daf5f50d79-kube-api-access-z8gzm\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:21:10.255266 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:10.255141    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a11aadc9-4004-45b9-b5bc-32daf5f50d79-trusted-ca-bundle\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:21:10.255266 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:10.255152    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a11aadc9-4004-45b9-b5bc-32daf5f50d79-console-config\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:21:10.385150 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:10.385126    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-867d5fcb47-rqz9v"]
Sep 16 02:21:10.387949 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:10.387928    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-867d5fcb47-rqz9v"]
Sep 16 02:21:11.380532 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:21:11.380499    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a11aadc9-4004-45b9-b5bc-32daf5f50d79" path="/var/lib/kubelet/pods/a11aadc9-4004-45b9-b5bc-32daf5f50d79/volumes"
Sep 16 02:22:07.697269 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:07.697190    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540782xl"]
Sep 16 02:22:07.697703 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:07.697536    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a11aadc9-4004-45b9-b5bc-32daf5f50d79" containerName="console"
Sep 16 02:22:07.697703 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:07.697550    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a11aadc9-4004-45b9-b5bc-32daf5f50d79" containerName="console"
Sep 16 02:22:07.697703 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:07.697601    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a11aadc9-4004-45b9-b5bc-32daf5f50d79" containerName="console"
Sep 16 02:22:07.699770 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:07.699754    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540782xl"
Sep 16 02:22:07.701874 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:07.701836    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 02:22:07.701988 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:07.701951    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7d226\""
Sep 16 02:22:07.702042 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:07.701954    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 02:22:07.708700 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:07.708680    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540782xl"]
Sep 16 02:22:07.741190 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:07.741161    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55d4ed70-45fa-4fc3-bd1e-55f3f396ad23-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540782xl\" (UID: \"55d4ed70-45fa-4fc3-bd1e-55f3f396ad23\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540782xl"
Sep 16 02:22:07.741311 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:07.741201    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55d4ed70-45fa-4fc3-bd1e-55f3f396ad23-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540782xl\" (UID: \"55d4ed70-45fa-4fc3-bd1e-55f3f396ad23\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540782xl"
Sep 16 02:22:07.741311 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:07.741234    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52dkx\" (UniqueName: \"kubernetes.io/projected/55d4ed70-45fa-4fc3-bd1e-55f3f396ad23-kube-api-access-52dkx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540782xl\" (UID: \"55d4ed70-45fa-4fc3-bd1e-55f3f396ad23\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540782xl"
Sep 16 02:22:07.842105 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:07.842073    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52dkx\" (UniqueName: \"kubernetes.io/projected/55d4ed70-45fa-4fc3-bd1e-55f3f396ad23-kube-api-access-52dkx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540782xl\" (UID: \"55d4ed70-45fa-4fc3-bd1e-55f3f396ad23\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540782xl"
Sep 16 02:22:07.842261 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:07.842137    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55d4ed70-45fa-4fc3-bd1e-55f3f396ad23-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540782xl\" (UID: \"55d4ed70-45fa-4fc3-bd1e-55f3f396ad23\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540782xl"
Sep 16 02:22:07.842261 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:07.842161    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55d4ed70-45fa-4fc3-bd1e-55f3f396ad23-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540782xl\" (UID: \"55d4ed70-45fa-4fc3-bd1e-55f3f396ad23\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540782xl"
Sep 16 02:22:07.842487 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:07.842471    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55d4ed70-45fa-4fc3-bd1e-55f3f396ad23-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540782xl\" (UID: \"55d4ed70-45fa-4fc3-bd1e-55f3f396ad23\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540782xl"
Sep 16 02:22:07.842552 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:07.842507    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55d4ed70-45fa-4fc3-bd1e-55f3f396ad23-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540782xl\" (UID: \"55d4ed70-45fa-4fc3-bd1e-55f3f396ad23\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540782xl"
Sep 16 02:22:07.850694 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:07.850666    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52dkx\" (UniqueName: \"kubernetes.io/projected/55d4ed70-45fa-4fc3-bd1e-55f3f396ad23-kube-api-access-52dkx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540782xl\" (UID: \"55d4ed70-45fa-4fc3-bd1e-55f3f396ad23\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540782xl"
Sep 16 02:22:08.009086 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:08.009003    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540782xl"
Sep 16 02:22:08.275925 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:08.275810    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540782xl"]
Sep 16 02:22:08.277916 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:22:08.277889    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55d4ed70_45fa_4fc3_bd1e_55f3f396ad23.slice/crio-b6516a779d7b0e82b0d942f355c3b96a3e4ff62f7feffeefe680bcfa0339c7e1 WatchSource:0}: Error finding container b6516a779d7b0e82b0d942f355c3b96a3e4ff62f7feffeefe680bcfa0339c7e1: Status 404 returned error can't find the container with id b6516a779d7b0e82b0d942f355c3b96a3e4ff62f7feffeefe680bcfa0339c7e1
Sep 16 02:22:09.282262 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:09.282228    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540782xl" event={"ID":"55d4ed70-45fa-4fc3-bd1e-55f3f396ad23","Type":"ContainerStarted","Data":"b6516a779d7b0e82b0d942f355c3b96a3e4ff62f7feffeefe680bcfa0339c7e1"}
Sep 16 02:22:14.303422 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:14.303386    2581 generic.go:356] "Generic (PLEG): container finished" podID="55d4ed70-45fa-4fc3-bd1e-55f3f396ad23" containerID="dd1608212fcbfe5088d919c5aeabcc0d85ada9b38fb4d39369c99e4387d2754d" exitCode=0
Sep 16 02:22:14.303779 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:14.303469    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540782xl" event={"ID":"55d4ed70-45fa-4fc3-bd1e-55f3f396ad23","Type":"ContainerDied","Data":"dd1608212fcbfe5088d919c5aeabcc0d85ada9b38fb4d39369c99e4387d2754d"}
Sep 16 02:22:17.316296 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:17.316261    2581 generic.go:356] "Generic (PLEG): container finished" podID="55d4ed70-45fa-4fc3-bd1e-55f3f396ad23" containerID="4790645b2175991165b891f7b9606d2e20f24501062aea0533967d21944a1bdb" exitCode=0
Sep 16 02:22:17.316663 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:17.316342    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540782xl" event={"ID":"55d4ed70-45fa-4fc3-bd1e-55f3f396ad23","Type":"ContainerDied","Data":"4790645b2175991165b891f7b9606d2e20f24501062aea0533967d21944a1bdb"}
Sep 16 02:22:24.348481 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:24.348451    2581 generic.go:356] "Generic (PLEG): container finished" podID="55d4ed70-45fa-4fc3-bd1e-55f3f396ad23" containerID="9e09b3abc6ac2b3559432fa90619623f76ea6852a0627341c6d61418abd84b1d" exitCode=0
Sep 16 02:22:24.348911 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:24.348524    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540782xl" event={"ID":"55d4ed70-45fa-4fc3-bd1e-55f3f396ad23","Type":"ContainerDied","Data":"9e09b3abc6ac2b3559432fa90619623f76ea6852a0627341c6d61418abd84b1d"}
Sep 16 02:22:25.474919 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:25.474895    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540782xl"
Sep 16 02:22:25.571600 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:25.571563    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55d4ed70-45fa-4fc3-bd1e-55f3f396ad23-util\") pod \"55d4ed70-45fa-4fc3-bd1e-55f3f396ad23\" (UID: \"55d4ed70-45fa-4fc3-bd1e-55f3f396ad23\") "
Sep 16 02:22:25.571762 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:25.571625    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55d4ed70-45fa-4fc3-bd1e-55f3f396ad23-bundle\") pod \"55d4ed70-45fa-4fc3-bd1e-55f3f396ad23\" (UID: \"55d4ed70-45fa-4fc3-bd1e-55f3f396ad23\") "
Sep 16 02:22:25.571762 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:25.571658    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52dkx\" (UniqueName: \"kubernetes.io/projected/55d4ed70-45fa-4fc3-bd1e-55f3f396ad23-kube-api-access-52dkx\") pod \"55d4ed70-45fa-4fc3-bd1e-55f3f396ad23\" (UID: \"55d4ed70-45fa-4fc3-bd1e-55f3f396ad23\") "
Sep 16 02:22:25.572274 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:25.572253    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55d4ed70-45fa-4fc3-bd1e-55f3f396ad23-bundle" (OuterVolumeSpecName: "bundle") pod "55d4ed70-45fa-4fc3-bd1e-55f3f396ad23" (UID: "55d4ed70-45fa-4fc3-bd1e-55f3f396ad23"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:22:25.573930 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:25.573906    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55d4ed70-45fa-4fc3-bd1e-55f3f396ad23-kube-api-access-52dkx" (OuterVolumeSpecName: "kube-api-access-52dkx") pod "55d4ed70-45fa-4fc3-bd1e-55f3f396ad23" (UID: "55d4ed70-45fa-4fc3-bd1e-55f3f396ad23"). InnerVolumeSpecName "kube-api-access-52dkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:22:25.575618 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:25.575596    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55d4ed70-45fa-4fc3-bd1e-55f3f396ad23-util" (OuterVolumeSpecName: "util") pod "55d4ed70-45fa-4fc3-bd1e-55f3f396ad23" (UID: "55d4ed70-45fa-4fc3-bd1e-55f3f396ad23"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:22:25.672438 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:25.672361    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55d4ed70-45fa-4fc3-bd1e-55f3f396ad23-bundle\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:22:25.672438 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:25.672385    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52dkx\" (UniqueName: \"kubernetes.io/projected/55d4ed70-45fa-4fc3-bd1e-55f3f396ad23-kube-api-access-52dkx\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:22:25.672438 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:25.672395    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55d4ed70-45fa-4fc3-bd1e-55f3f396ad23-util\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:22:26.358196 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:26.358168    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540782xl"
Sep 16 02:22:26.358362 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:26.358169    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540782xl" event={"ID":"55d4ed70-45fa-4fc3-bd1e-55f3f396ad23","Type":"ContainerDied","Data":"b6516a779d7b0e82b0d942f355c3b96a3e4ff62f7feffeefe680bcfa0339c7e1"}
Sep 16 02:22:26.358362 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:26.358287    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b6516a779d7b0e82b0d942f355c3b96a3e4ff62f7feffeefe680bcfa0339c7e1"
Sep 16 02:22:30.593489 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:30.593452    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m2lms"]
Sep 16 02:22:30.593866 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:30.593718    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55d4ed70-45fa-4fc3-bd1e-55f3f396ad23" containerName="extract"
Sep 16 02:22:30.593866 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:30.593728    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="55d4ed70-45fa-4fc3-bd1e-55f3f396ad23" containerName="extract"
Sep 16 02:22:30.593866 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:30.593742    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55d4ed70-45fa-4fc3-bd1e-55f3f396ad23" containerName="util"
Sep 16 02:22:30.593866 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:30.593748    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="55d4ed70-45fa-4fc3-bd1e-55f3f396ad23" containerName="util"
Sep 16 02:22:30.593866 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:30.593753    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55d4ed70-45fa-4fc3-bd1e-55f3f396ad23" containerName="pull"
Sep 16 02:22:30.593866 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:30.593758    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="55d4ed70-45fa-4fc3-bd1e-55f3f396ad23" containerName="pull"
Sep 16 02:22:30.593866 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:30.593798    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="55d4ed70-45fa-4fc3-bd1e-55f3f396ad23" containerName="extract"
Sep 16 02:22:30.642663 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:30.642635    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m2lms"]
Sep 16 02:22:30.642801 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:30.642715    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m2lms"
Sep 16 02:22:30.644976 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:30.644955    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 16 02:22:30.645085 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:30.645036    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-phsfl\""
Sep 16 02:22:30.645085 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:30.645071    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 16 02:22:30.707928 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:30.707903    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmh7t\" (UniqueName: \"kubernetes.io/projected/467e6eb8-de49-4c69-866f-3e0a75e1ae0c-kube-api-access-hmh7t\") pod \"cert-manager-operator-controller-manager-55c444bf86-m2lms\" (UID: \"467e6eb8-de49-4c69-866f-3e0a75e1ae0c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m2lms"
Sep 16 02:22:30.708018 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:30.707934    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/467e6eb8-de49-4c69-866f-3e0a75e1ae0c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-m2lms\" (UID: \"467e6eb8-de49-4c69-866f-3e0a75e1ae0c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m2lms"
Sep 16 02:22:30.809119 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:30.809093    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmh7t\" (UniqueName: \"kubernetes.io/projected/467e6eb8-de49-4c69-866f-3e0a75e1ae0c-kube-api-access-hmh7t\") pod \"cert-manager-operator-controller-manager-55c444bf86-m2lms\" (UID: \"467e6eb8-de49-4c69-866f-3e0a75e1ae0c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m2lms"
Sep 16 02:22:30.809200 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:30.809122    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/467e6eb8-de49-4c69-866f-3e0a75e1ae0c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-m2lms\" (UID: \"467e6eb8-de49-4c69-866f-3e0a75e1ae0c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m2lms"
Sep 16 02:22:30.809396 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:30.809382    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/467e6eb8-de49-4c69-866f-3e0a75e1ae0c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-m2lms\" (UID: \"467e6eb8-de49-4c69-866f-3e0a75e1ae0c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m2lms"
Sep 16 02:22:30.816605 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:30.816583    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmh7t\" (UniqueName: \"kubernetes.io/projected/467e6eb8-de49-4c69-866f-3e0a75e1ae0c-kube-api-access-hmh7t\") pod \"cert-manager-operator-controller-manager-55c444bf86-m2lms\" (UID: \"467e6eb8-de49-4c69-866f-3e0a75e1ae0c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m2lms"
Sep 16 02:22:30.951000 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:30.950929    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m2lms"
Sep 16 02:22:31.246893 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:31.246838    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m2lms"]
Sep 16 02:22:31.248483 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:22:31.248461    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod467e6eb8_de49_4c69_866f_3e0a75e1ae0c.slice/crio-8a56f869224186c962ef2e48b247a080ef4589d7209923404f9d69feb7330cb7 WatchSource:0}: Error finding container 8a56f869224186c962ef2e48b247a080ef4589d7209923404f9d69feb7330cb7: Status 404 returned error can't find the container with id 8a56f869224186c962ef2e48b247a080ef4589d7209923404f9d69feb7330cb7
Sep 16 02:22:31.380614 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:31.380584    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m2lms" event={"ID":"467e6eb8-de49-4c69-866f-3e0a75e1ae0c","Type":"ContainerStarted","Data":"8a56f869224186c962ef2e48b247a080ef4589d7209923404f9d69feb7330cb7"}
Sep 16 02:22:34.389236 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:34.389201    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m2lms" event={"ID":"467e6eb8-de49-4c69-866f-3e0a75e1ae0c","Type":"ContainerStarted","Data":"260419f2fa320becd0683d1d7881d2e535caa3df5e0d117a79658df3d4301be9"}
Sep 16 02:22:34.407166 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:34.407111    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m2lms" podStartSLOduration=2.361030056 podStartE2EDuration="4.407091306s" totalImagesPullingTime="2.04606125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:22:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:22:34.405647626 +0000 UTC m=+559.497829598" watchObservedRunningTime="2026-09-16 02:22:34.407091306 +0000 UTC m=+559.499273279"
Sep 16 02:22:35.074716 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:35.074678    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqj5rj"]
Sep 16 02:22:35.091017 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:35.090990    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqj5rj"]
Sep 16 02:22:35.091171 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:35.091084    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqj5rj"
Sep 16 02:22:35.093399 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:35.093381    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 02:22:35.093501 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:35.093464    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 02:22:35.094255 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:35.094235    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7d226\""
Sep 16 02:22:35.147669 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:35.147644    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7bk4\" (UniqueName: \"kubernetes.io/projected/5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f-kube-api-access-l7bk4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqj5rj\" (UID: \"5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqj5rj"
Sep 16 02:22:35.147746 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:35.147687    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqj5rj\" (UID: \"5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqj5rj"
Sep 16 02:22:35.147746 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:35.147717    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqj5rj\" (UID: \"5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqj5rj"
Sep 16 02:22:35.248329 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:35.248307    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqj5rj\" (UID: \"5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqj5rj"
Sep 16 02:22:35.248419 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:35.248368    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7bk4\" (UniqueName: \"kubernetes.io/projected/5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f-kube-api-access-l7bk4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqj5rj\" (UID: \"5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqj5rj"
Sep 16 02:22:35.248419 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:35.248394    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqj5rj\" (UID: \"5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqj5rj"
Sep 16 02:22:35.248743 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:35.248729    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqj5rj\" (UID: \"5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqj5rj"
Sep 16 02:22:35.248777 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:35.248728    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqj5rj\" (UID: \"5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqj5rj"
Sep 16 02:22:35.262559 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:35.262533    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7bk4\" (UniqueName: \"kubernetes.io/projected/5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f-kube-api-access-l7bk4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqj5rj\" (UID: \"5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqj5rj"
Sep 16 02:22:35.399428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:35.399360    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqj5rj"
Sep 16 02:22:35.690215 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:35.690142    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqj5rj"]
Sep 16 02:22:35.693213 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:22:35.693183    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cebc4e2_3fe8_4fb3_bb98_aa149a8df69f.slice/crio-23bf5292fc63d5b7ae789208d72f3c70760749e80be488c7314adb7cbc63ad1f WatchSource:0}: Error finding container 23bf5292fc63d5b7ae789208d72f3c70760749e80be488c7314adb7cbc63ad1f: Status 404 returned error can't find the container with id 23bf5292fc63d5b7ae789208d72f3c70760749e80be488c7314adb7cbc63ad1f
Sep 16 02:22:36.403405 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:36.403373    2581 generic.go:356] "Generic (PLEG): container finished" podID="5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f" containerID="2cd83fd52d611a423b4cc234d92fd24b9bf7a0c31a2a666f2a84cdb6317f68eb" exitCode=0
Sep 16 02:22:36.403730 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:36.403432    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqj5rj" event={"ID":"5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f","Type":"ContainerDied","Data":"2cd83fd52d611a423b4cc234d92fd24b9bf7a0c31a2a666f2a84cdb6317f68eb"}
Sep 16 02:22:36.403730 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:36.403472    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqj5rj" event={"ID":"5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f","Type":"ContainerStarted","Data":"23bf5292fc63d5b7ae789208d72f3c70760749e80be488c7314adb7cbc63ad1f"}
Sep 16 02:22:36.857366 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:36.857328    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-f659g"]
Sep 16 02:22:36.859925 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:36.859905    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-f659g"
Sep 16 02:22:36.862436 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:36.862252    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 16 02:22:36.862436 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:36.862349    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 16 02:22:36.862631 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:36.862613    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-kkh4n\""
Sep 16 02:22:36.868174 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:36.868079    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-f659g"]
Sep 16 02:22:36.963516 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:36.963487    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ea8753c-5476-4a46-8703-d604a0cc5687-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-f659g\" (UID: \"1ea8753c-5476-4a46-8703-d604a0cc5687\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-f659g"
Sep 16 02:22:36.963643 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:36.963529    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9h57\" (UniqueName: \"kubernetes.io/projected/1ea8753c-5476-4a46-8703-d604a0cc5687-kube-api-access-w9h57\") pod \"cert-manager-cainjector-559cdd8c87-f659g\" (UID: \"1ea8753c-5476-4a46-8703-d604a0cc5687\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-f659g"
Sep 16 02:22:37.064304 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:37.064273    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ea8753c-5476-4a46-8703-d604a0cc5687-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-f659g\" (UID: \"1ea8753c-5476-4a46-8703-d604a0cc5687\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-f659g"
Sep 16 02:22:37.064461 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:37.064311    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9h57\" (UniqueName: \"kubernetes.io/projected/1ea8753c-5476-4a46-8703-d604a0cc5687-kube-api-access-w9h57\") pod \"cert-manager-cainjector-559cdd8c87-f659g\" (UID: \"1ea8753c-5476-4a46-8703-d604a0cc5687\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-f659g"
Sep 16 02:22:37.072443 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:37.072413    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ea8753c-5476-4a46-8703-d604a0cc5687-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-f659g\" (UID: \"1ea8753c-5476-4a46-8703-d604a0cc5687\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-f659g"
Sep 16 02:22:37.072659 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:37.072634    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9h57\" (UniqueName: \"kubernetes.io/projected/1ea8753c-5476-4a46-8703-d604a0cc5687-kube-api-access-w9h57\") pod \"cert-manager-cainjector-559cdd8c87-f659g\" (UID: \"1ea8753c-5476-4a46-8703-d604a0cc5687\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-f659g"
Sep 16 02:22:37.179662 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:37.179591    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-f659g"
Sep 16 02:22:37.457791 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:37.457767    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-f659g"]
Sep 16 02:22:37.977410 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:22:37.977379    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ea8753c_5476_4a46_8703_d604a0cc5687.slice/crio-0d3583933fdab37b44203d008f18320b41a7d882379f6bc98754bfc5a3be65ed WatchSource:0}: Error finding container 0d3583933fdab37b44203d008f18320b41a7d882379f6bc98754bfc5a3be65ed: Status 404 returned error can't find the container with id 0d3583933fdab37b44203d008f18320b41a7d882379f6bc98754bfc5a3be65ed
Sep 16 02:22:38.413753 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:38.413721    2581 generic.go:356] "Generic (PLEG): container finished" podID="5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f" containerID="3c11765d9d21e6733499d79a836f142fc439e74a978fe717fc327ddace137d1c" exitCode=0
Sep 16 02:22:38.413942 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:38.413791    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqj5rj" event={"ID":"5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f","Type":"ContainerDied","Data":"3c11765d9d21e6733499d79a836f142fc439e74a978fe717fc327ddace137d1c"}
Sep 16 02:22:38.415000 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:38.414981    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-f659g" event={"ID":"1ea8753c-5476-4a46-8703-d604a0cc5687","Type":"ContainerStarted","Data":"0d3583933fdab37b44203d008f18320b41a7d882379f6bc98754bfc5a3be65ed"}
Sep 16 02:22:39.428297 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:39.428260    2581 generic.go:356] "Generic (PLEG): container finished" podID="5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f" containerID="dd19370d96effbdf419f83476286105425a69ef7d621022c78c0fcd236689abc" exitCode=0
Sep 16 02:22:39.428700 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:39.428349    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqj5rj" event={"ID":"5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f","Type":"ContainerDied","Data":"dd19370d96effbdf419f83476286105425a69ef7d621022c78c0fcd236689abc"}
Sep 16 02:22:40.676342 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:40.676311    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqj5rj"
Sep 16 02:22:40.795373 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:40.795343    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f-bundle\") pod \"5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f\" (UID: \"5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f\") "
Sep 16 02:22:40.795503 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:40.795397    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f-util\") pod \"5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f\" (UID: \"5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f\") "
Sep 16 02:22:40.795503 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:40.795422    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7bk4\" (UniqueName: \"kubernetes.io/projected/5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f-kube-api-access-l7bk4\") pod \"5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f\" (UID: \"5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f\") "
Sep 16 02:22:40.795772 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:40.795745    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f-bundle" (OuterVolumeSpecName: "bundle") pod "5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f" (UID: "5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:22:40.797407 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:40.797380    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f-kube-api-access-l7bk4" (OuterVolumeSpecName: "kube-api-access-l7bk4") pod "5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f" (UID: "5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f"). InnerVolumeSpecName "kube-api-access-l7bk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:22:40.800044 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:40.800023    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f-util" (OuterVolumeSpecName: "util") pod "5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f" (UID: "5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:22:40.896634 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:40.896601    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f-bundle\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:22:40.896634 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:40.896626    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f-util\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:22:40.896634 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:40.896635    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7bk4\" (UniqueName: \"kubernetes.io/projected/5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f-kube-api-access-l7bk4\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:22:41.439956 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:41.439932    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqj5rj"
Sep 16 02:22:41.440096 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:41.439930    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqj5rj" event={"ID":"5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f","Type":"ContainerDied","Data":"23bf5292fc63d5b7ae789208d72f3c70760749e80be488c7314adb7cbc63ad1f"}
Sep 16 02:22:41.440096 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:41.440056    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="23bf5292fc63d5b7ae789208d72f3c70760749e80be488c7314adb7cbc63ad1f"
Sep 16 02:22:41.441629 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:41.441607    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-f659g" event={"ID":"1ea8753c-5476-4a46-8703-d604a0cc5687","Type":"ContainerStarted","Data":"6f49c9e6552b055f4db2895c27f9ca589ccc406b057b41654e537e7b72d539fc"}
Sep 16 02:22:41.455895 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:41.455833    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-f659g" podStartSLOduration=2.737032558 podStartE2EDuration="5.455817263s" totalImagesPullingTime="2.718784705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:22:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:22:41.455494285 +0000 UTC m=+566.547676254" watchObservedRunningTime="2026-09-16 02:22:41.455817263 +0000 UTC m=+566.547999246"
Sep 16 02:22:45.558073 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:45.558044    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2g75b"]
Sep 16 02:22:45.558490 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:45.558351    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f" containerName="util"
Sep 16 02:22:45.558490 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:45.558363    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f" containerName="util"
Sep 16 02:22:45.558490 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:45.558371    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f" containerName="pull"
Sep 16 02:22:45.558490 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:45.558376    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f" containerName="pull"
Sep 16 02:22:45.558490 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:45.558385    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f" containerName="extract"
Sep 16 02:22:45.558490 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:45.558391    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f" containerName="extract"
Sep 16 02:22:45.558490 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:45.558435    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cebc4e2-3fe8-4fb3-bb98-aa149a8df69f" containerName="extract"
Sep 16 02:22:45.560209 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:45.560192    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-2g75b"
Sep 16 02:22:45.563141 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:45.563118    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-pjbgm\""
Sep 16 02:22:45.568042 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:45.568020    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2g75b"]
Sep 16 02:22:45.628490 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:45.628465    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lghx2\" (UniqueName: \"kubernetes.io/projected/fcf7554b-5b08-48de-8d6c-f880e0b77187-kube-api-access-lghx2\") pod \"cert-manager-55b4d954d5-2g75b\" (UID: \"fcf7554b-5b08-48de-8d6c-f880e0b77187\") " pod="cert-manager/cert-manager-55b4d954d5-2g75b"
Sep 16 02:22:45.628643 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:45.628514    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fcf7554b-5b08-48de-8d6c-f880e0b77187-bound-sa-token\") pod \"cert-manager-55b4d954d5-2g75b\" (UID: \"fcf7554b-5b08-48de-8d6c-f880e0b77187\") " pod="cert-manager/cert-manager-55b4d954d5-2g75b"
Sep 16 02:22:45.729562 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:45.729531    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fcf7554b-5b08-48de-8d6c-f880e0b77187-bound-sa-token\") pod \"cert-manager-55b4d954d5-2g75b\" (UID: \"fcf7554b-5b08-48de-8d6c-f880e0b77187\") " pod="cert-manager/cert-manager-55b4d954d5-2g75b"
Sep 16 02:22:45.729692 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:45.729654    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lghx2\" (UniqueName: \"kubernetes.io/projected/fcf7554b-5b08-48de-8d6c-f880e0b77187-kube-api-access-lghx2\") pod \"cert-manager-55b4d954d5-2g75b\" (UID: \"fcf7554b-5b08-48de-8d6c-f880e0b77187\") " pod="cert-manager/cert-manager-55b4d954d5-2g75b"
Sep 16 02:22:45.737130 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:45.737102    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lghx2\" (UniqueName: \"kubernetes.io/projected/fcf7554b-5b08-48de-8d6c-f880e0b77187-kube-api-access-lghx2\") pod \"cert-manager-55b4d954d5-2g75b\" (UID: \"fcf7554b-5b08-48de-8d6c-f880e0b77187\") " pod="cert-manager/cert-manager-55b4d954d5-2g75b"
Sep 16 02:22:45.737130 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:45.737117    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fcf7554b-5b08-48de-8d6c-f880e0b77187-bound-sa-token\") pod \"cert-manager-55b4d954d5-2g75b\" (UID: \"fcf7554b-5b08-48de-8d6c-f880e0b77187\") " pod="cert-manager/cert-manager-55b4d954d5-2g75b"
Sep 16 02:22:45.871895 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:45.871825    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-2g75b"
Sep 16 02:22:46.135118 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:46.135093    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2g75b"]
Sep 16 02:22:46.137836 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:22:46.137804    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfcf7554b_5b08_48de_8d6c_f880e0b77187.slice/crio-01f42f0ce3af163b37bab9ffe856c562188d9fe74ebe698c4810e9bc808941e1 WatchSource:0}: Error finding container 01f42f0ce3af163b37bab9ffe856c562188d9fe74ebe698c4810e9bc808941e1: Status 404 returned error can't find the container with id 01f42f0ce3af163b37bab9ffe856c562188d9fe74ebe698c4810e9bc808941e1
Sep 16 02:22:46.463213 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:46.463128    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-2g75b" event={"ID":"fcf7554b-5b08-48de-8d6c-f880e0b77187","Type":"ContainerStarted","Data":"e72cd6b8961ce4cab341a64e09e42b131255f158e93c3bd0db371bc35589ef75"}
Sep 16 02:22:46.463213 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:46.463177    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-2g75b" event={"ID":"fcf7554b-5b08-48de-8d6c-f880e0b77187","Type":"ContainerStarted","Data":"01f42f0ce3af163b37bab9ffe856c562188d9fe74ebe698c4810e9bc808941e1"}
Sep 16 02:22:46.477702 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:46.477660    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-2g75b" podStartSLOduration=1.477645288 podStartE2EDuration="1.477645288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:22:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:22:46.476269753 +0000 UTC m=+571.568451739" watchObservedRunningTime="2026-09-16 02:22:46.477645288 +0000 UTC m=+571.569827261"
Sep 16 02:22:52.100044 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:52.100013    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b246"]
Sep 16 02:22:52.102262 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:52.102245    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b246"
Sep 16 02:22:52.104508 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:52.104480    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 02:22:52.104620 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:52.104608    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 02:22:52.104707 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:52.104692    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7d226\""
Sep 16 02:22:52.112037 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:52.112016    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b246"]
Sep 16 02:22:52.176625 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:52.176600    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37487544-dde6-495f-b3b4-2e61b88430e6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b246\" (UID: \"37487544-dde6-495f-b3b4-2e61b88430e6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b246"
Sep 16 02:22:52.176763 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:52.176657    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj6n9\" (UniqueName: \"kubernetes.io/projected/37487544-dde6-495f-b3b4-2e61b88430e6-kube-api-access-rj6n9\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b246\" (UID: \"37487544-dde6-495f-b3b4-2e61b88430e6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b246"
Sep 16 02:22:52.176763 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:52.176730    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37487544-dde6-495f-b3b4-2e61b88430e6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b246\" (UID: \"37487544-dde6-495f-b3b4-2e61b88430e6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b246"
Sep 16 02:22:52.277344 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:52.277313    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37487544-dde6-495f-b3b4-2e61b88430e6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b246\" (UID: \"37487544-dde6-495f-b3b4-2e61b88430e6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b246"
Sep 16 02:22:52.277481 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:52.277369    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj6n9\" (UniqueName: \"kubernetes.io/projected/37487544-dde6-495f-b3b4-2e61b88430e6-kube-api-access-rj6n9\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b246\" (UID: \"37487544-dde6-495f-b3b4-2e61b88430e6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b246"
Sep 16 02:22:52.277481 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:52.277401    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37487544-dde6-495f-b3b4-2e61b88430e6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b246\" (UID: \"37487544-dde6-495f-b3b4-2e61b88430e6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b246"
Sep 16 02:22:52.277690 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:52.277672    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37487544-dde6-495f-b3b4-2e61b88430e6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b246\" (UID: \"37487544-dde6-495f-b3b4-2e61b88430e6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b246"
Sep 16 02:22:52.277733 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:52.277695    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37487544-dde6-495f-b3b4-2e61b88430e6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b246\" (UID: \"37487544-dde6-495f-b3b4-2e61b88430e6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b246"
Sep 16 02:22:52.284998 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:52.284970    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj6n9\" (UniqueName: \"kubernetes.io/projected/37487544-dde6-495f-b3b4-2e61b88430e6-kube-api-access-rj6n9\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b246\" (UID: \"37487544-dde6-495f-b3b4-2e61b88430e6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b246"
Sep 16 02:22:52.411545 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:52.411476    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b246"
Sep 16 02:22:52.678228 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:52.678154    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b246"]
Sep 16 02:22:52.681483 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:22:52.681456    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37487544_dde6_495f_b3b4_2e61b88430e6.slice/crio-eae4a6433907bde3f0235224604586771115d1a223dafb870cc81e661ed4072f WatchSource:0}: Error finding container eae4a6433907bde3f0235224604586771115d1a223dafb870cc81e661ed4072f: Status 404 returned error can't find the container with id eae4a6433907bde3f0235224604586771115d1a223dafb870cc81e661ed4072f
Sep 16 02:22:53.493212 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:53.493173    2581 generic.go:356] "Generic (PLEG): container finished" podID="37487544-dde6-495f-b3b4-2e61b88430e6" containerID="74d62ffe8a2411e79b2c0e5da0d31d8a1c4491314aaf448a919e25d71e8adb50" exitCode=0
Sep 16 02:22:53.493626 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:53.493236    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b246" event={"ID":"37487544-dde6-495f-b3b4-2e61b88430e6","Type":"ContainerDied","Data":"74d62ffe8a2411e79b2c0e5da0d31d8a1c4491314aaf448a919e25d71e8adb50"}
Sep 16 02:22:53.493626 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:53.493268    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b246" event={"ID":"37487544-dde6-495f-b3b4-2e61b88430e6","Type":"ContainerStarted","Data":"eae4a6433907bde3f0235224604586771115d1a223dafb870cc81e661ed4072f"}
Sep 16 02:22:54.499375 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:54.499281    2581 generic.go:356] "Generic (PLEG): container finished" podID="37487544-dde6-495f-b3b4-2e61b88430e6" containerID="9b657186f0fa69c4d6ffa86fb951cf90e7953e643f830d2911ecc3698a2ce111" exitCode=0
Sep 16 02:22:54.499722 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:54.499376    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b246" event={"ID":"37487544-dde6-495f-b3b4-2e61b88430e6","Type":"ContainerDied","Data":"9b657186f0fa69c4d6ffa86fb951cf90e7953e643f830d2911ecc3698a2ce111"}
Sep 16 02:22:55.505413 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:55.505376    2581 generic.go:356] "Generic (PLEG): container finished" podID="37487544-dde6-495f-b3b4-2e61b88430e6" containerID="17eba74dac2dd9535bfe9fe5dd769beac7dda0a98e97677befcb90fba3fb6013" exitCode=0
Sep 16 02:22:55.505802 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:55.505424    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b246" event={"ID":"37487544-dde6-495f-b3b4-2e61b88430e6","Type":"ContainerDied","Data":"17eba74dac2dd9535bfe9fe5dd769beac7dda0a98e97677befcb90fba3fb6013"}
Sep 16 02:22:56.628021 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:56.627997    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b246"
Sep 16 02:22:56.715198 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:56.715169    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37487544-dde6-495f-b3b4-2e61b88430e6-util\") pod \"37487544-dde6-495f-b3b4-2e61b88430e6\" (UID: \"37487544-dde6-495f-b3b4-2e61b88430e6\") "
Sep 16 02:22:56.715328 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:56.715231    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rj6n9\" (UniqueName: \"kubernetes.io/projected/37487544-dde6-495f-b3b4-2e61b88430e6-kube-api-access-rj6n9\") pod \"37487544-dde6-495f-b3b4-2e61b88430e6\" (UID: \"37487544-dde6-495f-b3b4-2e61b88430e6\") "
Sep 16 02:22:56.715328 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:56.715273    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37487544-dde6-495f-b3b4-2e61b88430e6-bundle\") pod \"37487544-dde6-495f-b3b4-2e61b88430e6\" (UID: \"37487544-dde6-495f-b3b4-2e61b88430e6\") "
Sep 16 02:22:56.715944 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:56.715910    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37487544-dde6-495f-b3b4-2e61b88430e6-bundle" (OuterVolumeSpecName: "bundle") pod "37487544-dde6-495f-b3b4-2e61b88430e6" (UID: "37487544-dde6-495f-b3b4-2e61b88430e6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:22:56.717236 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:56.717213    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37487544-dde6-495f-b3b4-2e61b88430e6-kube-api-access-rj6n9" (OuterVolumeSpecName: "kube-api-access-rj6n9") pod "37487544-dde6-495f-b3b4-2e61b88430e6" (UID: "37487544-dde6-495f-b3b4-2e61b88430e6"). InnerVolumeSpecName "kube-api-access-rj6n9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:22:56.722880 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:56.722842    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37487544-dde6-495f-b3b4-2e61b88430e6-util" (OuterVolumeSpecName: "util") pod "37487544-dde6-495f-b3b4-2e61b88430e6" (UID: "37487544-dde6-495f-b3b4-2e61b88430e6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:22:56.816408 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:56.816385    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37487544-dde6-495f-b3b4-2e61b88430e6-util\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:22:56.816538 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:56.816411    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rj6n9\" (UniqueName: \"kubernetes.io/projected/37487544-dde6-495f-b3b4-2e61b88430e6-kube-api-access-rj6n9\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:22:56.816538 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:56.816424    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37487544-dde6-495f-b3b4-2e61b88430e6-bundle\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:22:57.515107 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:57.515076    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b246"
Sep 16 02:22:57.515259 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:57.515102    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7b246" event={"ID":"37487544-dde6-495f-b3b4-2e61b88430e6","Type":"ContainerDied","Data":"eae4a6433907bde3f0235224604586771115d1a223dafb870cc81e661ed4072f"}
Sep 16 02:22:57.515259 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:22:57.515146    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eae4a6433907bde3f0235224604586771115d1a223dafb870cc81e661ed4072f"
Sep 16 02:23:09.337557 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.337523    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cpdjr"]
Sep 16 02:23:09.337953 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.337818    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37487544-dde6-495f-b3b4-2e61b88430e6" containerName="util"
Sep 16 02:23:09.337953 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.337828    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="37487544-dde6-495f-b3b4-2e61b88430e6" containerName="util"
Sep 16 02:23:09.337953 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.337861    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37487544-dde6-495f-b3b4-2e61b88430e6" containerName="pull"
Sep 16 02:23:09.337953 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.337866    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="37487544-dde6-495f-b3b4-2e61b88430e6" containerName="pull"
Sep 16 02:23:09.337953 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.337871    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37487544-dde6-495f-b3b4-2e61b88430e6" containerName="extract"
Sep 16 02:23:09.337953 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.337876    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="37487544-dde6-495f-b3b4-2e61b88430e6" containerName="extract"
Sep 16 02:23:09.337953 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.337922    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="37487544-dde6-495f-b3b4-2e61b88430e6" containerName="extract"
Sep 16 02:23:09.339710 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.339695    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cpdjr"
Sep 16 02:23:09.343534 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.343510    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 02:23:09.343742 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.343729    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7d226\""
Sep 16 02:23:09.344386 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.344371    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 02:23:09.410476 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.410446    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cpdjr"]
Sep 16 02:23:09.511225 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.511193    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5be695a7-dfff-4da9-9c70-506a5d99f77f-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cpdjr\" (UID: \"5be695a7-dfff-4da9-9c70-506a5d99f77f\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cpdjr"
Sep 16 02:23:09.511358 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.511233    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5be695a7-dfff-4da9-9c70-506a5d99f77f-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cpdjr\" (UID: \"5be695a7-dfff-4da9-9c70-506a5d99f77f\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cpdjr"
Sep 16 02:23:09.511358 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.511261    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlqkg\" (UniqueName: \"kubernetes.io/projected/5be695a7-dfff-4da9-9c70-506a5d99f77f-kube-api-access-vlqkg\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cpdjr\" (UID: \"5be695a7-dfff-4da9-9c70-506a5d99f77f\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cpdjr"
Sep 16 02:23:09.612180 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.612107    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5be695a7-dfff-4da9-9c70-506a5d99f77f-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cpdjr\" (UID: \"5be695a7-dfff-4da9-9c70-506a5d99f77f\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cpdjr"
Sep 16 02:23:09.612180 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.612144    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5be695a7-dfff-4da9-9c70-506a5d99f77f-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cpdjr\" (UID: \"5be695a7-dfff-4da9-9c70-506a5d99f77f\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cpdjr"
Sep 16 02:23:09.612180 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.612169    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlqkg\" (UniqueName: \"kubernetes.io/projected/5be695a7-dfff-4da9-9c70-506a5d99f77f-kube-api-access-vlqkg\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cpdjr\" (UID: \"5be695a7-dfff-4da9-9c70-506a5d99f77f\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cpdjr"
Sep 16 02:23:09.612465 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.612445    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5be695a7-dfff-4da9-9c70-506a5d99f77f-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cpdjr\" (UID: \"5be695a7-dfff-4da9-9c70-506a5d99f77f\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cpdjr"
Sep 16 02:23:09.612509 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.612480    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5be695a7-dfff-4da9-9c70-506a5d99f77f-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cpdjr\" (UID: \"5be695a7-dfff-4da9-9c70-506a5d99f77f\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cpdjr"
Sep 16 02:23:09.640287 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.640254    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlqkg\" (UniqueName: \"kubernetes.io/projected/5be695a7-dfff-4da9-9c70-506a5d99f77f-kube-api-access-vlqkg\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cpdjr\" (UID: \"5be695a7-dfff-4da9-9c70-506a5d99f77f\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cpdjr"
Sep 16 02:23:09.648081 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.648060    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cpdjr"
Sep 16 02:23:09.760870 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.760818    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74fbd865d6-5cmwz"]
Sep 16 02:23:09.763085 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.763071    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74fbd865d6-5cmwz"
Sep 16 02:23:09.775301 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.775283    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 16 02:23:09.775400 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.775305    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xzpsv\""
Sep 16 02:23:09.775508 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.775496    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 16 02:23:09.776283 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.776268    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 16 02:23:09.776493 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.776479    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 16 02:23:09.801347 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.801321    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74fbd865d6-5cmwz"]
Sep 16 02:23:09.915094 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.915018    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6zst\" (UniqueName: \"kubernetes.io/projected/d1e50091-37d5-4e5d-9dc0-83081aa8dbcd-kube-api-access-p6zst\") pod \"opendatahub-operator-controller-manager-74fbd865d6-5cmwz\" (UID: \"d1e50091-37d5-4e5d-9dc0-83081aa8dbcd\") " pod="opendatahub/opendatahub-operator-controller-manager-74fbd865d6-5cmwz"
Sep 16 02:23:09.915094 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.915057    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d1e50091-37d5-4e5d-9dc0-83081aa8dbcd-manifests\") pod \"opendatahub-operator-controller-manager-74fbd865d6-5cmwz\" (UID: \"d1e50091-37d5-4e5d-9dc0-83081aa8dbcd\") " pod="opendatahub/opendatahub-operator-controller-manager-74fbd865d6-5cmwz"
Sep 16 02:23:09.915327 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.915105    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d1e50091-37d5-4e5d-9dc0-83081aa8dbcd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74fbd865d6-5cmwz\" (UID: \"d1e50091-37d5-4e5d-9dc0-83081aa8dbcd\") " pod="opendatahub/opendatahub-operator-controller-manager-74fbd865d6-5cmwz"
Sep 16 02:23:09.915327 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.915157    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1e50091-37d5-4e5d-9dc0-83081aa8dbcd-tmp\") pod \"opendatahub-operator-controller-manager-74fbd865d6-5cmwz\" (UID: \"d1e50091-37d5-4e5d-9dc0-83081aa8dbcd\") " pod="opendatahub/opendatahub-operator-controller-manager-74fbd865d6-5cmwz"
Sep 16 02:23:09.915327 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.915248    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1e50091-37d5-4e5d-9dc0-83081aa8dbcd-webhook-cert\") pod \"opendatahub-operator-controller-manager-74fbd865d6-5cmwz\" (UID: \"d1e50091-37d5-4e5d-9dc0-83081aa8dbcd\") " pod="opendatahub/opendatahub-operator-controller-manager-74fbd865d6-5cmwz"
Sep 16 02:23:09.983924 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:23:09.983901    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5be695a7_dfff_4da9_9c70_506a5d99f77f.slice/crio-da2a981cf2488856dcc18a5fe2da2865ccfaf9c949c1badcf2bf1d5dd7227835 WatchSource:0}: Error finding container da2a981cf2488856dcc18a5fe2da2865ccfaf9c949c1badcf2bf1d5dd7227835: Status 404 returned error can't find the container with id da2a981cf2488856dcc18a5fe2da2865ccfaf9c949c1badcf2bf1d5dd7227835
Sep 16 02:23:09.984890 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:09.984834    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cpdjr"]
Sep 16 02:23:10.015605 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:10.015579    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6zst\" (UniqueName: \"kubernetes.io/projected/d1e50091-37d5-4e5d-9dc0-83081aa8dbcd-kube-api-access-p6zst\") pod \"opendatahub-operator-controller-manager-74fbd865d6-5cmwz\" (UID: \"d1e50091-37d5-4e5d-9dc0-83081aa8dbcd\") " pod="opendatahub/opendatahub-operator-controller-manager-74fbd865d6-5cmwz"
Sep 16 02:23:10.015722 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:10.015618    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d1e50091-37d5-4e5d-9dc0-83081aa8dbcd-manifests\") pod \"opendatahub-operator-controller-manager-74fbd865d6-5cmwz\" (UID: \"d1e50091-37d5-4e5d-9dc0-83081aa8dbcd\") " pod="opendatahub/opendatahub-operator-controller-manager-74fbd865d6-5cmwz"
Sep 16 02:23:10.015722 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:10.015650    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d1e50091-37d5-4e5d-9dc0-83081aa8dbcd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74fbd865d6-5cmwz\" (UID: \"d1e50091-37d5-4e5d-9dc0-83081aa8dbcd\") " pod="opendatahub/opendatahub-operator-controller-manager-74fbd865d6-5cmwz"
Sep 16 02:23:10.015722 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:10.015697    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1e50091-37d5-4e5d-9dc0-83081aa8dbcd-tmp\") pod \"opendatahub-operator-controller-manager-74fbd865d6-5cmwz\" (UID: \"d1e50091-37d5-4e5d-9dc0-83081aa8dbcd\") " pod="opendatahub/opendatahub-operator-controller-manager-74fbd865d6-5cmwz"
Sep 16 02:23:10.015908 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:10.015762    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1e50091-37d5-4e5d-9dc0-83081aa8dbcd-webhook-cert\") pod \"opendatahub-operator-controller-manager-74fbd865d6-5cmwz\" (UID: \"d1e50091-37d5-4e5d-9dc0-83081aa8dbcd\") " pod="opendatahub/opendatahub-operator-controller-manager-74fbd865d6-5cmwz"
Sep 16 02:23:10.016042 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:10.016021    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d1e50091-37d5-4e5d-9dc0-83081aa8dbcd-manifests\") pod \"opendatahub-operator-controller-manager-74fbd865d6-5cmwz\" (UID: \"d1e50091-37d5-4e5d-9dc0-83081aa8dbcd\") " pod="opendatahub/opendatahub-operator-controller-manager-74fbd865d6-5cmwz"
Sep 16 02:23:10.018173 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:10.018149    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1e50091-37d5-4e5d-9dc0-83081aa8dbcd-tmp\") pod \"opendatahub-operator-controller-manager-74fbd865d6-5cmwz\" (UID: \"d1e50091-37d5-4e5d-9dc0-83081aa8dbcd\") " pod="opendatahub/opendatahub-operator-controller-manager-74fbd865d6-5cmwz"
Sep 16 02:23:10.018417 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:10.018397    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1e50091-37d5-4e5d-9dc0-83081aa8dbcd-webhook-cert\") pod \"opendatahub-operator-controller-manager-74fbd865d6-5cmwz\" (UID: \"d1e50091-37d5-4e5d-9dc0-83081aa8dbcd\") " pod="opendatahub/opendatahub-operator-controller-manager-74fbd865d6-5cmwz"
Sep 16 02:23:10.018462 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:10.018443    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d1e50091-37d5-4e5d-9dc0-83081aa8dbcd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74fbd865d6-5cmwz\" (UID: \"d1e50091-37d5-4e5d-9dc0-83081aa8dbcd\") " pod="opendatahub/opendatahub-operator-controller-manager-74fbd865d6-5cmwz"
Sep 16 02:23:10.027666 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:10.027643    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6zst\" (UniqueName: \"kubernetes.io/projected/d1e50091-37d5-4e5d-9dc0-83081aa8dbcd-kube-api-access-p6zst\") pod \"opendatahub-operator-controller-manager-74fbd865d6-5cmwz\" (UID: \"d1e50091-37d5-4e5d-9dc0-83081aa8dbcd\") " pod="opendatahub/opendatahub-operator-controller-manager-74fbd865d6-5cmwz"
Sep 16 02:23:10.072584 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:10.072560    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74fbd865d6-5cmwz"
Sep 16 02:23:10.350292 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:10.350269    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74fbd865d6-5cmwz"]
Sep 16 02:23:10.352635 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:23:10.352611    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1e50091_37d5_4e5d_9dc0_83081aa8dbcd.slice/crio-b8f7873c93092e13a5b70c35209eb01d14db4dbd02b3ade429ccb107820d6ecf WatchSource:0}: Error finding container b8f7873c93092e13a5b70c35209eb01d14db4dbd02b3ade429ccb107820d6ecf: Status 404 returned error can't find the container with id b8f7873c93092e13a5b70c35209eb01d14db4dbd02b3ade429ccb107820d6ecf
Sep 16 02:23:10.572274 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:10.572238    2581 generic.go:356] "Generic (PLEG): container finished" podID="5be695a7-dfff-4da9-9c70-506a5d99f77f" containerID="a1f0adf8690e94508664dab9ff5531285cc654fc16e6024949b5f7199e3bcc63" exitCode=0
Sep 16 02:23:10.572426 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:10.572326    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cpdjr" event={"ID":"5be695a7-dfff-4da9-9c70-506a5d99f77f","Type":"ContainerDied","Data":"a1f0adf8690e94508664dab9ff5531285cc654fc16e6024949b5f7199e3bcc63"}
Sep 16 02:23:10.572426 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:10.572375    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cpdjr" event={"ID":"5be695a7-dfff-4da9-9c70-506a5d99f77f","Type":"ContainerStarted","Data":"da2a981cf2488856dcc18a5fe2da2865ccfaf9c949c1badcf2bf1d5dd7227835"}
Sep 16 02:23:10.573706 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:10.573681    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74fbd865d6-5cmwz" event={"ID":"d1e50091-37d5-4e5d-9dc0-83081aa8dbcd","Type":"ContainerStarted","Data":"b8f7873c93092e13a5b70c35209eb01d14db4dbd02b3ade429ccb107820d6ecf"}
Sep 16 02:23:11.581866 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:11.581822    2581 generic.go:356] "Generic (PLEG): container finished" podID="5be695a7-dfff-4da9-9c70-506a5d99f77f" containerID="e2f3482c92d1ffe4b7a19d5ed3fea7ae6c32e93246c0d2c1b9de593785742372" exitCode=0
Sep 16 02:23:11.582281 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:11.581881    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cpdjr" event={"ID":"5be695a7-dfff-4da9-9c70-506a5d99f77f","Type":"ContainerDied","Data":"e2f3482c92d1ffe4b7a19d5ed3fea7ae6c32e93246c0d2c1b9de593785742372"}
Sep 16 02:23:13.592398 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:13.592362    2581 generic.go:356] "Generic (PLEG): container finished" podID="5be695a7-dfff-4da9-9c70-506a5d99f77f" containerID="254225566b4c34053c2481bbcaf877a7a4e8ac1081af63b1ed3d9a22ad71d3f4" exitCode=0
Sep 16 02:23:13.592748 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:13.592448    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cpdjr" event={"ID":"5be695a7-dfff-4da9-9c70-506a5d99f77f","Type":"ContainerDied","Data":"254225566b4c34053c2481bbcaf877a7a4e8ac1081af63b1ed3d9a22ad71d3f4"}
Sep 16 02:23:13.593986 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:13.593965    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74fbd865d6-5cmwz" event={"ID":"d1e50091-37d5-4e5d-9dc0-83081aa8dbcd","Type":"ContainerStarted","Data":"aa346441e63c637f7726e77f78dad64b75b1dff82135841a631c899d28f71f8a"}
Sep 16 02:23:14.599834 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:14.599799    2581 generic.go:356] "Generic (PLEG): container finished" podID="d1e50091-37d5-4e5d-9dc0-83081aa8dbcd" containerID="aa346441e63c637f7726e77f78dad64b75b1dff82135841a631c899d28f71f8a" exitCode=0
Sep 16 02:23:14.600217 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:14.599877    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74fbd865d6-5cmwz" event={"ID":"d1e50091-37d5-4e5d-9dc0-83081aa8dbcd","Type":"ContainerDied","Data":"aa346441e63c637f7726e77f78dad64b75b1dff82135841a631c899d28f71f8a"}
Sep 16 02:23:14.720078 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:14.720055    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cpdjr"
Sep 16 02:23:14.853812 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:14.853729    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlqkg\" (UniqueName: \"kubernetes.io/projected/5be695a7-dfff-4da9-9c70-506a5d99f77f-kube-api-access-vlqkg\") pod \"5be695a7-dfff-4da9-9c70-506a5d99f77f\" (UID: \"5be695a7-dfff-4da9-9c70-506a5d99f77f\") "
Sep 16 02:23:14.853812 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:14.853790    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5be695a7-dfff-4da9-9c70-506a5d99f77f-util\") pod \"5be695a7-dfff-4da9-9c70-506a5d99f77f\" (UID: \"5be695a7-dfff-4da9-9c70-506a5d99f77f\") "
Sep 16 02:23:14.854035 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:14.853814    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5be695a7-dfff-4da9-9c70-506a5d99f77f-bundle\") pod \"5be695a7-dfff-4da9-9c70-506a5d99f77f\" (UID: \"5be695a7-dfff-4da9-9c70-506a5d99f77f\") "
Sep 16 02:23:14.854643 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:14.854609    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5be695a7-dfff-4da9-9c70-506a5d99f77f-bundle" (OuterVolumeSpecName: "bundle") pod "5be695a7-dfff-4da9-9c70-506a5d99f77f" (UID: "5be695a7-dfff-4da9-9c70-506a5d99f77f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:23:14.856375 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:14.856355    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5be695a7-dfff-4da9-9c70-506a5d99f77f-kube-api-access-vlqkg" (OuterVolumeSpecName: "kube-api-access-vlqkg") pod "5be695a7-dfff-4da9-9c70-506a5d99f77f" (UID: "5be695a7-dfff-4da9-9c70-506a5d99f77f"). InnerVolumeSpecName "kube-api-access-vlqkg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:23:14.859871 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:14.859837    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5be695a7-dfff-4da9-9c70-506a5d99f77f-util" (OuterVolumeSpecName: "util") pod "5be695a7-dfff-4da9-9c70-506a5d99f77f" (UID: "5be695a7-dfff-4da9-9c70-506a5d99f77f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:23:14.954567 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:14.954542    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlqkg\" (UniqueName: \"kubernetes.io/projected/5be695a7-dfff-4da9-9c70-506a5d99f77f-kube-api-access-vlqkg\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:23:14.954567 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:14.954568    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5be695a7-dfff-4da9-9c70-506a5d99f77f-util\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:23:14.954723 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:14.954579    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5be695a7-dfff-4da9-9c70-506a5d99f77f-bundle\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:23:15.326350 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:15.326314    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g54gh_308f30e2-2871-442a-ba30-54ada02ad832/ovn-acl-logging/0.log"
Sep 16 02:23:15.326534 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:15.326439    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g54gh_308f30e2-2871-442a-ba30-54ada02ad832/ovn-acl-logging/0.log"
Sep 16 02:23:15.606173 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:15.606081    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74fbd865d6-5cmwz" event={"ID":"d1e50091-37d5-4e5d-9dc0-83081aa8dbcd","Type":"ContainerStarted","Data":"bbfe9d8fd83b86a1a898ea95090e5af7dbfdbaf8dcd128d436728f8979b314e2"}
Sep 16 02:23:15.606173 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:15.606171    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74fbd865d6-5cmwz"
Sep 16 02:23:15.607974 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:15.607950    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cpdjr" event={"ID":"5be695a7-dfff-4da9-9c70-506a5d99f77f","Type":"ContainerDied","Data":"da2a981cf2488856dcc18a5fe2da2865ccfaf9c949c1badcf2bf1d5dd7227835"}
Sep 16 02:23:15.608074 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:15.607988    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da2a981cf2488856dcc18a5fe2da2865ccfaf9c949c1badcf2bf1d5dd7227835"
Sep 16 02:23:15.608074 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:15.607991    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cpdjr"
Sep 16 02:23:15.629571 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:15.629529    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74fbd865d6-5cmwz" podStartSLOduration=2.511239647 podStartE2EDuration="6.629516429s" totalImagesPullingTime="3.0584519s" totalInitContainerRuntime="1.059824882s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:23:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:23:15.629471638 +0000 UTC m=+600.721653610" watchObservedRunningTime="2026-09-16 02:23:15.629516429 +0000 UTC m=+600.721698403"
Sep 16 02:23:18.578680 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.578648    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75b88cdd65-wxfqx"]
Sep 16 02:23:18.580815 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.578947    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5be695a7-dfff-4da9-9c70-506a5d99f77f" containerName="extract"
Sep 16 02:23:18.580815 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.578959    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5be695a7-dfff-4da9-9c70-506a5d99f77f" containerName="extract"
Sep 16 02:23:18.580815 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.578971    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5be695a7-dfff-4da9-9c70-506a5d99f77f" containerName="pull"
Sep 16 02:23:18.580815 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.578977    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5be695a7-dfff-4da9-9c70-506a5d99f77f" containerName="pull"
Sep 16 02:23:18.580815 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.578985    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5be695a7-dfff-4da9-9c70-506a5d99f77f" containerName="util"
Sep 16 02:23:18.580815 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.578992    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5be695a7-dfff-4da9-9c70-506a5d99f77f" containerName="util"
Sep 16 02:23:18.580815 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.579040    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5be695a7-dfff-4da9-9c70-506a5d99f77f" containerName="extract"
Sep 16 02:23:18.581405 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.581390    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75b88cdd65-wxfqx"
Sep 16 02:23:18.583808 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.583787    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 16 02:23:18.584135 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.584113    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 16 02:23:18.584135 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.584121    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 16 02:23:18.584294 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.584218    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 16 02:23:18.584294 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.584222    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 16 02:23:18.584687 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.584667    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 16 02:23:18.584795 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.584671    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wrs7f\""
Sep 16 02:23:18.584866 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.584671    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 16 02:23:18.589615 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.589595    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 16 02:23:18.591907 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.591888    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75b88cdd65-wxfqx"]
Sep 16 02:23:18.683305 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.683273    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c71c03a-6d8f-45c0-b453-d0253eac9e8b-console-config\") pod \"console-75b88cdd65-wxfqx\" (UID: \"3c71c03a-6d8f-45c0-b453-d0253eac9e8b\") " pod="openshift-console/console-75b88cdd65-wxfqx"
Sep 16 02:23:18.683468 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.683311    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv4qk\" (UniqueName: \"kubernetes.io/projected/3c71c03a-6d8f-45c0-b453-d0253eac9e8b-kube-api-access-tv4qk\") pod \"console-75b88cdd65-wxfqx\" (UID: \"3c71c03a-6d8f-45c0-b453-d0253eac9e8b\") " pod="openshift-console/console-75b88cdd65-wxfqx"
Sep 16 02:23:18.683468 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.683338    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c71c03a-6d8f-45c0-b453-d0253eac9e8b-console-oauth-config\") pod \"console-75b88cdd65-wxfqx\" (UID: \"3c71c03a-6d8f-45c0-b453-d0253eac9e8b\") " pod="openshift-console/console-75b88cdd65-wxfqx"
Sep 16 02:23:18.683585 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.683461    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c71c03a-6d8f-45c0-b453-d0253eac9e8b-trusted-ca-bundle\") pod \"console-75b88cdd65-wxfqx\" (UID: \"3c71c03a-6d8f-45c0-b453-d0253eac9e8b\") " pod="openshift-console/console-75b88cdd65-wxfqx"
Sep 16 02:23:18.683585 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.683492    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c71c03a-6d8f-45c0-b453-d0253eac9e8b-oauth-serving-cert\") pod \"console-75b88cdd65-wxfqx\" (UID: \"3c71c03a-6d8f-45c0-b453-d0253eac9e8b\") " pod="openshift-console/console-75b88cdd65-wxfqx"
Sep 16 02:23:18.683585 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.683540    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c71c03a-6d8f-45c0-b453-d0253eac9e8b-console-serving-cert\") pod \"console-75b88cdd65-wxfqx\" (UID: \"3c71c03a-6d8f-45c0-b453-d0253eac9e8b\") " pod="openshift-console/console-75b88cdd65-wxfqx"
Sep 16 02:23:18.683585 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.683574    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c71c03a-6d8f-45c0-b453-d0253eac9e8b-service-ca\") pod \"console-75b88cdd65-wxfqx\" (UID: \"3c71c03a-6d8f-45c0-b453-d0253eac9e8b\") " pod="openshift-console/console-75b88cdd65-wxfqx"
Sep 16 02:23:18.784484 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.784459    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c71c03a-6d8f-45c0-b453-d0253eac9e8b-console-config\") pod \"console-75b88cdd65-wxfqx\" (UID: \"3c71c03a-6d8f-45c0-b453-d0253eac9e8b\") " pod="openshift-console/console-75b88cdd65-wxfqx"
Sep 16 02:23:18.784587 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.784489    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv4qk\" (UniqueName: \"kubernetes.io/projected/3c71c03a-6d8f-45c0-b453-d0253eac9e8b-kube-api-access-tv4qk\") pod \"console-75b88cdd65-wxfqx\" (UID: \"3c71c03a-6d8f-45c0-b453-d0253eac9e8b\") " pod="openshift-console/console-75b88cdd65-wxfqx"
Sep 16 02:23:18.784587 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.784506    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c71c03a-6d8f-45c0-b453-d0253eac9e8b-console-oauth-config\") pod \"console-75b88cdd65-wxfqx\" (UID: \"3c71c03a-6d8f-45c0-b453-d0253eac9e8b\") " pod="openshift-console/console-75b88cdd65-wxfqx"
Sep 16 02:23:18.784587 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.784526    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c71c03a-6d8f-45c0-b453-d0253eac9e8b-trusted-ca-bundle\") pod \"console-75b88cdd65-wxfqx\" (UID: \"3c71c03a-6d8f-45c0-b453-d0253eac9e8b\") " pod="openshift-console/console-75b88cdd65-wxfqx"
Sep 16 02:23:18.784726 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.784653    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c71c03a-6d8f-45c0-b453-d0253eac9e8b-oauth-serving-cert\") pod \"console-75b88cdd65-wxfqx\" (UID: \"3c71c03a-6d8f-45c0-b453-d0253eac9e8b\") " pod="openshift-console/console-75b88cdd65-wxfqx"
Sep 16 02:23:18.784726 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.784699    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c71c03a-6d8f-45c0-b453-d0253eac9e8b-console-serving-cert\") pod \"console-75b88cdd65-wxfqx\" (UID: \"3c71c03a-6d8f-45c0-b453-d0253eac9e8b\") " pod="openshift-console/console-75b88cdd65-wxfqx"
Sep 16 02:23:18.784726 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.784722    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c71c03a-6d8f-45c0-b453-d0253eac9e8b-service-ca\") pod \"console-75b88cdd65-wxfqx\" (UID: \"3c71c03a-6d8f-45c0-b453-d0253eac9e8b\") " pod="openshift-console/console-75b88cdd65-wxfqx"
Sep 16 02:23:18.785306 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.785281    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c71c03a-6d8f-45c0-b453-d0253eac9e8b-console-config\") pod \"console-75b88cdd65-wxfqx\" (UID: \"3c71c03a-6d8f-45c0-b453-d0253eac9e8b\") " pod="openshift-console/console-75b88cdd65-wxfqx"
Sep 16 02:23:18.785491 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.785337    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c71c03a-6d8f-45c0-b453-d0253eac9e8b-service-ca\") pod \"console-75b88cdd65-wxfqx\" (UID: \"3c71c03a-6d8f-45c0-b453-d0253eac9e8b\") " pod="openshift-console/console-75b88cdd65-wxfqx"
Sep 16 02:23:18.785491 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.785380    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c71c03a-6d8f-45c0-b453-d0253eac9e8b-oauth-serving-cert\") pod \"console-75b88cdd65-wxfqx\" (UID: \"3c71c03a-6d8f-45c0-b453-d0253eac9e8b\") " pod="openshift-console/console-75b88cdd65-wxfqx"
Sep 16 02:23:18.785491 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.785404    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c71c03a-6d8f-45c0-b453-d0253eac9e8b-trusted-ca-bundle\") pod \"console-75b88cdd65-wxfqx\" (UID: \"3c71c03a-6d8f-45c0-b453-d0253eac9e8b\") " pod="openshift-console/console-75b88cdd65-wxfqx"
Sep 16 02:23:18.787131 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.787111    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c71c03a-6d8f-45c0-b453-d0253eac9e8b-console-oauth-config\") pod \"console-75b88cdd65-wxfqx\" (UID: \"3c71c03a-6d8f-45c0-b453-d0253eac9e8b\") " pod="openshift-console/console-75b88cdd65-wxfqx"
Sep 16 02:23:18.787264 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.787246    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c71c03a-6d8f-45c0-b453-d0253eac9e8b-console-serving-cert\") pod \"console-75b88cdd65-wxfqx\" (UID: \"3c71c03a-6d8f-45c0-b453-d0253eac9e8b\") " pod="openshift-console/console-75b88cdd65-wxfqx"
Sep 16 02:23:18.792042 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.792019    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv4qk\" (UniqueName: \"kubernetes.io/projected/3c71c03a-6d8f-45c0-b453-d0253eac9e8b-kube-api-access-tv4qk\") pod \"console-75b88cdd65-wxfqx\" (UID: \"3c71c03a-6d8f-45c0-b453-d0253eac9e8b\") " pod="openshift-console/console-75b88cdd65-wxfqx"
Sep 16 02:23:18.890661 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:18.890587    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75b88cdd65-wxfqx"
Sep 16 02:23:19.167488 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:19.167463    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75b88cdd65-wxfqx"]
Sep 16 02:23:19.169996 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:23:19.169966    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c71c03a_6d8f_45c0_b453_d0253eac9e8b.slice/crio-daf96791bb55dc0efb00e6e2bfe2eb14c2b3f8ba5614d260169c22507257b33f WatchSource:0}: Error finding container daf96791bb55dc0efb00e6e2bfe2eb14c2b3f8ba5614d260169c22507257b33f: Status 404 returned error can't find the container with id daf96791bb55dc0efb00e6e2bfe2eb14c2b3f8ba5614d260169c22507257b33f
Sep 16 02:23:19.625920 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:19.625884    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75b88cdd65-wxfqx" event={"ID":"3c71c03a-6d8f-45c0-b453-d0253eac9e8b","Type":"ContainerStarted","Data":"8464401345f8f0e9b8b780131ee095630612469896e13334136d1866efb9cc02"}
Sep 16 02:23:19.626285 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:19.625934    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75b88cdd65-wxfqx" event={"ID":"3c71c03a-6d8f-45c0-b453-d0253eac9e8b","Type":"ContainerStarted","Data":"daf96791bb55dc0efb00e6e2bfe2eb14c2b3f8ba5614d260169c22507257b33f"}
Sep 16 02:23:19.646120 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:19.646076    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75b88cdd65-wxfqx" podStartSLOduration=1.6460627460000001 podStartE2EDuration="1.646062746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:23:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:23:19.644096004 +0000 UTC m=+604.736277967" watchObservedRunningTime="2026-09-16 02:23:19.646062746 +0000 UTC m=+604.738244747"
Sep 16 02:23:26.614916 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:26.614883    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74fbd865d6-5cmwz"
Sep 16 02:23:28.891468 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:28.891431    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75b88cdd65-wxfqx"
Sep 16 02:23:28.891874 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:28.891717    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75b88cdd65-wxfqx"
Sep 16 02:23:28.896047 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:28.896027    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75b88cdd65-wxfqx"
Sep 16 02:23:29.672796 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:29.672768    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75b88cdd65-wxfqx"
Sep 16 02:23:30.473464 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:30.473423    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7cff6fbc6c-fgn5w"]
Sep 16 02:23:30.478138 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:30.478121    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cff6fbc6c-fgn5w"
Sep 16 02:23:30.483368 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:30.483348    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 16 02:23:30.483598 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:30.483585    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-6b4pj\""
Sep 16 02:23:30.489380 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:30.489362    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 16 02:23:30.489476 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:30.489380    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 16 02:23:30.489476 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:30.489396    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 16 02:23:30.504165 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:30.504143    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cff6fbc6c-fgn5w"]
Sep 16 02:23:30.571009 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:30.570978    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6868\" (UniqueName: \"kubernetes.io/projected/f8918289-f2aa-48aa-bd86-73619fb967f5-kube-api-access-s6868\") pod \"kube-auth-proxy-7cff6fbc6c-fgn5w\" (UID: \"f8918289-f2aa-48aa-bd86-73619fb967f5\") " pod="openshift-ingress/kube-auth-proxy-7cff6fbc6c-fgn5w"
Sep 16 02:23:30.571146 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:30.571047    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8918289-f2aa-48aa-bd86-73619fb967f5-tmp\") pod \"kube-auth-proxy-7cff6fbc6c-fgn5w\" (UID: \"f8918289-f2aa-48aa-bd86-73619fb967f5\") " pod="openshift-ingress/kube-auth-proxy-7cff6fbc6c-fgn5w"
Sep 16 02:23:30.571146 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:30.571099    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8918289-f2aa-48aa-bd86-73619fb967f5-tls-certs\") pod \"kube-auth-proxy-7cff6fbc6c-fgn5w\" (UID: \"f8918289-f2aa-48aa-bd86-73619fb967f5\") " pod="openshift-ingress/kube-auth-proxy-7cff6fbc6c-fgn5w"
Sep 16 02:23:30.671557 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:30.671524    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6868\" (UniqueName: \"kubernetes.io/projected/f8918289-f2aa-48aa-bd86-73619fb967f5-kube-api-access-s6868\") pod \"kube-auth-proxy-7cff6fbc6c-fgn5w\" (UID: \"f8918289-f2aa-48aa-bd86-73619fb967f5\") " pod="openshift-ingress/kube-auth-proxy-7cff6fbc6c-fgn5w"
Sep 16 02:23:30.671691 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:30.671594    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8918289-f2aa-48aa-bd86-73619fb967f5-tmp\") pod \"kube-auth-proxy-7cff6fbc6c-fgn5w\" (UID: \"f8918289-f2aa-48aa-bd86-73619fb967f5\") " pod="openshift-ingress/kube-auth-proxy-7cff6fbc6c-fgn5w"
Sep 16 02:23:30.671691 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:30.671634    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8918289-f2aa-48aa-bd86-73619fb967f5-tls-certs\") pod \"kube-auth-proxy-7cff6fbc6c-fgn5w\" (UID: \"f8918289-f2aa-48aa-bd86-73619fb967f5\") " pod="openshift-ingress/kube-auth-proxy-7cff6fbc6c-fgn5w"
Sep 16 02:23:30.674183 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:30.674156    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8918289-f2aa-48aa-bd86-73619fb967f5-tmp\") pod \"kube-auth-proxy-7cff6fbc6c-fgn5w\" (UID: \"f8918289-f2aa-48aa-bd86-73619fb967f5\") " pod="openshift-ingress/kube-auth-proxy-7cff6fbc6c-fgn5w"
Sep 16 02:23:30.674297 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:30.674277    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8918289-f2aa-48aa-bd86-73619fb967f5-tls-certs\") pod \"kube-auth-proxy-7cff6fbc6c-fgn5w\" (UID: \"f8918289-f2aa-48aa-bd86-73619fb967f5\") " pod="openshift-ingress/kube-auth-proxy-7cff6fbc6c-fgn5w"
Sep 16 02:23:30.726134 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:30.726078    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6868\" (UniqueName: \"kubernetes.io/projected/f8918289-f2aa-48aa-bd86-73619fb967f5-kube-api-access-s6868\") pod \"kube-auth-proxy-7cff6fbc6c-fgn5w\" (UID: \"f8918289-f2aa-48aa-bd86-73619fb967f5\") " pod="openshift-ingress/kube-auth-proxy-7cff6fbc6c-fgn5w"
Sep 16 02:23:30.788450 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:30.788423    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cff6fbc6c-fgn5w"
Sep 16 02:23:31.103865 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:31.103815    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cff6fbc6c-fgn5w"]
Sep 16 02:23:31.111286 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:23:31.111264    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8918289_f2aa_48aa_bd86_73619fb967f5.slice/crio-497630484d98a4932629fa7e0dd565b76eb659c6edfbc933189e3be386a28ba7 WatchSource:0}: Error finding container 497630484d98a4932629fa7e0dd565b76eb659c6edfbc933189e3be386a28ba7: Status 404 returned error can't find the container with id 497630484d98a4932629fa7e0dd565b76eb659c6edfbc933189e3be386a28ba7
Sep 16 02:23:31.113148 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:31.113132    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 02:23:31.681991 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:31.681958    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cff6fbc6c-fgn5w" event={"ID":"f8918289-f2aa-48aa-bd86-73619fb967f5","Type":"ContainerStarted","Data":"497630484d98a4932629fa7e0dd565b76eb659c6edfbc933189e3be386a28ba7"}
Sep 16 02:23:33.396933 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:33.396902    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"]
Sep 16 02:23:33.402356 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:33.402322    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"
Sep 16 02:23:33.407416 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:33.407392    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 16 02:23:33.407580 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:33.407457    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-mrtw8\""
Sep 16 02:23:33.407907 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:33.407888    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 16 02:23:33.408014 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:33.407932    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 16 02:23:33.408014 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:33.407886    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 16 02:23:33.434394 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:33.434370    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"]
Sep 16 02:23:33.494151 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:33.494116    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aa7daca9-c76b-4904-a60a-1f3388c93b69-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-ff47n\" (UID: \"aa7daca9-c76b-4904-a60a-1f3388c93b69\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"
Sep 16 02:23:33.494319 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:33.494166    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aa7daca9-c76b-4904-a60a-1f3388c93b69-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-ff47n\" (UID: \"aa7daca9-c76b-4904-a60a-1f3388c93b69\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"
Sep 16 02:23:33.494319 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:33.494261    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fqbq\" (UniqueName: \"kubernetes.io/projected/aa7daca9-c76b-4904-a60a-1f3388c93b69-kube-api-access-8fqbq\") pod \"istiod-openshift-gateway-7b7995d5cd-ff47n\" (UID: \"aa7daca9-c76b-4904-a60a-1f3388c93b69\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"
Sep 16 02:23:33.494436 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:33.494315    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa7daca9-c76b-4904-a60a-1f3388c93b69-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-ff47n\" (UID: \"aa7daca9-c76b-4904-a60a-1f3388c93b69\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"
Sep 16 02:23:33.494436 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:33.494349    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa7daca9-c76b-4904-a60a-1f3388c93b69-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-ff47n\" (UID: \"aa7daca9-c76b-4904-a60a-1f3388c93b69\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"
Sep 16 02:23:33.494436 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:33.494377    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aa7daca9-c76b-4904-a60a-1f3388c93b69-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-ff47n\" (UID: \"aa7daca9-c76b-4904-a60a-1f3388c93b69\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"
Sep 16 02:23:33.494436 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:33.494405    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aa7daca9-c76b-4904-a60a-1f3388c93b69-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-ff47n\" (UID: \"aa7daca9-c76b-4904-a60a-1f3388c93b69\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"
Sep 16 02:23:33.595593 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:33.595561    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aa7daca9-c76b-4904-a60a-1f3388c93b69-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-ff47n\" (UID: \"aa7daca9-c76b-4904-a60a-1f3388c93b69\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"
Sep 16 02:23:33.595593 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:33.595595    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aa7daca9-c76b-4904-a60a-1f3388c93b69-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-ff47n\" (UID: \"aa7daca9-c76b-4904-a60a-1f3388c93b69\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"
Sep 16 02:23:33.595820 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:33.595628    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fqbq\" (UniqueName: \"kubernetes.io/projected/aa7daca9-c76b-4904-a60a-1f3388c93b69-kube-api-access-8fqbq\") pod \"istiod-openshift-gateway-7b7995d5cd-ff47n\" (UID: \"aa7daca9-c76b-4904-a60a-1f3388c93b69\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"
Sep 16 02:23:33.595820 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:33.595670    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa7daca9-c76b-4904-a60a-1f3388c93b69-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-ff47n\" (UID: \"aa7daca9-c76b-4904-a60a-1f3388c93b69\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"
Sep 16 02:23:33.595820 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:33.595703    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa7daca9-c76b-4904-a60a-1f3388c93b69-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-ff47n\" (UID: \"aa7daca9-c76b-4904-a60a-1f3388c93b69\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"
Sep 16 02:23:33.595820 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:33.595732    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aa7daca9-c76b-4904-a60a-1f3388c93b69-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-ff47n\" (UID: \"aa7daca9-c76b-4904-a60a-1f3388c93b69\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"
Sep 16 02:23:33.595820 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:33.595772    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aa7daca9-c76b-4904-a60a-1f3388c93b69-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-ff47n\" (UID: \"aa7daca9-c76b-4904-a60a-1f3388c93b69\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"
Sep 16 02:23:33.596598 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:33.596551    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aa7daca9-c76b-4904-a60a-1f3388c93b69-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-ff47n\" (UID: \"aa7daca9-c76b-4904-a60a-1f3388c93b69\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"
Sep 16 02:23:33.598611 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:33.598584    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aa7daca9-c76b-4904-a60a-1f3388c93b69-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-ff47n\" (UID: \"aa7daca9-c76b-4904-a60a-1f3388c93b69\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"
Sep 16 02:23:33.598831 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:33.598794    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa7daca9-c76b-4904-a60a-1f3388c93b69-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-ff47n\" (UID: \"aa7daca9-c76b-4904-a60a-1f3388c93b69\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"
Sep 16 02:23:33.599034 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:33.599012    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aa7daca9-c76b-4904-a60a-1f3388c93b69-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-ff47n\" (UID: \"aa7daca9-c76b-4904-a60a-1f3388c93b69\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"
Sep 16 02:23:33.599099 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:33.599019    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aa7daca9-c76b-4904-a60a-1f3388c93b69-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-ff47n\" (UID: \"aa7daca9-c76b-4904-a60a-1f3388c93b69\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"
Sep 16 02:23:33.616931 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:33.616899    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa7daca9-c76b-4904-a60a-1f3388c93b69-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-ff47n\" (UID: \"aa7daca9-c76b-4904-a60a-1f3388c93b69\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"
Sep 16 02:23:33.617136 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:33.617109    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fqbq\" (UniqueName: \"kubernetes.io/projected/aa7daca9-c76b-4904-a60a-1f3388c93b69-kube-api-access-8fqbq\") pod \"istiod-openshift-gateway-7b7995d5cd-ff47n\" (UID: \"aa7daca9-c76b-4904-a60a-1f3388c93b69\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"
Sep 16 02:23:33.713659 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:33.713582    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"
Sep 16 02:23:34.016917 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:34.016893    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"]
Sep 16 02:23:34.019298 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:23:34.019259    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa7daca9_c76b_4904_a60a_1f3388c93b69.slice/crio-97735e68106f91f7de3d494c9c7acea5b19538eb175053cf50913642ff5eaad2 WatchSource:0}: Error finding container 97735e68106f91f7de3d494c9c7acea5b19538eb175053cf50913642ff5eaad2: Status 404 returned error can't find the container with id 97735e68106f91f7de3d494c9c7acea5b19538eb175053cf50913642ff5eaad2
Sep 16 02:23:34.701527 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:34.701308    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cff6fbc6c-fgn5w" event={"ID":"f8918289-f2aa-48aa-bd86-73619fb967f5","Type":"ContainerStarted","Data":"4297db20234d6eae4bdd09cfdf6fa67db9c5001de9326514f4d45e46dd16037d"}
Sep 16 02:23:34.702870 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:34.702816    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n" event={"ID":"aa7daca9-c76b-4904-a60a-1f3388c93b69","Type":"ContainerStarted","Data":"97735e68106f91f7de3d494c9c7acea5b19538eb175053cf50913642ff5eaad2"}
Sep 16 02:23:34.739074 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:34.739023    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7cff6fbc6c-fgn5w" podStartSLOduration=2.1155428 podStartE2EDuration="4.739007525s" totalImagesPullingTime="2.623464725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:23:34.736627179 +0000 UTC m=+619.828809151" watchObservedRunningTime="2026-09-16 02:23:34.739007525 +0000 UTC m=+619.831189496"
Sep 16 02:23:36.261320 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:36.261286    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 02:23:36.261567 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:36.261352    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 02:23:36.714875 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:36.714779    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n" event={"ID":"aa7daca9-c76b-4904-a60a-1f3388c93b69","Type":"ContainerStarted","Data":"1675f06b4784e219be764b42b6cb3a46a4545d19bbccc4e46ce8fb4a7c6c8b48"}
Sep 16 02:23:36.715039 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:36.714875    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"
Sep 16 02:23:36.745545 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:36.745500    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n" podStartSLOduration=1.505788315 podStartE2EDuration="3.745487312s" totalImagesPullingTime="2.239698997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:23:36.745102501 +0000 UTC m=+621.837284473" watchObservedRunningTime="2026-09-16 02:23:36.745487312 +0000 UTC m=+621.837669284"
Sep 16 02:23:37.721338 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:37.721305    2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-ff47n container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 02:23:37.721731 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:37.721363    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n" podUID="aa7daca9-c76b-4904-a60a-1f3388c93b69" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 02:23:40.720715 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:40.720685    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"
Sep 16 02:23:41.114947 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:41.114916    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qdjzj"]
Sep 16 02:23:41.119350 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:41.119334    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qdjzj"
Sep 16 02:23:41.122337 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:41.122305    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 16 02:23:41.135198 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:41.135175    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qdjzj"]
Sep 16 02:23:41.157709 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:41.157678    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9htn\" (UniqueName: \"kubernetes.io/projected/3403d7df-c4b4-47db-b0eb-061b59d6f889-kube-api-access-q9htn\") pod \"model-serving-api-54d89bd5fc-qdjzj\" (UID: \"3403d7df-c4b4-47db-b0eb-061b59d6f889\") " pod="opendatahub/model-serving-api-54d89bd5fc-qdjzj"
Sep 16 02:23:41.157901 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:41.157733    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3403d7df-c4b4-47db-b0eb-061b59d6f889-tls-certs\") pod \"model-serving-api-54d89bd5fc-qdjzj\" (UID: \"3403d7df-c4b4-47db-b0eb-061b59d6f889\") " pod="opendatahub/model-serving-api-54d89bd5fc-qdjzj"
Sep 16 02:23:41.258330 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:41.258293    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9htn\" (UniqueName: \"kubernetes.io/projected/3403d7df-c4b4-47db-b0eb-061b59d6f889-kube-api-access-q9htn\") pod \"model-serving-api-54d89bd5fc-qdjzj\" (UID: \"3403d7df-c4b4-47db-b0eb-061b59d6f889\") " pod="opendatahub/model-serving-api-54d89bd5fc-qdjzj"
Sep 16 02:23:41.258488 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:41.258347    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3403d7df-c4b4-47db-b0eb-061b59d6f889-tls-certs\") pod \"model-serving-api-54d89bd5fc-qdjzj\" (UID: \"3403d7df-c4b4-47db-b0eb-061b59d6f889\") " pod="opendatahub/model-serving-api-54d89bd5fc-qdjzj"
Sep 16 02:23:41.258570 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:23:41.258488    2581 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 16 02:23:41.258570 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:23:41.258556    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3403d7df-c4b4-47db-b0eb-061b59d6f889-tls-certs podName:3403d7df-c4b4-47db-b0eb-061b59d6f889 nodeName:}" failed. No retries permitted until 2026-09-16 02:23:41.758534633 +0000 UTC m=+626.850716589 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/3403d7df-c4b4-47db-b0eb-061b59d6f889-tls-certs") pod "model-serving-api-54d89bd5fc-qdjzj" (UID: "3403d7df-c4b4-47db-b0eb-061b59d6f889") : secret "model-serving-api-tls" not found
Sep 16 02:23:41.268234 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:41.268202    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9htn\" (UniqueName: \"kubernetes.io/projected/3403d7df-c4b4-47db-b0eb-061b59d6f889-kube-api-access-q9htn\") pod \"model-serving-api-54d89bd5fc-qdjzj\" (UID: \"3403d7df-c4b4-47db-b0eb-061b59d6f889\") " pod="opendatahub/model-serving-api-54d89bd5fc-qdjzj"
Sep 16 02:23:41.764181 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:41.764148    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3403d7df-c4b4-47db-b0eb-061b59d6f889-tls-certs\") pod \"model-serving-api-54d89bd5fc-qdjzj\" (UID: \"3403d7df-c4b4-47db-b0eb-061b59d6f889\") " pod="opendatahub/model-serving-api-54d89bd5fc-qdjzj"
Sep 16 02:23:41.766885 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:41.766862    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3403d7df-c4b4-47db-b0eb-061b59d6f889-tls-certs\") pod \"model-serving-api-54d89bd5fc-qdjzj\" (UID: \"3403d7df-c4b4-47db-b0eb-061b59d6f889\") " pod="opendatahub/model-serving-api-54d89bd5fc-qdjzj"
Sep 16 02:23:42.030585 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:42.030553    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qdjzj"
Sep 16 02:23:42.310253 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:42.310147    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qdjzj"]
Sep 16 02:23:42.313034 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:23:42.313012    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3403d7df_c4b4_47db_b0eb_061b59d6f889.slice/crio-2bea662025f0fc481f60ca408d72654a3890d5c9fdbecd15cc2c1af46f44ae3d WatchSource:0}: Error finding container 2bea662025f0fc481f60ca408d72654a3890d5c9fdbecd15cc2c1af46f44ae3d: Status 404 returned error can't find the container with id 2bea662025f0fc481f60ca408d72654a3890d5c9fdbecd15cc2c1af46f44ae3d
Sep 16 02:23:42.745658 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:42.745566    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qdjzj" event={"ID":"3403d7df-c4b4-47db-b0eb-061b59d6f889","Type":"ContainerStarted","Data":"2bea662025f0fc481f60ca408d72654a3890d5c9fdbecd15cc2c1af46f44ae3d"}
Sep 16 02:23:43.751488 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:43.751446    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qdjzj" event={"ID":"3403d7df-c4b4-47db-b0eb-061b59d6f889","Type":"ContainerStarted","Data":"9ae30ff39012f16cfd2cf72ff18a4689f98ad3ea4720e9c0eb59e2afbee51959"}
Sep 16 02:23:43.751924 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:43.751556    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-qdjzj"
Sep 16 02:23:43.767594 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:43.767536    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-qdjzj" podStartSLOduration=1.488001869 podStartE2EDuration="2.767522003s" totalImagesPullingTime="1.279520134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:23:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:23:43.766014139 +0000 UTC m=+628.858196110" watchObservedRunningTime="2026-09-16 02:23:43.767522003 +0000 UTC m=+628.859704024"
Sep 16 02:23:50.400530 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:50.400496    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-spc9b"]
Sep 16 02:23:50.410509 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:50.410479    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-spc9b"
Sep 16 02:23:50.415173 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:50.414789    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 16 02:23:50.416835 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:50.416814    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8vzkc"]
Sep 16 02:23:50.418013 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:50.417992    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-qjphr\""
Sep 16 02:23:50.421197 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:50.420550    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-spc9b"]
Sep 16 02:23:50.421197 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:50.420650    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8vzkc"
Sep 16 02:23:50.423531 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:50.423513    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 16 02:23:50.424214 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:50.424196    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-w2srz\""
Sep 16 02:23:50.432164 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:50.432145    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8vzkc"]
Sep 16 02:23:50.537832 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:50.537787    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5st6\" (UniqueName: \"kubernetes.io/projected/51419f06-9d15-42fd-872a-7b5d99cc20df-kube-api-access-w5st6\") pod \"llmisvc-controller-manager-777c6bd7d5-8vzkc\" (UID: \"51419f06-9d15-42fd-872a-7b5d99cc20df\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8vzkc"
Sep 16 02:23:50.538026 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:50.537882    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v8zz\" (UniqueName: \"kubernetes.io/projected/1c66e3c9-15a5-4d10-b1ca-71d96ed1f2bb-kube-api-access-9v8zz\") pod \"kserve-controller-manager-d6f4b65b8-spc9b\" (UID: \"1c66e3c9-15a5-4d10-b1ca-71d96ed1f2bb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-spc9b"
Sep 16 02:23:50.538026 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:50.537999    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51419f06-9d15-42fd-872a-7b5d99cc20df-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8vzkc\" (UID: \"51419f06-9d15-42fd-872a-7b5d99cc20df\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8vzkc"
Sep 16 02:23:50.538146 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:50.538052    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c66e3c9-15a5-4d10-b1ca-71d96ed1f2bb-cert\") pod \"kserve-controller-manager-d6f4b65b8-spc9b\" (UID: \"1c66e3c9-15a5-4d10-b1ca-71d96ed1f2bb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-spc9b"
Sep 16 02:23:50.639443 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:50.639407    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5st6\" (UniqueName: \"kubernetes.io/projected/51419f06-9d15-42fd-872a-7b5d99cc20df-kube-api-access-w5st6\") pod \"llmisvc-controller-manager-777c6bd7d5-8vzkc\" (UID: \"51419f06-9d15-42fd-872a-7b5d99cc20df\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8vzkc"
Sep 16 02:23:50.639590 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:50.639455    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v8zz\" (UniqueName: \"kubernetes.io/projected/1c66e3c9-15a5-4d10-b1ca-71d96ed1f2bb-kube-api-access-9v8zz\") pod \"kserve-controller-manager-d6f4b65b8-spc9b\" (UID: \"1c66e3c9-15a5-4d10-b1ca-71d96ed1f2bb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-spc9b"
Sep 16 02:23:50.639590 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:50.639508    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51419f06-9d15-42fd-872a-7b5d99cc20df-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8vzkc\" (UID: \"51419f06-9d15-42fd-872a-7b5d99cc20df\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8vzkc"
Sep 16 02:23:50.639590 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:50.639550    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c66e3c9-15a5-4d10-b1ca-71d96ed1f2bb-cert\") pod \"kserve-controller-manager-d6f4b65b8-spc9b\" (UID: \"1c66e3c9-15a5-4d10-b1ca-71d96ed1f2bb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-spc9b"
Sep 16 02:23:50.639717 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:23:50.639652    2581 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 16 02:23:50.639770 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:23:50.639726    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c66e3c9-15a5-4d10-b1ca-71d96ed1f2bb-cert podName:1c66e3c9-15a5-4d10-b1ca-71d96ed1f2bb nodeName:}" failed. No retries permitted until 2026-09-16 02:23:51.13970759 +0000 UTC m=+636.231889545 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1c66e3c9-15a5-4d10-b1ca-71d96ed1f2bb-cert") pod "kserve-controller-manager-d6f4b65b8-spc9b" (UID: "1c66e3c9-15a5-4d10-b1ca-71d96ed1f2bb") : secret "kserve-webhook-server-cert" not found
Sep 16 02:23:50.642122 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:50.642098    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51419f06-9d15-42fd-872a-7b5d99cc20df-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8vzkc\" (UID: \"51419f06-9d15-42fd-872a-7b5d99cc20df\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8vzkc"
Sep 16 02:23:50.657043 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:50.656983    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v8zz\" (UniqueName: \"kubernetes.io/projected/1c66e3c9-15a5-4d10-b1ca-71d96ed1f2bb-kube-api-access-9v8zz\") pod \"kserve-controller-manager-d6f4b65b8-spc9b\" (UID: \"1c66e3c9-15a5-4d10-b1ca-71d96ed1f2bb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-spc9b"
Sep 16 02:23:50.658188 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:50.658161    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5st6\" (UniqueName: \"kubernetes.io/projected/51419f06-9d15-42fd-872a-7b5d99cc20df-kube-api-access-w5st6\") pod \"llmisvc-controller-manager-777c6bd7d5-8vzkc\" (UID: \"51419f06-9d15-42fd-872a-7b5d99cc20df\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8vzkc"
Sep 16 02:23:50.739222 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:50.739176    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8vzkc"
Sep 16 02:23:51.010745 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:51.010676    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8vzkc"]
Sep 16 02:23:51.016779 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:23:51.016755    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod51419f06_9d15_42fd_872a_7b5d99cc20df.slice/crio-532016d095c5285966dd5b9d010fea8a87f9a00cc7b444857e3b1e2c53c31102 WatchSource:0}: Error finding container 532016d095c5285966dd5b9d010fea8a87f9a00cc7b444857e3b1e2c53c31102: Status 404 returned error can't find the container with id 532016d095c5285966dd5b9d010fea8a87f9a00cc7b444857e3b1e2c53c31102
Sep 16 02:23:51.143620 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:51.143586    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c66e3c9-15a5-4d10-b1ca-71d96ed1f2bb-cert\") pod \"kserve-controller-manager-d6f4b65b8-spc9b\" (UID: \"1c66e3c9-15a5-4d10-b1ca-71d96ed1f2bb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-spc9b"
Sep 16 02:23:51.146021 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:51.146002    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c66e3c9-15a5-4d10-b1ca-71d96ed1f2bb-cert\") pod \"kserve-controller-manager-d6f4b65b8-spc9b\" (UID: \"1c66e3c9-15a5-4d10-b1ca-71d96ed1f2bb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-spc9b"
Sep 16 02:23:51.329907 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:51.329870    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-spc9b"
Sep 16 02:23:51.607324 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:51.607248    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-spc9b"]
Sep 16 02:23:51.634548 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:23:51.634511    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c66e3c9_15a5_4d10_b1ca_71d96ed1f2bb.slice/crio-5c4854fc89570dc18757b7beaed1e5d613729a6794018c07c0ecaa4585da43f3 WatchSource:0}: Error finding container 5c4854fc89570dc18757b7beaed1e5d613729a6794018c07c0ecaa4585da43f3: Status 404 returned error can't find the container with id 5c4854fc89570dc18757b7beaed1e5d613729a6794018c07c0ecaa4585da43f3
Sep 16 02:23:51.792940 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:51.792907    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8vzkc" event={"ID":"51419f06-9d15-42fd-872a-7b5d99cc20df","Type":"ContainerStarted","Data":"532016d095c5285966dd5b9d010fea8a87f9a00cc7b444857e3b1e2c53c31102"}
Sep 16 02:23:51.794190 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:51.794162    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-spc9b" event={"ID":"1c66e3c9-15a5-4d10-b1ca-71d96ed1f2bb","Type":"ContainerStarted","Data":"5c4854fc89570dc18757b7beaed1e5d613729a6794018c07c0ecaa4585da43f3"}
Sep 16 02:23:52.132627 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:52.132591    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"]
Sep 16 02:23:52.132832 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:52.132795    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n" podUID="aa7daca9-c76b-4904-a60a-1f3388c93b69" containerName="discovery" containerID="cri-o://1675f06b4784e219be764b42b6cb3a46a4545d19bbccc4e46ce8fb4a7c6c8b48" gracePeriod=30
Sep 16 02:23:52.474944 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:52.474914    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"
Sep 16 02:23:52.557703 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:52.557634    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa7daca9-c76b-4904-a60a-1f3388c93b69-istio-token\") pod \"aa7daca9-c76b-4904-a60a-1f3388c93b69\" (UID: \"aa7daca9-c76b-4904-a60a-1f3388c93b69\") "
Sep 16 02:23:52.557703 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:52.557713    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aa7daca9-c76b-4904-a60a-1f3388c93b69-istio-csr-dns-cert\") pod \"aa7daca9-c76b-4904-a60a-1f3388c93b69\" (UID: \"aa7daca9-c76b-4904-a60a-1f3388c93b69\") "
Sep 16 02:23:52.558024 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:52.557747    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aa7daca9-c76b-4904-a60a-1f3388c93b69-cacerts\") pod \"aa7daca9-c76b-4904-a60a-1f3388c93b69\" (UID: \"aa7daca9-c76b-4904-a60a-1f3388c93b69\") "
Sep 16 02:23:52.558024 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:52.557797    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa7daca9-c76b-4904-a60a-1f3388c93b69-local-certs\") pod \"aa7daca9-c76b-4904-a60a-1f3388c93b69\" (UID: \"aa7daca9-c76b-4904-a60a-1f3388c93b69\") "
Sep 16 02:23:52.558024 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:52.557836    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fqbq\" (UniqueName: \"kubernetes.io/projected/aa7daca9-c76b-4904-a60a-1f3388c93b69-kube-api-access-8fqbq\") pod \"aa7daca9-c76b-4904-a60a-1f3388c93b69\" (UID: \"aa7daca9-c76b-4904-a60a-1f3388c93b69\") "
Sep 16 02:23:52.558024 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:52.557901    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aa7daca9-c76b-4904-a60a-1f3388c93b69-istio-csr-ca-configmap\") pod \"aa7daca9-c76b-4904-a60a-1f3388c93b69\" (UID: \"aa7daca9-c76b-4904-a60a-1f3388c93b69\") "
Sep 16 02:23:52.558024 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:52.557936    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aa7daca9-c76b-4904-a60a-1f3388c93b69-istio-kubeconfig\") pod \"aa7daca9-c76b-4904-a60a-1f3388c93b69\" (UID: \"aa7daca9-c76b-4904-a60a-1f3388c93b69\") "
Sep 16 02:23:52.559125 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:52.559073    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa7daca9-c76b-4904-a60a-1f3388c93b69-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "aa7daca9-c76b-4904-a60a-1f3388c93b69" (UID: "aa7daca9-c76b-4904-a60a-1f3388c93b69"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:23:52.564615 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:52.564586    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa7daca9-c76b-4904-a60a-1f3388c93b69-istio-token" (OuterVolumeSpecName: "istio-token") pod "aa7daca9-c76b-4904-a60a-1f3388c93b69" (UID: "aa7daca9-c76b-4904-a60a-1f3388c93b69"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:23:52.565023 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:52.564994    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa7daca9-c76b-4904-a60a-1f3388c93b69-local-certs" (OuterVolumeSpecName: "local-certs") pod "aa7daca9-c76b-4904-a60a-1f3388c93b69" (UID: "aa7daca9-c76b-4904-a60a-1f3388c93b69"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:23:52.565110 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:52.565075    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa7daca9-c76b-4904-a60a-1f3388c93b69-kube-api-access-8fqbq" (OuterVolumeSpecName: "kube-api-access-8fqbq") pod "aa7daca9-c76b-4904-a60a-1f3388c93b69" (UID: "aa7daca9-c76b-4904-a60a-1f3388c93b69"). InnerVolumeSpecName "kube-api-access-8fqbq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:23:52.565164 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:52.565121    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa7daca9-c76b-4904-a60a-1f3388c93b69-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "aa7daca9-c76b-4904-a60a-1f3388c93b69" (UID: "aa7daca9-c76b-4904-a60a-1f3388c93b69"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:23:52.565208 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:52.565164    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa7daca9-c76b-4904-a60a-1f3388c93b69-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "aa7daca9-c76b-4904-a60a-1f3388c93b69" (UID: "aa7daca9-c76b-4904-a60a-1f3388c93b69"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:23:52.568476 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:52.568384    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa7daca9-c76b-4904-a60a-1f3388c93b69-cacerts" (OuterVolumeSpecName: "cacerts") pod "aa7daca9-c76b-4904-a60a-1f3388c93b69" (UID: "aa7daca9-c76b-4904-a60a-1f3388c93b69"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:23:52.658741 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:52.658687    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fqbq\" (UniqueName: \"kubernetes.io/projected/aa7daca9-c76b-4904-a60a-1f3388c93b69-kube-api-access-8fqbq\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:23:52.658741 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:52.658725    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aa7daca9-c76b-4904-a60a-1f3388c93b69-istio-csr-ca-configmap\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:23:52.658741 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:52.658740    2581 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aa7daca9-c76b-4904-a60a-1f3388c93b69-istio-kubeconfig\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:23:52.659242 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:52.658755    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa7daca9-c76b-4904-a60a-1f3388c93b69-istio-token\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:23:52.659242 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:52.658770    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aa7daca9-c76b-4904-a60a-1f3388c93b69-istio-csr-dns-cert\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:23:52.659242 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:52.658784    2581 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aa7daca9-c76b-4904-a60a-1f3388c93b69-cacerts\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:23:52.659242 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:52.658797    2581 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa7daca9-c76b-4904-a60a-1f3388c93b69-local-certs\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:23:52.800856 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:52.800822    2581 generic.go:356] "Generic (PLEG): container finished" podID="aa7daca9-c76b-4904-a60a-1f3388c93b69" containerID="1675f06b4784e219be764b42b6cb3a46a4545d19bbccc4e46ce8fb4a7c6c8b48" exitCode=0
Sep 16 02:23:52.801028 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:52.800890    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"
Sep 16 02:23:52.801028 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:52.800920    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n" event={"ID":"aa7daca9-c76b-4904-a60a-1f3388c93b69","Type":"ContainerDied","Data":"1675f06b4784e219be764b42b6cb3a46a4545d19bbccc4e46ce8fb4a7c6c8b48"}
Sep 16 02:23:52.801028 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:52.800977    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n" event={"ID":"aa7daca9-c76b-4904-a60a-1f3388c93b69","Type":"ContainerDied","Data":"97735e68106f91f7de3d494c9c7acea5b19538eb175053cf50913642ff5eaad2"}
Sep 16 02:23:52.801028 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:52.801003    2581 scope.go:117] "RemoveContainer" containerID="1675f06b4784e219be764b42b6cb3a46a4545d19bbccc4e46ce8fb4a7c6c8b48"
Sep 16 02:23:52.837129 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:52.837101    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"]
Sep 16 02:23:52.853912 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:52.853835    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ff47n"]
Sep 16 02:23:53.270004 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:53.269878    2581 scope.go:117] "RemoveContainer" containerID="1675f06b4784e219be764b42b6cb3a46a4545d19bbccc4e46ce8fb4a7c6c8b48"
Sep 16 02:23:53.270251 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:23:53.270230    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1675f06b4784e219be764b42b6cb3a46a4545d19bbccc4e46ce8fb4a7c6c8b48\": container with ID starting with 1675f06b4784e219be764b42b6cb3a46a4545d19bbccc4e46ce8fb4a7c6c8b48 not found: ID does not exist" containerID="1675f06b4784e219be764b42b6cb3a46a4545d19bbccc4e46ce8fb4a7c6c8b48"
Sep 16 02:23:53.270292 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:53.270260    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1675f06b4784e219be764b42b6cb3a46a4545d19bbccc4e46ce8fb4a7c6c8b48"} err="failed to get container status \"1675f06b4784e219be764b42b6cb3a46a4545d19bbccc4e46ce8fb4a7c6c8b48\": rpc error: code = NotFound desc = could not find container \"1675f06b4784e219be764b42b6cb3a46a4545d19bbccc4e46ce8fb4a7c6c8b48\": container with ID starting with 1675f06b4784e219be764b42b6cb3a46a4545d19bbccc4e46ce8fb4a7c6c8b48 not found: ID does not exist"
Sep 16 02:23:53.383330 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:53.383297    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa7daca9-c76b-4904-a60a-1f3388c93b69" path="/var/lib/kubelet/pods/aa7daca9-c76b-4904-a60a-1f3388c93b69/volumes"
Sep 16 02:23:54.760571 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:54.760535    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-qdjzj"
Sep 16 02:23:54.812600 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:54.812568    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8vzkc" event={"ID":"51419f06-9d15-42fd-872a-7b5d99cc20df","Type":"ContainerStarted","Data":"8c8aac854375393b8511d64e9f389463677bc08d3f9c54e98261dfab9c26ee69"}
Sep 16 02:23:54.812774 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:54.812630    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8vzkc"
Sep 16 02:23:54.814633 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:54.814603    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-spc9b" event={"ID":"1c66e3c9-15a5-4d10-b1ca-71d96ed1f2bb","Type":"ContainerStarted","Data":"7678ae4b7c47a9b35816fa5f853947add1c71268557de6ca6089c1b393f98f5d"}
Sep 16 02:23:54.814742 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:54.814697    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-spc9b"
Sep 16 02:23:54.841394 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:54.841349    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8vzkc" podStartSLOduration=2.000298003 podStartE2EDuration="4.841333483s" totalImagesPullingTime="2.84103548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:23:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:23:54.840480048 +0000 UTC m=+639.932662020" watchObservedRunningTime="2026-09-16 02:23:54.841333483 +0000 UTC m=+639.933515449"
Sep 16 02:23:54.857631 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:23:54.857587    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-spc9b" podStartSLOduration=2.627995463 podStartE2EDuration="4.857573224s" totalImagesPullingTime="2.229577761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:23:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:23:54.856126751 +0000 UTC m=+639.948308726" watchObservedRunningTime="2026-09-16 02:23:54.857573224 +0000 UTC m=+639.949755196"
Sep 16 02:24:25.820967 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:25.820930    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8vzkc"
Sep 16 02:24:25.823962 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:25.823943    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-spc9b"
Sep 16 02:24:45.499870 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.499819    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctfpq6"]
Sep 16 02:24:45.500318 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.500288    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa7daca9-c76b-4904-a60a-1f3388c93b69" containerName="discovery"
Sep 16 02:24:45.500318 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.500305    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa7daca9-c76b-4904-a60a-1f3388c93b69" containerName="discovery"
Sep 16 02:24:45.500444 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.500411    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa7daca9-c76b-4904-a60a-1f3388c93b69" containerName="discovery"
Sep 16 02:24:45.503308 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.503288    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctfpq6"
Sep 16 02:24:45.505738 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.505714    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 02:24:45.506463 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.506448    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7d226\""
Sep 16 02:24:45.506541 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.506448    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 02:24:45.511812 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.511784    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctfpq6"]
Sep 16 02:24:45.562005 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.561980    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e02c65a0-ce8b-42ee-86c8-212b28ae0684-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctfpq6\" (UID: \"e02c65a0-ce8b-42ee-86c8-212b28ae0684\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctfpq6"
Sep 16 02:24:45.562005 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.562005    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e02c65a0-ce8b-42ee-86c8-212b28ae0684-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctfpq6\" (UID: \"e02c65a0-ce8b-42ee-86c8-212b28ae0684\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctfpq6"
Sep 16 02:24:45.562146 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.562025    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g968z\" (UniqueName: \"kubernetes.io/projected/e02c65a0-ce8b-42ee-86c8-212b28ae0684-kube-api-access-g968z\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctfpq6\" (UID: \"e02c65a0-ce8b-42ee-86c8-212b28ae0684\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctfpq6"
Sep 16 02:24:45.602777 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.602747    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bm57g"]
Sep 16 02:24:45.606109 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.606092    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bm57g"
Sep 16 02:24:45.614875 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.614838    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bm57g"]
Sep 16 02:24:45.662721 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.662696    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-272vs\" (UniqueName: \"kubernetes.io/projected/0da8c36f-e0a6-4a09-965f-d4b3515b7a9e-kube-api-access-272vs\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bm57g\" (UID: \"0da8c36f-e0a6-4a09-965f-d4b3515b7a9e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bm57g"
Sep 16 02:24:45.662833 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.662730    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0da8c36f-e0a6-4a09-965f-d4b3515b7a9e-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bm57g\" (UID: \"0da8c36f-e0a6-4a09-965f-d4b3515b7a9e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bm57g"
Sep 16 02:24:45.662833 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.662808    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e02c65a0-ce8b-42ee-86c8-212b28ae0684-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctfpq6\" (UID: \"e02c65a0-ce8b-42ee-86c8-212b28ae0684\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctfpq6"
Sep 16 02:24:45.662833 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.662831    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e02c65a0-ce8b-42ee-86c8-212b28ae0684-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctfpq6\" (UID: \"e02c65a0-ce8b-42ee-86c8-212b28ae0684\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctfpq6"
Sep 16 02:24:45.662986 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.662860    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g968z\" (UniqueName: \"kubernetes.io/projected/e02c65a0-ce8b-42ee-86c8-212b28ae0684-kube-api-access-g968z\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctfpq6\" (UID: \"e02c65a0-ce8b-42ee-86c8-212b28ae0684\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctfpq6"
Sep 16 02:24:45.662986 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.662885    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0da8c36f-e0a6-4a09-965f-d4b3515b7a9e-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bm57g\" (UID: \"0da8c36f-e0a6-4a09-965f-d4b3515b7a9e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bm57g"
Sep 16 02:24:45.663215 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.663189    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e02c65a0-ce8b-42ee-86c8-212b28ae0684-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctfpq6\" (UID: \"e02c65a0-ce8b-42ee-86c8-212b28ae0684\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctfpq6"
Sep 16 02:24:45.663260 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.663246    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e02c65a0-ce8b-42ee-86c8-212b28ae0684-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctfpq6\" (UID: \"e02c65a0-ce8b-42ee-86c8-212b28ae0684\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctfpq6"
Sep 16 02:24:45.672096 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.672072    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g968z\" (UniqueName: \"kubernetes.io/projected/e02c65a0-ce8b-42ee-86c8-212b28ae0684-kube-api-access-g968z\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctfpq6\" (UID: \"e02c65a0-ce8b-42ee-86c8-212b28ae0684\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctfpq6"
Sep 16 02:24:45.705179 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.705155    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqhh5b"]
Sep 16 02:24:45.708486 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.708469    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqhh5b"
Sep 16 02:24:45.718167 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.718149    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqhh5b"]
Sep 16 02:24:45.763329 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.763280    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0da8c36f-e0a6-4a09-965f-d4b3515b7a9e-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bm57g\" (UID: \"0da8c36f-e0a6-4a09-965f-d4b3515b7a9e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bm57g"
Sep 16 02:24:45.763329 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.763314    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5khm\" (UniqueName: \"kubernetes.io/projected/c800b21f-a645-41ee-97a2-638691e231d6-kube-api-access-n5khm\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqhh5b\" (UID: \"c800b21f-a645-41ee-97a2-638691e231d6\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqhh5b"
Sep 16 02:24:45.763472 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.763348    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-272vs\" (UniqueName: \"kubernetes.io/projected/0da8c36f-e0a6-4a09-965f-d4b3515b7a9e-kube-api-access-272vs\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bm57g\" (UID: \"0da8c36f-e0a6-4a09-965f-d4b3515b7a9e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bm57g"
Sep 16 02:24:45.763472 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.763375    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0da8c36f-e0a6-4a09-965f-d4b3515b7a9e-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bm57g\" (UID: \"0da8c36f-e0a6-4a09-965f-d4b3515b7a9e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bm57g"
Sep 16 02:24:45.763472 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.763401    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c800b21f-a645-41ee-97a2-638691e231d6-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqhh5b\" (UID: \"c800b21f-a645-41ee-97a2-638691e231d6\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqhh5b"
Sep 16 02:24:45.763472 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.763419    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c800b21f-a645-41ee-97a2-638691e231d6-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqhh5b\" (UID: \"c800b21f-a645-41ee-97a2-638691e231d6\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqhh5b"
Sep 16 02:24:45.763684 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.763607    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0da8c36f-e0a6-4a09-965f-d4b3515b7a9e-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bm57g\" (UID: \"0da8c36f-e0a6-4a09-965f-d4b3515b7a9e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bm57g"
Sep 16 02:24:45.763734 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.763690    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0da8c36f-e0a6-4a09-965f-d4b3515b7a9e-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bm57g\" (UID: \"0da8c36f-e0a6-4a09-965f-d4b3515b7a9e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bm57g"
Sep 16 02:24:45.772315 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.772293    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-272vs\" (UniqueName: \"kubernetes.io/projected/0da8c36f-e0a6-4a09-965f-d4b3515b7a9e-kube-api-access-272vs\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bm57g\" (UID: \"0da8c36f-e0a6-4a09-965f-d4b3515b7a9e\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bm57g"
Sep 16 02:24:45.807370 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.807346    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7p9lnt"]
Sep 16 02:24:45.810641 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.810628    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7p9lnt"
Sep 16 02:24:45.812623 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.812609    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctfpq6"
Sep 16 02:24:45.820527 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.820508    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7p9lnt"]
Sep 16 02:24:45.864464 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.864434    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c800b21f-a645-41ee-97a2-638691e231d6-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqhh5b\" (UID: \"c800b21f-a645-41ee-97a2-638691e231d6\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqhh5b"
Sep 16 02:24:45.864585 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.864524    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c800b21f-a645-41ee-97a2-638691e231d6-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqhh5b\" (UID: \"c800b21f-a645-41ee-97a2-638691e231d6\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqhh5b"
Sep 16 02:24:45.864649 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.864615    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb3e55c2-30c5-4c20-82c6-f8bb3674041b-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7p9lnt\" (UID: \"bb3e55c2-30c5-4c20-82c6-f8bb3674041b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7p9lnt"
Sep 16 02:24:45.864703 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.864653    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5khm\" (UniqueName: \"kubernetes.io/projected/c800b21f-a645-41ee-97a2-638691e231d6-kube-api-access-n5khm\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqhh5b\" (UID: \"c800b21f-a645-41ee-97a2-638691e231d6\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqhh5b"
Sep 16 02:24:45.864703 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.864682    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb3e55c2-30c5-4c20-82c6-f8bb3674041b-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7p9lnt\" (UID: \"bb3e55c2-30c5-4c20-82c6-f8bb3674041b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7p9lnt"
Sep 16 02:24:45.864806 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.864750    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8vkj\" (UniqueName: \"kubernetes.io/projected/bb3e55c2-30c5-4c20-82c6-f8bb3674041b-kube-api-access-f8vkj\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7p9lnt\" (UID: \"bb3e55c2-30c5-4c20-82c6-f8bb3674041b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7p9lnt"
Sep 16 02:24:45.865242 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.865214    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c800b21f-a645-41ee-97a2-638691e231d6-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqhh5b\" (UID: \"c800b21f-a645-41ee-97a2-638691e231d6\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqhh5b"
Sep 16 02:24:45.865349 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.865268    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c800b21f-a645-41ee-97a2-638691e231d6-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqhh5b\" (UID: \"c800b21f-a645-41ee-97a2-638691e231d6\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqhh5b"
Sep 16 02:24:45.877177 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.877148    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5khm\" (UniqueName: \"kubernetes.io/projected/c800b21f-a645-41ee-97a2-638691e231d6-kube-api-access-n5khm\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqhh5b\" (UID: \"c800b21f-a645-41ee-97a2-638691e231d6\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqhh5b"
Sep 16 02:24:45.914797 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.914766    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bm57g"
Sep 16 02:24:45.966117 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.966044    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8vkj\" (UniqueName: \"kubernetes.io/projected/bb3e55c2-30c5-4c20-82c6-f8bb3674041b-kube-api-access-f8vkj\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7p9lnt\" (UID: \"bb3e55c2-30c5-4c20-82c6-f8bb3674041b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7p9lnt"
Sep 16 02:24:45.966197 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.966154    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb3e55c2-30c5-4c20-82c6-f8bb3674041b-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7p9lnt\" (UID: \"bb3e55c2-30c5-4c20-82c6-f8bb3674041b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7p9lnt"
Sep 16 02:24:45.966197 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.966189    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb3e55c2-30c5-4c20-82c6-f8bb3674041b-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7p9lnt\" (UID: \"bb3e55c2-30c5-4c20-82c6-f8bb3674041b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7p9lnt"
Sep 16 02:24:45.966955 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.966587    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb3e55c2-30c5-4c20-82c6-f8bb3674041b-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7p9lnt\" (UID: \"bb3e55c2-30c5-4c20-82c6-f8bb3674041b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7p9lnt"
Sep 16 02:24:45.967068 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.966962    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb3e55c2-30c5-4c20-82c6-f8bb3674041b-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7p9lnt\" (UID: \"bb3e55c2-30c5-4c20-82c6-f8bb3674041b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7p9lnt"
Sep 16 02:24:45.977775 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:45.977715    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8vkj\" (UniqueName: \"kubernetes.io/projected/bb3e55c2-30c5-4c20-82c6-f8bb3674041b-kube-api-access-f8vkj\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7p9lnt\" (UID: \"bb3e55c2-30c5-4c20-82c6-f8bb3674041b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7p9lnt"
Sep 16 02:24:46.017344 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:46.017287    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqhh5b"
Sep 16 02:24:46.090470 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:46.090228    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctfpq6"]
Sep 16 02:24:46.092625 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:24:46.092600    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode02c65a0_ce8b_42ee_86c8_212b28ae0684.slice/crio-40cc6d04e76bc69fdf62d2b07371ff07915e57c0ff8e28d4e23628070274076b WatchSource:0}: Error finding container 40cc6d04e76bc69fdf62d2b07371ff07915e57c0ff8e28d4e23628070274076b: Status 404 returned error can't find the container with id 40cc6d04e76bc69fdf62d2b07371ff07915e57c0ff8e28d4e23628070274076b
Sep 16 02:24:46.120010 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:46.119989    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7p9lnt"
Sep 16 02:24:46.194476 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:46.194444    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bm57g"]
Sep 16 02:24:46.197258 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:24:46.197195    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0da8c36f_e0a6_4a09_965f_d4b3515b7a9e.slice/crio-e151cf8e398399e44620abdb74208d1e582c804619bfe5034e57bd2d1b585880 WatchSource:0}: Error finding container e151cf8e398399e44620abdb74208d1e582c804619bfe5034e57bd2d1b585880: Status 404 returned error can't find the container with id e151cf8e398399e44620abdb74208d1e582c804619bfe5034e57bd2d1b585880
Sep 16 02:24:46.288861 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:46.288819    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqhh5b"]
Sep 16 02:24:46.291514 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:24:46.291491    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc800b21f_a645_41ee_97a2_638691e231d6.slice/crio-aa8b9c781d5230582ae2f6177bf0b43096743738c9ba2c42325ab5771b1c9041 WatchSource:0}: Error finding container aa8b9c781d5230582ae2f6177bf0b43096743738c9ba2c42325ab5771b1c9041: Status 404 returned error can't find the container with id aa8b9c781d5230582ae2f6177bf0b43096743738c9ba2c42325ab5771b1c9041
Sep 16 02:24:46.392185 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:46.392163    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7p9lnt"]
Sep 16 02:24:46.394423 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:24:46.394400    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb3e55c2_30c5_4c20_82c6_f8bb3674041b.slice/crio-681dc4fbc154a8d03ca3eb2960266e4bd70a3480d345bdd73fbc17ff36228897 WatchSource:0}: Error finding container 681dc4fbc154a8d03ca3eb2960266e4bd70a3480d345bdd73fbc17ff36228897: Status 404 returned error can't find the container with id 681dc4fbc154a8d03ca3eb2960266e4bd70a3480d345bdd73fbc17ff36228897
Sep 16 02:24:47.071490 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:47.071454    2581 generic.go:356] "Generic (PLEG): container finished" podID="0da8c36f-e0a6-4a09-965f-d4b3515b7a9e" containerID="d438d0ccb084be227853bf3d9186ab6d0a445760d755124822a188d04bba0137" exitCode=0
Sep 16 02:24:47.071959 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:47.071537    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bm57g" event={"ID":"0da8c36f-e0a6-4a09-965f-d4b3515b7a9e","Type":"ContainerDied","Data":"d438d0ccb084be227853bf3d9186ab6d0a445760d755124822a188d04bba0137"}
Sep 16 02:24:47.071959 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:47.071585    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bm57g" event={"ID":"0da8c36f-e0a6-4a09-965f-d4b3515b7a9e","Type":"ContainerStarted","Data":"e151cf8e398399e44620abdb74208d1e582c804619bfe5034e57bd2d1b585880"}
Sep 16 02:24:47.073190 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:47.073170    2581 generic.go:356] "Generic (PLEG): container finished" podID="e02c65a0-ce8b-42ee-86c8-212b28ae0684" containerID="75f116c2883edce45e49b06165c3dfe4fb8977d4423db1452a10e37993a42d19" exitCode=0
Sep 16 02:24:47.073280 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:47.073257    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctfpq6" event={"ID":"e02c65a0-ce8b-42ee-86c8-212b28ae0684","Type":"ContainerDied","Data":"75f116c2883edce45e49b06165c3dfe4fb8977d4423db1452a10e37993a42d19"}
Sep 16 02:24:47.073337 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:47.073308    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctfpq6" event={"ID":"e02c65a0-ce8b-42ee-86c8-212b28ae0684","Type":"ContainerStarted","Data":"40cc6d04e76bc69fdf62d2b07371ff07915e57c0ff8e28d4e23628070274076b"}
Sep 16 02:24:47.074800 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:47.074782    2581 generic.go:356] "Generic (PLEG): container finished" podID="bb3e55c2-30c5-4c20-82c6-f8bb3674041b" containerID="762e10beeb3ac4d5771ca59402436eae64d2e94b930196ebff729e2b56e8ff04" exitCode=0
Sep 16 02:24:47.074913 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:47.074835    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7p9lnt" event={"ID":"bb3e55c2-30c5-4c20-82c6-f8bb3674041b","Type":"ContainerDied","Data":"762e10beeb3ac4d5771ca59402436eae64d2e94b930196ebff729e2b56e8ff04"}
Sep 16 02:24:47.074913 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:47.074884    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7p9lnt" event={"ID":"bb3e55c2-30c5-4c20-82c6-f8bb3674041b","Type":"ContainerStarted","Data":"681dc4fbc154a8d03ca3eb2960266e4bd70a3480d345bdd73fbc17ff36228897"}
Sep 16 02:24:47.076549 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:47.076528    2581 generic.go:356] "Generic (PLEG): container finished" podID="c800b21f-a645-41ee-97a2-638691e231d6" containerID="1f390d06258d463c4fbdb6f47f69403bc7b1ed43478835583076fc72ff8ac793" exitCode=0
Sep 16 02:24:47.076631 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:47.076608    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqhh5b" event={"ID":"c800b21f-a645-41ee-97a2-638691e231d6","Type":"ContainerDied","Data":"1f390d06258d463c4fbdb6f47f69403bc7b1ed43478835583076fc72ff8ac793"}
Sep 16 02:24:47.076693 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:47.076654    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqhh5b" event={"ID":"c800b21f-a645-41ee-97a2-638691e231d6","Type":"ContainerStarted","Data":"aa8b9c781d5230582ae2f6177bf0b43096743738c9ba2c42325ab5771b1c9041"}
Sep 16 02:24:48.082661 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:48.082632    2581 generic.go:356] "Generic (PLEG): container finished" podID="0da8c36f-e0a6-4a09-965f-d4b3515b7a9e" containerID="d8028ad59c18fd88a7e168eec30c207f559011d99e6e9ab387dfc3bac71537f8" exitCode=0
Sep 16 02:24:48.083170 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:48.082711    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bm57g" event={"ID":"0da8c36f-e0a6-4a09-965f-d4b3515b7a9e","Type":"ContainerDied","Data":"d8028ad59c18fd88a7e168eec30c207f559011d99e6e9ab387dfc3bac71537f8"}
Sep 16 02:24:48.084718 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:48.084699    2581 generic.go:356] "Generic (PLEG): container finished" podID="e02c65a0-ce8b-42ee-86c8-212b28ae0684" containerID="c84cff3a534c0c009274bef4f621a5c826956b2ccfaf1932ca77e04031d52da4" exitCode=0
Sep 16 02:24:48.084808 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:48.084778    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctfpq6" event={"ID":"e02c65a0-ce8b-42ee-86c8-212b28ae0684","Type":"ContainerDied","Data":"c84cff3a534c0c009274bef4f621a5c826956b2ccfaf1932ca77e04031d52da4"}
Sep 16 02:24:48.086641 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:48.086624    2581 generic.go:356] "Generic (PLEG): container finished" podID="bb3e55c2-30c5-4c20-82c6-f8bb3674041b" containerID="52b5a050b37231d7dd4afbff2ef07bb24280eb8fe019f7a5b1bd514d433363f2" exitCode=0
Sep 16 02:24:48.086721 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:48.086685    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7p9lnt" event={"ID":"bb3e55c2-30c5-4c20-82c6-f8bb3674041b","Type":"ContainerDied","Data":"52b5a050b37231d7dd4afbff2ef07bb24280eb8fe019f7a5b1bd514d433363f2"}
Sep 16 02:24:48.094838 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:48.094814    2581 generic.go:356] "Generic (PLEG): container finished" podID="c800b21f-a645-41ee-97a2-638691e231d6" containerID="b4540559d9addf4c3eba53703347d1afbcd024bccc99489c1af6048b4b980405" exitCode=0
Sep 16 02:24:48.094935 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:48.094918    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqhh5b" event={"ID":"c800b21f-a645-41ee-97a2-638691e231d6","Type":"ContainerDied","Data":"b4540559d9addf4c3eba53703347d1afbcd024bccc99489c1af6048b4b980405"}
Sep 16 02:24:49.101964 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:49.101929    2581 generic.go:356] "Generic (PLEG): container finished" podID="e02c65a0-ce8b-42ee-86c8-212b28ae0684" containerID="f54b9bbeef63c6cd98a3c9ff84a56e52fc1ef9fab67f021c6fcab78ad6c22378" exitCode=0
Sep 16 02:24:49.102324 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:49.101981    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctfpq6" event={"ID":"e02c65a0-ce8b-42ee-86c8-212b28ae0684","Type":"ContainerDied","Data":"f54b9bbeef63c6cd98a3c9ff84a56e52fc1ef9fab67f021c6fcab78ad6c22378"}
Sep 16 02:24:49.104196 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:49.104175    2581 generic.go:356] "Generic (PLEG): container finished" podID="bb3e55c2-30c5-4c20-82c6-f8bb3674041b" containerID="d7a486a0d2c05c0bddf4f0ba8f795995f6addc8d4fb1580abba62e63846d478e" exitCode=0
Sep 16 02:24:49.104316 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:49.104238    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7p9lnt" event={"ID":"bb3e55c2-30c5-4c20-82c6-f8bb3674041b","Type":"ContainerDied","Data":"d7a486a0d2c05c0bddf4f0ba8f795995f6addc8d4fb1580abba62e63846d478e"}
Sep 16 02:24:49.106353 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:49.106333    2581 generic.go:356] "Generic (PLEG): container finished" podID="c800b21f-a645-41ee-97a2-638691e231d6" containerID="2c1a9d39746e7f8dc1ac90a4f4f2ee383d43d07e154843e0f7b6acb09c08b462" exitCode=0
Sep 16 02:24:49.106431 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:49.106408    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqhh5b" event={"ID":"c800b21f-a645-41ee-97a2-638691e231d6","Type":"ContainerDied","Data":"2c1a9d39746e7f8dc1ac90a4f4f2ee383d43d07e154843e0f7b6acb09c08b462"}
Sep 16 02:24:49.108434 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:49.108417    2581 generic.go:356] "Generic (PLEG): container finished" podID="0da8c36f-e0a6-4a09-965f-d4b3515b7a9e" containerID="edd27d06973603d002331c2de9aa3e7ed48e5c2e8c9aa337a913455df170e57e" exitCode=0
Sep 16 02:24:49.108505 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:49.108444    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bm57g" event={"ID":"0da8c36f-e0a6-4a09-965f-d4b3515b7a9e","Type":"ContainerDied","Data":"edd27d06973603d002331c2de9aa3e7ed48e5c2e8c9aa337a913455df170e57e"}
Sep 16 02:24:50.266096 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.266063    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7p9lnt"
Sep 16 02:24:50.296824 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.296801    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb3e55c2-30c5-4c20-82c6-f8bb3674041b-bundle\") pod \"bb3e55c2-30c5-4c20-82c6-f8bb3674041b\" (UID: \"bb3e55c2-30c5-4c20-82c6-f8bb3674041b\") "
Sep 16 02:24:50.296965 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.296913    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb3e55c2-30c5-4c20-82c6-f8bb3674041b-util\") pod \"bb3e55c2-30c5-4c20-82c6-f8bb3674041b\" (UID: \"bb3e55c2-30c5-4c20-82c6-f8bb3674041b\") "
Sep 16 02:24:50.297026 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.296999    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8vkj\" (UniqueName: \"kubernetes.io/projected/bb3e55c2-30c5-4c20-82c6-f8bb3674041b-kube-api-access-f8vkj\") pod \"bb3e55c2-30c5-4c20-82c6-f8bb3674041b\" (UID: \"bb3e55c2-30c5-4c20-82c6-f8bb3674041b\") "
Sep 16 02:24:50.297491 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.297440    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb3e55c2-30c5-4c20-82c6-f8bb3674041b-bundle" (OuterVolumeSpecName: "bundle") pod "bb3e55c2-30c5-4c20-82c6-f8bb3674041b" (UID: "bb3e55c2-30c5-4c20-82c6-f8bb3674041b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:24:50.297782 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.297763    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bm57g"
Sep 16 02:24:50.299532 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.299507    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb3e55c2-30c5-4c20-82c6-f8bb3674041b-kube-api-access-f8vkj" (OuterVolumeSpecName: "kube-api-access-f8vkj") pod "bb3e55c2-30c5-4c20-82c6-f8bb3674041b" (UID: "bb3e55c2-30c5-4c20-82c6-f8bb3674041b"). InnerVolumeSpecName "kube-api-access-f8vkj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:24:50.301149 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.301131    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqhh5b"
Sep 16 02:24:50.304352 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.304329    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb3e55c2-30c5-4c20-82c6-f8bb3674041b-util" (OuterVolumeSpecName: "util") pod "bb3e55c2-30c5-4c20-82c6-f8bb3674041b" (UID: "bb3e55c2-30c5-4c20-82c6-f8bb3674041b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:24:50.305107 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.305093    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctfpq6"
Sep 16 02:24:50.397883 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.397800    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0da8c36f-e0a6-4a09-965f-d4b3515b7a9e-util\") pod \"0da8c36f-e0a6-4a09-965f-d4b3515b7a9e\" (UID: \"0da8c36f-e0a6-4a09-965f-d4b3515b7a9e\") "
Sep 16 02:24:50.397883 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.397835    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g968z\" (UniqueName: \"kubernetes.io/projected/e02c65a0-ce8b-42ee-86c8-212b28ae0684-kube-api-access-g968z\") pod \"e02c65a0-ce8b-42ee-86c8-212b28ae0684\" (UID: \"e02c65a0-ce8b-42ee-86c8-212b28ae0684\") "
Sep 16 02:24:50.398055 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.397895    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5khm\" (UniqueName: \"kubernetes.io/projected/c800b21f-a645-41ee-97a2-638691e231d6-kube-api-access-n5khm\") pod \"c800b21f-a645-41ee-97a2-638691e231d6\" (UID: \"c800b21f-a645-41ee-97a2-638691e231d6\") "
Sep 16 02:24:50.398055 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.397923    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0da8c36f-e0a6-4a09-965f-d4b3515b7a9e-bundle\") pod \"0da8c36f-e0a6-4a09-965f-d4b3515b7a9e\" (UID: \"0da8c36f-e0a6-4a09-965f-d4b3515b7a9e\") "
Sep 16 02:24:50.398055 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.397955    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e02c65a0-ce8b-42ee-86c8-212b28ae0684-bundle\") pod \"e02c65a0-ce8b-42ee-86c8-212b28ae0684\" (UID: \"e02c65a0-ce8b-42ee-86c8-212b28ae0684\") "
Sep 16 02:24:50.398055 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.397987    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c800b21f-a645-41ee-97a2-638691e231d6-bundle\") pod \"c800b21f-a645-41ee-97a2-638691e231d6\" (UID: \"c800b21f-a645-41ee-97a2-638691e231d6\") "
Sep 16 02:24:50.398055 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.398032    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c800b21f-a645-41ee-97a2-638691e231d6-util\") pod \"c800b21f-a645-41ee-97a2-638691e231d6\" (UID: \"c800b21f-a645-41ee-97a2-638691e231d6\") "
Sep 16 02:24:50.398055 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.398056    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e02c65a0-ce8b-42ee-86c8-212b28ae0684-util\") pod \"e02c65a0-ce8b-42ee-86c8-212b28ae0684\" (UID: \"e02c65a0-ce8b-42ee-86c8-212b28ae0684\") "
Sep 16 02:24:50.398631 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.398428    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0da8c36f-e0a6-4a09-965f-d4b3515b7a9e-bundle" (OuterVolumeSpecName: "bundle") pod "0da8c36f-e0a6-4a09-965f-d4b3515b7a9e" (UID: "0da8c36f-e0a6-4a09-965f-d4b3515b7a9e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:24:50.398631 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.398575    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e02c65a0-ce8b-42ee-86c8-212b28ae0684-bundle" (OuterVolumeSpecName: "bundle") pod "e02c65a0-ce8b-42ee-86c8-212b28ae0684" (UID: "e02c65a0-ce8b-42ee-86c8-212b28ae0684"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:24:50.399009 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.398959    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c800b21f-a645-41ee-97a2-638691e231d6-bundle" (OuterVolumeSpecName: "bundle") pod "c800b21f-a645-41ee-97a2-638691e231d6" (UID: "c800b21f-a645-41ee-97a2-638691e231d6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:24:50.400151 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.400113    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-272vs\" (UniqueName: \"kubernetes.io/projected/0da8c36f-e0a6-4a09-965f-d4b3515b7a9e-kube-api-access-272vs\") pod \"0da8c36f-e0a6-4a09-965f-d4b3515b7a9e\" (UID: \"0da8c36f-e0a6-4a09-965f-d4b3515b7a9e\") "
Sep 16 02:24:50.400257 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.400212    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c800b21f-a645-41ee-97a2-638691e231d6-kube-api-access-n5khm" (OuterVolumeSpecName: "kube-api-access-n5khm") pod "c800b21f-a645-41ee-97a2-638691e231d6" (UID: "c800b21f-a645-41ee-97a2-638691e231d6"). InnerVolumeSpecName "kube-api-access-n5khm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:24:50.400403 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.400384    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0da8c36f-e0a6-4a09-965f-d4b3515b7a9e-bundle\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:24:50.400485 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.400404    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e02c65a0-ce8b-42ee-86c8-212b28ae0684-bundle\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:24:50.400485 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.400417    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c800b21f-a645-41ee-97a2-638691e231d6-bundle\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:24:50.400485 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.400429    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb3e55c2-30c5-4c20-82c6-f8bb3674041b-bundle\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:24:50.400485 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.400441    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb3e55c2-30c5-4c20-82c6-f8bb3674041b-util\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:24:50.400485 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.400453    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5khm\" (UniqueName: \"kubernetes.io/projected/c800b21f-a645-41ee-97a2-638691e231d6-kube-api-access-n5khm\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:24:50.400485 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.400468    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8vkj\" (UniqueName: \"kubernetes.io/projected/bb3e55c2-30c5-4c20-82c6-f8bb3674041b-kube-api-access-f8vkj\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:24:50.400485 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.400401    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e02c65a0-ce8b-42ee-86c8-212b28ae0684-kube-api-access-g968z" (OuterVolumeSpecName: "kube-api-access-g968z") pod "e02c65a0-ce8b-42ee-86c8-212b28ae0684" (UID: "e02c65a0-ce8b-42ee-86c8-212b28ae0684"). InnerVolumeSpecName "kube-api-access-g968z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:24:50.401922 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.401903    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0da8c36f-e0a6-4a09-965f-d4b3515b7a9e-kube-api-access-272vs" (OuterVolumeSpecName: "kube-api-access-272vs") pod "0da8c36f-e0a6-4a09-965f-d4b3515b7a9e" (UID: "0da8c36f-e0a6-4a09-965f-d4b3515b7a9e"). InnerVolumeSpecName "kube-api-access-272vs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:24:50.404567 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.404541    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c800b21f-a645-41ee-97a2-638691e231d6-util" (OuterVolumeSpecName: "util") pod "c800b21f-a645-41ee-97a2-638691e231d6" (UID: "c800b21f-a645-41ee-97a2-638691e231d6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:24:50.406754 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.406732    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e02c65a0-ce8b-42ee-86c8-212b28ae0684-util" (OuterVolumeSpecName: "util") pod "e02c65a0-ce8b-42ee-86c8-212b28ae0684" (UID: "e02c65a0-ce8b-42ee-86c8-212b28ae0684"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:24:50.406999 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.406984    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0da8c36f-e0a6-4a09-965f-d4b3515b7a9e-util" (OuterVolumeSpecName: "util") pod "0da8c36f-e0a6-4a09-965f-d4b3515b7a9e" (UID: "0da8c36f-e0a6-4a09-965f-d4b3515b7a9e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:24:50.500919 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.500893    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c800b21f-a645-41ee-97a2-638691e231d6-util\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:24:50.500919 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.500914    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e02c65a0-ce8b-42ee-86c8-212b28ae0684-util\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:24:50.500919 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.500923    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-272vs\" (UniqueName: \"kubernetes.io/projected/0da8c36f-e0a6-4a09-965f-d4b3515b7a9e-kube-api-access-272vs\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:24:50.501080 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.500932    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0da8c36f-e0a6-4a09-965f-d4b3515b7a9e-util\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:24:50.501080 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:50.500941    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g968z\" (UniqueName: \"kubernetes.io/projected/e02c65a0-ce8b-42ee-86c8-212b28ae0684-kube-api-access-g968z\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:24:51.120205 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:51.120174    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bm57g"
Sep 16 02:24:51.120205 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:51.120179    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bm57g" event={"ID":"0da8c36f-e0a6-4a09-965f-d4b3515b7a9e","Type":"ContainerDied","Data":"e151cf8e398399e44620abdb74208d1e582c804619bfe5034e57bd2d1b585880"}
Sep 16 02:24:51.120442 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:51.120256    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e151cf8e398399e44620abdb74208d1e582c804619bfe5034e57bd2d1b585880"
Sep 16 02:24:51.122008 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:51.121989    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctfpq6"
Sep 16 02:24:51.122008 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:51.121997    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctfpq6" event={"ID":"e02c65a0-ce8b-42ee-86c8-212b28ae0684","Type":"ContainerDied","Data":"40cc6d04e76bc69fdf62d2b07371ff07915e57c0ff8e28d4e23628070274076b"}
Sep 16 02:24:51.122157 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:51.122031    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40cc6d04e76bc69fdf62d2b07371ff07915e57c0ff8e28d4e23628070274076b"
Sep 16 02:24:51.123805 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:51.123786    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7p9lnt" event={"ID":"bb3e55c2-30c5-4c20-82c6-f8bb3674041b","Type":"ContainerDied","Data":"681dc4fbc154a8d03ca3eb2960266e4bd70a3480d345bdd73fbc17ff36228897"}
Sep 16 02:24:51.123912 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:51.123821    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="681dc4fbc154a8d03ca3eb2960266e4bd70a3480d345bdd73fbc17ff36228897"
Sep 16 02:24:51.123912 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:51.123793    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7p9lnt"
Sep 16 02:24:51.125780 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:51.125751    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqhh5b" event={"ID":"c800b21f-a645-41ee-97a2-638691e231d6","Type":"ContainerDied","Data":"aa8b9c781d5230582ae2f6177bf0b43096743738c9ba2c42325ab5771b1c9041"}
Sep 16 02:24:51.125780 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:51.125768    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqhh5b"
Sep 16 02:24:51.125911 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:51.125790    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa8b9c781d5230582ae2f6177bf0b43096743738c9ba2c42325ab5771b1c9041"
Sep 16 02:24:57.623868 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.623821    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-tgqmk"]
Sep 16 02:24:57.624338 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.624138    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c800b21f-a645-41ee-97a2-638691e231d6" containerName="pull"
Sep 16 02:24:57.624338 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.624148    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c800b21f-a645-41ee-97a2-638691e231d6" containerName="pull"
Sep 16 02:24:57.624338 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.624156    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb3e55c2-30c5-4c20-82c6-f8bb3674041b" containerName="extract"
Sep 16 02:24:57.624338 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.624162    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb3e55c2-30c5-4c20-82c6-f8bb3674041b" containerName="extract"
Sep 16 02:24:57.624338 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.624173    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e02c65a0-ce8b-42ee-86c8-212b28ae0684" containerName="pull"
Sep 16 02:24:57.624338 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.624178    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e02c65a0-ce8b-42ee-86c8-212b28ae0684" containerName="pull"
Sep 16 02:24:57.624338 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.624187    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e02c65a0-ce8b-42ee-86c8-212b28ae0684" containerName="extract"
Sep 16 02:24:57.624338 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.624193    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e02c65a0-ce8b-42ee-86c8-212b28ae0684" containerName="extract"
Sep 16 02:24:57.624338 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.624201    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e02c65a0-ce8b-42ee-86c8-212b28ae0684" containerName="util"
Sep 16 02:24:57.624338 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.624206    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e02c65a0-ce8b-42ee-86c8-212b28ae0684" containerName="util"
Sep 16 02:24:57.624338 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.624211    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c800b21f-a645-41ee-97a2-638691e231d6" containerName="util"
Sep 16 02:24:57.624338 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.624216    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c800b21f-a645-41ee-97a2-638691e231d6" containerName="util"
Sep 16 02:24:57.624338 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.624221    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0da8c36f-e0a6-4a09-965f-d4b3515b7a9e" containerName="pull"
Sep 16 02:24:57.624338 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.624226    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0da8c36f-e0a6-4a09-965f-d4b3515b7a9e" containerName="pull"
Sep 16 02:24:57.624338 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.624232    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb3e55c2-30c5-4c20-82c6-f8bb3674041b" containerName="util"
Sep 16 02:24:57.624338 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.624236    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb3e55c2-30c5-4c20-82c6-f8bb3674041b" containerName="util"
Sep 16 02:24:57.624338 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.624242    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0da8c36f-e0a6-4a09-965f-d4b3515b7a9e" containerName="extract"
Sep 16 02:24:57.624338 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.624247    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0da8c36f-e0a6-4a09-965f-d4b3515b7a9e" containerName="extract"
Sep 16 02:24:57.624338 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.624255    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0da8c36f-e0a6-4a09-965f-d4b3515b7a9e" containerName="util"
Sep 16 02:24:57.624338 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.624261    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0da8c36f-e0a6-4a09-965f-d4b3515b7a9e" containerName="util"
Sep 16 02:24:57.624338 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.624273    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb3e55c2-30c5-4c20-82c6-f8bb3674041b" containerName="pull"
Sep 16 02:24:57.624338 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.624277    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb3e55c2-30c5-4c20-82c6-f8bb3674041b" containerName="pull"
Sep 16 02:24:57.624338 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.624282    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c800b21f-a645-41ee-97a2-638691e231d6" containerName="extract"
Sep 16 02:24:57.624338 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.624286    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c800b21f-a645-41ee-97a2-638691e231d6" containerName="extract"
Sep 16 02:24:57.624338 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.624330    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e02c65a0-ce8b-42ee-86c8-212b28ae0684" containerName="extract"
Sep 16 02:24:57.624338 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.624338    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c800b21f-a645-41ee-97a2-638691e231d6" containerName="extract"
Sep 16 02:24:57.624338 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.624346    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0da8c36f-e0a6-4a09-965f-d4b3515b7a9e" containerName="extract"
Sep 16 02:24:57.624338 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.624352    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb3e55c2-30c5-4c20-82c6-f8bb3674041b" containerName="extract"
Sep 16 02:24:57.628932 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.628911    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-tgqmk"
Sep 16 02:24:57.631488 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.631468    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 16 02:24:57.631601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.631468    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-z4nz6\""
Sep 16 02:24:57.631601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.631468    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 16 02:24:57.631601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.631542    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 16 02:24:57.639921 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.639902    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-tgqmk"]
Sep 16 02:24:57.654363 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.654338    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgcqh\" (UniqueName: \"kubernetes.io/projected/9142ad38-fd27-49f2-934c-e1824266ee2c-kube-api-access-qgcqh\") pod \"dns-operator-controller-manager-7b84cd7c9c-tgqmk\" (UID: \"9142ad38-fd27-49f2-934c-e1824266ee2c\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-tgqmk"
Sep 16 02:24:57.755121 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.755100    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgcqh\" (UniqueName: \"kubernetes.io/projected/9142ad38-fd27-49f2-934c-e1824266ee2c-kube-api-access-qgcqh\") pod \"dns-operator-controller-manager-7b84cd7c9c-tgqmk\" (UID: \"9142ad38-fd27-49f2-934c-e1824266ee2c\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-tgqmk"
Sep 16 02:24:57.770912 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.770886    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgcqh\" (UniqueName: \"kubernetes.io/projected/9142ad38-fd27-49f2-934c-e1824266ee2c-kube-api-access-qgcqh\") pod \"dns-operator-controller-manager-7b84cd7c9c-tgqmk\" (UID: \"9142ad38-fd27-49f2-934c-e1824266ee2c\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-tgqmk"
Sep 16 02:24:57.938392 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:57.938328    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-tgqmk"
Sep 16 02:24:58.216995 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:58.216967    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-tgqmk"]
Sep 16 02:24:58.218286 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:24:58.218263    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9142ad38_fd27_49f2_934c_e1824266ee2c.slice/crio-8f926d484a1404c68a4e4f0c76bd11e7513087b078981e26f0a77a6e00e1428b WatchSource:0}: Error finding container 8f926d484a1404c68a4e4f0c76bd11e7513087b078981e26f0a77a6e00e1428b: Status 404 returned error can't find the container with id 8f926d484a1404c68a4e4f0c76bd11e7513087b078981e26f0a77a6e00e1428b
Sep 16 02:24:59.166200 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:24:59.166166    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-tgqmk" event={"ID":"9142ad38-fd27-49f2-934c-e1824266ee2c","Type":"ContainerStarted","Data":"8f926d484a1404c68a4e4f0c76bd11e7513087b078981e26f0a77a6e00e1428b"}
Sep 16 02:25:00.181585 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:00.181544    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-5z4zb"]
Sep 16 02:25:00.185774 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:00.185238    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-5z4zb"
Sep 16 02:25:00.188346 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:00.187688    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-vzkrl\""
Sep 16 02:25:00.195900 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:00.195881    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-5z4zb"]
Sep 16 02:25:00.275350 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:00.275310    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2596\" (UniqueName: \"kubernetes.io/projected/53e79266-1f0f-4bb2-a50a-1f95bd4c750e-kube-api-access-q2596\") pod \"authorino-operator-76b478bd78-5z4zb\" (UID: \"53e79266-1f0f-4bb2-a50a-1f95bd4c750e\") " pod="kuadrant-system/authorino-operator-76b478bd78-5z4zb"
Sep 16 02:25:00.376567 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:00.376531    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2596\" (UniqueName: \"kubernetes.io/projected/53e79266-1f0f-4bb2-a50a-1f95bd4c750e-kube-api-access-q2596\") pod \"authorino-operator-76b478bd78-5z4zb\" (UID: \"53e79266-1f0f-4bb2-a50a-1f95bd4c750e\") " pod="kuadrant-system/authorino-operator-76b478bd78-5z4zb"
Sep 16 02:25:00.387362 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:00.387332    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2596\" (UniqueName: \"kubernetes.io/projected/53e79266-1f0f-4bb2-a50a-1f95bd4c750e-kube-api-access-q2596\") pod \"authorino-operator-76b478bd78-5z4zb\" (UID: \"53e79266-1f0f-4bb2-a50a-1f95bd4c750e\") " pod="kuadrant-system/authorino-operator-76b478bd78-5z4zb"
Sep 16 02:25:00.501181 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:00.501113    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-5z4zb"
Sep 16 02:25:01.689299 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:01.689273    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-5z4zb"]
Sep 16 02:25:01.691351 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:25:01.691328    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53e79266_1f0f_4bb2_a50a_1f95bd4c750e.slice/crio-974037a26a79eff59ec801f1633f9a3ae30b853486e01c34060e88db22d91a6a WatchSource:0}: Error finding container 974037a26a79eff59ec801f1633f9a3ae30b853486e01c34060e88db22d91a6a: Status 404 returned error can't find the container with id 974037a26a79eff59ec801f1633f9a3ae30b853486e01c34060e88db22d91a6a
Sep 16 02:25:02.184865 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:02.184814    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-5z4zb" event={"ID":"53e79266-1f0f-4bb2-a50a-1f95bd4c750e","Type":"ContainerStarted","Data":"974037a26a79eff59ec801f1633f9a3ae30b853486e01c34060e88db22d91a6a"}
Sep 16 02:25:02.186534 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:02.186504    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-tgqmk" event={"ID":"9142ad38-fd27-49f2-934c-e1824266ee2c","Type":"ContainerStarted","Data":"7a37e82b05b1a920af278bc59a0e0b754ab8f14d5b6f18fb79e29935275a8c58"}
Sep 16 02:25:02.186671 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:02.186631    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-tgqmk"
Sep 16 02:25:02.211290 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:02.211247    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-tgqmk" podStartSLOduration=1.94195524 podStartE2EDuration="5.21123431s" totalImagesPullingTime="3.26927907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:24:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:25:02.210819221 +0000 UTC m=+707.303001196" watchObservedRunningTime="2026-09-16 02:25:02.21123431 +0000 UTC m=+707.303416280"
Sep 16 02:25:02.957801 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:02.957769    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-fcf47"]
Sep 16 02:25:02.961715 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:02.961693    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fcf47"
Sep 16 02:25:02.965170 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:02.965151    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-rsc57\""
Sep 16 02:25:02.977824 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:02.977800    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-fcf47"]
Sep 16 02:25:02.999957 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:02.999934    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq9tz\" (UniqueName: \"kubernetes.io/projected/5b815f5f-7fa1-4fc7-b517-b367f569f988-kube-api-access-kq9tz\") pod \"limitador-operator-controller-manager-74495c69f8-fcf47\" (UID: \"5b815f5f-7fa1-4fc7-b517-b367f569f988\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fcf47"
Sep 16 02:25:03.100903 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:03.100877    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq9tz\" (UniqueName: \"kubernetes.io/projected/5b815f5f-7fa1-4fc7-b517-b367f569f988-kube-api-access-kq9tz\") pod \"limitador-operator-controller-manager-74495c69f8-fcf47\" (UID: \"5b815f5f-7fa1-4fc7-b517-b367f569f988\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fcf47"
Sep 16 02:25:03.108704 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:03.108682    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq9tz\" (UniqueName: \"kubernetes.io/projected/5b815f5f-7fa1-4fc7-b517-b367f569f988-kube-api-access-kq9tz\") pod \"limitador-operator-controller-manager-74495c69f8-fcf47\" (UID: \"5b815f5f-7fa1-4fc7-b517-b367f569f988\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fcf47"
Sep 16 02:25:03.193191 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:03.193157    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-5z4zb" event={"ID":"53e79266-1f0f-4bb2-a50a-1f95bd4c750e","Type":"ContainerStarted","Data":"70db72ab88747754bef50aadcd5f27ecf4b7951e9df97a19bf414b85d7bb456d"}
Sep 16 02:25:03.193358 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:03.193289    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-5z4zb"
Sep 16 02:25:03.210827 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:03.210747    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-5z4zb" podStartSLOduration=1.879179795 podStartE2EDuration="3.210733761s" totalImagesPullingTime="1.331553966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:25:03.208502849 +0000 UTC m=+708.300684821" watchObservedRunningTime="2026-09-16 02:25:03.210733761 +0000 UTC m=+708.302915733"
Sep 16 02:25:03.272549 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:03.272520    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fcf47"
Sep 16 02:25:03.546352 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:03.546323    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-fcf47"]
Sep 16 02:25:03.547745 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:25:03.547711    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b815f5f_7fa1_4fc7_b517_b367f569f988.slice/crio-d086fc6b86090d56ebdb26a7da8e87703e3aa835db86e35943e3d4d55d424ee7 WatchSource:0}: Error finding container d086fc6b86090d56ebdb26a7da8e87703e3aa835db86e35943e3d4d55d424ee7: Status 404 returned error can't find the container with id d086fc6b86090d56ebdb26a7da8e87703e3aa835db86e35943e3d4d55d424ee7
Sep 16 02:25:04.199671 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:04.199639    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fcf47" event={"ID":"5b815f5f-7fa1-4fc7-b517-b367f569f988","Type":"ContainerStarted","Data":"d086fc6b86090d56ebdb26a7da8e87703e3aa835db86e35943e3d4d55d424ee7"}
Sep 16 02:25:05.206570 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:05.206496    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fcf47" event={"ID":"5b815f5f-7fa1-4fc7-b517-b367f569f988","Type":"ContainerStarted","Data":"5b5928a9f01a79eb67b726e76d5961e4f11ab3877214c8d08a66db675753d3c4"}
Sep 16 02:25:05.206926 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:05.206638    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fcf47"
Sep 16 02:25:05.221179 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:05.221132    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fcf47" podStartSLOduration=1.83462511 podStartE2EDuration="3.221115521s" totalImagesPullingTime="1.386490411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:25:05.220976306 +0000 UTC m=+710.313158272" watchObservedRunningTime="2026-09-16 02:25:05.221115521 +0000 UTC m=+710.313297515"
Sep 16 02:25:07.290464 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:07.290390    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9h8tr"]
Sep 16 02:25:07.294251 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:07.294231    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9h8tr"
Sep 16 02:25:07.296468 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:07.296451    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9967l\""
Sep 16 02:25:07.306055 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:07.306035    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9h8tr"]
Sep 16 02:25:07.334522 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:07.334498    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6vgw\" (UniqueName: \"kubernetes.io/projected/c8af27c2-d98c-4e47-a958-b8c61f8333b9-kube-api-access-h6vgw\") pod \"kuadrant-operator-controller-manager-76f8f686bf-9h8tr\" (UID: \"c8af27c2-d98c-4e47-a958-b8c61f8333b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9h8tr"
Sep 16 02:25:07.334626 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:07.334537    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8af27c2-d98c-4e47-a958-b8c61f8333b9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-9h8tr\" (UID: \"c8af27c2-d98c-4e47-a958-b8c61f8333b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9h8tr"
Sep 16 02:25:07.435248 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:07.435221    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6vgw\" (UniqueName: \"kubernetes.io/projected/c8af27c2-d98c-4e47-a958-b8c61f8333b9-kube-api-access-h6vgw\") pod \"kuadrant-operator-controller-manager-76f8f686bf-9h8tr\" (UID: \"c8af27c2-d98c-4e47-a958-b8c61f8333b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9h8tr"
Sep 16 02:25:07.435383 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:07.435261    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8af27c2-d98c-4e47-a958-b8c61f8333b9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-9h8tr\" (UID: \"c8af27c2-d98c-4e47-a958-b8c61f8333b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9h8tr"
Sep 16 02:25:07.435651 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:07.435628    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8af27c2-d98c-4e47-a958-b8c61f8333b9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-9h8tr\" (UID: \"c8af27c2-d98c-4e47-a958-b8c61f8333b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9h8tr"
Sep 16 02:25:07.443425 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:07.443397    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6vgw\" (UniqueName: \"kubernetes.io/projected/c8af27c2-d98c-4e47-a958-b8c61f8333b9-kube-api-access-h6vgw\") pod \"kuadrant-operator-controller-manager-76f8f686bf-9h8tr\" (UID: \"c8af27c2-d98c-4e47-a958-b8c61f8333b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9h8tr"
Sep 16 02:25:07.605754 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:07.605672    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9h8tr"
Sep 16 02:25:07.877907 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:07.877811    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9h8tr"]
Sep 16 02:25:07.880922 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:25:07.880894    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8af27c2_d98c_4e47_a958_b8c61f8333b9.slice/crio-15d8ec3413f4326eeb7309e8eee6d8b93f2d9bd74e6f4ac9ea6a0d76e83cdfeb WatchSource:0}: Error finding container 15d8ec3413f4326eeb7309e8eee6d8b93f2d9bd74e6f4ac9ea6a0d76e83cdfeb: Status 404 returned error can't find the container with id 15d8ec3413f4326eeb7309e8eee6d8b93f2d9bd74e6f4ac9ea6a0d76e83cdfeb
Sep 16 02:25:08.224269 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:08.224180    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9h8tr" event={"ID":"c8af27c2-d98c-4e47-a958-b8c61f8333b9","Type":"ContainerStarted","Data":"15d8ec3413f4326eeb7309e8eee6d8b93f2d9bd74e6f4ac9ea6a0d76e83cdfeb"}
Sep 16 02:25:12.248542 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:12.248505    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9h8tr" event={"ID":"c8af27c2-d98c-4e47-a958-b8c61f8333b9","Type":"ContainerStarted","Data":"b531de0a2a0e83c973cb77d71f5af6e1038a0d8bc4ab38aa9384c5a629a1d183"}
Sep 16 02:25:12.248914 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:12.248655    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9h8tr"
Sep 16 02:25:12.268296 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:12.268248    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9h8tr" podStartSLOduration=1.501791764 podStartE2EDuration="5.268234263s" totalImagesPullingTime="3.766442499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:25:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:25:12.265339078 +0000 UTC m=+717.357521052" watchObservedRunningTime="2026-09-16 02:25:12.268234263 +0000 UTC m=+717.360416235"
Sep 16 02:25:13.195151 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:13.195115    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-tgqmk"
Sep 16 02:25:14.201992 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:14.201956    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-5z4zb"
Sep 16 02:25:14.253918 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:14.253881    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-wbfpp"]
Sep 16 02:25:14.258058 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:14.258029    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-wbfpp"
Sep 16 02:25:14.260504 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:14.260159    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2t5hl\""
Sep 16 02:25:14.260504 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:14.260351    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 16 02:25:14.261243 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:14.261228    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 16 02:25:14.266484 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:14.266465    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-wbfpp"]
Sep 16 02:25:14.395779 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:14.395747    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0c480db-3e2e-46fa-8f32-35b50819abdc-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-wbfpp\" (UID: \"d0c480db-3e2e-46fa-8f32-35b50819abdc\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-wbfpp"
Sep 16 02:25:14.395976 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:14.395832    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d0c480db-3e2e-46fa-8f32-35b50819abdc-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-wbfpp\" (UID: \"d0c480db-3e2e-46fa-8f32-35b50819abdc\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-wbfpp"
Sep 16 02:25:14.395976 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:14.395880    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4497c\" (UniqueName: \"kubernetes.io/projected/d0c480db-3e2e-46fa-8f32-35b50819abdc-kube-api-access-4497c\") pod \"kuadrant-console-plugin-fbdd4f445-wbfpp\" (UID: \"d0c480db-3e2e-46fa-8f32-35b50819abdc\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-wbfpp"
Sep 16 02:25:14.496653 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:14.496575    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d0c480db-3e2e-46fa-8f32-35b50819abdc-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-wbfpp\" (UID: \"d0c480db-3e2e-46fa-8f32-35b50819abdc\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-wbfpp"
Sep 16 02:25:14.496653 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:14.496621    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4497c\" (UniqueName: \"kubernetes.io/projected/d0c480db-3e2e-46fa-8f32-35b50819abdc-kube-api-access-4497c\") pod \"kuadrant-console-plugin-fbdd4f445-wbfpp\" (UID: \"d0c480db-3e2e-46fa-8f32-35b50819abdc\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-wbfpp"
Sep 16 02:25:14.496885 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:14.496653    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0c480db-3e2e-46fa-8f32-35b50819abdc-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-wbfpp\" (UID: \"d0c480db-3e2e-46fa-8f32-35b50819abdc\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-wbfpp"
Sep 16 02:25:14.497184 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:14.497164    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d0c480db-3e2e-46fa-8f32-35b50819abdc-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-wbfpp\" (UID: \"d0c480db-3e2e-46fa-8f32-35b50819abdc\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-wbfpp"
Sep 16 02:25:14.499076 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:14.499055    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0c480db-3e2e-46fa-8f32-35b50819abdc-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-wbfpp\" (UID: \"d0c480db-3e2e-46fa-8f32-35b50819abdc\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-wbfpp"
Sep 16 02:25:14.504769 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:14.504748    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4497c\" (UniqueName: \"kubernetes.io/projected/d0c480db-3e2e-46fa-8f32-35b50819abdc-kube-api-access-4497c\") pod \"kuadrant-console-plugin-fbdd4f445-wbfpp\" (UID: \"d0c480db-3e2e-46fa-8f32-35b50819abdc\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-wbfpp"
Sep 16 02:25:14.571715 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:14.571693    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-wbfpp"
Sep 16 02:25:14.854650 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:14.854628    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-wbfpp"]
Sep 16 02:25:14.856208 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:25:14.856184    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0c480db_3e2e_46fa_8f32_35b50819abdc.slice/crio-bfbe3039368f230b3c41f66114e6f193dca243d3ff75818fe7dd8df12190c748 WatchSource:0}: Error finding container bfbe3039368f230b3c41f66114e6f193dca243d3ff75818fe7dd8df12190c748: Status 404 returned error can't find the container with id bfbe3039368f230b3c41f66114e6f193dca243d3ff75818fe7dd8df12190c748
Sep 16 02:25:15.270325 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:15.270251    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-wbfpp" event={"ID":"d0c480db-3e2e-46fa-8f32-35b50819abdc","Type":"ContainerStarted","Data":"bfbe3039368f230b3c41f66114e6f193dca243d3ff75818fe7dd8df12190c748"}
Sep 16 02:25:16.214626 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:16.214592    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fcf47"
Sep 16 02:25:19.296490 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:19.296397    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-wbfpp" event={"ID":"d0c480db-3e2e-46fa-8f32-35b50819abdc","Type":"ContainerStarted","Data":"761f7e17d160499a37794d487ecff9ff5a6fd5584b1557a37463ebb4b6d0aae4"}
Sep 16 02:25:19.326535 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:19.326492    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-wbfpp" podStartSLOduration=1.150440146 podStartE2EDuration="5.326477172s" totalImagesPullingTime="4.176037026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:25:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:25:19.325062783 +0000 UTC m=+724.417244747" watchObservedRunningTime="2026-09-16 02:25:19.326477172 +0000 UTC m=+724.418659143"
Sep 16 02:25:23.257166 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:23.257137    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9h8tr"
Sep 16 02:25:24.244001 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:24.243965    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lzv7p"]
Sep 16 02:25:24.248786 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:24.248768    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lzv7p"
Sep 16 02:25:24.257959 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:24.257933    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lzv7p"]
Sep 16 02:25:24.387696 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:24.387665    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89648606-883a-4fbb-a7ad-b5546e49fb56-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-lzv7p\" (UID: \"89648606-883a-4fbb-a7ad-b5546e49fb56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lzv7p"
Sep 16 02:25:24.387835 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:24.387718    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95q74\" (UniqueName: \"kubernetes.io/projected/89648606-883a-4fbb-a7ad-b5546e49fb56-kube-api-access-95q74\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-lzv7p\" (UID: \"89648606-883a-4fbb-a7ad-b5546e49fb56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lzv7p"
Sep 16 02:25:24.488980 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:24.488952    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89648606-883a-4fbb-a7ad-b5546e49fb56-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-lzv7p\" (UID: \"89648606-883a-4fbb-a7ad-b5546e49fb56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lzv7p"
Sep 16 02:25:24.489132 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:24.489009    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95q74\" (UniqueName: \"kubernetes.io/projected/89648606-883a-4fbb-a7ad-b5546e49fb56-kube-api-access-95q74\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-lzv7p\" (UID: \"89648606-883a-4fbb-a7ad-b5546e49fb56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lzv7p"
Sep 16 02:25:24.489366 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:24.489338    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89648606-883a-4fbb-a7ad-b5546e49fb56-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-lzv7p\" (UID: \"89648606-883a-4fbb-a7ad-b5546e49fb56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lzv7p"
Sep 16 02:25:24.497331 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:24.497280    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95q74\" (UniqueName: \"kubernetes.io/projected/89648606-883a-4fbb-a7ad-b5546e49fb56-kube-api-access-95q74\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-lzv7p\" (UID: \"89648606-883a-4fbb-a7ad-b5546e49fb56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lzv7p"
Sep 16 02:25:24.560241 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:24.560216    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lzv7p"
Sep 16 02:25:24.832982 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:24.832958    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lzv7p"]
Sep 16 02:25:24.833754 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:25:24.833730    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89648606_883a_4fbb_a7ad_b5546e49fb56.slice/crio-09373ea17a1b4bbd9a5605150b75db23083104073b61eb9fe11f35dcf7ddca48 WatchSource:0}: Error finding container 09373ea17a1b4bbd9a5605150b75db23083104073b61eb9fe11f35dcf7ddca48: Status 404 returned error can't find the container with id 09373ea17a1b4bbd9a5605150b75db23083104073b61eb9fe11f35dcf7ddca48
Sep 16 02:25:25.330642 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.330604    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lzv7p" event={"ID":"89648606-883a-4fbb-a7ad-b5546e49fb56","Type":"ContainerStarted","Data":"b242f247a3f5ca47e02ee42242683e13a8b011c624effb9ed1f019b0c65f68b2"}
Sep 16 02:25:25.331143 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.330659    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lzv7p" event={"ID":"89648606-883a-4fbb-a7ad-b5546e49fb56","Type":"ContainerStarted","Data":"09373ea17a1b4bbd9a5605150b75db23083104073b61eb9fe11f35dcf7ddca48"}
Sep 16 02:25:25.331143 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.330695    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lzv7p"
Sep 16 02:25:25.351791 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.351754    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lzv7p" podStartSLOduration=1.351739295 podStartE2EDuration="1.351739295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:25:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:25:25.349044211 +0000 UTC m=+730.441226185" watchObservedRunningTime="2026-09-16 02:25:25.351739295 +0000 UTC m=+730.443921268"
Sep 16 02:25:25.493261 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.493229    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lzv7p"]
Sep 16 02:25:25.498053 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.498026    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lzv7p"]
Sep 16 02:25:25.507739 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.507714    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9h8tr"]
Sep 16 02:25:25.507970 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.507925    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9h8tr" podUID="c8af27c2-d98c-4e47-a958-b8c61f8333b9" containerName="manager" containerID="cri-o://b531de0a2a0e83c973cb77d71f5af6e1038a0d8bc4ab38aa9384c5a629a1d183" gracePeriod=2
Sep 16 02:25:25.520801 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.520776    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9h8tr"]
Sep 16 02:25:25.528959 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.526220    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xj6k8"]
Sep 16 02:25:25.528959 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.526694    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89648606-883a-4fbb-a7ad-b5546e49fb56" containerName="manager"
Sep 16 02:25:25.528959 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.526711    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="89648606-883a-4fbb-a7ad-b5546e49fb56" containerName="manager"
Sep 16 02:25:25.528959 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.526741    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8af27c2-d98c-4e47-a958-b8c61f8333b9" containerName="manager"
Sep 16 02:25:25.528959 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.526750    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8af27c2-d98c-4e47-a958-b8c61f8333b9" containerName="manager"
Sep 16 02:25:25.528959 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.526835    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="89648606-883a-4fbb-a7ad-b5546e49fb56" containerName="manager"
Sep 16 02:25:25.528959 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.526869    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8af27c2-d98c-4e47-a958-b8c61f8333b9" containerName="manager"
Sep 16 02:25:25.529361 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:25:25.529206    2581 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"c8af27c2-d98c-4e47-a958-b8c61f8333b9\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-9h8tr\": pods \"kuadrant-operator-controller-manager-76f8f686bf-9h8tr\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9h8tr"
Sep 16 02:25:25.531471 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.531453    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xj6k8"
Sep 16 02:25:25.533083 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.533059    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-fcf47"]
Sep 16 02:25:25.533275 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.533235    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fcf47" podUID="5b815f5f-7fa1-4fc7-b517-b367f569f988" containerName="manager" containerID="cri-o://5b5928a9f01a79eb67b726e76d5961e4f11ab3877214c8d08a66db675753d3c4" gracePeriod=2
Sep 16 02:25:25.534155 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:25:25.534123    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-9h8tr\" is forbidden: User \"system:node:ip-10-0-139-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-191.ec2.internal' and this object" podUID="c8af27c2-d98c-4e47-a958-b8c61f8333b9" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9h8tr"
Sep 16 02:25:25.542543 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.542518    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gfq2h"]
Sep 16 02:25:25.546107 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.546086    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gfq2h"
Sep 16 02:25:25.547209 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.547182    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xj6k8"]
Sep 16 02:25:25.551647 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.551625    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-fcf47"]
Sep 16 02:25:25.560420 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.560397    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-rl8pw"]
Sep 16 02:25:25.560955 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.560937    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b815f5f-7fa1-4fc7-b517-b367f569f988" containerName="manager"
Sep 16 02:25:25.561026 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.560958    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b815f5f-7fa1-4fc7-b517-b367f569f988" containerName="manager"
Sep 16 02:25:25.561087 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.561076    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b815f5f-7fa1-4fc7-b517-b367f569f988" containerName="manager"
Sep 16 02:25:25.564432 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.564407    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rl8pw"
Sep 16 02:25:25.565933 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.565910    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gfq2h"]
Sep 16 02:25:25.591462 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:25:25.591357    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-fcf47\" is forbidden: User \"system:node:ip-10-0-139-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-191.ec2.internal' and this object" podUID="5b815f5f-7fa1-4fc7-b517-b367f569f988" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fcf47"
Sep 16 02:25:25.593726 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:25:25.593700    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-9h8tr\" is forbidden: User \"system:node:ip-10-0-139-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-191.ec2.internal' and this object" podUID="c8af27c2-d98c-4e47-a958-b8c61f8333b9" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9h8tr"
Sep 16 02:25:25.594907 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.594887    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-rl8pw"]
Sep 16 02:25:25.698943 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.698913    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghct4\" (UniqueName: \"kubernetes.io/projected/1c50404d-bbb3-436c-8a11-6828296609d8-kube-api-access-ghct4\") pod \"limitador-operator-controller-manager-74495c69f8-rl8pw\" (UID: \"1c50404d-bbb3-436c-8a11-6828296609d8\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rl8pw"
Sep 16 02:25:25.698943 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.698945    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/777c6fb2-3046-4e67-9eea-f0662386c932-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gfq2h\" (UID: \"777c6fb2-3046-4e67-9eea-f0662386c932\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gfq2h"
Sep 16 02:25:25.699200 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.698963    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnc8p\" (UniqueName: \"kubernetes.io/projected/777c6fb2-3046-4e67-9eea-f0662386c932-kube-api-access-hnc8p\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gfq2h\" (UID: \"777c6fb2-3046-4e67-9eea-f0662386c932\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gfq2h"
Sep 16 02:25:25.699200 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.698992    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b15aed12-9df8-45c6-956c-9031df31d301-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-xj6k8\" (UID: \"b15aed12-9df8-45c6-956c-9031df31d301\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xj6k8"
Sep 16 02:25:25.699200 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.699014    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwmtx\" (UniqueName: \"kubernetes.io/projected/b15aed12-9df8-45c6-956c-9031df31d301-kube-api-access-lwmtx\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-xj6k8\" (UID: \"b15aed12-9df8-45c6-956c-9031df31d301\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xj6k8"
Sep 16 02:25:25.782347 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.782321    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9h8tr"
Sep 16 02:25:25.784201 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:25:25.784174    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-fcf47\" is forbidden: User \"system:node:ip-10-0-139-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-191.ec2.internal' and this object" podUID="5b815f5f-7fa1-4fc7-b517-b367f569f988" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fcf47"
Sep 16 02:25:25.784789 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.784773    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fcf47"
Sep 16 02:25:25.785776 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:25:25.785757    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-9h8tr\" is forbidden: User \"system:node:ip-10-0-139-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-191.ec2.internal' and this object" podUID="c8af27c2-d98c-4e47-a958-b8c61f8333b9" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9h8tr"
Sep 16 02:25:25.787252 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:25:25.787234    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-fcf47\" is forbidden: User \"system:node:ip-10-0-139-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-191.ec2.internal' and this object" podUID="5b815f5f-7fa1-4fc7-b517-b367f569f988" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fcf47"
Sep 16 02:25:25.788653 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:25:25.788637    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-9h8tr\" is forbidden: User \"system:node:ip-10-0-139-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-191.ec2.internal' and this object" podUID="c8af27c2-d98c-4e47-a958-b8c61f8333b9" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9h8tr"
Sep 16 02:25:25.800080 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.800048    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghct4\" (UniqueName: \"kubernetes.io/projected/1c50404d-bbb3-436c-8a11-6828296609d8-kube-api-access-ghct4\") pod \"limitador-operator-controller-manager-74495c69f8-rl8pw\" (UID: \"1c50404d-bbb3-436c-8a11-6828296609d8\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rl8pw"
Sep 16 02:25:25.800156 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.800094    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/777c6fb2-3046-4e67-9eea-f0662386c932-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gfq2h\" (UID: \"777c6fb2-3046-4e67-9eea-f0662386c932\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gfq2h"
Sep 16 02:25:25.800243 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.800218    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnc8p\" (UniqueName: \"kubernetes.io/projected/777c6fb2-3046-4e67-9eea-f0662386c932-kube-api-access-hnc8p\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gfq2h\" (UID: \"777c6fb2-3046-4e67-9eea-f0662386c932\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gfq2h"
Sep 16 02:25:25.800362 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.800292    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b15aed12-9df8-45c6-956c-9031df31d301-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-xj6k8\" (UID: \"b15aed12-9df8-45c6-956c-9031df31d301\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xj6k8"
Sep 16 02:25:25.800362 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.800332    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwmtx\" (UniqueName: \"kubernetes.io/projected/b15aed12-9df8-45c6-956c-9031df31d301-kube-api-access-lwmtx\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-xj6k8\" (UID: \"b15aed12-9df8-45c6-956c-9031df31d301\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xj6k8"
Sep 16 02:25:25.800468 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.800399    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/777c6fb2-3046-4e67-9eea-f0662386c932-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gfq2h\" (UID: \"777c6fb2-3046-4e67-9eea-f0662386c932\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gfq2h"
Sep 16 02:25:25.800620 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.800602    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b15aed12-9df8-45c6-956c-9031df31d301-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-xj6k8\" (UID: \"b15aed12-9df8-45c6-956c-9031df31d301\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xj6k8"
Sep 16 02:25:25.808051 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.808028    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghct4\" (UniqueName: \"kubernetes.io/projected/1c50404d-bbb3-436c-8a11-6828296609d8-kube-api-access-ghct4\") pod \"limitador-operator-controller-manager-74495c69f8-rl8pw\" (UID: \"1c50404d-bbb3-436c-8a11-6828296609d8\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rl8pw"
Sep 16 02:25:25.808363 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.808344    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnc8p\" (UniqueName: \"kubernetes.io/projected/777c6fb2-3046-4e67-9eea-f0662386c932-kube-api-access-hnc8p\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gfq2h\" (UID: \"777c6fb2-3046-4e67-9eea-f0662386c932\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gfq2h"
Sep 16 02:25:25.808405 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.808363    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwmtx\" (UniqueName: \"kubernetes.io/projected/b15aed12-9df8-45c6-956c-9031df31d301-kube-api-access-lwmtx\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-xj6k8\" (UID: \"b15aed12-9df8-45c6-956c-9031df31d301\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xj6k8"
Sep 16 02:25:25.901722 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.901643    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8af27c2-d98c-4e47-a958-b8c61f8333b9-extensions-socket-volume\") pod \"c8af27c2-d98c-4e47-a958-b8c61f8333b9\" (UID: \"c8af27c2-d98c-4e47-a958-b8c61f8333b9\") "
Sep 16 02:25:25.901722 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.901720    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kq9tz\" (UniqueName: \"kubernetes.io/projected/5b815f5f-7fa1-4fc7-b517-b367f569f988-kube-api-access-kq9tz\") pod \"5b815f5f-7fa1-4fc7-b517-b367f569f988\" (UID: \"5b815f5f-7fa1-4fc7-b517-b367f569f988\") "
Sep 16 02:25:25.901895 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.901780    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6vgw\" (UniqueName: \"kubernetes.io/projected/c8af27c2-d98c-4e47-a958-b8c61f8333b9-kube-api-access-h6vgw\") pod \"c8af27c2-d98c-4e47-a958-b8c61f8333b9\" (UID: \"c8af27c2-d98c-4e47-a958-b8c61f8333b9\") "
Sep 16 02:25:25.902072 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.902048    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8af27c2-d98c-4e47-a958-b8c61f8333b9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c8af27c2-d98c-4e47-a958-b8c61f8333b9" (UID: "c8af27c2-d98c-4e47-a958-b8c61f8333b9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:25:25.903943 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.903912    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8af27c2-d98c-4e47-a958-b8c61f8333b9-kube-api-access-h6vgw" (OuterVolumeSpecName: "kube-api-access-h6vgw") pod "c8af27c2-d98c-4e47-a958-b8c61f8333b9" (UID: "c8af27c2-d98c-4e47-a958-b8c61f8333b9"). InnerVolumeSpecName "kube-api-access-h6vgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:25:25.904018 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.903948    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b815f5f-7fa1-4fc7-b517-b367f569f988-kube-api-access-kq9tz" (OuterVolumeSpecName: "kube-api-access-kq9tz") pod "5b815f5f-7fa1-4fc7-b517-b367f569f988" (UID: "5b815f5f-7fa1-4fc7-b517-b367f569f988"). InnerVolumeSpecName "kube-api-access-kq9tz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:25:25.937223 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.937203    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xj6k8"
Sep 16 02:25:25.946121 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.946103    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gfq2h"
Sep 16 02:25:25.952948 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:25.952931    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rl8pw"
Sep 16 02:25:26.003590 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:26.002915    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8af27c2-d98c-4e47-a958-b8c61f8333b9-extensions-socket-volume\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:25:26.003590 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:26.002944    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kq9tz\" (UniqueName: \"kubernetes.io/projected/5b815f5f-7fa1-4fc7-b517-b367f569f988-kube-api-access-kq9tz\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:25:26.003590 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:26.002960    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6vgw\" (UniqueName: \"kubernetes.io/projected/c8af27c2-d98c-4e47-a958-b8c61f8333b9-kube-api-access-h6vgw\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:25:26.215920 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:26.215896    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xj6k8"]
Sep 16 02:25:26.217139 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:25:26.217113    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb15aed12_9df8_45c6_956c_9031df31d301.slice/crio-92da808e6de11373a693c7f46b0ba016874588f90e7cc4722fd85f22e2a4c22f WatchSource:0}: Error finding container 92da808e6de11373a693c7f46b0ba016874588f90e7cc4722fd85f22e2a4c22f: Status 404 returned error can't find the container with id 92da808e6de11373a693c7f46b0ba016874588f90e7cc4722fd85f22e2a4c22f
Sep 16 02:25:26.234395 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:26.234375    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gfq2h"]
Sep 16 02:25:26.235503 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:25:26.235479    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod777c6fb2_3046_4e67_9eea_f0662386c932.slice/crio-3b81e83ccfd81f50397f9f0d7eea6cb8502ae5fcd6dd294495c135fdaf1ee1f4 WatchSource:0}: Error finding container 3b81e83ccfd81f50397f9f0d7eea6cb8502ae5fcd6dd294495c135fdaf1ee1f4: Status 404 returned error can't find the container with id 3b81e83ccfd81f50397f9f0d7eea6cb8502ae5fcd6dd294495c135fdaf1ee1f4
Sep 16 02:25:26.249619 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:26.249600    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-rl8pw"]
Sep 16 02:25:26.251721 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:25:26.251696    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c50404d_bbb3_436c_8a11_6828296609d8.slice/crio-54dd55d5229680655e09aceb7832e19e717affd0ee4ec347675f4c9d77c21cd2 WatchSource:0}: Error finding container 54dd55d5229680655e09aceb7832e19e717affd0ee4ec347675f4c9d77c21cd2: Status 404 returned error can't find the container with id 54dd55d5229680655e09aceb7832e19e717affd0ee4ec347675f4c9d77c21cd2
Sep 16 02:25:26.340212 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:26.340180    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gfq2h" event={"ID":"777c6fb2-3046-4e67-9eea-f0662386c932","Type":"ContainerStarted","Data":"4fc2d51d6f9cb31af779e395e73ec358ae260d1b8c29fa00bc6ac6ca461390f0"}
Sep 16 02:25:26.340627 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:26.340235    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gfq2h"
Sep 16 02:25:26.340627 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:26.340258    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gfq2h" event={"ID":"777c6fb2-3046-4e67-9eea-f0662386c932","Type":"ContainerStarted","Data":"3b81e83ccfd81f50397f9f0d7eea6cb8502ae5fcd6dd294495c135fdaf1ee1f4"}
Sep 16 02:25:26.341777 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:26.341757    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rl8pw" event={"ID":"1c50404d-bbb3-436c-8a11-6828296609d8","Type":"ContainerStarted","Data":"485053b63b57cd4ff0af2bfd3d0d942b8527d762c723f1063d04796d55c1236c"}
Sep 16 02:25:26.341903 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:26.341791    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rl8pw" event={"ID":"1c50404d-bbb3-436c-8a11-6828296609d8","Type":"ContainerStarted","Data":"54dd55d5229680655e09aceb7832e19e717affd0ee4ec347675f4c9d77c21cd2"}
Sep 16 02:25:26.341903 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:26.341824    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rl8pw"
Sep 16 02:25:26.342515 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:25:26.342483    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-fcf47\" is forbidden: User \"system:node:ip-10-0-139-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-191.ec2.internal' and this object" podUID="5b815f5f-7fa1-4fc7-b517-b367f569f988" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fcf47"
Sep 16 02:25:26.343183 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:26.343165    2581 generic.go:356] "Generic (PLEG): container finished" podID="c8af27c2-d98c-4e47-a958-b8c61f8333b9" containerID="b531de0a2a0e83c973cb77d71f5af6e1038a0d8bc4ab38aa9384c5a629a1d183" exitCode=0
Sep 16 02:25:26.343260 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:26.343203    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9h8tr"
Sep 16 02:25:26.343260 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:26.343244    2581 scope.go:117] "RemoveContainer" containerID="b531de0a2a0e83c973cb77d71f5af6e1038a0d8bc4ab38aa9384c5a629a1d183"
Sep 16 02:25:26.344652 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:26.344631    2581 generic.go:356] "Generic (PLEG): container finished" podID="5b815f5f-7fa1-4fc7-b517-b367f569f988" containerID="5b5928a9f01a79eb67b726e76d5961e4f11ab3877214c8d08a66db675753d3c4" exitCode=0
Sep 16 02:25:26.344821 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:26.344682    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fcf47"
Sep 16 02:25:26.346081 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:25:26.346042    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-9h8tr\" is forbidden: User \"system:node:ip-10-0-139-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-191.ec2.internal' and this object" podUID="c8af27c2-d98c-4e47-a958-b8c61f8333b9" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9h8tr"
Sep 16 02:25:26.346620 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:26.346503    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xj6k8" event={"ID":"b15aed12-9df8-45c6-956c-9031df31d301","Type":"ContainerStarted","Data":"90280b4b74be3db0f38acc3ca63d648dce10da31166495c66b5e15c66c116499"}
Sep 16 02:25:26.346620 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:26.346566    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xj6k8"
Sep 16 02:25:26.346620 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:26.346592    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xj6k8" event={"ID":"b15aed12-9df8-45c6-956c-9031df31d301","Type":"ContainerStarted","Data":"92da808e6de11373a693c7f46b0ba016874588f90e7cc4722fd85f22e2a4c22f"}
Sep 16 02:25:26.346915 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:25:26.346627    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lzv7p" container="manager"
Sep 16 02:25:26.352937 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:26.352921    2581 scope.go:117] "RemoveContainer" containerID="b531de0a2a0e83c973cb77d71f5af6e1038a0d8bc4ab38aa9384c5a629a1d183"
Sep 16 02:25:26.353212 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:25:26.353195    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b531de0a2a0e83c973cb77d71f5af6e1038a0d8bc4ab38aa9384c5a629a1d183\": container with ID starting with b531de0a2a0e83c973cb77d71f5af6e1038a0d8bc4ab38aa9384c5a629a1d183 not found: ID does not exist" containerID="b531de0a2a0e83c973cb77d71f5af6e1038a0d8bc4ab38aa9384c5a629a1d183"
Sep 16 02:25:26.353266 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:26.353219    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b531de0a2a0e83c973cb77d71f5af6e1038a0d8bc4ab38aa9384c5a629a1d183"} err="failed to get container status \"b531de0a2a0e83c973cb77d71f5af6e1038a0d8bc4ab38aa9384c5a629a1d183\": rpc error: code = NotFound desc = could not find container \"b531de0a2a0e83c973cb77d71f5af6e1038a0d8bc4ab38aa9384c5a629a1d183\": container with ID starting with b531de0a2a0e83c973cb77d71f5af6e1038a0d8bc4ab38aa9384c5a629a1d183 not found: ID does not exist"
Sep 16 02:25:26.353266 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:26.353233    2581 scope.go:117] "RemoveContainer" containerID="5b5928a9f01a79eb67b726e76d5961e4f11ab3877214c8d08a66db675753d3c4"
Sep 16 02:25:26.361692 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:26.361554    2581 scope.go:117] "RemoveContainer" containerID="5b5928a9f01a79eb67b726e76d5961e4f11ab3877214c8d08a66db675753d3c4"
Sep 16 02:25:26.361825 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:25:26.361807    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b5928a9f01a79eb67b726e76d5961e4f11ab3877214c8d08a66db675753d3c4\": container with ID starting with 5b5928a9f01a79eb67b726e76d5961e4f11ab3877214c8d08a66db675753d3c4 not found: ID does not exist" containerID="5b5928a9f01a79eb67b726e76d5961e4f11ab3877214c8d08a66db675753d3c4"
Sep 16 02:25:26.361919 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:26.361833    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b5928a9f01a79eb67b726e76d5961e4f11ab3877214c8d08a66db675753d3c4"} err="failed to get container status \"5b5928a9f01a79eb67b726e76d5961e4f11ab3877214c8d08a66db675753d3c4\": rpc error: code = NotFound desc = could not find container \"5b5928a9f01a79eb67b726e76d5961e4f11ab3877214c8d08a66db675753d3c4\": container with ID starting with 5b5928a9f01a79eb67b726e76d5961e4f11ab3877214c8d08a66db675753d3c4 not found: ID does not exist"
Sep 16 02:25:26.367801 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:26.367761    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gfq2h" podStartSLOduration=1.367749048 podStartE2EDuration="1.367749048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:25:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:25:26.36598653 +0000 UTC m=+731.458168516" watchObservedRunningTime="2026-09-16 02:25:26.367749048 +0000 UTC m=+731.459931021"
Sep 16 02:25:26.368138 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:25:26.368116    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-fcf47\" is forbidden: User \"system:node:ip-10-0-139-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-191.ec2.internal' and this object" podUID="5b815f5f-7fa1-4fc7-b517-b367f569f988" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fcf47"
Sep 16 02:25:26.369834 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:25:26.369815    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-9h8tr\" is forbidden: User \"system:node:ip-10-0-139-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-191.ec2.internal' and this object" podUID="c8af27c2-d98c-4e47-a958-b8c61f8333b9" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9h8tr"
Sep 16 02:25:26.390099 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:26.390059    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xj6k8" podStartSLOduration=1.390047702 podStartE2EDuration="1.390047702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:25:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:25:26.387937739 +0000 UTC m=+731.480119712" watchObservedRunningTime="2026-09-16 02:25:26.390047702 +0000 UTC m=+731.482229674"
Sep 16 02:25:26.406874 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:26.406806    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rl8pw" podStartSLOduration=1.406796015 podStartE2EDuration="1.406796015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:25:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:25:26.406403625 +0000 UTC m=+731.498585603" watchObservedRunningTime="2026-09-16 02:25:26.406796015 +0000 UTC m=+731.498977986"
Sep 16 02:25:26.408144 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:25:26.408121    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-lzv7p\" is forbidden: User \"system:node:ip-10-0-139-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-191.ec2.internal' and this object" podUID="89648606-883a-4fbb-a7ad-b5546e49fb56" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lzv7p"
Sep 16 02:25:27.355864 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:27.355818    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lzv7p" podUID="89648606-883a-4fbb-a7ad-b5546e49fb56" containerName="manager" containerID="cri-o://b242f247a3f5ca47e02ee42242683e13a8b011c624effb9ed1f019b0c65f68b2" gracePeriod=2
Sep 16 02:25:27.357955 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:25:27.357926    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-fcf47\" is forbidden: User \"system:node:ip-10-0-139-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-191.ec2.internal' and this object" podUID="5b815f5f-7fa1-4fc7-b517-b367f569f988" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fcf47"
Sep 16 02:25:27.359619 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:25:27.359592    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-9h8tr\" is forbidden: User \"system:node:ip-10-0-139-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-191.ec2.internal' and this object" podUID="c8af27c2-d98c-4e47-a958-b8c61f8333b9" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-9h8tr"
Sep 16 02:25:27.361345 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:25:27.361315    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-lzv7p\" is forbidden: User \"system:node:ip-10-0-139-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-191.ec2.internal' and this object" podUID="89648606-883a-4fbb-a7ad-b5546e49fb56" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lzv7p"
Sep 16 02:25:27.382306 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:27.382283    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b815f5f-7fa1-4fc7-b517-b367f569f988" path="/var/lib/kubelet/pods/5b815f5f-7fa1-4fc7-b517-b367f569f988/volumes"
Sep 16 02:25:27.382652 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:27.382634    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8af27c2-d98c-4e47-a958-b8c61f8333b9" path="/var/lib/kubelet/pods/c8af27c2-d98c-4e47-a958-b8c61f8333b9/volumes"
Sep 16 02:25:27.595005 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:27.594983    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lzv7p"
Sep 16 02:25:27.717386 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:27.717329    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89648606-883a-4fbb-a7ad-b5546e49fb56-extensions-socket-volume\") pod \"89648606-883a-4fbb-a7ad-b5546e49fb56\" (UID: \"89648606-883a-4fbb-a7ad-b5546e49fb56\") "
Sep 16 02:25:27.717386 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:27.717374    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95q74\" (UniqueName: \"kubernetes.io/projected/89648606-883a-4fbb-a7ad-b5546e49fb56-kube-api-access-95q74\") pod \"89648606-883a-4fbb-a7ad-b5546e49fb56\" (UID: \"89648606-883a-4fbb-a7ad-b5546e49fb56\") "
Sep 16 02:25:27.717720 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:27.717691    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89648606-883a-4fbb-a7ad-b5546e49fb56-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "89648606-883a-4fbb-a7ad-b5546e49fb56" (UID: "89648606-883a-4fbb-a7ad-b5546e49fb56"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:25:27.719417 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:27.719398    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89648606-883a-4fbb-a7ad-b5546e49fb56-kube-api-access-95q74" (OuterVolumeSpecName: "kube-api-access-95q74") pod "89648606-883a-4fbb-a7ad-b5546e49fb56" (UID: "89648606-883a-4fbb-a7ad-b5546e49fb56"). InnerVolumeSpecName "kube-api-access-95q74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:25:27.817803 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:27.817781    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95q74\" (UniqueName: \"kubernetes.io/projected/89648606-883a-4fbb-a7ad-b5546e49fb56-kube-api-access-95q74\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:25:27.817803 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:27.817800    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89648606-883a-4fbb-a7ad-b5546e49fb56-extensions-socket-volume\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:25:28.362680 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:28.362645    2581 generic.go:356] "Generic (PLEG): container finished" podID="89648606-883a-4fbb-a7ad-b5546e49fb56" containerID="b242f247a3f5ca47e02ee42242683e13a8b011c624effb9ed1f019b0c65f68b2" exitCode=0
Sep 16 02:25:28.363119 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:28.362705    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lzv7p"
Sep 16 02:25:28.363119 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:28.362743    2581 scope.go:117] "RemoveContainer" containerID="b242f247a3f5ca47e02ee42242683e13a8b011c624effb9ed1f019b0c65f68b2"
Sep 16 02:25:28.375482 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:28.375463    2581 scope.go:117] "RemoveContainer" containerID="b242f247a3f5ca47e02ee42242683e13a8b011c624effb9ed1f019b0c65f68b2"
Sep 16 02:25:28.375829 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:25:28.375806    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b242f247a3f5ca47e02ee42242683e13a8b011c624effb9ed1f019b0c65f68b2\": container with ID starting with b242f247a3f5ca47e02ee42242683e13a8b011c624effb9ed1f019b0c65f68b2 not found: ID does not exist" containerID="b242f247a3f5ca47e02ee42242683e13a8b011c624effb9ed1f019b0c65f68b2"
Sep 16 02:25:28.375905 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:28.375841    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b242f247a3f5ca47e02ee42242683e13a8b011c624effb9ed1f019b0c65f68b2"} err="failed to get container status \"b242f247a3f5ca47e02ee42242683e13a8b011c624effb9ed1f019b0c65f68b2\": rpc error: code = NotFound desc = could not find container \"b242f247a3f5ca47e02ee42242683e13a8b011c624effb9ed1f019b0c65f68b2\": container with ID starting with b242f247a3f5ca47e02ee42242683e13a8b011c624effb9ed1f019b0c65f68b2 not found: ID does not exist"
Sep 16 02:25:28.376146 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:25:28.376125    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-lzv7p\" is forbidden: User \"system:node:ip-10-0-139-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-191.ec2.internal' and this object" podUID="89648606-883a-4fbb-a7ad-b5546e49fb56" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-lzv7p"
Sep 16 02:25:29.381973 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:29.381941    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89648606-883a-4fbb-a7ad-b5546e49fb56" path="/var/lib/kubelet/pods/89648606-883a-4fbb-a7ad-b5546e49fb56/volumes"
Sep 16 02:25:37.357720 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:37.357694    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xj6k8"
Sep 16 02:25:37.358104 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:37.357756    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gfq2h"
Sep 16 02:25:37.358104 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:37.357786    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rl8pw"
Sep 16 02:25:37.434484 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:37.434448    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gfq2h"]
Sep 16 02:25:37.434652 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:37.434633    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gfq2h" podUID="777c6fb2-3046-4e67-9eea-f0662386c932" containerName="manager" containerID="cri-o://4fc2d51d6f9cb31af779e395e73ec358ae260d1b8c29fa00bc6ac6ca461390f0" gracePeriod=10
Sep 16 02:25:37.675598 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:37.675577    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gfq2h"
Sep 16 02:25:37.694861 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:37.694806    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/777c6fb2-3046-4e67-9eea-f0662386c932-extensions-socket-volume\") pod \"777c6fb2-3046-4e67-9eea-f0662386c932\" (UID: \"777c6fb2-3046-4e67-9eea-f0662386c932\") "
Sep 16 02:25:37.694985 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:37.694894    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hnc8p\" (UniqueName: \"kubernetes.io/projected/777c6fb2-3046-4e67-9eea-f0662386c932-kube-api-access-hnc8p\") pod \"777c6fb2-3046-4e67-9eea-f0662386c932\" (UID: \"777c6fb2-3046-4e67-9eea-f0662386c932\") "
Sep 16 02:25:37.695275 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:37.695242    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/777c6fb2-3046-4e67-9eea-f0662386c932-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "777c6fb2-3046-4e67-9eea-f0662386c932" (UID: "777c6fb2-3046-4e67-9eea-f0662386c932"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:25:37.697317 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:37.697293    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/777c6fb2-3046-4e67-9eea-f0662386c932-kube-api-access-hnc8p" (OuterVolumeSpecName: "kube-api-access-hnc8p") pod "777c6fb2-3046-4e67-9eea-f0662386c932" (UID: "777c6fb2-3046-4e67-9eea-f0662386c932"). InnerVolumeSpecName "kube-api-access-hnc8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:25:37.796193 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:37.796165    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/777c6fb2-3046-4e67-9eea-f0662386c932-extensions-socket-volume\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:25:37.796193 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:37.796188    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnc8p\" (UniqueName: \"kubernetes.io/projected/777c6fb2-3046-4e67-9eea-f0662386c932-kube-api-access-hnc8p\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:25:38.057073 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:38.057043    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lz9l5"]
Sep 16 02:25:38.057408 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:38.057397    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="777c6fb2-3046-4e67-9eea-f0662386c932" containerName="manager"
Sep 16 02:25:38.057451 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:38.057410    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="777c6fb2-3046-4e67-9eea-f0662386c932" containerName="manager"
Sep 16 02:25:38.057484 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:38.057477    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="777c6fb2-3046-4e67-9eea-f0662386c932" containerName="manager"
Sep 16 02:25:38.059427 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:38.059413    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lz9l5"
Sep 16 02:25:38.088374 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:38.088350    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lz9l5"]
Sep 16 02:25:38.098267 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:38.098244    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk56c\" (UniqueName: \"kubernetes.io/projected/780a1810-d799-416f-b2dc-1dfa7a0bf830-kube-api-access-nk56c\") pod \"kuadrant-operator-controller-manager-5769f99d9f-lz9l5\" (UID: \"780a1810-d799-416f-b2dc-1dfa7a0bf830\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lz9l5"
Sep 16 02:25:38.098366 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:38.098299    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/780a1810-d799-416f-b2dc-1dfa7a0bf830-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-lz9l5\" (UID: \"780a1810-d799-416f-b2dc-1dfa7a0bf830\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lz9l5"
Sep 16 02:25:38.199295 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:38.199273    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk56c\" (UniqueName: \"kubernetes.io/projected/780a1810-d799-416f-b2dc-1dfa7a0bf830-kube-api-access-nk56c\") pod \"kuadrant-operator-controller-manager-5769f99d9f-lz9l5\" (UID: \"780a1810-d799-416f-b2dc-1dfa7a0bf830\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lz9l5"
Sep 16 02:25:38.199437 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:38.199318    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/780a1810-d799-416f-b2dc-1dfa7a0bf830-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-lz9l5\" (UID: \"780a1810-d799-416f-b2dc-1dfa7a0bf830\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lz9l5"
Sep 16 02:25:38.199926 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:38.199900    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/780a1810-d799-416f-b2dc-1dfa7a0bf830-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-lz9l5\" (UID: \"780a1810-d799-416f-b2dc-1dfa7a0bf830\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lz9l5"
Sep 16 02:25:38.209814 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:38.209790    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk56c\" (UniqueName: \"kubernetes.io/projected/780a1810-d799-416f-b2dc-1dfa7a0bf830-kube-api-access-nk56c\") pod \"kuadrant-operator-controller-manager-5769f99d9f-lz9l5\" (UID: \"780a1810-d799-416f-b2dc-1dfa7a0bf830\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lz9l5"
Sep 16 02:25:38.368374 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:38.368301    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lz9l5"
Sep 16 02:25:38.424008 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:38.423909    2581 generic.go:356] "Generic (PLEG): container finished" podID="777c6fb2-3046-4e67-9eea-f0662386c932" containerID="4fc2d51d6f9cb31af779e395e73ec358ae260d1b8c29fa00bc6ac6ca461390f0" exitCode=0
Sep 16 02:25:38.424008 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:38.423977    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gfq2h" event={"ID":"777c6fb2-3046-4e67-9eea-f0662386c932","Type":"ContainerDied","Data":"4fc2d51d6f9cb31af779e395e73ec358ae260d1b8c29fa00bc6ac6ca461390f0"}
Sep 16 02:25:38.424008 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:38.423987    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gfq2h"
Sep 16 02:25:38.424251 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:38.424032    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gfq2h" event={"ID":"777c6fb2-3046-4e67-9eea-f0662386c932","Type":"ContainerDied","Data":"3b81e83ccfd81f50397f9f0d7eea6cb8502ae5fcd6dd294495c135fdaf1ee1f4"}
Sep 16 02:25:38.424251 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:38.424061    2581 scope.go:117] "RemoveContainer" containerID="4fc2d51d6f9cb31af779e395e73ec358ae260d1b8c29fa00bc6ac6ca461390f0"
Sep 16 02:25:38.436439 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:38.436247    2581 scope.go:117] "RemoveContainer" containerID="4fc2d51d6f9cb31af779e395e73ec358ae260d1b8c29fa00bc6ac6ca461390f0"
Sep 16 02:25:38.436533 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:25:38.436506    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fc2d51d6f9cb31af779e395e73ec358ae260d1b8c29fa00bc6ac6ca461390f0\": container with ID starting with 4fc2d51d6f9cb31af779e395e73ec358ae260d1b8c29fa00bc6ac6ca461390f0 not found: ID does not exist" containerID="4fc2d51d6f9cb31af779e395e73ec358ae260d1b8c29fa00bc6ac6ca461390f0"
Sep 16 02:25:38.436594 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:38.436547    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fc2d51d6f9cb31af779e395e73ec358ae260d1b8c29fa00bc6ac6ca461390f0"} err="failed to get container status \"4fc2d51d6f9cb31af779e395e73ec358ae260d1b8c29fa00bc6ac6ca461390f0\": rpc error: code = NotFound desc = could not find container \"4fc2d51d6f9cb31af779e395e73ec358ae260d1b8c29fa00bc6ac6ca461390f0\": container with ID starting with 4fc2d51d6f9cb31af779e395e73ec358ae260d1b8c29fa00bc6ac6ca461390f0 not found: ID does not exist"
Sep 16 02:25:38.456680 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:38.456658    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gfq2h"]
Sep 16 02:25:38.462554 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:38.462533    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gfq2h"]
Sep 16 02:25:38.638240 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:38.638221    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lz9l5"]
Sep 16 02:25:38.639955 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:25:38.639926    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod780a1810_d799_416f_b2dc_1dfa7a0bf830.slice/crio-990fec78d9266ddcc16ec126387626ac5ec7130e420a821a1ac82e697f34d7aa WatchSource:0}: Error finding container 990fec78d9266ddcc16ec126387626ac5ec7130e420a821a1ac82e697f34d7aa: Status 404 returned error can't find the container with id 990fec78d9266ddcc16ec126387626ac5ec7130e420a821a1ac82e697f34d7aa
Sep 16 02:25:39.382319 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:39.382288    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="777c6fb2-3046-4e67-9eea-f0662386c932" path="/var/lib/kubelet/pods/777c6fb2-3046-4e67-9eea-f0662386c932/volumes"
Sep 16 02:25:39.433779 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:39.433743    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lz9l5" event={"ID":"780a1810-d799-416f-b2dc-1dfa7a0bf830","Type":"ContainerStarted","Data":"34602c91c4b20c10db8e688a06d765d50075f1a5265fd7f574d77356a62a06c5"}
Sep 16 02:25:39.433946 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:39.433804    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lz9l5" event={"ID":"780a1810-d799-416f-b2dc-1dfa7a0bf830","Type":"ContainerStarted","Data":"990fec78d9266ddcc16ec126387626ac5ec7130e420a821a1ac82e697f34d7aa"}
Sep 16 02:25:39.433946 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:39.433898    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lz9l5"
Sep 16 02:25:39.452590 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:39.452550    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lz9l5" podStartSLOduration=1.452533906 podStartE2EDuration="1.452533906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:25:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:25:39.45166695 +0000 UTC m=+744.543848921" watchObservedRunningTime="2026-09-16 02:25:39.452533906 +0000 UTC m=+744.544715886"
Sep 16 02:25:50.441134 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:50.441102    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lz9l5"
Sep 16 02:25:50.493177 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:50.493145    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xj6k8"]
Sep 16 02:25:50.493376 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:50.493335    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xj6k8" podUID="b15aed12-9df8-45c6-956c-9031df31d301" containerName="manager" containerID="cri-o://90280b4b74be3db0f38acc3ca63d648dce10da31166495c66b5e15c66c116499" gracePeriod=10
Sep 16 02:25:50.728957 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:50.728934    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xj6k8"
Sep 16 02:25:50.793566 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:50.793536    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwmtx\" (UniqueName: \"kubernetes.io/projected/b15aed12-9df8-45c6-956c-9031df31d301-kube-api-access-lwmtx\") pod \"b15aed12-9df8-45c6-956c-9031df31d301\" (UID: \"b15aed12-9df8-45c6-956c-9031df31d301\") "
Sep 16 02:25:50.793735 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:50.793635    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b15aed12-9df8-45c6-956c-9031df31d301-extensions-socket-volume\") pod \"b15aed12-9df8-45c6-956c-9031df31d301\" (UID: \"b15aed12-9df8-45c6-956c-9031df31d301\") "
Sep 16 02:25:50.794038 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:50.794014    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b15aed12-9df8-45c6-956c-9031df31d301-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b15aed12-9df8-45c6-956c-9031df31d301" (UID: "b15aed12-9df8-45c6-956c-9031df31d301"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:25:50.795783 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:50.795760    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b15aed12-9df8-45c6-956c-9031df31d301-kube-api-access-lwmtx" (OuterVolumeSpecName: "kube-api-access-lwmtx") pod "b15aed12-9df8-45c6-956c-9031df31d301" (UID: "b15aed12-9df8-45c6-956c-9031df31d301"). InnerVolumeSpecName "kube-api-access-lwmtx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:25:50.894729 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:50.894686    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b15aed12-9df8-45c6-956c-9031df31d301-extensions-socket-volume\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:25:50.894729 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:50.894723    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwmtx\" (UniqueName: \"kubernetes.io/projected/b15aed12-9df8-45c6-956c-9031df31d301-kube-api-access-lwmtx\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:25:51.508761 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:51.508730    2581 generic.go:356] "Generic (PLEG): container finished" podID="b15aed12-9df8-45c6-956c-9031df31d301" containerID="90280b4b74be3db0f38acc3ca63d648dce10da31166495c66b5e15c66c116499" exitCode=0
Sep 16 02:25:51.509228 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:51.508791    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xj6k8"
Sep 16 02:25:51.509228 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:51.508801    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xj6k8" event={"ID":"b15aed12-9df8-45c6-956c-9031df31d301","Type":"ContainerDied","Data":"90280b4b74be3db0f38acc3ca63d648dce10da31166495c66b5e15c66c116499"}
Sep 16 02:25:51.509228 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:51.508912    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xj6k8" event={"ID":"b15aed12-9df8-45c6-956c-9031df31d301","Type":"ContainerDied","Data":"92da808e6de11373a693c7f46b0ba016874588f90e7cc4722fd85f22e2a4c22f"}
Sep 16 02:25:51.509228 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:51.508943    2581 scope.go:117] "RemoveContainer" containerID="90280b4b74be3db0f38acc3ca63d648dce10da31166495c66b5e15c66c116499"
Sep 16 02:25:51.518151 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:51.518134    2581 scope.go:117] "RemoveContainer" containerID="90280b4b74be3db0f38acc3ca63d648dce10da31166495c66b5e15c66c116499"
Sep 16 02:25:51.518410 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:25:51.518395    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90280b4b74be3db0f38acc3ca63d648dce10da31166495c66b5e15c66c116499\": container with ID starting with 90280b4b74be3db0f38acc3ca63d648dce10da31166495c66b5e15c66c116499 not found: ID does not exist" containerID="90280b4b74be3db0f38acc3ca63d648dce10da31166495c66b5e15c66c116499"
Sep 16 02:25:51.518464 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:51.518420    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90280b4b74be3db0f38acc3ca63d648dce10da31166495c66b5e15c66c116499"} err="failed to get container status \"90280b4b74be3db0f38acc3ca63d648dce10da31166495c66b5e15c66c116499\": rpc error: code = NotFound desc = could not find container \"90280b4b74be3db0f38acc3ca63d648dce10da31166495c66b5e15c66c116499\": container with ID starting with 90280b4b74be3db0f38acc3ca63d648dce10da31166495c66b5e15c66c116499 not found: ID does not exist"
Sep 16 02:25:51.529232 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:51.529209    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xj6k8"]
Sep 16 02:25:51.535085 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:51.535061    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-xj6k8"]
Sep 16 02:25:53.382862 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:25:53.382821    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b15aed12-9df8-45c6-956c-9031df31d301" path="/var/lib/kubelet/pods/b15aed12-9df8-45c6-956c-9031df31d301/volumes"
Sep 16 02:26:09.023504 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:09.023469    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:26:09.024197 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:09.023813    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b15aed12-9df8-45c6-956c-9031df31d301" containerName="manager"
Sep 16 02:26:09.024197 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:09.023824    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b15aed12-9df8-45c6-956c-9031df31d301" containerName="manager"
Sep 16 02:26:09.024197 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:09.023908    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b15aed12-9df8-45c6-956c-9031df31d301" containerName="manager"
Sep 16 02:26:09.047345 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:09.047314    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:26:09.047501 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:09.047416    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"
Sep 16 02:26:09.049518 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:09.049491    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 16 02:26:09.051127 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:09.051101    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:26:09.139794 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:09.139760    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7e10dfa3-de5f-4660-848a-3e26afec62f2-config-file\") pod \"limitador-limitador-84994f7ffc-w6lwt\" (UID: \"7e10dfa3-de5f-4660-848a-3e26afec62f2\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"
Sep 16 02:26:09.139968 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:09.139796    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rzjr\" (UniqueName: \"kubernetes.io/projected/7e10dfa3-de5f-4660-848a-3e26afec62f2-kube-api-access-8rzjr\") pod \"limitador-limitador-84994f7ffc-w6lwt\" (UID: \"7e10dfa3-de5f-4660-848a-3e26afec62f2\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"
Sep 16 02:26:09.241185 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:09.241150    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7e10dfa3-de5f-4660-848a-3e26afec62f2-config-file\") pod \"limitador-limitador-84994f7ffc-w6lwt\" (UID: \"7e10dfa3-de5f-4660-848a-3e26afec62f2\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"
Sep 16 02:26:09.241336 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:09.241192    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rzjr\" (UniqueName: \"kubernetes.io/projected/7e10dfa3-de5f-4660-848a-3e26afec62f2-kube-api-access-8rzjr\") pod \"limitador-limitador-84994f7ffc-w6lwt\" (UID: \"7e10dfa3-de5f-4660-848a-3e26afec62f2\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"
Sep 16 02:26:09.241761 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:09.241742    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7e10dfa3-de5f-4660-848a-3e26afec62f2-config-file\") pod \"limitador-limitador-84994f7ffc-w6lwt\" (UID: \"7e10dfa3-de5f-4660-848a-3e26afec62f2\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"
Sep 16 02:26:09.249449 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:09.249426    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rzjr\" (UniqueName: \"kubernetes.io/projected/7e10dfa3-de5f-4660-848a-3e26afec62f2-kube-api-access-8rzjr\") pod \"limitador-limitador-84994f7ffc-w6lwt\" (UID: \"7e10dfa3-de5f-4660-848a-3e26afec62f2\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"
Sep 16 02:26:09.362515 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:09.362486    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"
Sep 16 02:26:09.634454 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:09.634431    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:26:09.636254 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:26:09.636224    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e10dfa3_de5f_4660_848a_3e26afec62f2.slice/crio-36f1011fbb032827a67525525962e637160f9c971ebfeca3a3ef8b89a5e4f8c2 WatchSource:0}: Error finding container 36f1011fbb032827a67525525962e637160f9c971ebfeca3a3ef8b89a5e4f8c2: Status 404 returned error can't find the container with id 36f1011fbb032827a67525525962e637160f9c971ebfeca3a3ef8b89a5e4f8c2
Sep 16 02:26:09.654299 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:09.654270    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-l824r"]
Sep 16 02:26:09.657905 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:09.657888    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-l824r"
Sep 16 02:26:09.660108 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:09.660086    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7xl4z\""
Sep 16 02:26:09.663216 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:09.663194    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-l824r"]
Sep 16 02:26:09.744831 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:09.744798    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nknwz\" (UniqueName: \"kubernetes.io/projected/38d412b4-e145-4238-90ed-269c0b397890-kube-api-access-nknwz\") pod \"authorino-59c974bd48-l824r\" (UID: \"38d412b4-e145-4238-90ed-269c0b397890\") " pod="kuadrant-system/authorino-59c974bd48-l824r"
Sep 16 02:26:09.845293 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:09.845259    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nknwz\" (UniqueName: \"kubernetes.io/projected/38d412b4-e145-4238-90ed-269c0b397890-kube-api-access-nknwz\") pod \"authorino-59c974bd48-l824r\" (UID: \"38d412b4-e145-4238-90ed-269c0b397890\") " pod="kuadrant-system/authorino-59c974bd48-l824r"
Sep 16 02:26:09.853362 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:09.853343    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nknwz\" (UniqueName: \"kubernetes.io/projected/38d412b4-e145-4238-90ed-269c0b397890-kube-api-access-nknwz\") pod \"authorino-59c974bd48-l824r\" (UID: \"38d412b4-e145-4238-90ed-269c0b397890\") " pod="kuadrant-system/authorino-59c974bd48-l824r"
Sep 16 02:26:09.968074 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:09.968005    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-l824r"
Sep 16 02:26:10.237587 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:10.237565    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-l824r"]
Sep 16 02:26:10.238451 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:26:10.238424    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38d412b4_e145_4238_90ed_269c0b397890.slice/crio-e1b8b2ad9c33eeb5cd7b067fad58703c47e8a341aa3171f71033db39309137fb WatchSource:0}: Error finding container e1b8b2ad9c33eeb5cd7b067fad58703c47e8a341aa3171f71033db39309137fb: Status 404 returned error can't find the container with id e1b8b2ad9c33eeb5cd7b067fad58703c47e8a341aa3171f71033db39309137fb
Sep 16 02:26:10.623841 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:10.623815    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-l824r" event={"ID":"38d412b4-e145-4238-90ed-269c0b397890","Type":"ContainerStarted","Data":"e1b8b2ad9c33eeb5cd7b067fad58703c47e8a341aa3171f71033db39309137fb"}
Sep 16 02:26:10.625077 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:10.625055    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-w6lwt" event={"ID":"7e10dfa3-de5f-4660-848a-3e26afec62f2","Type":"ContainerStarted","Data":"36f1011fbb032827a67525525962e637160f9c971ebfeca3a3ef8b89a5e4f8c2"}
Sep 16 02:26:11.634236 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:11.634205    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-w6lwt" event={"ID":"7e10dfa3-de5f-4660-848a-3e26afec62f2","Type":"ContainerStarted","Data":"6ccd1088d35663d889446322fc8d06ccad8706bd46eef0a0eccdef2f38f17bef"}
Sep 16 02:26:11.634667 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:11.634280    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"
Sep 16 02:26:11.651978 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:11.651929    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-w6lwt" podStartSLOduration=1.674095141 podStartE2EDuration="2.651913835s" totalImagesPullingTime="977.818694ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:26:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:26:11.649711731 +0000 UTC m=+776.741893706" watchObservedRunningTime="2026-09-16 02:26:11.651913835 +0000 UTC m=+776.744095807"
Sep 16 02:26:12.641355 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:12.641310    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-l824r" event={"ID":"38d412b4-e145-4238-90ed-269c0b397890","Type":"ContainerStarted","Data":"514309f79f1bf23268b85aaa0f77c5082b705838e4c33a588868291bf9a9bc38"}
Sep 16 02:26:12.654564 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:12.654523    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-l824r" podStartSLOduration=2.101923652 podStartE2EDuration="3.654508298s" totalImagesPullingTime="1.552584646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:26:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:26:12.654026377 +0000 UTC m=+777.746208351" watchObservedRunningTime="2026-09-16 02:26:12.654508298 +0000 UTC m=+777.746690275"
Sep 16 02:26:22.642739 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:22.642710    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"
Sep 16 02:26:42.312875 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:42.312569    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-l824r"]
Sep 16 02:26:42.312875 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:42.312776    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-l824r" podUID="38d412b4-e145-4238-90ed-269c0b397890" containerName="authorino" containerID="cri-o://514309f79f1bf23268b85aaa0f77c5082b705838e4c33a588868291bf9a9bc38" gracePeriod=30
Sep 16 02:26:42.557743 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:42.557716    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-l824r"
Sep 16 02:26:42.708940 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:42.708871    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nknwz\" (UniqueName: \"kubernetes.io/projected/38d412b4-e145-4238-90ed-269c0b397890-kube-api-access-nknwz\") pod \"38d412b4-e145-4238-90ed-269c0b397890\" (UID: \"38d412b4-e145-4238-90ed-269c0b397890\") "
Sep 16 02:26:42.711011 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:42.710985    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38d412b4-e145-4238-90ed-269c0b397890-kube-api-access-nknwz" (OuterVolumeSpecName: "kube-api-access-nknwz") pod "38d412b4-e145-4238-90ed-269c0b397890" (UID: "38d412b4-e145-4238-90ed-269c0b397890"). InnerVolumeSpecName "kube-api-access-nknwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:26:42.804213 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:42.804180    2581 generic.go:356] "Generic (PLEG): container finished" podID="38d412b4-e145-4238-90ed-269c0b397890" containerID="514309f79f1bf23268b85aaa0f77c5082b705838e4c33a588868291bf9a9bc38" exitCode=0
Sep 16 02:26:42.804355 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:42.804222    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-l824r"
Sep 16 02:26:42.804355 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:42.804258    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-l824r" event={"ID":"38d412b4-e145-4238-90ed-269c0b397890","Type":"ContainerDied","Data":"514309f79f1bf23268b85aaa0f77c5082b705838e4c33a588868291bf9a9bc38"}
Sep 16 02:26:42.804355 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:42.804303    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-l824r" event={"ID":"38d412b4-e145-4238-90ed-269c0b397890","Type":"ContainerDied","Data":"e1b8b2ad9c33eeb5cd7b067fad58703c47e8a341aa3171f71033db39309137fb"}
Sep 16 02:26:42.804355 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:42.804319    2581 scope.go:117] "RemoveContainer" containerID="514309f79f1bf23268b85aaa0f77c5082b705838e4c33a588868291bf9a9bc38"
Sep 16 02:26:42.809618 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:42.809597    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nknwz\" (UniqueName: \"kubernetes.io/projected/38d412b4-e145-4238-90ed-269c0b397890-kube-api-access-nknwz\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:26:42.813738 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:42.813719    2581 scope.go:117] "RemoveContainer" containerID="514309f79f1bf23268b85aaa0f77c5082b705838e4c33a588868291bf9a9bc38"
Sep 16 02:26:42.814084 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:26:42.814048    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"514309f79f1bf23268b85aaa0f77c5082b705838e4c33a588868291bf9a9bc38\": container with ID starting with 514309f79f1bf23268b85aaa0f77c5082b705838e4c33a588868291bf9a9bc38 not found: ID does not exist" containerID="514309f79f1bf23268b85aaa0f77c5082b705838e4c33a588868291bf9a9bc38"
Sep 16 02:26:42.814175 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:42.814080    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"514309f79f1bf23268b85aaa0f77c5082b705838e4c33a588868291bf9a9bc38"} err="failed to get container status \"514309f79f1bf23268b85aaa0f77c5082b705838e4c33a588868291bf9a9bc38\": rpc error: code = NotFound desc = could not find container \"514309f79f1bf23268b85aaa0f77c5082b705838e4c33a588868291bf9a9bc38\": container with ID starting with 514309f79f1bf23268b85aaa0f77c5082b705838e4c33a588868291bf9a9bc38 not found: ID does not exist"
Sep 16 02:26:42.827231 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:42.827211    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-l824r"]
Sep 16 02:26:42.831231 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:42.831212    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-l824r"]
Sep 16 02:26:43.381724 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:26:43.381692    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38d412b4-e145-4238-90ed-269c0b397890" path="/var/lib/kubelet/pods/38d412b4-e145-4238-90ed-269c0b397890/volumes"
Sep 16 02:27:24.701168 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:24.701129    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-c2spl"]
Sep 16 02:27:24.701660 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:24.701645    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38d412b4-e145-4238-90ed-269c0b397890" containerName="authorino"
Sep 16 02:27:24.701703 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:24.701663    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="38d412b4-e145-4238-90ed-269c0b397890" containerName="authorino"
Sep 16 02:27:24.701785 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:24.701775    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="38d412b4-e145-4238-90ed-269c0b397890" containerName="authorino"
Sep 16 02:27:24.706340 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:24.706320    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-c2spl"
Sep 16 02:27:24.708724 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:24.708701    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 16 02:27:24.708836 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:24.708749    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 02:27:24.708836 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:24.708701    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 16 02:27:24.708996 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:24.708944    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 16 02:27:24.714932 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:24.714356    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-c2spl"]
Sep 16 02:27:24.831043 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:24.831016    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5a27842-1d52-4444-9d27-60bbb345f205-maas-api-tls\") pod \"maas-api-59f6566bbc-c2spl\" (UID: \"e5a27842-1d52-4444-9d27-60bbb345f205\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-c2spl"
Sep 16 02:27:24.831043 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:24.831045    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5a27842-1d52-4444-9d27-60bbb345f205-openshift-service-ca\") pod \"maas-api-59f6566bbc-c2spl\" (UID: \"e5a27842-1d52-4444-9d27-60bbb345f205\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-c2spl"
Sep 16 02:27:24.831238 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:24.831075    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmftj\" (UniqueName: \"kubernetes.io/projected/e5a27842-1d52-4444-9d27-60bbb345f205-kube-api-access-wmftj\") pod \"maas-api-59f6566bbc-c2spl\" (UID: \"e5a27842-1d52-4444-9d27-60bbb345f205\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-c2spl"
Sep 16 02:27:24.831238 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:24.831155    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5a27842-1d52-4444-9d27-60bbb345f205-metrics-certs\") pod \"maas-api-59f6566bbc-c2spl\" (UID: \"e5a27842-1d52-4444-9d27-60bbb345f205\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-c2spl"
Sep 16 02:27:24.931906 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:24.931878    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5a27842-1d52-4444-9d27-60bbb345f205-maas-api-tls\") pod \"maas-api-59f6566bbc-c2spl\" (UID: \"e5a27842-1d52-4444-9d27-60bbb345f205\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-c2spl"
Sep 16 02:27:24.932056 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:24.931916    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5a27842-1d52-4444-9d27-60bbb345f205-openshift-service-ca\") pod \"maas-api-59f6566bbc-c2spl\" (UID: \"e5a27842-1d52-4444-9d27-60bbb345f205\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-c2spl"
Sep 16 02:27:24.932056 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:24.931949    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmftj\" (UniqueName: \"kubernetes.io/projected/e5a27842-1d52-4444-9d27-60bbb345f205-kube-api-access-wmftj\") pod \"maas-api-59f6566bbc-c2spl\" (UID: \"e5a27842-1d52-4444-9d27-60bbb345f205\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-c2spl"
Sep 16 02:27:24.932056 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:24.931983    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5a27842-1d52-4444-9d27-60bbb345f205-metrics-certs\") pod \"maas-api-59f6566bbc-c2spl\" (UID: \"e5a27842-1d52-4444-9d27-60bbb345f205\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-c2spl"
Sep 16 02:27:24.932185 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:27:24.932132    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found
Sep 16 02:27:24.932221 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:27:24.932195    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5a27842-1d52-4444-9d27-60bbb345f205-metrics-certs podName:e5a27842-1d52-4444-9d27-60bbb345f205 nodeName:}" failed. No retries permitted until 2026-09-16 02:27:25.43217489 +0000 UTC m=+850.524356843 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5a27842-1d52-4444-9d27-60bbb345f205-metrics-certs") pod "maas-api-59f6566bbc-c2spl" (UID: "e5a27842-1d52-4444-9d27-60bbb345f205") : secret "maas-api-metrics-tls" not found
Sep 16 02:27:24.932607 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:24.932589    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5a27842-1d52-4444-9d27-60bbb345f205-openshift-service-ca\") pod \"maas-api-59f6566bbc-c2spl\" (UID: \"e5a27842-1d52-4444-9d27-60bbb345f205\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-c2spl"
Sep 16 02:27:24.934410 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:24.934391    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5a27842-1d52-4444-9d27-60bbb345f205-maas-api-tls\") pod \"maas-api-59f6566bbc-c2spl\" (UID: \"e5a27842-1d52-4444-9d27-60bbb345f205\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-c2spl"
Sep 16 02:27:24.940392 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:24.940369    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmftj\" (UniqueName: \"kubernetes.io/projected/e5a27842-1d52-4444-9d27-60bbb345f205-kube-api-access-wmftj\") pod \"maas-api-59f6566bbc-c2spl\" (UID: \"e5a27842-1d52-4444-9d27-60bbb345f205\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-c2spl"
Sep 16 02:27:25.285628 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:25.285593    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:27:25.436651 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:25.436617    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5a27842-1d52-4444-9d27-60bbb345f205-metrics-certs\") pod \"maas-api-59f6566bbc-c2spl\" (UID: \"e5a27842-1d52-4444-9d27-60bbb345f205\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-c2spl"
Sep 16 02:27:25.439334 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:25.439312    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5a27842-1d52-4444-9d27-60bbb345f205-metrics-certs\") pod \"maas-api-59f6566bbc-c2spl\" (UID: \"e5a27842-1d52-4444-9d27-60bbb345f205\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-c2spl"
Sep 16 02:27:25.619486 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:25.619399    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-c2spl"
Sep 16 02:27:25.891054 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:25.891027    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-c2spl"]
Sep 16 02:27:25.891926 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:27:25.891903    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5a27842_1d52_4444_9d27_60bbb345f205.slice/crio-d20defcda3e1c4500067ba2d37db4645bdc5c14b74f4bb8610af00650f546c36 WatchSource:0}: Error finding container d20defcda3e1c4500067ba2d37db4645bdc5c14b74f4bb8610af00650f546c36: Status 404 returned error can't find the container with id d20defcda3e1c4500067ba2d37db4645bdc5c14b74f4bb8610af00650f546c36
Sep 16 02:27:26.038360 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:26.038323    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-c2spl" event={"ID":"e5a27842-1d52-4444-9d27-60bbb345f205","Type":"ContainerStarted","Data":"d20defcda3e1c4500067ba2d37db4645bdc5c14b74f4bb8610af00650f546c36"}
Sep 16 02:27:29.067066 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:29.067028    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-c2spl" event={"ID":"e5a27842-1d52-4444-9d27-60bbb345f205","Type":"ContainerStarted","Data":"28a0f95e906a566822968576b371fda0055b4a547297342a34662bbc07ff76e9"}
Sep 16 02:27:29.067430 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:29.067120    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-c2spl"
Sep 16 02:27:29.082653 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:29.082610    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-c2spl" podStartSLOduration=2.567774134 podStartE2EDuration="5.082594187s" totalImagesPullingTime="2.514820053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:27:29.081841623 +0000 UTC m=+854.174023595" watchObservedRunningTime="2026-09-16 02:27:29.082594187 +0000 UTC m=+854.174776162"
Sep 16 02:27:35.077824 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:35.077798    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-c2spl"
Sep 16 02:27:47.502811 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:47.502779    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:27:55.587576 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:55.587543    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-rz8m5"]
Sep 16 02:27:55.594716 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:55.594691    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rz8m5"
Sep 16 02:27:55.597171 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:55.597151    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 16 02:27:55.597966 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:55.597947    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 16 02:27:55.598262 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:55.598239    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lrwjw\""
Sep 16 02:27:55.598366 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:55.598277    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 16 02:27:55.601914 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:55.601892    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-rz8m5"]
Sep 16 02:27:55.779974 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:55.779941    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95589b23-be8c-48f1-835c-0293d470f1f8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rz8m5\" (UID: \"95589b23-be8c-48f1-835c-0293d470f1f8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rz8m5"
Sep 16 02:27:55.780157 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:55.779980    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95589b23-be8c-48f1-835c-0293d470f1f8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rz8m5\" (UID: \"95589b23-be8c-48f1-835c-0293d470f1f8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rz8m5"
Sep 16 02:27:55.780157 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:55.779997    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95589b23-be8c-48f1-835c-0293d470f1f8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rz8m5\" (UID: \"95589b23-be8c-48f1-835c-0293d470f1f8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rz8m5"
Sep 16 02:27:55.780157 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:55.780046    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95589b23-be8c-48f1-835c-0293d470f1f8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rz8m5\" (UID: \"95589b23-be8c-48f1-835c-0293d470f1f8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rz8m5"
Sep 16 02:27:55.780157 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:55.780082    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95589b23-be8c-48f1-835c-0293d470f1f8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rz8m5\" (UID: \"95589b23-be8c-48f1-835c-0293d470f1f8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rz8m5"
Sep 16 02:27:55.780157 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:55.780120    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t8g4\" (UniqueName: \"kubernetes.io/projected/95589b23-be8c-48f1-835c-0293d470f1f8-kube-api-access-7t8g4\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rz8m5\" (UID: \"95589b23-be8c-48f1-835c-0293d470f1f8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rz8m5"
Sep 16 02:27:55.881231 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:55.881147    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95589b23-be8c-48f1-835c-0293d470f1f8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rz8m5\" (UID: \"95589b23-be8c-48f1-835c-0293d470f1f8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rz8m5"
Sep 16 02:27:55.881231 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:55.881186    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95589b23-be8c-48f1-835c-0293d470f1f8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rz8m5\" (UID: \"95589b23-be8c-48f1-835c-0293d470f1f8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rz8m5"
Sep 16 02:27:55.881231 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:55.881201    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95589b23-be8c-48f1-835c-0293d470f1f8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rz8m5\" (UID: \"95589b23-be8c-48f1-835c-0293d470f1f8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rz8m5"
Sep 16 02:27:55.881231 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:55.881219    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95589b23-be8c-48f1-835c-0293d470f1f8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rz8m5\" (UID: \"95589b23-be8c-48f1-835c-0293d470f1f8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rz8m5"
Sep 16 02:27:55.881551 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:55.881364    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95589b23-be8c-48f1-835c-0293d470f1f8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rz8m5\" (UID: \"95589b23-be8c-48f1-835c-0293d470f1f8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rz8m5"
Sep 16 02:27:55.881551 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:55.881415    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t8g4\" (UniqueName: \"kubernetes.io/projected/95589b23-be8c-48f1-835c-0293d470f1f8-kube-api-access-7t8g4\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rz8m5\" (UID: \"95589b23-be8c-48f1-835c-0293d470f1f8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rz8m5"
Sep 16 02:27:55.881679 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:55.881650    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95589b23-be8c-48f1-835c-0293d470f1f8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rz8m5\" (UID: \"95589b23-be8c-48f1-835c-0293d470f1f8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rz8m5"
Sep 16 02:27:55.881744 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:55.881685    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95589b23-be8c-48f1-835c-0293d470f1f8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rz8m5\" (UID: \"95589b23-be8c-48f1-835c-0293d470f1f8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rz8m5"
Sep 16 02:27:55.881821 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:55.881805    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95589b23-be8c-48f1-835c-0293d470f1f8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rz8m5\" (UID: \"95589b23-be8c-48f1-835c-0293d470f1f8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rz8m5"
Sep 16 02:27:55.883661 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:55.883636    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95589b23-be8c-48f1-835c-0293d470f1f8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rz8m5\" (UID: \"95589b23-be8c-48f1-835c-0293d470f1f8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rz8m5"
Sep 16 02:27:55.883920 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:55.883906    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95589b23-be8c-48f1-835c-0293d470f1f8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rz8m5\" (UID: \"95589b23-be8c-48f1-835c-0293d470f1f8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rz8m5"
Sep 16 02:27:55.888319 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:55.888301    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t8g4\" (UniqueName: \"kubernetes.io/projected/95589b23-be8c-48f1-835c-0293d470f1f8-kube-api-access-7t8g4\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rz8m5\" (UID: \"95589b23-be8c-48f1-835c-0293d470f1f8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rz8m5"
Sep 16 02:27:55.907240 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:55.907213    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rz8m5"
Sep 16 02:27:56.181117 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:56.181092    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-rz8m5"]
Sep 16 02:27:56.182215 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:27:56.182190    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95589b23_be8c_48f1_835c_0293d470f1f8.slice/crio-2625aeed70683f11574fe2164e1948e67206b6af77c7054f8ff1e7564b883674 WatchSource:0}: Error finding container 2625aeed70683f11574fe2164e1948e67206b6af77c7054f8ff1e7564b883674: Status 404 returned error can't find the container with id 2625aeed70683f11574fe2164e1948e67206b6af77c7054f8ff1e7564b883674
Sep 16 02:27:56.219902 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:56.219866    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rz8m5" event={"ID":"95589b23-be8c-48f1-835c-0293d470f1f8","Type":"ContainerStarted","Data":"2625aeed70683f11574fe2164e1948e67206b6af77c7054f8ff1e7564b883674"}
Sep 16 02:27:56.270596 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:56.270565    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:27:57.228342 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:57.228315    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rz8m5" event={"ID":"95589b23-be8c-48f1-835c-0293d470f1f8","Type":"ContainerStarted","Data":"ec3098ab61108fb2c82558a8203416145afee081711cd57eebca52206c3cd16a"}
Sep 16 02:27:57.251045 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:27:57.251001    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rz8m5" podStartSLOduration=1.28205795 podStartE2EDuration="2.250985707s" totalImagesPullingTime="968.927757ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:27:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:27:57.249433291 +0000 UTC m=+882.341615265" watchObservedRunningTime="2026-09-16 02:27:57.250985707 +0000 UTC m=+882.343167679"
Sep 16 02:28:05.907505 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:05.907473    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rz8m5"
Sep 16 02:28:05.907889 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:05.907534    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rz8m5"
Sep 16 02:28:05.919362 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:05.919343    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rz8m5"
Sep 16 02:28:06.287325 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:06.287297    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rz8m5"
Sep 16 02:28:15.366551 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:15.366523    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g54gh_308f30e2-2871-442a-ba30-54ada02ad832/ovn-acl-logging/0.log"
Sep 16 02:28:15.368150 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:15.368129    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g54gh_308f30e2-2871-442a-ba30-54ada02ad832/ovn-acl-logging/0.log"
Sep 16 02:28:16.074918 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:16.074882    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:28:27.382036 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:27.382007    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:28:32.079564 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:32.079533    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:28:36.775525 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:36.775466    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cs74c"]
Sep 16 02:28:36.779458 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:36.779435    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs74c"
Sep 16 02:28:36.781538 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:36.781516    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 16 02:28:36.787719 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:36.787693    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cs74c"]
Sep 16 02:28:36.908991 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:36.908960    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqhvv\" (UniqueName: \"kubernetes.io/projected/32ff4680-e586-4699-86ee-d93fd0d443f8-kube-api-access-gqhvv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs74c\" (UID: \"32ff4680-e586-4699-86ee-d93fd0d443f8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs74c"
Sep 16 02:28:36.908991 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:36.908992    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32ff4680-e586-4699-86ee-d93fd0d443f8-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs74c\" (UID: \"32ff4680-e586-4699-86ee-d93fd0d443f8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs74c"
Sep 16 02:28:36.909180 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:36.909017    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32ff4680-e586-4699-86ee-d93fd0d443f8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs74c\" (UID: \"32ff4680-e586-4699-86ee-d93fd0d443f8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs74c"
Sep 16 02:28:36.909180 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:36.909101    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32ff4680-e586-4699-86ee-d93fd0d443f8-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs74c\" (UID: \"32ff4680-e586-4699-86ee-d93fd0d443f8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs74c"
Sep 16 02:28:36.909180 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:36.909152    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32ff4680-e586-4699-86ee-d93fd0d443f8-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs74c\" (UID: \"32ff4680-e586-4699-86ee-d93fd0d443f8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs74c"
Sep 16 02:28:36.909278 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:36.909211    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32ff4680-e586-4699-86ee-d93fd0d443f8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs74c\" (UID: \"32ff4680-e586-4699-86ee-d93fd0d443f8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs74c"
Sep 16 02:28:37.010240 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:37.010207    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqhvv\" (UniqueName: \"kubernetes.io/projected/32ff4680-e586-4699-86ee-d93fd0d443f8-kube-api-access-gqhvv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs74c\" (UID: \"32ff4680-e586-4699-86ee-d93fd0d443f8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs74c"
Sep 16 02:28:37.010240 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:37.010245    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32ff4680-e586-4699-86ee-d93fd0d443f8-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs74c\" (UID: \"32ff4680-e586-4699-86ee-d93fd0d443f8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs74c"
Sep 16 02:28:37.010510 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:37.010279    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32ff4680-e586-4699-86ee-d93fd0d443f8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs74c\" (UID: \"32ff4680-e586-4699-86ee-d93fd0d443f8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs74c"
Sep 16 02:28:37.010510 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:37.010317    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32ff4680-e586-4699-86ee-d93fd0d443f8-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs74c\" (UID: \"32ff4680-e586-4699-86ee-d93fd0d443f8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs74c"
Sep 16 02:28:37.010510 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:37.010375    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32ff4680-e586-4699-86ee-d93fd0d443f8-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs74c\" (UID: \"32ff4680-e586-4699-86ee-d93fd0d443f8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs74c"
Sep 16 02:28:37.010510 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:37.010413    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32ff4680-e586-4699-86ee-d93fd0d443f8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs74c\" (UID: \"32ff4680-e586-4699-86ee-d93fd0d443f8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs74c"
Sep 16 02:28:37.010753 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:37.010730    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32ff4680-e586-4699-86ee-d93fd0d443f8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs74c\" (UID: \"32ff4680-e586-4699-86ee-d93fd0d443f8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs74c"
Sep 16 02:28:37.010818 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:37.010739    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32ff4680-e586-4699-86ee-d93fd0d443f8-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs74c\" (UID: \"32ff4680-e586-4699-86ee-d93fd0d443f8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs74c"
Sep 16 02:28:37.010818 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:37.010795    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32ff4680-e586-4699-86ee-d93fd0d443f8-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs74c\" (UID: \"32ff4680-e586-4699-86ee-d93fd0d443f8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs74c"
Sep 16 02:28:37.012666 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:37.012647    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32ff4680-e586-4699-86ee-d93fd0d443f8-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs74c\" (UID: \"32ff4680-e586-4699-86ee-d93fd0d443f8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs74c"
Sep 16 02:28:37.012936 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:37.012918    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32ff4680-e586-4699-86ee-d93fd0d443f8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs74c\" (UID: \"32ff4680-e586-4699-86ee-d93fd0d443f8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs74c"
Sep 16 02:28:37.017998 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:37.017977    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqhvv\" (UniqueName: \"kubernetes.io/projected/32ff4680-e586-4699-86ee-d93fd0d443f8-kube-api-access-gqhvv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cs74c\" (UID: \"32ff4680-e586-4699-86ee-d93fd0d443f8\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs74c"
Sep 16 02:28:37.091541 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:37.091473    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs74c"
Sep 16 02:28:37.361047 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:37.361019    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cs74c"]
Sep 16 02:28:37.362731 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:28:37.362693    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32ff4680_e586_4699_86ee_d93fd0d443f8.slice/crio-e263f42a43177b559333e3d389f3a33734b6937fea92fac9894e1edb4a0cec50 WatchSource:0}: Error finding container e263f42a43177b559333e3d389f3a33734b6937fea92fac9894e1edb4a0cec50: Status 404 returned error can't find the container with id e263f42a43177b559333e3d389f3a33734b6937fea92fac9894e1edb4a0cec50
Sep 16 02:28:37.364001 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:37.363985    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 02:28:37.446087 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:37.446056    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs74c" event={"ID":"32ff4680-e586-4699-86ee-d93fd0d443f8","Type":"ContainerStarted","Data":"e263f42a43177b559333e3d389f3a33734b6937fea92fac9894e1edb4a0cec50"}
Sep 16 02:28:38.453584 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:38.453538    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs74c" event={"ID":"32ff4680-e586-4699-86ee-d93fd0d443f8","Type":"ContainerStarted","Data":"1c4fde3053e31a58880011778aadcb8168cf6ce765a8d28ca849470f4fa3b659"}
Sep 16 02:28:38.469797 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:38.469753    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs74c" podStartSLOduration=2.273760068 podStartE2EDuration="2.469739747s" totalImagesPullingTime="195.979679ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:28:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:28:38.46882008 +0000 UTC m=+923.561002045" watchObservedRunningTime="2026-09-16 02:28:38.469739747 +0000 UTC m=+923.561921719"
Sep 16 02:28:38.681019 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:38.680983    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:28:45.785285 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:45.785252    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:28:47.091654 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:47.091613    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs74c"
Sep 16 02:28:47.092063 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:47.091698    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs74c"
Sep 16 02:28:47.104085 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:47.104062    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs74c"
Sep 16 02:28:47.510906 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:28:47.510804    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cs74c"
Sep 16 02:31:06.212768 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:06.212730    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k"]
Sep 16 02:31:06.216391 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:06.216370    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k"
Sep 16 02:31:06.218341 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:06.218317    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-60674e-serving-cert\""
Sep 16 02:31:06.218485 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:06.218465    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vlvfg\""
Sep 16 02:31:06.227280 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:06.227254    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k"]
Sep 16 02:31:06.311572 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:06.311539    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4clm5\" (UniqueName: \"kubernetes.io/projected/ba26e5d7-3917-44c9-866a-84e57d5f668b-kube-api-access-4clm5\") pod \"maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k\" (UID: \"ba26e5d7-3917-44c9-866a-84e57d5f668b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k"
Sep 16 02:31:06.311741 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:06.311581    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba26e5d7-3917-44c9-866a-84e57d5f668b-metrics-certs\") pod \"maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k\" (UID: \"ba26e5d7-3917-44c9-866a-84e57d5f668b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k"
Sep 16 02:31:06.311741 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:06.311606    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba26e5d7-3917-44c9-866a-84e57d5f668b-maas-api-tls\") pod \"maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k\" (UID: \"ba26e5d7-3917-44c9-866a-84e57d5f668b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k"
Sep 16 02:31:06.311741 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:06.311692    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba26e5d7-3917-44c9-866a-84e57d5f668b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k\" (UID: \"ba26e5d7-3917-44c9-866a-84e57d5f668b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k"
Sep 16 02:31:06.413035 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:06.412989    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba26e5d7-3917-44c9-866a-84e57d5f668b-maas-api-tls\") pod \"maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k\" (UID: \"ba26e5d7-3917-44c9-866a-84e57d5f668b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k"
Sep 16 02:31:06.413035 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:06.413044    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba26e5d7-3917-44c9-866a-84e57d5f668b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k\" (UID: \"ba26e5d7-3917-44c9-866a-84e57d5f668b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k"
Sep 16 02:31:06.413278 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:06.413096    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4clm5\" (UniqueName: \"kubernetes.io/projected/ba26e5d7-3917-44c9-866a-84e57d5f668b-kube-api-access-4clm5\") pod \"maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k\" (UID: \"ba26e5d7-3917-44c9-866a-84e57d5f668b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k"
Sep 16 02:31:06.413278 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:06.413124    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba26e5d7-3917-44c9-866a-84e57d5f668b-metrics-certs\") pod \"maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k\" (UID: \"ba26e5d7-3917-44c9-866a-84e57d5f668b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k"
Sep 16 02:31:06.413278 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:31:06.413142    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-serving-cert: secret "maas-api-e2e-inf-a-60674e-serving-cert" not found
Sep 16 02:31:06.413278 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:31:06.413219    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba26e5d7-3917-44c9-866a-84e57d5f668b-maas-api-tls podName:ba26e5d7-3917-44c9-866a-84e57d5f668b nodeName:}" failed. No retries permitted until 2026-09-16 02:31:06.913199705 +0000 UTC m=+1072.005381676 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ba26e5d7-3917-44c9-866a-84e57d5f668b-maas-api-tls") pod "maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k" (UID: "ba26e5d7-3917-44c9-866a-84e57d5f668b") : secret "maas-api-e2e-inf-a-60674e-serving-cert" not found
Sep 16 02:31:06.413764 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:06.413741    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba26e5d7-3917-44c9-866a-84e57d5f668b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k\" (UID: \"ba26e5d7-3917-44c9-866a-84e57d5f668b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k"
Sep 16 02:31:06.415614 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:06.415591    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba26e5d7-3917-44c9-866a-84e57d5f668b-metrics-certs\") pod \"maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k\" (UID: \"ba26e5d7-3917-44c9-866a-84e57d5f668b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k"
Sep 16 02:31:06.421350 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:06.421329    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4clm5\" (UniqueName: \"kubernetes.io/projected/ba26e5d7-3917-44c9-866a-84e57d5f668b-kube-api-access-4clm5\") pod \"maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k\" (UID: \"ba26e5d7-3917-44c9-866a-84e57d5f668b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k"
Sep 16 02:31:06.918761 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:06.918681    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba26e5d7-3917-44c9-866a-84e57d5f668b-maas-api-tls\") pod \"maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k\" (UID: \"ba26e5d7-3917-44c9-866a-84e57d5f668b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k"
Sep 16 02:31:06.921197 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:06.921178    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba26e5d7-3917-44c9-866a-84e57d5f668b-maas-api-tls\") pod \"maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k\" (UID: \"ba26e5d7-3917-44c9-866a-84e57d5f668b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k"
Sep 16 02:31:07.099103 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:07.099065    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b"]
Sep 16 02:31:07.103355 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:07.103333    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b"
Sep 16 02:31:07.105564 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:07.105543    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-619550-serving-cert\""
Sep 16 02:31:07.115749 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:07.115727    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b"]
Sep 16 02:31:07.132710 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:07.132682    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k"
Sep 16 02:31:07.221197 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:07.221136    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b\" (UID: \"2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b"
Sep 16 02:31:07.221197 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:07.221197    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431-metrics-certs\") pod \"maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b\" (UID: \"2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b"
Sep 16 02:31:07.221635 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:07.221237    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431-maas-api-tls\") pod \"maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b\" (UID: \"2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b"
Sep 16 02:31:07.221635 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:07.221340    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c875d\" (UniqueName: \"kubernetes.io/projected/2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431-kube-api-access-c875d\") pod \"maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b\" (UID: \"2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b"
Sep 16 02:31:07.322760 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:07.322724    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c875d\" (UniqueName: \"kubernetes.io/projected/2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431-kube-api-access-c875d\") pod \"maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b\" (UID: \"2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b"
Sep 16 02:31:07.322954 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:07.322794    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b\" (UID: \"2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b"
Sep 16 02:31:07.322954 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:07.322829    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431-metrics-certs\") pod \"maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b\" (UID: \"2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b"
Sep 16 02:31:07.322954 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:07.322892    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431-maas-api-tls\") pod \"maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b\" (UID: \"2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b"
Sep 16 02:31:07.323132 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:31:07.323060    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-serving-cert: secret "maas-api-e2e-worker-w0-619550-serving-cert" not found
Sep 16 02:31:07.323132 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:31:07.323124    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431-maas-api-tls podName:2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431 nodeName:}" failed. No retries permitted until 2026-09-16 02:31:07.823104763 +0000 UTC m=+1072.915286719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431-maas-api-tls") pod "maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b" (UID: "2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431") : secret "maas-api-e2e-worker-w0-619550-serving-cert" not found
Sep 16 02:31:07.323778 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:07.323754    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b\" (UID: \"2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b"
Sep 16 02:31:07.325796 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:07.325776    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431-metrics-certs\") pod \"maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b\" (UID: \"2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b"
Sep 16 02:31:07.330693 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:07.330665    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c875d\" (UniqueName: \"kubernetes.io/projected/2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431-kube-api-access-c875d\") pod \"maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b\" (UID: \"2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b"
Sep 16 02:31:07.408345 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:07.408318    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k"]
Sep 16 02:31:07.409836 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:31:07.409811    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba26e5d7_3917_44c9_866a_84e57d5f668b.slice/crio-1f261b6bb44e77b320a1b1e3cf5af610ee17cf71c62cab7c3de06f3d4f759082 WatchSource:0}: Error finding container 1f261b6bb44e77b320a1b1e3cf5af610ee17cf71c62cab7c3de06f3d4f759082: Status 404 returned error can't find the container with id 1f261b6bb44e77b320a1b1e3cf5af610ee17cf71c62cab7c3de06f3d4f759082
Sep 16 02:31:07.828670 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:07.828641    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431-maas-api-tls\") pod \"maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b\" (UID: \"2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b"
Sep 16 02:31:07.831160 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:07.831141    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431-maas-api-tls\") pod \"maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b\" (UID: \"2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b"
Sep 16 02:31:08.019101 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:08.019068    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b"
Sep 16 02:31:08.196513 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:08.196403    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-542ed5-599749c586-n8phb"]
Sep 16 02:31:08.201916 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:08.201484    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-542ed5-599749c586-n8phb"
Sep 16 02:31:08.203805 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:08.203782    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-542ed5-serving-cert\""
Sep 16 02:31:08.212134 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:08.211973    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-542ed5-599749c586-n8phb"]
Sep 16 02:31:08.263198 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:08.263165    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k" event={"ID":"ba26e5d7-3917-44c9-866a-84e57d5f668b","Type":"ContainerStarted","Data":"1ded0ef18e0e0272d5da33321e4594a2b9d5dfe83055aa18507e4360ff3a17c1"}
Sep 16 02:31:08.263649 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:08.263221    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k" event={"ID":"ba26e5d7-3917-44c9-866a-84e57d5f668b","Type":"ContainerStarted","Data":"1f261b6bb44e77b320a1b1e3cf5af610ee17cf71c62cab7c3de06f3d4f759082"}
Sep 16 02:31:08.263649 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:08.263348    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k"
Sep 16 02:31:08.286366 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:08.280601    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k" podStartSLOduration=1.792954753 podStartE2EDuration="2.280585094s" totalImagesPullingTime="487.630341ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:31:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:31:08.277308231 +0000 UTC m=+1073.369490392" watchObservedRunningTime="2026-09-16 02:31:08.280585094 +0000 UTC m=+1073.372767067"
Sep 16 02:31:08.291443 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:08.291423    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b"]
Sep 16 02:31:08.293415 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:31:08.293388    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fd2f7bc_0cf5_4d4d_aaa0_2d4a7d228431.slice/crio-d5c3390c3eeab8ed6d20fcb9122f1b0fe89a031308a5ced1616354a341c9f912 WatchSource:0}: Error finding container d5c3390c3eeab8ed6d20fcb9122f1b0fe89a031308a5ced1616354a341c9f912: Status 404 returned error can't find the container with id d5c3390c3eeab8ed6d20fcb9122f1b0fe89a031308a5ced1616354a341c9f912
Sep 16 02:31:08.333351 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:08.333321    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnhnc\" (UniqueName: \"kubernetes.io/projected/68d61ef3-a8d2-48b0-84b4-55abdace5cbb-kube-api-access-nnhnc\") pod \"maas-api-e2e-worker-w3-542ed5-599749c586-n8phb\" (UID: \"68d61ef3-a8d2-48b0-84b4-55abdace5cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-542ed5-599749c586-n8phb"
Sep 16 02:31:08.333503 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:08.333364    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68d61ef3-a8d2-48b0-84b4-55abdace5cbb-maas-api-tls\") pod \"maas-api-e2e-worker-w3-542ed5-599749c586-n8phb\" (UID: \"68d61ef3-a8d2-48b0-84b4-55abdace5cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-542ed5-599749c586-n8phb"
Sep 16 02:31:08.333503 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:08.333425    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68d61ef3-a8d2-48b0-84b4-55abdace5cbb-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-542ed5-599749c586-n8phb\" (UID: \"68d61ef3-a8d2-48b0-84b4-55abdace5cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-542ed5-599749c586-n8phb"
Sep 16 02:31:08.333642 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:08.333504    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68d61ef3-a8d2-48b0-84b4-55abdace5cbb-metrics-certs\") pod \"maas-api-e2e-worker-w3-542ed5-599749c586-n8phb\" (UID: \"68d61ef3-a8d2-48b0-84b4-55abdace5cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-542ed5-599749c586-n8phb"
Sep 16 02:31:08.434114 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:08.434081    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68d61ef3-a8d2-48b0-84b4-55abdace5cbb-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-542ed5-599749c586-n8phb\" (UID: \"68d61ef3-a8d2-48b0-84b4-55abdace5cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-542ed5-599749c586-n8phb"
Sep 16 02:31:08.434282 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:08.434232    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68d61ef3-a8d2-48b0-84b4-55abdace5cbb-metrics-certs\") pod \"maas-api-e2e-worker-w3-542ed5-599749c586-n8phb\" (UID: \"68d61ef3-a8d2-48b0-84b4-55abdace5cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-542ed5-599749c586-n8phb"
Sep 16 02:31:08.434456 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:08.434430    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnhnc\" (UniqueName: \"kubernetes.io/projected/68d61ef3-a8d2-48b0-84b4-55abdace5cbb-kube-api-access-nnhnc\") pod \"maas-api-e2e-worker-w3-542ed5-599749c586-n8phb\" (UID: \"68d61ef3-a8d2-48b0-84b4-55abdace5cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-542ed5-599749c586-n8phb"
Sep 16 02:31:08.434656 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:08.434622    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68d61ef3-a8d2-48b0-84b4-55abdace5cbb-maas-api-tls\") pod \"maas-api-e2e-worker-w3-542ed5-599749c586-n8phb\" (UID: \"68d61ef3-a8d2-48b0-84b4-55abdace5cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-542ed5-599749c586-n8phb"
Sep 16 02:31:08.434830 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:08.434811    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68d61ef3-a8d2-48b0-84b4-55abdace5cbb-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-542ed5-599749c586-n8phb\" (UID: \"68d61ef3-a8d2-48b0-84b4-55abdace5cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-542ed5-599749c586-n8phb"
Sep 16 02:31:08.436720 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:08.436702    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68d61ef3-a8d2-48b0-84b4-55abdace5cbb-metrics-certs\") pod \"maas-api-e2e-worker-w3-542ed5-599749c586-n8phb\" (UID: \"68d61ef3-a8d2-48b0-84b4-55abdace5cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-542ed5-599749c586-n8phb"
Sep 16 02:31:08.437054 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:08.437035    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68d61ef3-a8d2-48b0-84b4-55abdace5cbb-maas-api-tls\") pod \"maas-api-e2e-worker-w3-542ed5-599749c586-n8phb\" (UID: \"68d61ef3-a8d2-48b0-84b4-55abdace5cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-542ed5-599749c586-n8phb"
Sep 16 02:31:08.441649 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:08.441628    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnhnc\" (UniqueName: \"kubernetes.io/projected/68d61ef3-a8d2-48b0-84b4-55abdace5cbb-kube-api-access-nnhnc\") pod \"maas-api-e2e-worker-w3-542ed5-599749c586-n8phb\" (UID: \"68d61ef3-a8d2-48b0-84b4-55abdace5cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-542ed5-599749c586-n8phb"
Sep 16 02:31:08.515748 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:08.515673    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-542ed5-599749c586-n8phb"
Sep 16 02:31:08.792169 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:08.792141    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-542ed5-599749c586-n8phb"]
Sep 16 02:31:08.793356 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:31:08.793332    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68d61ef3_a8d2_48b0_84b4_55abdace5cbb.slice/crio-0568bec8d4d7f5f1b7dbaa28bfadad7eb029680c0bced1f0a0539058808eb668 WatchSource:0}: Error finding container 0568bec8d4d7f5f1b7dbaa28bfadad7eb029680c0bced1f0a0539058808eb668: Status 404 returned error can't find the container with id 0568bec8d4d7f5f1b7dbaa28bfadad7eb029680c0bced1f0a0539058808eb668
Sep 16 02:31:09.272148 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:09.272118    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-542ed5-599749c586-n8phb" event={"ID":"68d61ef3-a8d2-48b0-84b4-55abdace5cbb","Type":"ContainerStarted","Data":"0568bec8d4d7f5f1b7dbaa28bfadad7eb029680c0bced1f0a0539058808eb668"}
Sep 16 02:31:09.274094 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:09.274063    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b" event={"ID":"2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431","Type":"ContainerStarted","Data":"90591082349f90d8cc020d4d8fb3713c6d07a7a741245db37143fb24e02addfe"}
Sep 16 02:31:09.274211 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:09.274120    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b" event={"ID":"2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431","Type":"ContainerStarted","Data":"d5c3390c3eeab8ed6d20fcb9122f1b0fe89a031308a5ced1616354a341c9f912"}
Sep 16 02:31:09.280494 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:09.280471    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:31:09.292975 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:09.292934    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b" podStartSLOduration=1.733933787 podStartE2EDuration="2.292919869s" totalImagesPullingTime="558.986082ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:31:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:31:09.291447039 +0000 UTC m=+1074.383629024" watchObservedRunningTime="2026-09-16 02:31:09.292919869 +0000 UTC m=+1074.385101899"
Sep 16 02:31:10.280701 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:10.280660    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-542ed5-599749c586-n8phb" event={"ID":"68d61ef3-a8d2-48b0-84b4-55abdace5cbb","Type":"ContainerStarted","Data":"61d6a8f28cd5067d8e4aebfc8d0cef0ac70bd4985386bd89d59d105a26643bbd"}
Sep 16 02:31:10.281190 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:10.280881    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-542ed5-599749c586-n8phb"
Sep 16 02:31:10.281190 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:10.280908    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b"
Sep 16 02:31:10.298108 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:10.298061    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-542ed5-599749c586-n8phb" podStartSLOduration=1.8795902070000001 podStartE2EDuration="2.298048662s" totalImagesPullingTime="418.458455ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:31:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:31:10.295874032 +0000 UTC m=+1075.388056015" watchObservedRunningTime="2026-09-16 02:31:10.298048662 +0000 UTC m=+1075.390230634"
Sep 16 02:31:14.279641 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:14.279612    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k"
Sep 16 02:31:16.293616 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:16.293583    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-542ed5-599749c586-n8phb"
Sep 16 02:31:16.298778 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:16.298754    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b"
Sep 16 02:31:20.079076 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:20.079036    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:31:36.317186 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:36.317156    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9"]
Sep 16 02:31:36.321161 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:36.321140    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9"
Sep 16 02:31:36.325426 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:36.325406    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-1a323c-serving-cert\""
Sep 16 02:31:36.333457 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:36.333368    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9"]
Sep 16 02:31:36.371319 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:36.371293    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59f2a346-1276-432f-92e2-dff7cc7f0371-metrics-certs\") pod \"maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9\" (UID: \"59f2a346-1276-432f-92e2-dff7cc7f0371\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9"
Sep 16 02:31:36.371445 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:36.371329    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmwfx\" (UniqueName: \"kubernetes.io/projected/59f2a346-1276-432f-92e2-dff7cc7f0371-kube-api-access-nmwfx\") pod \"maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9\" (UID: \"59f2a346-1276-432f-92e2-dff7cc7f0371\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9"
Sep 16 02:31:36.371445 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:36.371392    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59f2a346-1276-432f-92e2-dff7cc7f0371-maas-api-tls\") pod \"maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9\" (UID: \"59f2a346-1276-432f-92e2-dff7cc7f0371\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9"
Sep 16 02:31:36.371445 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:36.371414    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59f2a346-1276-432f-92e2-dff7cc7f0371-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9\" (UID: \"59f2a346-1276-432f-92e2-dff7cc7f0371\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9"
Sep 16 02:31:36.472462 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:36.472436    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59f2a346-1276-432f-92e2-dff7cc7f0371-maas-api-tls\") pod \"maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9\" (UID: \"59f2a346-1276-432f-92e2-dff7cc7f0371\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9"
Sep 16 02:31:36.472592 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:36.472469    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59f2a346-1276-432f-92e2-dff7cc7f0371-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9\" (UID: \"59f2a346-1276-432f-92e2-dff7cc7f0371\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9"
Sep 16 02:31:36.472592 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:36.472514    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59f2a346-1276-432f-92e2-dff7cc7f0371-metrics-certs\") pod \"maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9\" (UID: \"59f2a346-1276-432f-92e2-dff7cc7f0371\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9"
Sep 16 02:31:36.472592 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:36.472547    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmwfx\" (UniqueName: \"kubernetes.io/projected/59f2a346-1276-432f-92e2-dff7cc7f0371-kube-api-access-nmwfx\") pod \"maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9\" (UID: \"59f2a346-1276-432f-92e2-dff7cc7f0371\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9"
Sep 16 02:31:36.472592 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:31:36.472571    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-serving-cert: secret "maas-api-e2e-inf-b-1a323c-serving-cert" not found
Sep 16 02:31:36.472767 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:31:36.472650    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59f2a346-1276-432f-92e2-dff7cc7f0371-maas-api-tls podName:59f2a346-1276-432f-92e2-dff7cc7f0371 nodeName:}" failed. No retries permitted until 2026-09-16 02:31:36.972629299 +0000 UTC m=+1102.064811269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/59f2a346-1276-432f-92e2-dff7cc7f0371-maas-api-tls") pod "maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9" (UID: "59f2a346-1276-432f-92e2-dff7cc7f0371") : secret "maas-api-e2e-inf-b-1a323c-serving-cert" not found
Sep 16 02:31:36.473249 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:36.473229    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59f2a346-1276-432f-92e2-dff7cc7f0371-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9\" (UID: \"59f2a346-1276-432f-92e2-dff7cc7f0371\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9"
Sep 16 02:31:36.475107 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:36.475085    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59f2a346-1276-432f-92e2-dff7cc7f0371-metrics-certs\") pod \"maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9\" (UID: \"59f2a346-1276-432f-92e2-dff7cc7f0371\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9"
Sep 16 02:31:36.480505 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:36.480481    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmwfx\" (UniqueName: \"kubernetes.io/projected/59f2a346-1276-432f-92e2-dff7cc7f0371-kube-api-access-nmwfx\") pod \"maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9\" (UID: \"59f2a346-1276-432f-92e2-dff7cc7f0371\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9"
Sep 16 02:31:36.977128 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:36.977092    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59f2a346-1276-432f-92e2-dff7cc7f0371-maas-api-tls\") pod \"maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9\" (UID: \"59f2a346-1276-432f-92e2-dff7cc7f0371\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9"
Sep 16 02:31:36.979730 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:36.979698    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59f2a346-1276-432f-92e2-dff7cc7f0371-maas-api-tls\") pod \"maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9\" (UID: \"59f2a346-1276-432f-92e2-dff7cc7f0371\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9"
Sep 16 02:31:37.238411 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:37.238325    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9"
Sep 16 02:31:37.514714 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:37.514685    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9"]
Sep 16 02:31:37.516572 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:31:37.516537    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59f2a346_1276_432f_92e2_dff7cc7f0371.slice/crio-458bec0d74de64965efa79a5da4f520a91703e0c9ea8a1305613399aa3a26f1b WatchSource:0}: Error finding container 458bec0d74de64965efa79a5da4f520a91703e0c9ea8a1305613399aa3a26f1b: Status 404 returned error can't find the container with id 458bec0d74de64965efa79a5da4f520a91703e0c9ea8a1305613399aa3a26f1b
Sep 16 02:31:38.444386 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:38.444350    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9" event={"ID":"59f2a346-1276-432f-92e2-dff7cc7f0371","Type":"ContainerStarted","Data":"767416c007b76eb2d789f4e787671916aef1170d53ee43bea7d44093ed42d3ad"}
Sep 16 02:31:38.444551 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:38.444405    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9" event={"ID":"59f2a346-1276-432f-92e2-dff7cc7f0371","Type":"ContainerStarted","Data":"458bec0d74de64965efa79a5da4f520a91703e0c9ea8a1305613399aa3a26f1b"}
Sep 16 02:31:38.444602 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:38.444550    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9"
Sep 16 02:31:38.460007 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:38.459967    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9" podStartSLOduration=2.163469451 podStartE2EDuration="2.459955304s" totalImagesPullingTime="296.485853ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:31:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:31:38.458722248 +0000 UTC m=+1103.550904222" watchObservedRunningTime="2026-09-16 02:31:38.459955304 +0000 UTC m=+1103.552137276"
Sep 16 02:31:40.880888 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:40.880840    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:31:44.455002 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:44.454971    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9"
Sep 16 02:31:52.179948 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:31:52.179909    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:32:10.079031 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:10.079002    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:32:36.383281 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:36.383248    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:32:52.271728 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:52.271687    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:32:58.661419 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:58.661377    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"]
Sep 16 02:32:58.665021 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:58.665001    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"
Sep 16 02:32:58.667291 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:58.667261    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-619550\"/\"kube-root-ca.crt\""
Sep 16 02:32:58.668007 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:58.667988    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-619550\"/\"openshift-service-ca.crt\""
Sep 16 02:32:58.668116 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:58.667988    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-619550\"/\"premium-w0-619550-kserve-self-signed-certs\""
Sep 16 02:32:58.668189 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:58.668115    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-619550\"/\"default-dockercfg-s94hk\""
Sep 16 02:32:58.676344 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:58.676316    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"]
Sep 16 02:32:58.776094 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:58.776059    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jxvz\" (UniqueName: \"kubernetes.io/projected/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-kube-api-access-6jxvz\") pod \"premium-w0-619550-kserve-7c5b754458-d6v7p\" (UID: \"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99\") " pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"
Sep 16 02:32:58.776249 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:58.776107    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-dshm\") pod \"premium-w0-619550-kserve-7c5b754458-d6v7p\" (UID: \"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99\") " pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"
Sep 16 02:32:58.776249 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:58.776131    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-model-cache\") pod \"premium-w0-619550-kserve-7c5b754458-d6v7p\" (UID: \"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99\") " pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"
Sep 16 02:32:58.776249 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:58.776163    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-tls-certs\") pod \"premium-w0-619550-kserve-7c5b754458-d6v7p\" (UID: \"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99\") " pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"
Sep 16 02:32:58.776249 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:58.776213    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-tmp-dir\") pod \"premium-w0-619550-kserve-7c5b754458-d6v7p\" (UID: \"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99\") " pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"
Sep 16 02:32:58.776249 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:58.776228    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-home\") pod \"premium-w0-619550-kserve-7c5b754458-d6v7p\" (UID: \"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99\") " pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"
Sep 16 02:32:58.876988 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:58.876954    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-tmp-dir\") pod \"premium-w0-619550-kserve-7c5b754458-d6v7p\" (UID: \"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99\") " pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"
Sep 16 02:32:58.876988 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:58.876993    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-home\") pod \"premium-w0-619550-kserve-7c5b754458-d6v7p\" (UID: \"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99\") " pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"
Sep 16 02:32:58.877161 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:58.877081    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jxvz\" (UniqueName: \"kubernetes.io/projected/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-kube-api-access-6jxvz\") pod \"premium-w0-619550-kserve-7c5b754458-d6v7p\" (UID: \"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99\") " pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"
Sep 16 02:32:58.877161 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:58.877114    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-dshm\") pod \"premium-w0-619550-kserve-7c5b754458-d6v7p\" (UID: \"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99\") " pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"
Sep 16 02:32:58.877161 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:58.877143    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-model-cache\") pod \"premium-w0-619550-kserve-7c5b754458-d6v7p\" (UID: \"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99\") " pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"
Sep 16 02:32:58.877324 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:58.877171    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-tls-certs\") pod \"premium-w0-619550-kserve-7c5b754458-d6v7p\" (UID: \"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99\") " pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"
Sep 16 02:32:58.877420 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:58.877400    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-tmp-dir\") pod \"premium-w0-619550-kserve-7c5b754458-d6v7p\" (UID: \"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99\") " pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"
Sep 16 02:32:58.877478 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:58.877415    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-home\") pod \"premium-w0-619550-kserve-7c5b754458-d6v7p\" (UID: \"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99\") " pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"
Sep 16 02:32:58.877478 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:58.877461    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-model-cache\") pod \"premium-w0-619550-kserve-7c5b754458-d6v7p\" (UID: \"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99\") " pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"
Sep 16 02:32:58.879549 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:58.879529    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-dshm\") pod \"premium-w0-619550-kserve-7c5b754458-d6v7p\" (UID: \"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99\") " pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"
Sep 16 02:32:58.879659 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:58.879647    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-tls-certs\") pod \"premium-w0-619550-kserve-7c5b754458-d6v7p\" (UID: \"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99\") " pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"
Sep 16 02:32:58.885319 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:58.885298    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jxvz\" (UniqueName: \"kubernetes.io/projected/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-kube-api-access-6jxvz\") pod \"premium-w0-619550-kserve-7c5b754458-d6v7p\" (UID: \"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99\") " pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"
Sep 16 02:32:58.976653 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:58.976588    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"
Sep 16 02:32:59.249863 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:59.249823    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"]
Sep 16 02:32:59.251451 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:32:59.251422    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod898094b1_ac6f_443a_b3f3_1f2ee6aa3a99.slice/crio-a7bb8e20582100b4124344680fbfd72cf20293f684f1926d00eba38508e42ea4 WatchSource:0}: Error finding container a7bb8e20582100b4124344680fbfd72cf20293f684f1926d00eba38508e42ea4: Status 404 returned error can't find the container with id a7bb8e20582100b4124344680fbfd72cf20293f684f1926d00eba38508e42ea4
Sep 16 02:32:59.901472 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:59.901443    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p" event={"ID":"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99","Type":"ContainerStarted","Data":"de1ef99a6fa982a4212fcfc0676fac8282e42edf44e484a6a5239ab48ba14199"}
Sep 16 02:32:59.901806 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:59.901479    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p" event={"ID":"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99","Type":"ContainerStarted","Data":"a7bb8e20582100b4124344680fbfd72cf20293f684f1926d00eba38508e42ea4"}
Sep 16 02:32:59.917411 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:32:59.917369    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p" podStartSLOduration=1.9173557460000001 podStartE2EDuration="1.917355746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:32:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:32:59.915765835 +0000 UTC m=+1185.007947808" watchObservedRunningTime="2026-09-16 02:32:59.917355746 +0000 UTC m=+1185.009537718"
Sep 16 02:33:03.588651 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:33:03.588617    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:33:08.976914 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:33:08.976884    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"
Sep 16 02:33:08.977352 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:33:08.977132    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"
Sep 16 02:33:08.988687 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:33:08.988669    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"
Sep 16 02:33:09.974151 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:33:09.974123    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"
Sep 16 02:33:15.406341 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:33:15.406317    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g54gh_308f30e2-2871-442a-ba30-54ada02ad832/ovn-acl-logging/0.log"
Sep 16 02:33:15.407975 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:33:15.407951    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g54gh_308f30e2-2871-442a-ba30-54ada02ad832/ovn-acl-logging/0.log"
Sep 16 02:33:27.882944 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:33:27.882910    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:33:46.375499 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:33:46.375462    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:34:02.476066 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:02.476030    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:34:07.562622 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:07.562549    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8885-5fe263"]
Sep 16 02:34:07.566271 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:07.566253    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8885-5fe263"
Sep 16 02:34:07.568317 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:07.568296    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-5sbqt\""
Sep 16 02:34:07.572788 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:07.572765    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8885-5fe263"]
Sep 16 02:34:07.658045 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:07.658013    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdpgh\" (UniqueName: \"kubernetes.io/projected/5c4fbe8a-929a-48aa-8b6a-3b664662dc54-kube-api-access-tdpgh\") pod \"test-curl-8885-5fe263\" (UID: \"5c4fbe8a-929a-48aa-8b6a-3b664662dc54\") " pod="opendatahub/test-curl-8885-5fe263"
Sep 16 02:34:07.759070 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:07.759042    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdpgh\" (UniqueName: \"kubernetes.io/projected/5c4fbe8a-929a-48aa-8b6a-3b664662dc54-kube-api-access-tdpgh\") pod \"test-curl-8885-5fe263\" (UID: \"5c4fbe8a-929a-48aa-8b6a-3b664662dc54\") " pod="opendatahub/test-curl-8885-5fe263"
Sep 16 02:34:07.767332 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:07.767308    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdpgh\" (UniqueName: \"kubernetes.io/projected/5c4fbe8a-929a-48aa-8b6a-3b664662dc54-kube-api-access-tdpgh\") pod \"test-curl-8885-5fe263\" (UID: \"5c4fbe8a-929a-48aa-8b6a-3b664662dc54\") " pod="opendatahub/test-curl-8885-5fe263"
Sep 16 02:34:07.877459 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:07.877387    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8885-5fe263"
Sep 16 02:34:08.146628 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:08.146605    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8885-5fe263"]
Sep 16 02:34:08.148026 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:34:08.148003    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c4fbe8a_929a_48aa_8b6a_3b664662dc54.slice/crio-d0ffe5b8b066aa0b9bc5ff6ec79d15ef9761efbcdb46c404cef83d9049572d0a WatchSource:0}: Error finding container d0ffe5b8b066aa0b9bc5ff6ec79d15ef9761efbcdb46c404cef83d9049572d0a: Status 404 returned error can't find the container with id d0ffe5b8b066aa0b9bc5ff6ec79d15ef9761efbcdb46c404cef83d9049572d0a
Sep 16 02:34:08.149840 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:08.149823    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 02:34:08.298102 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:08.298068    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8885-5fe263" event={"ID":"5c4fbe8a-929a-48aa-8b6a-3b664662dc54","Type":"ContainerStarted","Data":"d0ffe5b8b066aa0b9bc5ff6ec79d15ef9761efbcdb46c404cef83d9049572d0a"}
Sep 16 02:34:10.312705 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:10.312657    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8885-5fe263" event={"ID":"5c4fbe8a-929a-48aa-8b6a-3b664662dc54","Type":"ContainerStarted","Data":"198aca7d0449e6af190ae22f94ace8d9a1f1a4c11ca23cd38e80bec9dd13b440"}
Sep 16 02:34:10.329180 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:10.329127    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-8885-5fe263" podStartSLOduration=1.578550761 podStartE2EDuration="3.329108183s" totalImagesPullingTime="1.750557422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:34:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:34:10.326610439 +0000 UTC m=+1255.418792415" watchObservedRunningTime="2026-09-16 02:34:10.329108183 +0000 UTC m=+1255.421290157"
Sep 16 02:34:10.888574 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:10.888542    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8885-5fe263"]
Sep 16 02:34:10.892936 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:10.892911    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8885-5fe263"]
Sep 16 02:34:11.006875 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:11.006784    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8885-742901"]
Sep 16 02:34:11.007215 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:11.007203    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c4fbe8a-929a-48aa-8b6a-3b664662dc54" containerName="test-curl-8885-5fe263"
Sep 16 02:34:11.007267 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:11.007216    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c4fbe8a-929a-48aa-8b6a-3b664662dc54" containerName="test-curl-8885-5fe263"
Sep 16 02:34:11.007303 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:11.007292    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c4fbe8a-929a-48aa-8b6a-3b664662dc54" containerName="test-curl-8885-5fe263"
Sep 16 02:34:11.010438 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:11.010424    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8885-742901"
Sep 16 02:34:11.015817 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:11.015797    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8885-742901"]
Sep 16 02:34:11.092210 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:11.092183    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxhwz\" (UniqueName: \"kubernetes.io/projected/f9a4a6f6-c536-480a-9ec2-b08ce7d8b19c-kube-api-access-mxhwz\") pod \"test-curl-8885-742901\" (UID: \"f9a4a6f6-c536-480a-9ec2-b08ce7d8b19c\") " pod="opendatahub/test-curl-8885-742901"
Sep 16 02:34:11.193442 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:11.193413    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxhwz\" (UniqueName: \"kubernetes.io/projected/f9a4a6f6-c536-480a-9ec2-b08ce7d8b19c-kube-api-access-mxhwz\") pod \"test-curl-8885-742901\" (UID: \"f9a4a6f6-c536-480a-9ec2-b08ce7d8b19c\") " pod="opendatahub/test-curl-8885-742901"
Sep 16 02:34:11.200506 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:11.200485    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxhwz\" (UniqueName: \"kubernetes.io/projected/f9a4a6f6-c536-480a-9ec2-b08ce7d8b19c-kube-api-access-mxhwz\") pod \"test-curl-8885-742901\" (UID: \"f9a4a6f6-c536-480a-9ec2-b08ce7d8b19c\") " pod="opendatahub/test-curl-8885-742901"
Sep 16 02:34:11.318397 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:34:11.318374    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-8885-5fe263" container="test-curl-8885-5fe263"
Sep 16 02:34:11.321155 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:11.321138    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8885-742901"
Sep 16 02:34:11.589816 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:11.589789    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8885-742901"]
Sep 16 02:34:11.590693 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:34:11.590667    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9a4a6f6_c536_480a_9ec2_b08ce7d8b19c.slice/crio-9feaf248cc65ee0a737fa6f4cc17d88a1cccdc7962710c96128735b85c70cdda WatchSource:0}: Error finding container 9feaf248cc65ee0a737fa6f4cc17d88a1cccdc7962710c96128735b85c70cdda: Status 404 returned error can't find the container with id 9feaf248cc65ee0a737fa6f4cc17d88a1cccdc7962710c96128735b85c70cdda
Sep 16 02:34:12.326831 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:12.326788    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8885-742901" event={"ID":"f9a4a6f6-c536-480a-9ec2-b08ce7d8b19c","Type":"ContainerStarted","Data":"bf6d9cfca7d9339538856426d19ab2e2819a2241b9fda0dc3d6de318a1345a2a"}
Sep 16 02:34:12.326831 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:12.326816    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-8885-5fe263" podUID="5c4fbe8a-929a-48aa-8b6a-3b664662dc54" containerName="test-curl-8885-5fe263" containerID="cri-o://198aca7d0449e6af190ae22f94ace8d9a1f1a4c11ca23cd38e80bec9dd13b440" gracePeriod=2
Sep 16 02:34:12.327395 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:12.326842    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8885-742901" event={"ID":"f9a4a6f6-c536-480a-9ec2-b08ce7d8b19c","Type":"ContainerStarted","Data":"9feaf248cc65ee0a737fa6f4cc17d88a1cccdc7962710c96128735b85c70cdda"}
Sep 16 02:34:12.340490 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:12.340447    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-8885-742901" podStartSLOduration=2.340435288 podStartE2EDuration="2.340435288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:34:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:34:12.340045588 +0000 UTC m=+1257.432227561" watchObservedRunningTime="2026-09-16 02:34:12.340435288 +0000 UTC m=+1257.432617268"
Sep 16 02:34:12.953766 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:12.953734    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8885-742901"]
Sep 16 02:34:12.957352 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:12.957328    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8885-742901"]
Sep 16 02:34:13.332975 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:34:13.332944    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-8885-742901" container="test-curl-8885-742901"
Sep 16 02:34:14.338167 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:14.338131    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-8885-742901" podUID="f9a4a6f6-c536-480a-9ec2-b08ce7d8b19c" containerName="test-curl-8885-742901" containerID="cri-o://bf6d9cfca7d9339538856426d19ab2e2819a2241b9fda0dc3d6de318a1345a2a" gracePeriod=2
Sep 16 02:34:14.514291 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:14.514270    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8885-5fe263"
Sep 16 02:34:14.626526 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:14.626457    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdpgh\" (UniqueName: \"kubernetes.io/projected/5c4fbe8a-929a-48aa-8b6a-3b664662dc54-kube-api-access-tdpgh\") pod \"5c4fbe8a-929a-48aa-8b6a-3b664662dc54\" (UID: \"5c4fbe8a-929a-48aa-8b6a-3b664662dc54\") "
Sep 16 02:34:14.628780 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:14.628757    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c4fbe8a-929a-48aa-8b6a-3b664662dc54-kube-api-access-tdpgh" (OuterVolumeSpecName: "kube-api-access-tdpgh") pod "5c4fbe8a-929a-48aa-8b6a-3b664662dc54" (UID: "5c4fbe8a-929a-48aa-8b6a-3b664662dc54"). InnerVolumeSpecName "kube-api-access-tdpgh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:34:14.727484 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:14.727457    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdpgh\" (UniqueName: \"kubernetes.io/projected/5c4fbe8a-929a-48aa-8b6a-3b664662dc54-kube-api-access-tdpgh\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:34:15.344661 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:15.344625    2581 generic.go:356] "Generic (PLEG): container finished" podID="5c4fbe8a-929a-48aa-8b6a-3b664662dc54" containerID="198aca7d0449e6af190ae22f94ace8d9a1f1a4c11ca23cd38e80bec9dd13b440" exitCode=137
Sep 16 02:34:15.345117 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:15.344668    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8885-5fe263"
Sep 16 02:34:15.345117 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:15.344725    2581 scope.go:117] "RemoveContainer" containerID="198aca7d0449e6af190ae22f94ace8d9a1f1a4c11ca23cd38e80bec9dd13b440"
Sep 16 02:34:15.353952 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:15.353938    2581 scope.go:117] "RemoveContainer" containerID="198aca7d0449e6af190ae22f94ace8d9a1f1a4c11ca23cd38e80bec9dd13b440"
Sep 16 02:34:15.354194 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:34:15.354171    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"198aca7d0449e6af190ae22f94ace8d9a1f1a4c11ca23cd38e80bec9dd13b440\": container with ID starting with 198aca7d0449e6af190ae22f94ace8d9a1f1a4c11ca23cd38e80bec9dd13b440 not found: ID does not exist" containerID="198aca7d0449e6af190ae22f94ace8d9a1f1a4c11ca23cd38e80bec9dd13b440"
Sep 16 02:34:15.354286 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:15.354200    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"198aca7d0449e6af190ae22f94ace8d9a1f1a4c11ca23cd38e80bec9dd13b440"} err="failed to get container status \"198aca7d0449e6af190ae22f94ace8d9a1f1a4c11ca23cd38e80bec9dd13b440\": rpc error: code = NotFound desc = could not find container \"198aca7d0449e6af190ae22f94ace8d9a1f1a4c11ca23cd38e80bec9dd13b440\": container with ID starting with 198aca7d0449e6af190ae22f94ace8d9a1f1a4c11ca23cd38e80bec9dd13b440 not found: ID does not exist"
Sep 16 02:34:15.354373 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:34:15.354353    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8885-5fe263\" is forbidden: User \"system:node:ip-10-0-139-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-191.ec2.internal' and this object" podUID="5c4fbe8a-929a-48aa-8b6a-3b664662dc54" pod="opendatahub/test-curl-8885-5fe263"
Sep 16 02:34:15.381385 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:34:15.381354    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8885-5fe263\" is forbidden: User \"system:node:ip-10-0-139-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-191.ec2.internal' and this object" podUID="5c4fbe8a-929a-48aa-8b6a-3b664662dc54" pod="opendatahub/test-curl-8885-5fe263"
Sep 16 02:34:15.383166 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:15.383147    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c4fbe8a-929a-48aa-8b6a-3b664662dc54" path="/var/lib/kubelet/pods/5c4fbe8a-929a-48aa-8b6a-3b664662dc54/volumes"
Sep 16 02:34:16.517002 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:16.516980    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8885-742901"
Sep 16 02:34:16.645185 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:16.645114    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxhwz\" (UniqueName: \"kubernetes.io/projected/f9a4a6f6-c536-480a-9ec2-b08ce7d8b19c-kube-api-access-mxhwz\") pod \"f9a4a6f6-c536-480a-9ec2-b08ce7d8b19c\" (UID: \"f9a4a6f6-c536-480a-9ec2-b08ce7d8b19c\") "
Sep 16 02:34:16.647180 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:16.647156    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9a4a6f6-c536-480a-9ec2-b08ce7d8b19c-kube-api-access-mxhwz" (OuterVolumeSpecName: "kube-api-access-mxhwz") pod "f9a4a6f6-c536-480a-9ec2-b08ce7d8b19c" (UID: "f9a4a6f6-c536-480a-9ec2-b08ce7d8b19c"). InnerVolumeSpecName "kube-api-access-mxhwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:34:16.745976 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:16.745954    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxhwz\" (UniqueName: \"kubernetes.io/projected/f9a4a6f6-c536-480a-9ec2-b08ce7d8b19c-kube-api-access-mxhwz\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:34:17.356203 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:17.356159    2581 generic.go:356] "Generic (PLEG): container finished" podID="f9a4a6f6-c536-480a-9ec2-b08ce7d8b19c" containerID="bf6d9cfca7d9339538856426d19ab2e2819a2241b9fda0dc3d6de318a1345a2a" exitCode=137
Sep 16 02:34:17.356374 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:17.356204    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8885-742901"
Sep 16 02:34:17.356374 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:17.356251    2581 scope.go:117] "RemoveContainer" containerID="bf6d9cfca7d9339538856426d19ab2e2819a2241b9fda0dc3d6de318a1345a2a"
Sep 16 02:34:17.365347 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:17.365329    2581 scope.go:117] "RemoveContainer" containerID="bf6d9cfca7d9339538856426d19ab2e2819a2241b9fda0dc3d6de318a1345a2a"
Sep 16 02:34:17.365613 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:34:17.365597    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf6d9cfca7d9339538856426d19ab2e2819a2241b9fda0dc3d6de318a1345a2a\": container with ID starting with bf6d9cfca7d9339538856426d19ab2e2819a2241b9fda0dc3d6de318a1345a2a not found: ID does not exist" containerID="bf6d9cfca7d9339538856426d19ab2e2819a2241b9fda0dc3d6de318a1345a2a"
Sep 16 02:34:17.365664 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:17.365619    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf6d9cfca7d9339538856426d19ab2e2819a2241b9fda0dc3d6de318a1345a2a"} err="failed to get container status \"bf6d9cfca7d9339538856426d19ab2e2819a2241b9fda0dc3d6de318a1345a2a\": rpc error: code = NotFound desc = could not find container \"bf6d9cfca7d9339538856426d19ab2e2819a2241b9fda0dc3d6de318a1345a2a\": container with ID starting with bf6d9cfca7d9339538856426d19ab2e2819a2241b9fda0dc3d6de318a1345a2a not found: ID does not exist"
Sep 16 02:34:17.365932 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:34:17.365916    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8885-742901\" is forbidden: User \"system:node:ip-10-0-139-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-191.ec2.internal' and this object" podUID="f9a4a6f6-c536-480a-9ec2-b08ce7d8b19c" pod="opendatahub/test-curl-8885-742901"
Sep 16 02:34:17.382294 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:17.382272    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9a4a6f6-c536-480a-9ec2-b08ce7d8b19c" path="/var/lib/kubelet/pods/f9a4a6f6-c536-480a-9ec2-b08ce7d8b19c/volumes"
Sep 16 02:34:26.681229 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:26.681200    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:34:39.664821 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:39.664780    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"]
Sep 16 02:34:39.665811 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:39.665787    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9a4a6f6-c536-480a-9ec2-b08ce7d8b19c" containerName="test-curl-8885-742901"
Sep 16 02:34:39.665811 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:39.665813    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9a4a6f6-c536-480a-9ec2-b08ce7d8b19c" containerName="test-curl-8885-742901"
Sep 16 02:34:39.671959 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:39.671935    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9a4a6f6-c536-480a-9ec2-b08ce7d8b19c" containerName="test-curl-8885-742901"
Sep 16 02:34:39.677742 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:39.677718    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"
Sep 16 02:34:39.680097 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:39.680075    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-619550\"/\"distinct-w0-619550-kserve-self-signed-certs\""
Sep 16 02:34:39.680298 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:39.680276    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"]
Sep 16 02:34:39.848186 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:39.848153    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/224505ed-0f7b-4355-bbce-2e3090983a07-model-cache\") pod \"distinct-w0-619550-kserve-55d67bf69c-6cf6p\" (UID: \"224505ed-0f7b-4355-bbce-2e3090983a07\") " pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"
Sep 16 02:34:39.848347 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:39.848228    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/224505ed-0f7b-4355-bbce-2e3090983a07-tls-certs\") pod \"distinct-w0-619550-kserve-55d67bf69c-6cf6p\" (UID: \"224505ed-0f7b-4355-bbce-2e3090983a07\") " pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"
Sep 16 02:34:39.848347 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:39.848268    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/224505ed-0f7b-4355-bbce-2e3090983a07-dshm\") pod \"distinct-w0-619550-kserve-55d67bf69c-6cf6p\" (UID: \"224505ed-0f7b-4355-bbce-2e3090983a07\") " pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"
Sep 16 02:34:39.848347 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:39.848283    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/224505ed-0f7b-4355-bbce-2e3090983a07-tmp-dir\") pod \"distinct-w0-619550-kserve-55d67bf69c-6cf6p\" (UID: \"224505ed-0f7b-4355-bbce-2e3090983a07\") " pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"
Sep 16 02:34:39.848347 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:39.848297    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74q46\" (UniqueName: \"kubernetes.io/projected/224505ed-0f7b-4355-bbce-2e3090983a07-kube-api-access-74q46\") pod \"distinct-w0-619550-kserve-55d67bf69c-6cf6p\" (UID: \"224505ed-0f7b-4355-bbce-2e3090983a07\") " pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"
Sep 16 02:34:39.848347 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:39.848313    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/224505ed-0f7b-4355-bbce-2e3090983a07-home\") pod \"distinct-w0-619550-kserve-55d67bf69c-6cf6p\" (UID: \"224505ed-0f7b-4355-bbce-2e3090983a07\") " pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"
Sep 16 02:34:39.948988 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:39.948907    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/224505ed-0f7b-4355-bbce-2e3090983a07-model-cache\") pod \"distinct-w0-619550-kserve-55d67bf69c-6cf6p\" (UID: \"224505ed-0f7b-4355-bbce-2e3090983a07\") " pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"
Sep 16 02:34:39.949148 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:39.948995    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/224505ed-0f7b-4355-bbce-2e3090983a07-tls-certs\") pod \"distinct-w0-619550-kserve-55d67bf69c-6cf6p\" (UID: \"224505ed-0f7b-4355-bbce-2e3090983a07\") " pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"
Sep 16 02:34:39.949148 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:39.949036    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/224505ed-0f7b-4355-bbce-2e3090983a07-dshm\") pod \"distinct-w0-619550-kserve-55d67bf69c-6cf6p\" (UID: \"224505ed-0f7b-4355-bbce-2e3090983a07\") " pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"
Sep 16 02:34:39.949148 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:39.949057    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/224505ed-0f7b-4355-bbce-2e3090983a07-tmp-dir\") pod \"distinct-w0-619550-kserve-55d67bf69c-6cf6p\" (UID: \"224505ed-0f7b-4355-bbce-2e3090983a07\") " pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"
Sep 16 02:34:39.949148 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:39.949078    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74q46\" (UniqueName: \"kubernetes.io/projected/224505ed-0f7b-4355-bbce-2e3090983a07-kube-api-access-74q46\") pod \"distinct-w0-619550-kserve-55d67bf69c-6cf6p\" (UID: \"224505ed-0f7b-4355-bbce-2e3090983a07\") " pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"
Sep 16 02:34:39.949148 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:39.949103    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/224505ed-0f7b-4355-bbce-2e3090983a07-home\") pod \"distinct-w0-619550-kserve-55d67bf69c-6cf6p\" (UID: \"224505ed-0f7b-4355-bbce-2e3090983a07\") " pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"
Sep 16 02:34:39.949406 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:39.949296    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/224505ed-0f7b-4355-bbce-2e3090983a07-model-cache\") pod \"distinct-w0-619550-kserve-55d67bf69c-6cf6p\" (UID: \"224505ed-0f7b-4355-bbce-2e3090983a07\") " pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"
Sep 16 02:34:39.949406 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:39.949392    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/224505ed-0f7b-4355-bbce-2e3090983a07-tmp-dir\") pod \"distinct-w0-619550-kserve-55d67bf69c-6cf6p\" (UID: \"224505ed-0f7b-4355-bbce-2e3090983a07\") " pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"
Sep 16 02:34:39.949510 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:39.949462    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/224505ed-0f7b-4355-bbce-2e3090983a07-home\") pod \"distinct-w0-619550-kserve-55d67bf69c-6cf6p\" (UID: \"224505ed-0f7b-4355-bbce-2e3090983a07\") " pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"
Sep 16 02:34:39.951333 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:39.951315    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/224505ed-0f7b-4355-bbce-2e3090983a07-dshm\") pod \"distinct-w0-619550-kserve-55d67bf69c-6cf6p\" (UID: \"224505ed-0f7b-4355-bbce-2e3090983a07\") " pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"
Sep 16 02:34:39.951518 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:39.951501    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/224505ed-0f7b-4355-bbce-2e3090983a07-tls-certs\") pod \"distinct-w0-619550-kserve-55d67bf69c-6cf6p\" (UID: \"224505ed-0f7b-4355-bbce-2e3090983a07\") " pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"
Sep 16 02:34:39.958194 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:39.958174    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74q46\" (UniqueName: \"kubernetes.io/projected/224505ed-0f7b-4355-bbce-2e3090983a07-kube-api-access-74q46\") pod \"distinct-w0-619550-kserve-55d67bf69c-6cf6p\" (UID: \"224505ed-0f7b-4355-bbce-2e3090983a07\") " pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"
Sep 16 02:34:39.989343 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:39.989319    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"
Sep 16 02:34:40.263496 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:40.263469    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"]
Sep 16 02:34:40.264984 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:34:40.264957    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod224505ed_0f7b_4355_bbce_2e3090983a07.slice/crio-76ab12cfa85a5a838028500bd719a764149ad8ca802904e1dc26e70a895efd19 WatchSource:0}: Error finding container 76ab12cfa85a5a838028500bd719a764149ad8ca802904e1dc26e70a895efd19: Status 404 returned error can't find the container with id 76ab12cfa85a5a838028500bd719a764149ad8ca802904e1dc26e70a895efd19
Sep 16 02:34:40.495819 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:40.495779    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p" event={"ID":"224505ed-0f7b-4355-bbce-2e3090983a07","Type":"ContainerStarted","Data":"a3f64fab76d965c4ffe85116f426de9be054cde446a8f430c110f465862ed2c0"}
Sep 16 02:34:40.495819 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:40.495825    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p" event={"ID":"224505ed-0f7b-4355-bbce-2e3090983a07","Type":"ContainerStarted","Data":"76ab12cfa85a5a838028500bd719a764149ad8ca802904e1dc26e70a895efd19"}
Sep 16 02:34:40.513873 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:40.513781    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p" podStartSLOduration=1.5137685140000001 podStartE2EDuration="1.513768514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:34:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:34:40.512910861 +0000 UTC m=+1285.605092832" watchObservedRunningTime="2026-09-16 02:34:40.513768514 +0000 UTC m=+1285.605950524"
Sep 16 02:34:47.079084 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:47.079051    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:34:49.990220 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:49.990184    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"
Sep 16 02:34:49.990220 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:49.990226    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"
Sep 16 02:34:50.002416 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:50.002391    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"
Sep 16 02:34:50.565380 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:34:50.565349    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"
Sep 16 02:35:06.578416 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:06.578384    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:35:13.407454 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:13.407419    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t"]
Sep 16 02:35:13.411629 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:13.411608    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t"
Sep 16 02:35:13.413529 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:13.413505    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-e725a02e-serving-cert\""
Sep 16 02:35:13.418243 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:13.418222    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t"]
Sep 16 02:35:13.537948 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:13.537911    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6tx2\" (UniqueName: \"kubernetes.io/projected/07776f1f-b68c-4d85-bfb5-981aaa8a0eb1-kube-api-access-g6tx2\") pod \"maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t\" (UID: \"07776f1f-b68c-4d85-bfb5-981aaa8a0eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t"
Sep 16 02:35:13.537948 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:13.537949    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07776f1f-b68c-4d85-bfb5-981aaa8a0eb1-metrics-certs\") pod \"maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t\" (UID: \"07776f1f-b68c-4d85-bfb5-981aaa8a0eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t"
Sep 16 02:35:13.538174 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:13.538041    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07776f1f-b68c-4d85-bfb5-981aaa8a0eb1-maas-api-tls\") pod \"maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t\" (UID: \"07776f1f-b68c-4d85-bfb5-981aaa8a0eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t"
Sep 16 02:35:13.538174 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:13.538131    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07776f1f-b68c-4d85-bfb5-981aaa8a0eb1-openshift-service-ca\") pod \"maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t\" (UID: \"07776f1f-b68c-4d85-bfb5-981aaa8a0eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t"
Sep 16 02:35:13.638782 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:13.638753    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07776f1f-b68c-4d85-bfb5-981aaa8a0eb1-openshift-service-ca\") pod \"maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t\" (UID: \"07776f1f-b68c-4d85-bfb5-981aaa8a0eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t"
Sep 16 02:35:13.638946 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:13.638858    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6tx2\" (UniqueName: \"kubernetes.io/projected/07776f1f-b68c-4d85-bfb5-981aaa8a0eb1-kube-api-access-g6tx2\") pod \"maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t\" (UID: \"07776f1f-b68c-4d85-bfb5-981aaa8a0eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t"
Sep 16 02:35:13.638946 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:13.638887    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07776f1f-b68c-4d85-bfb5-981aaa8a0eb1-metrics-certs\") pod \"maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t\" (UID: \"07776f1f-b68c-4d85-bfb5-981aaa8a0eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t"
Sep 16 02:35:13.639044 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:13.638946    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07776f1f-b68c-4d85-bfb5-981aaa8a0eb1-maas-api-tls\") pod \"maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t\" (UID: \"07776f1f-b68c-4d85-bfb5-981aaa8a0eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t"
Sep 16 02:35:13.639522 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:13.639504    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07776f1f-b68c-4d85-bfb5-981aaa8a0eb1-openshift-service-ca\") pod \"maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t\" (UID: \"07776f1f-b68c-4d85-bfb5-981aaa8a0eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t"
Sep 16 02:35:13.641277 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:13.641259    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07776f1f-b68c-4d85-bfb5-981aaa8a0eb1-metrics-certs\") pod \"maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t\" (UID: \"07776f1f-b68c-4d85-bfb5-981aaa8a0eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t"
Sep 16 02:35:13.641348 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:13.641305    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07776f1f-b68c-4d85-bfb5-981aaa8a0eb1-maas-api-tls\") pod \"maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t\" (UID: \"07776f1f-b68c-4d85-bfb5-981aaa8a0eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t"
Sep 16 02:35:13.645815 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:13.645794    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6tx2\" (UniqueName: \"kubernetes.io/projected/07776f1f-b68c-4d85-bfb5-981aaa8a0eb1-kube-api-access-g6tx2\") pod \"maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t\" (UID: \"07776f1f-b68c-4d85-bfb5-981aaa8a0eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t"
Sep 16 02:35:13.725194 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:13.725108    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t"
Sep 16 02:35:14.000818 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:14.000787    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t"]
Sep 16 02:35:14.002588 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:35:14.002555    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07776f1f_b68c_4d85_bfb5_981aaa8a0eb1.slice/crio-2bb86081eeafe97b9d11df975756ad73323fc0c3b99b4f57800d2e01e2eb3b44 WatchSource:0}: Error finding container 2bb86081eeafe97b9d11df975756ad73323fc0c3b99b4f57800d2e01e2eb3b44: Status 404 returned error can't find the container with id 2bb86081eeafe97b9d11df975756ad73323fc0c3b99b4f57800d2e01e2eb3b44
Sep 16 02:35:14.701829 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:14.701793    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t" event={"ID":"07776f1f-b68c-4d85-bfb5-981aaa8a0eb1","Type":"ContainerStarted","Data":"0db323e18ecf11d6d5a882656f53d4f9f3ef2af757030328a93e6eb92263e5ef"}
Sep 16 02:35:14.702216 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:14.701860    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t" event={"ID":"07776f1f-b68c-4d85-bfb5-981aaa8a0eb1","Type":"ContainerStarted","Data":"2bb86081eeafe97b9d11df975756ad73323fc0c3b99b4f57800d2e01e2eb3b44"}
Sep 16 02:35:14.702216 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:14.701927    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t"
Sep 16 02:35:14.720280 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:14.720236    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t" podStartSLOduration=1.167681436 podStartE2EDuration="1.720223044s" totalImagesPullingTime="552.541608ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:35:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:35:14.717383769 +0000 UTC m=+1319.809565741" watchObservedRunningTime="2026-09-16 02:35:14.720223044 +0000 UTC m=+1319.812405057"
Sep 16 02:35:20.712574 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:20.712544    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t"
Sep 16 02:35:30.381787 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:30.381753    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:35:42.640524 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:42.640455    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t"]
Sep 16 02:35:42.640919 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:42.640684    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t" podUID="07776f1f-b68c-4d85-bfb5-981aaa8a0eb1" containerName="maas-api" containerID="cri-o://0db323e18ecf11d6d5a882656f53d4f9f3ef2af757030328a93e6eb92263e5ef" gracePeriod=30
Sep 16 02:35:42.873769 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:42.873742    2581 generic.go:356] "Generic (PLEG): container finished" podID="07776f1f-b68c-4d85-bfb5-981aaa8a0eb1" containerID="0db323e18ecf11d6d5a882656f53d4f9f3ef2af757030328a93e6eb92263e5ef" exitCode=0
Sep 16 02:35:42.873922 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:42.873819    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t" event={"ID":"07776f1f-b68c-4d85-bfb5-981aaa8a0eb1","Type":"ContainerDied","Data":"0db323e18ecf11d6d5a882656f53d4f9f3ef2af757030328a93e6eb92263e5ef"}
Sep 16 02:35:42.873922 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:42.873889    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t" event={"ID":"07776f1f-b68c-4d85-bfb5-981aaa8a0eb1","Type":"ContainerDied","Data":"2bb86081eeafe97b9d11df975756ad73323fc0c3b99b4f57800d2e01e2eb3b44"}
Sep 16 02:35:42.873922 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:42.873913    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2bb86081eeafe97b9d11df975756ad73323fc0c3b99b4f57800d2e01e2eb3b44"
Sep 16 02:35:42.887009 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:42.886990    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t"
Sep 16 02:35:43.003617 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:43.003535    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07776f1f-b68c-4d85-bfb5-981aaa8a0eb1-metrics-certs\") pod \"07776f1f-b68c-4d85-bfb5-981aaa8a0eb1\" (UID: \"07776f1f-b68c-4d85-bfb5-981aaa8a0eb1\") "
Sep 16 02:35:43.003617 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:43.003589    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6tx2\" (UniqueName: \"kubernetes.io/projected/07776f1f-b68c-4d85-bfb5-981aaa8a0eb1-kube-api-access-g6tx2\") pod \"07776f1f-b68c-4d85-bfb5-981aaa8a0eb1\" (UID: \"07776f1f-b68c-4d85-bfb5-981aaa8a0eb1\") "
Sep 16 02:35:43.003817 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:43.003656    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07776f1f-b68c-4d85-bfb5-981aaa8a0eb1-openshift-service-ca\") pod \"07776f1f-b68c-4d85-bfb5-981aaa8a0eb1\" (UID: \"07776f1f-b68c-4d85-bfb5-981aaa8a0eb1\") "
Sep 16 02:35:43.003817 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:43.003692    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07776f1f-b68c-4d85-bfb5-981aaa8a0eb1-maas-api-tls\") pod \"07776f1f-b68c-4d85-bfb5-981aaa8a0eb1\" (UID: \"07776f1f-b68c-4d85-bfb5-981aaa8a0eb1\") "
Sep 16 02:35:43.004086 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:43.004058    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07776f1f-b68c-4d85-bfb5-981aaa8a0eb1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "07776f1f-b68c-4d85-bfb5-981aaa8a0eb1" (UID: "07776f1f-b68c-4d85-bfb5-981aaa8a0eb1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:35:43.006084 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:43.006060    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07776f1f-b68c-4d85-bfb5-981aaa8a0eb1-kube-api-access-g6tx2" (OuterVolumeSpecName: "kube-api-access-g6tx2") pod "07776f1f-b68c-4d85-bfb5-981aaa8a0eb1" (UID: "07776f1f-b68c-4d85-bfb5-981aaa8a0eb1"). InnerVolumeSpecName "kube-api-access-g6tx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:35:43.006243 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:43.006113    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07776f1f-b68c-4d85-bfb5-981aaa8a0eb1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "07776f1f-b68c-4d85-bfb5-981aaa8a0eb1" (UID: "07776f1f-b68c-4d85-bfb5-981aaa8a0eb1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:35:43.006243 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:43.006148    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07776f1f-b68c-4d85-bfb5-981aaa8a0eb1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "07776f1f-b68c-4d85-bfb5-981aaa8a0eb1" (UID: "07776f1f-b68c-4d85-bfb5-981aaa8a0eb1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:35:43.104655 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:43.104623    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6tx2\" (UniqueName: \"kubernetes.io/projected/07776f1f-b68c-4d85-bfb5-981aaa8a0eb1-kube-api-access-g6tx2\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:35:43.104655 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:43.104651    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07776f1f-b68c-4d85-bfb5-981aaa8a0eb1-openshift-service-ca\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:35:43.104655 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:43.104662    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07776f1f-b68c-4d85-bfb5-981aaa8a0eb1-maas-api-tls\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:35:43.104905 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:43.104670    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07776f1f-b68c-4d85-bfb5-981aaa8a0eb1-metrics-certs\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:35:43.879224 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:43.879193    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t"
Sep 16 02:35:43.903016 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:43.902986    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t"]
Sep 16 02:35:43.907908 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:43.907885    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e725a02e-84d59f48f-ksq9t"]
Sep 16 02:35:45.389532 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:45.389500    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07776f1f-b68c-4d85-bfb5-981aaa8a0eb1" path="/var/lib/kubelet/pods/07776f1f-b68c-4d85-bfb5-981aaa8a0eb1/volumes"
Sep 16 02:35:49.541299 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:49.540997    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95"]
Sep 16 02:35:49.541756 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:49.541598    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07776f1f-b68c-4d85-bfb5-981aaa8a0eb1" containerName="maas-api"
Sep 16 02:35:49.541756 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:49.541613    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="07776f1f-b68c-4d85-bfb5-981aaa8a0eb1" containerName="maas-api"
Sep 16 02:35:49.541756 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:49.541719    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="07776f1f-b68c-4d85-bfb5-981aaa8a0eb1" containerName="maas-api"
Sep 16 02:35:49.545023 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:49.545008    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95"
Sep 16 02:35:49.547190 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:49.547166    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-0bdfbb54-serving-cert\""
Sep 16 02:35:49.556898 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:49.556874    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95"]
Sep 16 02:35:49.563217 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:49.563197    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05a176d6-9fec-4b6e-b0ed-54b0e8847c97-maas-api-tls\") pod \"maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95\" (UID: \"05a176d6-9fec-4b6e-b0ed-54b0e8847c97\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95"
Sep 16 02:35:49.563351 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:49.563249    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05a176d6-9fec-4b6e-b0ed-54b0e8847c97-metrics-certs\") pod \"maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95\" (UID: \"05a176d6-9fec-4b6e-b0ed-54b0e8847c97\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95"
Sep 16 02:35:49.563351 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:49.563317    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr8hw\" (UniqueName: \"kubernetes.io/projected/05a176d6-9fec-4b6e-b0ed-54b0e8847c97-kube-api-access-gr8hw\") pod \"maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95\" (UID: \"05a176d6-9fec-4b6e-b0ed-54b0e8847c97\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95"
Sep 16 02:35:49.563438 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:49.563387    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05a176d6-9fec-4b6e-b0ed-54b0e8847c97-openshift-service-ca\") pod \"maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95\" (UID: \"05a176d6-9fec-4b6e-b0ed-54b0e8847c97\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95"
Sep 16 02:35:49.664008 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:49.663971    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05a176d6-9fec-4b6e-b0ed-54b0e8847c97-maas-api-tls\") pod \"maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95\" (UID: \"05a176d6-9fec-4b6e-b0ed-54b0e8847c97\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95"
Sep 16 02:35:49.664189 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:49.664012    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05a176d6-9fec-4b6e-b0ed-54b0e8847c97-metrics-certs\") pod \"maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95\" (UID: \"05a176d6-9fec-4b6e-b0ed-54b0e8847c97\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95"
Sep 16 02:35:49.664189 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:49.664041    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr8hw\" (UniqueName: \"kubernetes.io/projected/05a176d6-9fec-4b6e-b0ed-54b0e8847c97-kube-api-access-gr8hw\") pod \"maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95\" (UID: \"05a176d6-9fec-4b6e-b0ed-54b0e8847c97\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95"
Sep 16 02:35:49.664189 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:49.664095    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05a176d6-9fec-4b6e-b0ed-54b0e8847c97-openshift-service-ca\") pod \"maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95\" (UID: \"05a176d6-9fec-4b6e-b0ed-54b0e8847c97\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95"
Sep 16 02:35:49.664794 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:49.664731    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05a176d6-9fec-4b6e-b0ed-54b0e8847c97-openshift-service-ca\") pod \"maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95\" (UID: \"05a176d6-9fec-4b6e-b0ed-54b0e8847c97\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95"
Sep 16 02:35:49.666502 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:49.666480    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05a176d6-9fec-4b6e-b0ed-54b0e8847c97-metrics-certs\") pod \"maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95\" (UID: \"05a176d6-9fec-4b6e-b0ed-54b0e8847c97\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95"
Sep 16 02:35:49.666586 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:49.666539    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05a176d6-9fec-4b6e-b0ed-54b0e8847c97-maas-api-tls\") pod \"maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95\" (UID: \"05a176d6-9fec-4b6e-b0ed-54b0e8847c97\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95"
Sep 16 02:35:49.671176 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:49.671150    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr8hw\" (UniqueName: \"kubernetes.io/projected/05a176d6-9fec-4b6e-b0ed-54b0e8847c97-kube-api-access-gr8hw\") pod \"maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95\" (UID: \"05a176d6-9fec-4b6e-b0ed-54b0e8847c97\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95"
Sep 16 02:35:49.860024 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:49.859934    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95"
Sep 16 02:35:50.137332 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:50.137301    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95"]
Sep 16 02:35:50.139000 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:35:50.138975    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05a176d6_9fec_4b6e_b0ed_54b0e8847c97.slice/crio-bc3a8251e680ab0eae847ad8f8b82e53a71546e1556b07fdbbe2facb1596ad4a WatchSource:0}: Error finding container bc3a8251e680ab0eae847ad8f8b82e53a71546e1556b07fdbbe2facb1596ad4a: Status 404 returned error can't find the container with id bc3a8251e680ab0eae847ad8f8b82e53a71546e1556b07fdbbe2facb1596ad4a
Sep 16 02:35:50.922365 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:50.922319    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95" event={"ID":"05a176d6-9fec-4b6e-b0ed-54b0e8847c97","Type":"ContainerStarted","Data":"ed81e1556a7c6f6f9e9992325fee325c7be7e733ab79f886531bbab128e1ac96"}
Sep 16 02:35:50.922812 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:50.922391    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95" event={"ID":"05a176d6-9fec-4b6e-b0ed-54b0e8847c97","Type":"ContainerStarted","Data":"bc3a8251e680ab0eae847ad8f8b82e53a71546e1556b07fdbbe2facb1596ad4a"}
Sep 16 02:35:50.922812 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:50.922435    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95"
Sep 16 02:35:50.938117 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:50.938073    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95" podStartSLOduration=1.6080844760000002 podStartE2EDuration="1.938059107s" totalImagesPullingTime="329.974631ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:35:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:35:50.936272033 +0000 UTC m=+1356.028454007" watchObservedRunningTime="2026-09-16 02:35:50.938059107 +0000 UTC m=+1356.030241118"
Sep 16 02:35:54.073972 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:54.073936    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:35:56.935088 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:35:56.935062    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95"
Sep 16 02:36:19.887327 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:19.887290    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:36:22.335923 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:22.335887    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k"]
Sep 16 02:36:22.336378 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:22.336204    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k" podUID="ba26e5d7-3917-44c9-866a-84e57d5f668b" containerName="maas-api" containerID="cri-o://1ded0ef18e0e0272d5da33321e4594a2b9d5dfe83055aa18507e4360ff3a17c1" gracePeriod=30
Sep 16 02:36:22.590304 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:22.590240    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k"
Sep 16 02:36:22.668312 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:22.668281    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba26e5d7-3917-44c9-866a-84e57d5f668b-metrics-certs\") pod \"ba26e5d7-3917-44c9-866a-84e57d5f668b\" (UID: \"ba26e5d7-3917-44c9-866a-84e57d5f668b\") "
Sep 16 02:36:22.668460 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:22.668339    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba26e5d7-3917-44c9-866a-84e57d5f668b-openshift-service-ca\") pod \"ba26e5d7-3917-44c9-866a-84e57d5f668b\" (UID: \"ba26e5d7-3917-44c9-866a-84e57d5f668b\") "
Sep 16 02:36:22.668460 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:22.668407    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba26e5d7-3917-44c9-866a-84e57d5f668b-maas-api-tls\") pod \"ba26e5d7-3917-44c9-866a-84e57d5f668b\" (UID: \"ba26e5d7-3917-44c9-866a-84e57d5f668b\") "
Sep 16 02:36:22.668460 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:22.668427    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4clm5\" (UniqueName: \"kubernetes.io/projected/ba26e5d7-3917-44c9-866a-84e57d5f668b-kube-api-access-4clm5\") pod \"ba26e5d7-3917-44c9-866a-84e57d5f668b\" (UID: \"ba26e5d7-3917-44c9-866a-84e57d5f668b\") "
Sep 16 02:36:22.668699 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:22.668677    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba26e5d7-3917-44c9-866a-84e57d5f668b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ba26e5d7-3917-44c9-866a-84e57d5f668b" (UID: "ba26e5d7-3917-44c9-866a-84e57d5f668b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:36:22.670535 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:22.670509    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba26e5d7-3917-44c9-866a-84e57d5f668b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ba26e5d7-3917-44c9-866a-84e57d5f668b" (UID: "ba26e5d7-3917-44c9-866a-84e57d5f668b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:36:22.670627 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:22.670543    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba26e5d7-3917-44c9-866a-84e57d5f668b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ba26e5d7-3917-44c9-866a-84e57d5f668b" (UID: "ba26e5d7-3917-44c9-866a-84e57d5f668b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:36:22.670627 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:22.670587    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba26e5d7-3917-44c9-866a-84e57d5f668b-kube-api-access-4clm5" (OuterVolumeSpecName: "kube-api-access-4clm5") pod "ba26e5d7-3917-44c9-866a-84e57d5f668b" (UID: "ba26e5d7-3917-44c9-866a-84e57d5f668b"). InnerVolumeSpecName "kube-api-access-4clm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:36:22.769639 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:22.769606    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba26e5d7-3917-44c9-866a-84e57d5f668b-metrics-certs\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:36:22.769639 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:22.769639    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba26e5d7-3917-44c9-866a-84e57d5f668b-openshift-service-ca\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:36:22.769798 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:22.769655    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba26e5d7-3917-44c9-866a-84e57d5f668b-maas-api-tls\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:36:22.769798 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:22.769667    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4clm5\" (UniqueName: \"kubernetes.io/projected/ba26e5d7-3917-44c9-866a-84e57d5f668b-kube-api-access-4clm5\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:36:23.120652 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:23.120620    2581 generic.go:356] "Generic (PLEG): container finished" podID="ba26e5d7-3917-44c9-866a-84e57d5f668b" containerID="1ded0ef18e0e0272d5da33321e4594a2b9d5dfe83055aa18507e4360ff3a17c1" exitCode=0
Sep 16 02:36:23.120652 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:23.120656    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k" event={"ID":"ba26e5d7-3917-44c9-866a-84e57d5f668b","Type":"ContainerDied","Data":"1ded0ef18e0e0272d5da33321e4594a2b9d5dfe83055aa18507e4360ff3a17c1"}
Sep 16 02:36:23.120886 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:23.120665    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k"
Sep 16 02:36:23.120886 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:23.120698    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k" event={"ID":"ba26e5d7-3917-44c9-866a-84e57d5f668b","Type":"ContainerDied","Data":"1f261b6bb44e77b320a1b1e3cf5af610ee17cf71c62cab7c3de06f3d4f759082"}
Sep 16 02:36:23.120886 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:23.120725    2581 scope.go:117] "RemoveContainer" containerID="1ded0ef18e0e0272d5da33321e4594a2b9d5dfe83055aa18507e4360ff3a17c1"
Sep 16 02:36:23.132174 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:23.132153    2581 scope.go:117] "RemoveContainer" containerID="1ded0ef18e0e0272d5da33321e4594a2b9d5dfe83055aa18507e4360ff3a17c1"
Sep 16 02:36:23.132422 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:36:23.132405    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ded0ef18e0e0272d5da33321e4594a2b9d5dfe83055aa18507e4360ff3a17c1\": container with ID starting with 1ded0ef18e0e0272d5da33321e4594a2b9d5dfe83055aa18507e4360ff3a17c1 not found: ID does not exist" containerID="1ded0ef18e0e0272d5da33321e4594a2b9d5dfe83055aa18507e4360ff3a17c1"
Sep 16 02:36:23.132488 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:23.132430    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ded0ef18e0e0272d5da33321e4594a2b9d5dfe83055aa18507e4360ff3a17c1"} err="failed to get container status \"1ded0ef18e0e0272d5da33321e4594a2b9d5dfe83055aa18507e4360ff3a17c1\": rpc error: code = NotFound desc = could not find container \"1ded0ef18e0e0272d5da33321e4594a2b9d5dfe83055aa18507e4360ff3a17c1\": container with ID starting with 1ded0ef18e0e0272d5da33321e4594a2b9d5dfe83055aa18507e4360ff3a17c1 not found: ID does not exist"
Sep 16 02:36:23.143900 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:23.143874    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k"]
Sep 16 02:36:23.147079 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:23.147057    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-60674e-5857b758f9-tkk8k"]
Sep 16 02:36:23.382901 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:23.382824    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba26e5d7-3917-44c9-866a-84e57d5f668b" path="/var/lib/kubelet/pods/ba26e5d7-3917-44c9-866a-84e57d5f668b/volumes"
Sep 16 02:36:28.786080 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:28.786046    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95"]
Sep 16 02:36:28.786601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:28.786304    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95" podUID="05a176d6-9fec-4b6e-b0ed-54b0e8847c97" containerName="maas-api" containerID="cri-o://ed81e1556a7c6f6f9e9992325fee325c7be7e733ab79f886531bbab128e1ac96" gracePeriod=30
Sep 16 02:36:29.040561 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:29.040497    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95"
Sep 16 02:36:29.128704 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:29.126191    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05a176d6-9fec-4b6e-b0ed-54b0e8847c97-metrics-certs\") pod \"05a176d6-9fec-4b6e-b0ed-54b0e8847c97\" (UID: \"05a176d6-9fec-4b6e-b0ed-54b0e8847c97\") "
Sep 16 02:36:29.128704 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:29.126244    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05a176d6-9fec-4b6e-b0ed-54b0e8847c97-maas-api-tls\") pod \"05a176d6-9fec-4b6e-b0ed-54b0e8847c97\" (UID: \"05a176d6-9fec-4b6e-b0ed-54b0e8847c97\") "
Sep 16 02:36:29.128704 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:29.126304    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05a176d6-9fec-4b6e-b0ed-54b0e8847c97-openshift-service-ca\") pod \"05a176d6-9fec-4b6e-b0ed-54b0e8847c97\" (UID: \"05a176d6-9fec-4b6e-b0ed-54b0e8847c97\") "
Sep 16 02:36:29.128704 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:29.126335    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gr8hw\" (UniqueName: \"kubernetes.io/projected/05a176d6-9fec-4b6e-b0ed-54b0e8847c97-kube-api-access-gr8hw\") pod \"05a176d6-9fec-4b6e-b0ed-54b0e8847c97\" (UID: \"05a176d6-9fec-4b6e-b0ed-54b0e8847c97\") "
Sep 16 02:36:29.128704 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:29.126969    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05a176d6-9fec-4b6e-b0ed-54b0e8847c97-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "05a176d6-9fec-4b6e-b0ed-54b0e8847c97" (UID: "05a176d6-9fec-4b6e-b0ed-54b0e8847c97"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:36:29.129572 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:29.129539    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05a176d6-9fec-4b6e-b0ed-54b0e8847c97-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "05a176d6-9fec-4b6e-b0ed-54b0e8847c97" (UID: "05a176d6-9fec-4b6e-b0ed-54b0e8847c97"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:36:29.131082 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:29.131045    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05a176d6-9fec-4b6e-b0ed-54b0e8847c97-kube-api-access-gr8hw" (OuterVolumeSpecName: "kube-api-access-gr8hw") pod "05a176d6-9fec-4b6e-b0ed-54b0e8847c97" (UID: "05a176d6-9fec-4b6e-b0ed-54b0e8847c97"). InnerVolumeSpecName "kube-api-access-gr8hw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:36:29.131474 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:29.131444    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05a176d6-9fec-4b6e-b0ed-54b0e8847c97-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "05a176d6-9fec-4b6e-b0ed-54b0e8847c97" (UID: "05a176d6-9fec-4b6e-b0ed-54b0e8847c97"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:36:29.160135 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:29.160107    2581 generic.go:356] "Generic (PLEG): container finished" podID="05a176d6-9fec-4b6e-b0ed-54b0e8847c97" containerID="ed81e1556a7c6f6f9e9992325fee325c7be7e733ab79f886531bbab128e1ac96" exitCode=0
Sep 16 02:36:29.160231 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:29.160150    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95"
Sep 16 02:36:29.160231 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:29.160163    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95" event={"ID":"05a176d6-9fec-4b6e-b0ed-54b0e8847c97","Type":"ContainerDied","Data":"ed81e1556a7c6f6f9e9992325fee325c7be7e733ab79f886531bbab128e1ac96"}
Sep 16 02:36:29.160344 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:29.160240    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95" event={"ID":"05a176d6-9fec-4b6e-b0ed-54b0e8847c97","Type":"ContainerDied","Data":"bc3a8251e680ab0eae847ad8f8b82e53a71546e1556b07fdbbe2facb1596ad4a"}
Sep 16 02:36:29.160344 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:29.160263    2581 scope.go:117] "RemoveContainer" containerID="ed81e1556a7c6f6f9e9992325fee325c7be7e733ab79f886531bbab128e1ac96"
Sep 16 02:36:29.169713 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:29.169696    2581 scope.go:117] "RemoveContainer" containerID="ed81e1556a7c6f6f9e9992325fee325c7be7e733ab79f886531bbab128e1ac96"
Sep 16 02:36:29.170013 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:36:29.169994    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed81e1556a7c6f6f9e9992325fee325c7be7e733ab79f886531bbab128e1ac96\": container with ID starting with ed81e1556a7c6f6f9e9992325fee325c7be7e733ab79f886531bbab128e1ac96 not found: ID does not exist" containerID="ed81e1556a7c6f6f9e9992325fee325c7be7e733ab79f886531bbab128e1ac96"
Sep 16 02:36:29.170098 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:29.170019    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed81e1556a7c6f6f9e9992325fee325c7be7e733ab79f886531bbab128e1ac96"} err="failed to get container status \"ed81e1556a7c6f6f9e9992325fee325c7be7e733ab79f886531bbab128e1ac96\": rpc error: code = NotFound desc = could not find container \"ed81e1556a7c6f6f9e9992325fee325c7be7e733ab79f886531bbab128e1ac96\": container with ID starting with ed81e1556a7c6f6f9e9992325fee325c7be7e733ab79f886531bbab128e1ac96 not found: ID does not exist"
Sep 16 02:36:29.181875 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:29.181840    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95"]
Sep 16 02:36:29.187629 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:29.187607    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-0bdfbb54-5dd8b945d4-64x95"]
Sep 16 02:36:29.227666 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:29.227640    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05a176d6-9fec-4b6e-b0ed-54b0e8847c97-metrics-certs\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:36:29.227666 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:29.227659    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05a176d6-9fec-4b6e-b0ed-54b0e8847c97-maas-api-tls\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:36:29.227666 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:29.227667    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05a176d6-9fec-4b6e-b0ed-54b0e8847c97-openshift-service-ca\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:36:29.227937 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:29.227677    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gr8hw\" (UniqueName: \"kubernetes.io/projected/05a176d6-9fec-4b6e-b0ed-54b0e8847c97-kube-api-access-gr8hw\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:36:29.382827 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:29.382752    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05a176d6-9fec-4b6e-b0ed-54b0e8847c97" path="/var/lib/kubelet/pods/05a176d6-9fec-4b6e-b0ed-54b0e8847c97/volumes"
Sep 16 02:36:35.334692 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:35.334653    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb"]
Sep 16 02:36:35.335183 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:35.335167    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05a176d6-9fec-4b6e-b0ed-54b0e8847c97" containerName="maas-api"
Sep 16 02:36:35.335241 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:35.335185    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="05a176d6-9fec-4b6e-b0ed-54b0e8847c97" containerName="maas-api"
Sep 16 02:36:35.335241 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:35.335213    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba26e5d7-3917-44c9-866a-84e57d5f668b" containerName="maas-api"
Sep 16 02:36:35.335241 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:35.335226    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba26e5d7-3917-44c9-866a-84e57d5f668b" containerName="maas-api"
Sep 16 02:36:35.335343 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:35.335290    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="05a176d6-9fec-4b6e-b0ed-54b0e8847c97" containerName="maas-api"
Sep 16 02:36:35.335343 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:35.335301    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba26e5d7-3917-44c9-866a-84e57d5f668b" containerName="maas-api"
Sep 16 02:36:35.339829 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:35.339809    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb"
Sep 16 02:36:35.342381 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:35.342360    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-4108a843-serving-cert\""
Sep 16 02:36:35.351476 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:35.351449    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb"]
Sep 16 02:36:35.483831 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:35.483794    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3f88929-c88d-46f0-a25e-34943e163b5b-metrics-certs\") pod \"maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb\" (UID: \"c3f88929-c88d-46f0-a25e-34943e163b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb"
Sep 16 02:36:35.484262 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:35.484233    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3f88929-c88d-46f0-a25e-34943e163b5b-maas-api-tls\") pod \"maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb\" (UID: \"c3f88929-c88d-46f0-a25e-34943e163b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb"
Sep 16 02:36:35.484390 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:35.484279    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3f88929-c88d-46f0-a25e-34943e163b5b-openshift-service-ca\") pod \"maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb\" (UID: \"c3f88929-c88d-46f0-a25e-34943e163b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb"
Sep 16 02:36:35.484390 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:35.484319    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftr59\" (UniqueName: \"kubernetes.io/projected/c3f88929-c88d-46f0-a25e-34943e163b5b-kube-api-access-ftr59\") pod \"maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb\" (UID: \"c3f88929-c88d-46f0-a25e-34943e163b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb"
Sep 16 02:36:35.585509 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:35.585436    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3f88929-c88d-46f0-a25e-34943e163b5b-maas-api-tls\") pod \"maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb\" (UID: \"c3f88929-c88d-46f0-a25e-34943e163b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb"
Sep 16 02:36:35.585509 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:35.585485    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3f88929-c88d-46f0-a25e-34943e163b5b-openshift-service-ca\") pod \"maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb\" (UID: \"c3f88929-c88d-46f0-a25e-34943e163b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb"
Sep 16 02:36:35.585705 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:35.585525    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftr59\" (UniqueName: \"kubernetes.io/projected/c3f88929-c88d-46f0-a25e-34943e163b5b-kube-api-access-ftr59\") pod \"maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb\" (UID: \"c3f88929-c88d-46f0-a25e-34943e163b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb"
Sep 16 02:36:35.585705 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:36:35.585558    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-serving-cert: secret "maas-api-e2e-ait-4108a843-serving-cert" not found
Sep 16 02:36:35.585705 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:35.585573    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3f88929-c88d-46f0-a25e-34943e163b5b-metrics-certs\") pod \"maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb\" (UID: \"c3f88929-c88d-46f0-a25e-34943e163b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb"
Sep 16 02:36:35.585705 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:36:35.585624    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3f88929-c88d-46f0-a25e-34943e163b5b-maas-api-tls podName:c3f88929-c88d-46f0-a25e-34943e163b5b nodeName:}" failed. No retries permitted until 2026-09-16 02:36:36.085608539 +0000 UTC m=+1401.177790490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c3f88929-c88d-46f0-a25e-34943e163b5b-maas-api-tls") pod "maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb" (UID: "c3f88929-c88d-46f0-a25e-34943e163b5b") : secret "maas-api-e2e-ait-4108a843-serving-cert" not found
Sep 16 02:36:35.586106 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:35.586088    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3f88929-c88d-46f0-a25e-34943e163b5b-openshift-service-ca\") pod \"maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb\" (UID: \"c3f88929-c88d-46f0-a25e-34943e163b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb"
Sep 16 02:36:35.588150 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:35.588127    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3f88929-c88d-46f0-a25e-34943e163b5b-metrics-certs\") pod \"maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb\" (UID: \"c3f88929-c88d-46f0-a25e-34943e163b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb"
Sep 16 02:36:35.593783 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:35.593761    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftr59\" (UniqueName: \"kubernetes.io/projected/c3f88929-c88d-46f0-a25e-34943e163b5b-kube-api-access-ftr59\") pod \"maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb\" (UID: \"c3f88929-c88d-46f0-a25e-34943e163b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb"
Sep 16 02:36:36.090371 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:36.090336    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3f88929-c88d-46f0-a25e-34943e163b5b-maas-api-tls\") pod \"maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb\" (UID: \"c3f88929-c88d-46f0-a25e-34943e163b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb"
Sep 16 02:36:36.092815 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:36.092796    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3f88929-c88d-46f0-a25e-34943e163b5b-maas-api-tls\") pod \"maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb\" (UID: \"c3f88929-c88d-46f0-a25e-34943e163b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb"
Sep 16 02:36:36.254127 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:36.254099    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb"
Sep 16 02:36:36.528445 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:36.528421    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb"]
Sep 16 02:36:36.530239 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:36:36.530214    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3f88929_c88d_46f0_a25e_34943e163b5b.slice/crio-3646b48ebc3daa188529add958c2c1e34bad9cf4b001b0128cc5fa44867cde58 WatchSource:0}: Error finding container 3646b48ebc3daa188529add958c2c1e34bad9cf4b001b0128cc5fa44867cde58: Status 404 returned error can't find the container with id 3646b48ebc3daa188529add958c2c1e34bad9cf4b001b0128cc5fa44867cde58
Sep 16 02:36:37.213603 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:37.213510    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb" event={"ID":"c3f88929-c88d-46f0-a25e-34943e163b5b","Type":"ContainerStarted","Data":"691bddfb67276a6d132a53c4d64a5c3b7d62c0af1ce83bd4bb9de2cc2befdf22"}
Sep 16 02:36:37.213603 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:37.213578    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb" event={"ID":"c3f88929-c88d-46f0-a25e-34943e163b5b","Type":"ContainerStarted","Data":"3646b48ebc3daa188529add958c2c1e34bad9cf4b001b0128cc5fa44867cde58"}
Sep 16 02:36:37.214026 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:37.213605    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb"
Sep 16 02:36:37.230081 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:37.230038    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb" podStartSLOduration=1.7990229119999999 podStartE2EDuration="2.230021731s" totalImagesPullingTime="430.998819ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:36:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:36:37.228702717 +0000 UTC m=+1402.320884690" watchObservedRunningTime="2026-09-16 02:36:37.230021731 +0000 UTC m=+1402.322203705"
Sep 16 02:36:40.641866 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:40.641815    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9"]
Sep 16 02:36:40.642287 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:40.642050    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9" podUID="59f2a346-1276-432f-92e2-dff7cc7f0371" containerName="maas-api" containerID="cri-o://767416c007b76eb2d789f4e787671916aef1170d53ee43bea7d44093ed42d3ad" gracePeriod=30
Sep 16 02:36:40.890240 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:40.890216    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9"
Sep 16 02:36:40.936265 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:40.936194    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59f2a346-1276-432f-92e2-dff7cc7f0371-metrics-certs\") pod \"59f2a346-1276-432f-92e2-dff7cc7f0371\" (UID: \"59f2a346-1276-432f-92e2-dff7cc7f0371\") "
Sep 16 02:36:40.936265 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:40.936249    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59f2a346-1276-432f-92e2-dff7cc7f0371-maas-api-tls\") pod \"59f2a346-1276-432f-92e2-dff7cc7f0371\" (UID: \"59f2a346-1276-432f-92e2-dff7cc7f0371\") "
Sep 16 02:36:40.936447 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:40.936278    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmwfx\" (UniqueName: \"kubernetes.io/projected/59f2a346-1276-432f-92e2-dff7cc7f0371-kube-api-access-nmwfx\") pod \"59f2a346-1276-432f-92e2-dff7cc7f0371\" (UID: \"59f2a346-1276-432f-92e2-dff7cc7f0371\") "
Sep 16 02:36:40.936447 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:40.936301    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59f2a346-1276-432f-92e2-dff7cc7f0371-openshift-service-ca\") pod \"59f2a346-1276-432f-92e2-dff7cc7f0371\" (UID: \"59f2a346-1276-432f-92e2-dff7cc7f0371\") "
Sep 16 02:36:40.936729 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:40.936702    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59f2a346-1276-432f-92e2-dff7cc7f0371-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "59f2a346-1276-432f-92e2-dff7cc7f0371" (UID: "59f2a346-1276-432f-92e2-dff7cc7f0371"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:36:40.938429 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:40.938405    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59f2a346-1276-432f-92e2-dff7cc7f0371-kube-api-access-nmwfx" (OuterVolumeSpecName: "kube-api-access-nmwfx") pod "59f2a346-1276-432f-92e2-dff7cc7f0371" (UID: "59f2a346-1276-432f-92e2-dff7cc7f0371"). InnerVolumeSpecName "kube-api-access-nmwfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:36:40.938811 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:40.938795    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59f2a346-1276-432f-92e2-dff7cc7f0371-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "59f2a346-1276-432f-92e2-dff7cc7f0371" (UID: "59f2a346-1276-432f-92e2-dff7cc7f0371"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:36:40.938910 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:40.938817    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59f2a346-1276-432f-92e2-dff7cc7f0371-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "59f2a346-1276-432f-92e2-dff7cc7f0371" (UID: "59f2a346-1276-432f-92e2-dff7cc7f0371"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:36:41.037281 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:41.037253    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59f2a346-1276-432f-92e2-dff7cc7f0371-maas-api-tls\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:36:41.037281 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:41.037282    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmwfx\" (UniqueName: \"kubernetes.io/projected/59f2a346-1276-432f-92e2-dff7cc7f0371-kube-api-access-nmwfx\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:36:41.037444 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:41.037292    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59f2a346-1276-432f-92e2-dff7cc7f0371-openshift-service-ca\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:36:41.037444 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:41.037301    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59f2a346-1276-432f-92e2-dff7cc7f0371-metrics-certs\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:36:41.240006 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:41.239927    2581 generic.go:356] "Generic (PLEG): container finished" podID="59f2a346-1276-432f-92e2-dff7cc7f0371" containerID="767416c007b76eb2d789f4e787671916aef1170d53ee43bea7d44093ed42d3ad" exitCode=0
Sep 16 02:36:41.240006 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:41.239972    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9"
Sep 16 02:36:41.240201 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:41.240009    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9" event={"ID":"59f2a346-1276-432f-92e2-dff7cc7f0371","Type":"ContainerDied","Data":"767416c007b76eb2d789f4e787671916aef1170d53ee43bea7d44093ed42d3ad"}
Sep 16 02:36:41.240201 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:41.240064    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9" event={"ID":"59f2a346-1276-432f-92e2-dff7cc7f0371","Type":"ContainerDied","Data":"458bec0d74de64965efa79a5da4f520a91703e0c9ea8a1305613399aa3a26f1b"}
Sep 16 02:36:41.240201 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:41.240093    2581 scope.go:117] "RemoveContainer" containerID="767416c007b76eb2d789f4e787671916aef1170d53ee43bea7d44093ed42d3ad"
Sep 16 02:36:41.250067 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:41.250047    2581 scope.go:117] "RemoveContainer" containerID="767416c007b76eb2d789f4e787671916aef1170d53ee43bea7d44093ed42d3ad"
Sep 16 02:36:41.250337 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:36:41.250320    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"767416c007b76eb2d789f4e787671916aef1170d53ee43bea7d44093ed42d3ad\": container with ID starting with 767416c007b76eb2d789f4e787671916aef1170d53ee43bea7d44093ed42d3ad not found: ID does not exist" containerID="767416c007b76eb2d789f4e787671916aef1170d53ee43bea7d44093ed42d3ad"
Sep 16 02:36:41.250408 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:41.250345    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"767416c007b76eb2d789f4e787671916aef1170d53ee43bea7d44093ed42d3ad"} err="failed to get container status \"767416c007b76eb2d789f4e787671916aef1170d53ee43bea7d44093ed42d3ad\": rpc error: code = NotFound desc = could not find container \"767416c007b76eb2d789f4e787671916aef1170d53ee43bea7d44093ed42d3ad\": container with ID starting with 767416c007b76eb2d789f4e787671916aef1170d53ee43bea7d44093ed42d3ad not found: ID does not exist"
Sep 16 02:36:41.262217 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:41.262194    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9"]
Sep 16 02:36:41.265192 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:41.265175    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1a323c-58bdfd4d59-k5lb9"]
Sep 16 02:36:41.382832 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:41.382798    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59f2a346-1276-432f-92e2-dff7cc7f0371" path="/var/lib/kubelet/pods/59f2a346-1276-432f-92e2-dff7cc7f0371/volumes"
Sep 16 02:36:43.226344 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:43.226316    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb"
Sep 16 02:36:48.181865 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.181817    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"]
Sep 16 02:36:48.182312 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.182243    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59f2a346-1276-432f-92e2-dff7cc7f0371" containerName="maas-api"
Sep 16 02:36:48.182312 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.182254    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="59f2a346-1276-432f-92e2-dff7cc7f0371" containerName="maas-api"
Sep 16 02:36:48.182420 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.182319    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="59f2a346-1276-432f-92e2-dff7cc7f0371" containerName="maas-api"
Sep 16 02:36:48.185542 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.185473    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:48.187900 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.187880    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-24aabe-openshift-default-dockercfg-jfkpd\""
Sep 16 02:36:48.188006 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.187885    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 16 02:36:48.197588 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.197566    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"]
Sep 16 02:36:48.298985 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.298955    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/839d2afe-c2eb-4480-b9fa-3ef261b87fef-istio-token\") pod \"e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") " pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:48.299132 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.298994    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/839d2afe-c2eb-4480-b9fa-3ef261b87fef-istiod-ca-cert\") pod \"e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") " pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:48.299132 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.299017    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgwkw\" (UniqueName: \"kubernetes.io/projected/839d2afe-c2eb-4480-b9fa-3ef261b87fef-kube-api-access-lgwkw\") pod \"e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") " pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:48.299132 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.299095    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/839d2afe-c2eb-4480-b9fa-3ef261b87fef-istio-envoy\") pod \"e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") " pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:48.299312 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.299133    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/839d2afe-c2eb-4480-b9fa-3ef261b87fef-istio-data\") pod \"e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") " pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:48.299312 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.299152    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/839d2afe-c2eb-4480-b9fa-3ef261b87fef-workload-socket\") pod \"e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") " pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:48.299312 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.299173    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/839d2afe-c2eb-4480-b9fa-3ef261b87fef-credential-socket\") pod \"e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") " pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:48.299312 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.299210    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/839d2afe-c2eb-4480-b9fa-3ef261b87fef-workload-certs\") pod \"e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") " pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:48.299312 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.299233    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/839d2afe-c2eb-4480-b9fa-3ef261b87fef-istio-podinfo\") pod \"e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") " pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:48.400394 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.400358    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/839d2afe-c2eb-4480-b9fa-3ef261b87fef-istio-token\") pod \"e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") " pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:48.400535 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.400401    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/839d2afe-c2eb-4480-b9fa-3ef261b87fef-istiod-ca-cert\") pod \"e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") " pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:48.400535 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.400420    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgwkw\" (UniqueName: \"kubernetes.io/projected/839d2afe-c2eb-4480-b9fa-3ef261b87fef-kube-api-access-lgwkw\") pod \"e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") " pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:48.400535 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.400452    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/839d2afe-c2eb-4480-b9fa-3ef261b87fef-istio-envoy\") pod \"e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") " pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:48.400535 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.400474    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/839d2afe-c2eb-4480-b9fa-3ef261b87fef-istio-data\") pod \"e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") " pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:48.400535 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.400495    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/839d2afe-c2eb-4480-b9fa-3ef261b87fef-workload-socket\") pod \"e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") " pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:48.400535 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.400513    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/839d2afe-c2eb-4480-b9fa-3ef261b87fef-credential-socket\") pod \"e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") " pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:48.400830 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.400564    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/839d2afe-c2eb-4480-b9fa-3ef261b87fef-workload-certs\") pod \"e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") " pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:48.400830 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.400588    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/839d2afe-c2eb-4480-b9fa-3ef261b87fef-istio-podinfo\") pod \"e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") " pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:48.400960 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.400937    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/839d2afe-c2eb-4480-b9fa-3ef261b87fef-credential-socket\") pod \"e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") " pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:48.401080 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.401050    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/839d2afe-c2eb-4480-b9fa-3ef261b87fef-workload-certs\") pod \"e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") " pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:48.401151 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.401133    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/839d2afe-c2eb-4480-b9fa-3ef261b87fef-istio-data\") pod \"e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") " pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:48.401151 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.401147    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/839d2afe-c2eb-4480-b9fa-3ef261b87fef-workload-socket\") pod \"e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") " pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:48.401254 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.401232    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/839d2afe-c2eb-4480-b9fa-3ef261b87fef-istiod-ca-cert\") pod \"e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") " pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:48.402967 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.402947    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/839d2afe-c2eb-4480-b9fa-3ef261b87fef-istio-envoy\") pod \"e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") " pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:48.403091 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.403074    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/839d2afe-c2eb-4480-b9fa-3ef261b87fef-istio-podinfo\") pod \"e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") " pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:48.407923 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.407899    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/839d2afe-c2eb-4480-b9fa-3ef261b87fef-istio-token\") pod \"e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") " pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:48.408334 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.408315    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgwkw\" (UniqueName: \"kubernetes.io/projected/839d2afe-c2eb-4480-b9fa-3ef261b87fef-kube-api-access-lgwkw\") pod \"e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") " pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:48.498241 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.498177    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:48.773534 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:48.773508    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"]
Sep 16 02:36:48.774877 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:36:48.774830    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod839d2afe_c2eb_4480_b9fa_3ef261b87fef.slice/crio-a2b1619c3012035b7404e7538132fd1b0ab430b2c970d6730817648ba49e7b4a WatchSource:0}: Error finding container a2b1619c3012035b7404e7538132fd1b0ab430b2c970d6730817648ba49e7b4a: Status 404 returned error can't find the container with id a2b1619c3012035b7404e7538132fd1b0ab430b2c970d6730817648ba49e7b4a
Sep 16 02:36:49.292159 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:49.292126    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7" event={"ID":"839d2afe-c2eb-4480-b9fa-3ef261b87fef","Type":"ContainerStarted","Data":"a2b1619c3012035b7404e7538132fd1b0ab430b2c970d6730817648ba49e7b4a"}
Sep 16 02:36:51.420266 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:51.420235    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 02:36:51.420499 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:51.420304    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 02:36:51.420499 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:51.420332    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 02:36:52.313038 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:52.313001    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7" event={"ID":"839d2afe-c2eb-4480-b9fa-3ef261b87fef","Type":"ContainerStarted","Data":"629030d00ecdfdd6a1f611a8804d1e914842c5ce84ffc8679489d8a24e5d8387"}
Sep 16 02:36:52.334386 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:52.334339    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7" podStartSLOduration=1.691256503 podStartE2EDuration="4.334323404s" totalImagesPullingTime="2.643066901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:36:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:36:52.330931865 +0000 UTC m=+1417.423113837" watchObservedRunningTime="2026-09-16 02:36:52.334323404 +0000 UTC m=+1417.426505376"
Sep 16 02:36:52.499105 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:52.499071    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:52.504949 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:52.504926    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:53.319315 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:53.319284    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:53.320101 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:53.320082    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:36:55.994293 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:55.994262    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:36:56.525640 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:56.525606    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr"]
Sep 16 02:36:56.530063 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:56.530040    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr"
Sep 16 02:36:56.532349 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:56.532333    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-24aabe-serving-cert\""
Sep 16 02:36:56.542549 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:56.542515    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr"]
Sep 16 02:36:56.578190 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:56.578156    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fac8f915-7d33-47f2-8722-b173cedcf6d2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr\" (UID: \"fac8f915-7d33-47f2-8722-b173cedcf6d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr"
Sep 16 02:36:56.578300 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:56.578204    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q6wt\" (UniqueName: \"kubernetes.io/projected/fac8f915-7d33-47f2-8722-b173cedcf6d2-kube-api-access-2q6wt\") pod \"maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr\" (UID: \"fac8f915-7d33-47f2-8722-b173cedcf6d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr"
Sep 16 02:36:56.578349 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:56.578303    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fac8f915-7d33-47f2-8722-b173cedcf6d2-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr\" (UID: \"fac8f915-7d33-47f2-8722-b173cedcf6d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr"
Sep 16 02:36:56.578389 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:56.578367    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac8f915-7d33-47f2-8722-b173cedcf6d2-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr\" (UID: \"fac8f915-7d33-47f2-8722-b173cedcf6d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr"
Sep 16 02:36:56.679342 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:56.679304    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fac8f915-7d33-47f2-8722-b173cedcf6d2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr\" (UID: \"fac8f915-7d33-47f2-8722-b173cedcf6d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr"
Sep 16 02:36:56.679523 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:56.679349    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q6wt\" (UniqueName: \"kubernetes.io/projected/fac8f915-7d33-47f2-8722-b173cedcf6d2-kube-api-access-2q6wt\") pod \"maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr\" (UID: \"fac8f915-7d33-47f2-8722-b173cedcf6d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr"
Sep 16 02:36:56.679523 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:56.679416    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fac8f915-7d33-47f2-8722-b173cedcf6d2-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr\" (UID: \"fac8f915-7d33-47f2-8722-b173cedcf6d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr"
Sep 16 02:36:56.679523 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:56.679470    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac8f915-7d33-47f2-8722-b173cedcf6d2-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr\" (UID: \"fac8f915-7d33-47f2-8722-b173cedcf6d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr"
Sep 16 02:36:56.680140 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:56.680103    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fac8f915-7d33-47f2-8722-b173cedcf6d2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr\" (UID: \"fac8f915-7d33-47f2-8722-b173cedcf6d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr"
Sep 16 02:36:56.681997 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:56.681977    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac8f915-7d33-47f2-8722-b173cedcf6d2-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr\" (UID: \"fac8f915-7d33-47f2-8722-b173cedcf6d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr"
Sep 16 02:36:56.682122 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:56.682101    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fac8f915-7d33-47f2-8722-b173cedcf6d2-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr\" (UID: \"fac8f915-7d33-47f2-8722-b173cedcf6d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr"
Sep 16 02:36:56.686866 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:56.686827    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q6wt\" (UniqueName: \"kubernetes.io/projected/fac8f915-7d33-47f2-8722-b173cedcf6d2-kube-api-access-2q6wt\") pod \"maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr\" (UID: \"fac8f915-7d33-47f2-8722-b173cedcf6d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr"
Sep 16 02:36:56.845587 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:56.845509    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr"
Sep 16 02:36:57.121383 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:57.121360    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr"]
Sep 16 02:36:57.122683 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:36:57.122639    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfac8f915_7d33_47f2_8722_b173cedcf6d2.slice/crio-ddfa7d1c7d1674aea9e53a45ca30df04a71652a7eed2725c5ecaab52940b8a6f WatchSource:0}: Error finding container ddfa7d1c7d1674aea9e53a45ca30df04a71652a7eed2725c5ecaab52940b8a6f: Status 404 returned error can't find the container with id ddfa7d1c7d1674aea9e53a45ca30df04a71652a7eed2725c5ecaab52940b8a6f
Sep 16 02:36:57.346238 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:57.346206    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr" event={"ID":"fac8f915-7d33-47f2-8722-b173cedcf6d2","Type":"ContainerStarted","Data":"ddfa7d1c7d1674aea9e53a45ca30df04a71652a7eed2725c5ecaab52940b8a6f"}
Sep 16 02:36:58.353596 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:58.353560    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr" event={"ID":"fac8f915-7d33-47f2-8722-b173cedcf6d2","Type":"ContainerStarted","Data":"d72f6c412a115b57ed4c558ae99c6fd6b9a4e92f4fcfed713a22361c0ceaddcc"}
Sep 16 02:36:58.354018 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:58.353626    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr"
Sep 16 02:36:58.371232 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:36:58.371181    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr" podStartSLOduration=1.836988898 podStartE2EDuration="2.371168761s" totalImagesPullingTime="534.179863ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:36:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:36:58.369110799 +0000 UTC m=+1423.461292772" watchObservedRunningTime="2026-09-16 02:36:58.371168761 +0000 UTC m=+1423.463350733"
Sep 16 02:37:04.091440 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:04.091406    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb"]
Sep 16 02:37:04.091987 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:04.091636    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb" podUID="c3f88929-c88d-46f0-a25e-34943e163b5b" containerName="maas-api" containerID="cri-o://691bddfb67276a6d132a53c4d64a5c3b7d62c0af1ce83bd4bb9de2cc2befdf22" gracePeriod=30
Sep 16 02:37:04.355662 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:04.355608    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb"
Sep 16 02:37:04.365331 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:04.365308    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr"
Sep 16 02:37:04.401392 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:04.401333    2581 generic.go:356] "Generic (PLEG): container finished" podID="c3f88929-c88d-46f0-a25e-34943e163b5b" containerID="691bddfb67276a6d132a53c4d64a5c3b7d62c0af1ce83bd4bb9de2cc2befdf22" exitCode=0
Sep 16 02:37:04.401392 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:04.401369    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb" event={"ID":"c3f88929-c88d-46f0-a25e-34943e163b5b","Type":"ContainerDied","Data":"691bddfb67276a6d132a53c4d64a5c3b7d62c0af1ce83bd4bb9de2cc2befdf22"}
Sep 16 02:37:04.401634 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:04.401433    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb" event={"ID":"c3f88929-c88d-46f0-a25e-34943e163b5b","Type":"ContainerDied","Data":"3646b48ebc3daa188529add958c2c1e34bad9cf4b001b0128cc5fa44867cde58"}
Sep 16 02:37:04.401634 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:04.401464    2581 scope.go:117] "RemoveContainer" containerID="691bddfb67276a6d132a53c4d64a5c3b7d62c0af1ce83bd4bb9de2cc2befdf22"
Sep 16 02:37:04.401723 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:04.401655    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb"
Sep 16 02:37:04.413949 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:04.413930    2581 scope.go:117] "RemoveContainer" containerID="691bddfb67276a6d132a53c4d64a5c3b7d62c0af1ce83bd4bb9de2cc2befdf22"
Sep 16 02:37:04.414262 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:37:04.414239    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"691bddfb67276a6d132a53c4d64a5c3b7d62c0af1ce83bd4bb9de2cc2befdf22\": container with ID starting with 691bddfb67276a6d132a53c4d64a5c3b7d62c0af1ce83bd4bb9de2cc2befdf22 not found: ID does not exist" containerID="691bddfb67276a6d132a53c4d64a5c3b7d62c0af1ce83bd4bb9de2cc2befdf22"
Sep 16 02:37:04.414319 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:04.414276    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"691bddfb67276a6d132a53c4d64a5c3b7d62c0af1ce83bd4bb9de2cc2befdf22"} err="failed to get container status \"691bddfb67276a6d132a53c4d64a5c3b7d62c0af1ce83bd4bb9de2cc2befdf22\": rpc error: code = NotFound desc = could not find container \"691bddfb67276a6d132a53c4d64a5c3b7d62c0af1ce83bd4bb9de2cc2befdf22\": container with ID starting with 691bddfb67276a6d132a53c4d64a5c3b7d62c0af1ce83bd4bb9de2cc2befdf22 not found: ID does not exist"
Sep 16 02:37:04.451698 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:04.451673    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3f88929-c88d-46f0-a25e-34943e163b5b-metrics-certs\") pod \"c3f88929-c88d-46f0-a25e-34943e163b5b\" (UID: \"c3f88929-c88d-46f0-a25e-34943e163b5b\") "
Sep 16 02:37:04.451862 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:04.451779    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftr59\" (UniqueName: \"kubernetes.io/projected/c3f88929-c88d-46f0-a25e-34943e163b5b-kube-api-access-ftr59\") pod \"c3f88929-c88d-46f0-a25e-34943e163b5b\" (UID: \"c3f88929-c88d-46f0-a25e-34943e163b5b\") "
Sep 16 02:37:04.451862 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:04.451798    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3f88929-c88d-46f0-a25e-34943e163b5b-openshift-service-ca\") pod \"c3f88929-c88d-46f0-a25e-34943e163b5b\" (UID: \"c3f88929-c88d-46f0-a25e-34943e163b5b\") "
Sep 16 02:37:04.451862 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:04.451860    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3f88929-c88d-46f0-a25e-34943e163b5b-maas-api-tls\") pod \"c3f88929-c88d-46f0-a25e-34943e163b5b\" (UID: \"c3f88929-c88d-46f0-a25e-34943e163b5b\") "
Sep 16 02:37:04.452208 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:04.452173    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3f88929-c88d-46f0-a25e-34943e163b5b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c3f88929-c88d-46f0-a25e-34943e163b5b" (UID: "c3f88929-c88d-46f0-a25e-34943e163b5b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:37:04.453800 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:04.453774    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3f88929-c88d-46f0-a25e-34943e163b5b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c3f88929-c88d-46f0-a25e-34943e163b5b" (UID: "c3f88929-c88d-46f0-a25e-34943e163b5b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:37:04.453986 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:04.453968    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3f88929-c88d-46f0-a25e-34943e163b5b-kube-api-access-ftr59" (OuterVolumeSpecName: "kube-api-access-ftr59") pod "c3f88929-c88d-46f0-a25e-34943e163b5b" (UID: "c3f88929-c88d-46f0-a25e-34943e163b5b"). InnerVolumeSpecName "kube-api-access-ftr59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:37:04.454065 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:04.454047    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3f88929-c88d-46f0-a25e-34943e163b5b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c3f88929-c88d-46f0-a25e-34943e163b5b" (UID: "c3f88929-c88d-46f0-a25e-34943e163b5b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:37:04.553006 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:04.552977    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftr59\" (UniqueName: \"kubernetes.io/projected/c3f88929-c88d-46f0-a25e-34943e163b5b-kube-api-access-ftr59\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:37:04.553006 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:04.553003    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3f88929-c88d-46f0-a25e-34943e163b5b-openshift-service-ca\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:37:04.553182 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:04.553018    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3f88929-c88d-46f0-a25e-34943e163b5b-maas-api-tls\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:37:04.553182 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:04.553029    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3f88929-c88d-46f0-a25e-34943e163b5b-metrics-certs\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:37:04.736027 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:04.735997    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb"]
Sep 16 02:37:04.748861 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:04.748824    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4108a843-6989ddf6c5-nkwnb"]
Sep 16 02:37:05.383734 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:05.383701    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3f88929-c88d-46f0-a25e-34943e163b5b" path="/var/lib/kubelet/pods/c3f88929-c88d-46f0-a25e-34943e163b5b/volumes"
Sep 16 02:37:10.003045 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:10.002956    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2"]
Sep 16 02:37:10.004412 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:10.004385    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3f88929-c88d-46f0-a25e-34943e163b5b" containerName="maas-api"
Sep 16 02:37:10.004412 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:10.004410    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3f88929-c88d-46f0-a25e-34943e163b5b" containerName="maas-api"
Sep 16 02:37:10.004612 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:10.004557    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3f88929-c88d-46f0-a25e-34943e163b5b" containerName="maas-api"
Sep 16 02:37:10.010559 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:10.010542    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2"
Sep 16 02:37:10.013000 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:10.012978    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-2e69f8df-serving-cert\""
Sep 16 02:37:10.017140 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:10.017117    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2"]
Sep 16 02:37:10.106522 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:10.106489    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44ec6a4a-ad43-4d32-8b15-ceffbb1717b4-openshift-service-ca\") pod \"maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2\" (UID: \"44ec6a4a-ad43-4d32-8b15-ceffbb1717b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2"
Sep 16 02:37:10.106522 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:10.106524    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44ec6a4a-ad43-4d32-8b15-ceffbb1717b4-metrics-certs\") pod \"maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2\" (UID: \"44ec6a4a-ad43-4d32-8b15-ceffbb1717b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2"
Sep 16 02:37:10.106724 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:10.106545    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44ec6a4a-ad43-4d32-8b15-ceffbb1717b4-maas-api-tls\") pod \"maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2\" (UID: \"44ec6a4a-ad43-4d32-8b15-ceffbb1717b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2"
Sep 16 02:37:10.106724 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:10.106615    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8lm4\" (UniqueName: \"kubernetes.io/projected/44ec6a4a-ad43-4d32-8b15-ceffbb1717b4-kube-api-access-f8lm4\") pod \"maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2\" (UID: \"44ec6a4a-ad43-4d32-8b15-ceffbb1717b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2"
Sep 16 02:37:10.207626 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:10.207582    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44ec6a4a-ad43-4d32-8b15-ceffbb1717b4-maas-api-tls\") pod \"maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2\" (UID: \"44ec6a4a-ad43-4d32-8b15-ceffbb1717b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2"
Sep 16 02:37:10.207793 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:10.207652    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8lm4\" (UniqueName: \"kubernetes.io/projected/44ec6a4a-ad43-4d32-8b15-ceffbb1717b4-kube-api-access-f8lm4\") pod \"maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2\" (UID: \"44ec6a4a-ad43-4d32-8b15-ceffbb1717b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2"
Sep 16 02:37:10.207793 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:10.207779    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44ec6a4a-ad43-4d32-8b15-ceffbb1717b4-openshift-service-ca\") pod \"maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2\" (UID: \"44ec6a4a-ad43-4d32-8b15-ceffbb1717b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2"
Sep 16 02:37:10.207901 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:10.207809    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44ec6a4a-ad43-4d32-8b15-ceffbb1717b4-metrics-certs\") pod \"maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2\" (UID: \"44ec6a4a-ad43-4d32-8b15-ceffbb1717b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2"
Sep 16 02:37:10.208394 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:10.208367    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44ec6a4a-ad43-4d32-8b15-ceffbb1717b4-openshift-service-ca\") pod \"maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2\" (UID: \"44ec6a4a-ad43-4d32-8b15-ceffbb1717b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2"
Sep 16 02:37:10.210447 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:10.210427    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44ec6a4a-ad43-4d32-8b15-ceffbb1717b4-metrics-certs\") pod \"maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2\" (UID: \"44ec6a4a-ad43-4d32-8b15-ceffbb1717b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2"
Sep 16 02:37:10.210576 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:10.210468    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44ec6a4a-ad43-4d32-8b15-ceffbb1717b4-maas-api-tls\") pod \"maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2\" (UID: \"44ec6a4a-ad43-4d32-8b15-ceffbb1717b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2"
Sep 16 02:37:10.224976 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:10.224954    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8lm4\" (UniqueName: \"kubernetes.io/projected/44ec6a4a-ad43-4d32-8b15-ceffbb1717b4-kube-api-access-f8lm4\") pod \"maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2\" (UID: \"44ec6a4a-ad43-4d32-8b15-ceffbb1717b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2"
Sep 16 02:37:10.324938 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:10.324914    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2"
Sep 16 02:37:10.600747 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:10.600710    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2"]
Sep 16 02:37:10.601954 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:37:10.601933    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44ec6a4a_ad43_4d32_8b15_ceffbb1717b4.slice/crio-dd273b4623420469fba10fb70d245dd3d90492fd0c0795b0d5af4807b8a5637f WatchSource:0}: Error finding container dd273b4623420469fba10fb70d245dd3d90492fd0c0795b0d5af4807b8a5637f: Status 404 returned error can't find the container with id dd273b4623420469fba10fb70d245dd3d90492fd0c0795b0d5af4807b8a5637f
Sep 16 02:37:11.448745 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:11.448661    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2" event={"ID":"44ec6a4a-ad43-4d32-8b15-ceffbb1717b4","Type":"ContainerStarted","Data":"43fc3b9a023f02075b752625d55bf2f835d5d144f89e0e8ccf8d69861fd7ea55"}
Sep 16 02:37:11.448745 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:11.448722    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2" event={"ID":"44ec6a4a-ad43-4d32-8b15-ceffbb1717b4","Type":"ContainerStarted","Data":"dd273b4623420469fba10fb70d245dd3d90492fd0c0795b0d5af4807b8a5637f"}
Sep 16 02:37:11.449151 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:11.448842    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2"
Sep 16 02:37:11.463347 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:11.463307    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2" podStartSLOduration=1.9286192309999999 podStartE2EDuration="2.46329397s" totalImagesPullingTime="534.674739ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:37:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:37:11.462556859 +0000 UTC m=+1436.554738834" watchObservedRunningTime="2026-09-16 02:37:11.46329397 +0000 UTC m=+1436.555475943"
Sep 16 02:37:14.421985 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:14.421941    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q"]
Sep 16 02:37:14.428783 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:14.428756    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q"
Sep 16 02:37:14.431254 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:14.431234    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-a53a44-serving-cert\""
Sep 16 02:37:14.435402 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:14.435378    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q"]
Sep 16 02:37:14.550697 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:14.550663    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77e1acd3-8ce3-4ab4-b109-5e03c3e447c0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q\" (UID: \"77e1acd3-8ce3-4ab4-b109-5e03c3e447c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q"
Sep 16 02:37:14.550878 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:14.550721    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77e1acd3-8ce3-4ab4-b109-5e03c3e447c0-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q\" (UID: \"77e1acd3-8ce3-4ab4-b109-5e03c3e447c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q"
Sep 16 02:37:14.550878 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:14.550743    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77e1acd3-8ce3-4ab4-b109-5e03c3e447c0-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q\" (UID: \"77e1acd3-8ce3-4ab4-b109-5e03c3e447c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q"
Sep 16 02:37:14.550878 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:14.550797    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvjxb\" (UniqueName: \"kubernetes.io/projected/77e1acd3-8ce3-4ab4-b109-5e03c3e447c0-kube-api-access-rvjxb\") pod \"maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q\" (UID: \"77e1acd3-8ce3-4ab4-b109-5e03c3e447c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q"
Sep 16 02:37:14.652300 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:14.652258    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvjxb\" (UniqueName: \"kubernetes.io/projected/77e1acd3-8ce3-4ab4-b109-5e03c3e447c0-kube-api-access-rvjxb\") pod \"maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q\" (UID: \"77e1acd3-8ce3-4ab4-b109-5e03c3e447c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q"
Sep 16 02:37:14.652481 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:14.652338    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77e1acd3-8ce3-4ab4-b109-5e03c3e447c0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q\" (UID: \"77e1acd3-8ce3-4ab4-b109-5e03c3e447c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q"
Sep 16 02:37:14.652481 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:14.652378    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77e1acd3-8ce3-4ab4-b109-5e03c3e447c0-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q\" (UID: \"77e1acd3-8ce3-4ab4-b109-5e03c3e447c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q"
Sep 16 02:37:14.652481 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:14.652400    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77e1acd3-8ce3-4ab4-b109-5e03c3e447c0-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q\" (UID: \"77e1acd3-8ce3-4ab4-b109-5e03c3e447c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q"
Sep 16 02:37:14.652649 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:37:14.652514    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-serving-cert: secret "maas-api-e2e-shared-b-w2-a53a44-serving-cert" not found
Sep 16 02:37:14.652649 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:37:14.652593    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77e1acd3-8ce3-4ab4-b109-5e03c3e447c0-maas-api-tls podName:77e1acd3-8ce3-4ab4-b109-5e03c3e447c0 nodeName:}" failed. No retries permitted until 2026-09-16 02:37:15.152572651 +0000 UTC m=+1440.244754615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/77e1acd3-8ce3-4ab4-b109-5e03c3e447c0-maas-api-tls") pod "maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q" (UID: "77e1acd3-8ce3-4ab4-b109-5e03c3e447c0") : secret "maas-api-e2e-shared-b-w2-a53a44-serving-cert" not found
Sep 16 02:37:14.653037 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:14.653012    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77e1acd3-8ce3-4ab4-b109-5e03c3e447c0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q\" (UID: \"77e1acd3-8ce3-4ab4-b109-5e03c3e447c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q"
Sep 16 02:37:14.655076 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:14.655058    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77e1acd3-8ce3-4ab4-b109-5e03c3e447c0-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q\" (UID: \"77e1acd3-8ce3-4ab4-b109-5e03c3e447c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q"
Sep 16 02:37:14.667176 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:14.667153    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvjxb\" (UniqueName: \"kubernetes.io/projected/77e1acd3-8ce3-4ab4-b109-5e03c3e447c0-kube-api-access-rvjxb\") pod \"maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q\" (UID: \"77e1acd3-8ce3-4ab4-b109-5e03c3e447c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q"
Sep 16 02:37:15.158260 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:15.158233    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77e1acd3-8ce3-4ab4-b109-5e03c3e447c0-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q\" (UID: \"77e1acd3-8ce3-4ab4-b109-5e03c3e447c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q"
Sep 16 02:37:15.161045 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:15.161011    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77e1acd3-8ce3-4ab4-b109-5e03c3e447c0-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q\" (UID: \"77e1acd3-8ce3-4ab4-b109-5e03c3e447c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q"
Sep 16 02:37:15.345820 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:15.345786    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q"
Sep 16 02:37:15.624507 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:15.624467    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q"]
Sep 16 02:37:16.479478 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:16.479394    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q" event={"ID":"77e1acd3-8ce3-4ab4-b109-5e03c3e447c0","Type":"ContainerStarted","Data":"4a26900ebf91cab4d7abaf6c840779d033472677dc31316b84e4120430baf8a5"}
Sep 16 02:37:16.479478 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:16.479451    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q" event={"ID":"77e1acd3-8ce3-4ab4-b109-5e03c3e447c0","Type":"ContainerStarted","Data":"bf478a1230260290ef6fd4960699001d11781e774e75e6c841921f74b3eeefbd"}
Sep 16 02:37:16.479666 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:16.479581    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q"
Sep 16 02:37:16.503210 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:16.503149    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q" podStartSLOduration=1.9881806499999999 podStartE2EDuration="2.503130181s" totalImagesPullingTime="514.949531ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:37:16.496843167 +0000 UTC m=+1441.589025139" watchObservedRunningTime="2026-09-16 02:37:16.503130181 +0000 UTC m=+1441.595312154"
Sep 16 02:37:17.460461 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:17.460428    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2"
Sep 16 02:37:22.491794 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:22.491760    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q"
Sep 16 02:37:23.694087 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:23.694055    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": read tcp 10.134.0.2:56110->10.134.0.65:15021: read: connection reset by peer" start-of-body=
Sep 16 02:37:23.694506 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:23.694133    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7" podUID="839d2afe-c2eb-4480-b9fa-3ef261b87fef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": read tcp 10.134.0.2:56110->10.134.0.65:15021: read: connection reset by peer"
Sep 16 02:37:24.538836 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:24.538804    2581 generic.go:356] "Generic (PLEG): container finished" podID="839d2afe-c2eb-4480-b9fa-3ef261b87fef" containerID="629030d00ecdfdd6a1f611a8804d1e914842c5ce84ffc8679489d8a24e5d8387" exitCode=0
Sep 16 02:37:24.539019 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:24.538883    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7" event={"ID":"839d2afe-c2eb-4480-b9fa-3ef261b87fef","Type":"ContainerDied","Data":"629030d00ecdfdd6a1f611a8804d1e914842c5ce84ffc8679489d8a24e5d8387"}
Sep 16 02:37:24.539294 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:24.539279    2581 scope.go:117] "RemoveContainer" containerID="629030d00ecdfdd6a1f611a8804d1e914842c5ce84ffc8679489d8a24e5d8387"
Sep 16 02:37:24.540368 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:24.540339    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 02:37:24.540468 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:24.540420    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 02:37:24.540528 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:24.540467    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 02:37:25.552885 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:25.552071    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7" event={"ID":"839d2afe-c2eb-4480-b9fa-3ef261b87fef","Type":"ContainerStarted","Data":"5addf3f6c0b936bebd08ca07f2326476b14567ff1b7e375f4efb57b358d6c0dd"}
Sep 16 02:37:26.499247 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:26.499209    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:37:26.499431 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:26.499395    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 16 02:37:26.499477 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:26.499439    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7" podUID="839d2afe-c2eb-4480-b9fa-3ef261b87fef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 16 02:37:27.498598 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:27.498571    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 16 02:37:27.498998 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:27.498941    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7" podUID="839d2afe-c2eb-4480-b9fa-3ef261b87fef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 16 02:37:28.499300 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:28.499265    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 16 02:37:28.499694 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:28.499343    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7" podUID="839d2afe-c2eb-4480-b9fa-3ef261b87fef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 16 02:37:29.499196 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:29.499159    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 16 02:37:29.499373 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:29.499211    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7" podUID="839d2afe-c2eb-4480-b9fa-3ef261b87fef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 16 02:37:30.502593 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:30.502563    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:37:30.503031 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:30.503018    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:37:30.503675 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:30.503658    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:37:32.190072 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:32.190043    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:37:40.647068 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:40.647038    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2"]
Sep 16 02:37:40.647587 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:40.647267    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2" podUID="44ec6a4a-ad43-4d32-8b15-ceffbb1717b4" containerName="maas-api" containerID="cri-o://43fc3b9a023f02075b752625d55bf2f835d5d144f89e0e8ccf8d69861fd7ea55" gracePeriod=30
Sep 16 02:37:40.886366 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:40.886341    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2"
Sep 16 02:37:41.005681 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:41.005604    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44ec6a4a-ad43-4d32-8b15-ceffbb1717b4-maas-api-tls\") pod \"44ec6a4a-ad43-4d32-8b15-ceffbb1717b4\" (UID: \"44ec6a4a-ad43-4d32-8b15-ceffbb1717b4\") "
Sep 16 02:37:41.005681 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:41.005642    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8lm4\" (UniqueName: \"kubernetes.io/projected/44ec6a4a-ad43-4d32-8b15-ceffbb1717b4-kube-api-access-f8lm4\") pod \"44ec6a4a-ad43-4d32-8b15-ceffbb1717b4\" (UID: \"44ec6a4a-ad43-4d32-8b15-ceffbb1717b4\") "
Sep 16 02:37:41.005947 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:41.005687    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44ec6a4a-ad43-4d32-8b15-ceffbb1717b4-openshift-service-ca\") pod \"44ec6a4a-ad43-4d32-8b15-ceffbb1717b4\" (UID: \"44ec6a4a-ad43-4d32-8b15-ceffbb1717b4\") "
Sep 16 02:37:41.005947 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:41.005720    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44ec6a4a-ad43-4d32-8b15-ceffbb1717b4-metrics-certs\") pod \"44ec6a4a-ad43-4d32-8b15-ceffbb1717b4\" (UID: \"44ec6a4a-ad43-4d32-8b15-ceffbb1717b4\") "
Sep 16 02:37:41.006093 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:41.006072    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44ec6a4a-ad43-4d32-8b15-ceffbb1717b4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "44ec6a4a-ad43-4d32-8b15-ceffbb1717b4" (UID: "44ec6a4a-ad43-4d32-8b15-ceffbb1717b4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:37:41.007796 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:41.007764    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44ec6a4a-ad43-4d32-8b15-ceffbb1717b4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "44ec6a4a-ad43-4d32-8b15-ceffbb1717b4" (UID: "44ec6a4a-ad43-4d32-8b15-ceffbb1717b4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:37:41.007946 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:41.007798    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44ec6a4a-ad43-4d32-8b15-ceffbb1717b4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "44ec6a4a-ad43-4d32-8b15-ceffbb1717b4" (UID: "44ec6a4a-ad43-4d32-8b15-ceffbb1717b4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:37:41.007946 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:41.007875    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44ec6a4a-ad43-4d32-8b15-ceffbb1717b4-kube-api-access-f8lm4" (OuterVolumeSpecName: "kube-api-access-f8lm4") pod "44ec6a4a-ad43-4d32-8b15-ceffbb1717b4" (UID: "44ec6a4a-ad43-4d32-8b15-ceffbb1717b4"). InnerVolumeSpecName "kube-api-access-f8lm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:37:41.107285 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:41.107251    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8lm4\" (UniqueName: \"kubernetes.io/projected/44ec6a4a-ad43-4d32-8b15-ceffbb1717b4-kube-api-access-f8lm4\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:37:41.107285 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:41.107277    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44ec6a4a-ad43-4d32-8b15-ceffbb1717b4-openshift-service-ca\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:37:41.107285 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:41.107286    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44ec6a4a-ad43-4d32-8b15-ceffbb1717b4-metrics-certs\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:37:41.107285 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:41.107294    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44ec6a4a-ad43-4d32-8b15-ceffbb1717b4-maas-api-tls\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:37:41.659250 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:41.659167    2581 generic.go:356] "Generic (PLEG): container finished" podID="44ec6a4a-ad43-4d32-8b15-ceffbb1717b4" containerID="43fc3b9a023f02075b752625d55bf2f835d5d144f89e0e8ccf8d69861fd7ea55" exitCode=0
Sep 16 02:37:41.659250 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:41.659223    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2"
Sep 16 02:37:41.659250 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:41.659244    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2" event={"ID":"44ec6a4a-ad43-4d32-8b15-ceffbb1717b4","Type":"ContainerDied","Data":"43fc3b9a023f02075b752625d55bf2f835d5d144f89e0e8ccf8d69861fd7ea55"}
Sep 16 02:37:41.659731 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:41.659287    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2" event={"ID":"44ec6a4a-ad43-4d32-8b15-ceffbb1717b4","Type":"ContainerDied","Data":"dd273b4623420469fba10fb70d245dd3d90492fd0c0795b0d5af4807b8a5637f"}
Sep 16 02:37:41.659731 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:41.659310    2581 scope.go:117] "RemoveContainer" containerID="43fc3b9a023f02075b752625d55bf2f835d5d144f89e0e8ccf8d69861fd7ea55"
Sep 16 02:37:41.668663 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:41.668631    2581 scope.go:117] "RemoveContainer" containerID="43fc3b9a023f02075b752625d55bf2f835d5d144f89e0e8ccf8d69861fd7ea55"
Sep 16 02:37:41.668945 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:37:41.668925    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43fc3b9a023f02075b752625d55bf2f835d5d144f89e0e8ccf8d69861fd7ea55\": container with ID starting with 43fc3b9a023f02075b752625d55bf2f835d5d144f89e0e8ccf8d69861fd7ea55 not found: ID does not exist" containerID="43fc3b9a023f02075b752625d55bf2f835d5d144f89e0e8ccf8d69861fd7ea55"
Sep 16 02:37:41.669026 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:41.668954    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43fc3b9a023f02075b752625d55bf2f835d5d144f89e0e8ccf8d69861fd7ea55"} err="failed to get container status \"43fc3b9a023f02075b752625d55bf2f835d5d144f89e0e8ccf8d69861fd7ea55\": rpc error: code = NotFound desc = could not find container \"43fc3b9a023f02075b752625d55bf2f835d5d144f89e0e8ccf8d69861fd7ea55\": container with ID starting with 43fc3b9a023f02075b752625d55bf2f835d5d144f89e0e8ccf8d69861fd7ea55 not found: ID does not exist"
Sep 16 02:37:41.678866 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:41.678834    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2"]
Sep 16 02:37:41.685115 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:41.685090    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2e69f8df-54ccfdfc4f-7w2v2"]
Sep 16 02:37:43.383141 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:37:43.383110    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44ec6a4a-ad43-4d32-8b15-ceffbb1717b4" path="/var/lib/kubelet/pods/44ec6a4a-ad43-4d32-8b15-ceffbb1717b4/volumes"
Sep 16 02:38:02.479575 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:38:02.479540    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:38:15.449912 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:38:15.449879    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g54gh_308f30e2-2871-442a-ba30-54ada02ad832/ovn-acl-logging/0.log"
Sep 16 02:38:15.452387 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:38:15.452369    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g54gh_308f30e2-2871-442a-ba30-54ada02ad832/ovn-acl-logging/0.log"
Sep 16 02:38:27.778007 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:38:27.777977    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:38:50.390327 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:38:50.390248    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:39:22.618353 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:22.618320    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7"]
Sep 16 02:39:22.618982 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:22.618965    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44ec6a4a-ad43-4d32-8b15-ceffbb1717b4" containerName="maas-api"
Sep 16 02:39:22.619071 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:22.618985    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="44ec6a4a-ad43-4d32-8b15-ceffbb1717b4" containerName="maas-api"
Sep 16 02:39:22.619124 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:22.619089    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="44ec6a4a-ad43-4d32-8b15-ceffbb1717b4" containerName="maas-api"
Sep 16 02:39:22.622338 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:22.622315    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7"
Sep 16 02:39:22.625796 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:22.624751    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-e415ca22-serving-cert\""
Sep 16 02:39:22.636723 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:22.636648    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7"]
Sep 16 02:39:22.722340 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:22.722306    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f418529a-0cfd-485f-8e1b-e88ae1b0f0f4-maas-api-tls\") pod \"maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7\" (UID: \"f418529a-0cfd-485f-8e1b-e88ae1b0f0f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7"
Sep 16 02:39:22.722518 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:22.722413    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f418529a-0cfd-485f-8e1b-e88ae1b0f0f4-openshift-service-ca\") pod \"maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7\" (UID: \"f418529a-0cfd-485f-8e1b-e88ae1b0f0f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7"
Sep 16 02:39:22.722518 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:22.722448    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f418529a-0cfd-485f-8e1b-e88ae1b0f0f4-metrics-certs\") pod \"maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7\" (UID: \"f418529a-0cfd-485f-8e1b-e88ae1b0f0f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7"
Sep 16 02:39:22.722518 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:22.722474    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqrsz\" (UniqueName: \"kubernetes.io/projected/f418529a-0cfd-485f-8e1b-e88ae1b0f0f4-kube-api-access-jqrsz\") pod \"maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7\" (UID: \"f418529a-0cfd-485f-8e1b-e88ae1b0f0f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7"
Sep 16 02:39:22.824008 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:22.823975    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f418529a-0cfd-485f-8e1b-e88ae1b0f0f4-maas-api-tls\") pod \"maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7\" (UID: \"f418529a-0cfd-485f-8e1b-e88ae1b0f0f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7"
Sep 16 02:39:22.824213 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:22.824084    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f418529a-0cfd-485f-8e1b-e88ae1b0f0f4-openshift-service-ca\") pod \"maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7\" (UID: \"f418529a-0cfd-485f-8e1b-e88ae1b0f0f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7"
Sep 16 02:39:22.824213 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:22.824117    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f418529a-0cfd-485f-8e1b-e88ae1b0f0f4-metrics-certs\") pod \"maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7\" (UID: \"f418529a-0cfd-485f-8e1b-e88ae1b0f0f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7"
Sep 16 02:39:22.824213 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:22.824145    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqrsz\" (UniqueName: \"kubernetes.io/projected/f418529a-0cfd-485f-8e1b-e88ae1b0f0f4-kube-api-access-jqrsz\") pod \"maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7\" (UID: \"f418529a-0cfd-485f-8e1b-e88ae1b0f0f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7"
Sep 16 02:39:22.824898 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:22.824869    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f418529a-0cfd-485f-8e1b-e88ae1b0f0f4-openshift-service-ca\") pod \"maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7\" (UID: \"f418529a-0cfd-485f-8e1b-e88ae1b0f0f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7"
Sep 16 02:39:22.826813 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:22.826790    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f418529a-0cfd-485f-8e1b-e88ae1b0f0f4-maas-api-tls\") pod \"maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7\" (UID: \"f418529a-0cfd-485f-8e1b-e88ae1b0f0f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7"
Sep 16 02:39:22.827273 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:22.827254    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f418529a-0cfd-485f-8e1b-e88ae1b0f0f4-metrics-certs\") pod \"maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7\" (UID: \"f418529a-0cfd-485f-8e1b-e88ae1b0f0f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7"
Sep 16 02:39:22.831439 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:22.831415    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqrsz\" (UniqueName: \"kubernetes.io/projected/f418529a-0cfd-485f-8e1b-e88ae1b0f0f4-kube-api-access-jqrsz\") pod \"maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7\" (UID: \"f418529a-0cfd-485f-8e1b-e88ae1b0f0f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7"
Sep 16 02:39:22.941951 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:22.941882    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7"
Sep 16 02:39:23.221197 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:23.221173    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7"]
Sep 16 02:39:23.224743 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:39:23.224711    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf418529a_0cfd_485f_8e1b_e88ae1b0f0f4.slice/crio-bf692c4f8734a19a4b8ff44353f08db91886fc4ebb17d03764d8efc189590202 WatchSource:0}: Error finding container bf692c4f8734a19a4b8ff44353f08db91886fc4ebb17d03764d8efc189590202: Status 404 returned error can't find the container with id bf692c4f8734a19a4b8ff44353f08db91886fc4ebb17d03764d8efc189590202
Sep 16 02:39:23.226518 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:23.226387    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 02:39:23.276071 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:23.276039    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7" event={"ID":"f418529a-0cfd-485f-8e1b-e88ae1b0f0f4","Type":"ContainerStarted","Data":"bf692c4f8734a19a4b8ff44353f08db91886fc4ebb17d03764d8efc189590202"}
Sep 16 02:39:24.283914 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:24.283884    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7" event={"ID":"f418529a-0cfd-485f-8e1b-e88ae1b0f0f4","Type":"ContainerStarted","Data":"830599f7d5f9213a94751068cbc76b7ec7a017f38bec478c57cc8670e63b1410"}
Sep 16 02:39:24.284294 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:24.284037    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7"
Sep 16 02:39:24.300516 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:24.300477    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7" podStartSLOduration=1.830023931 podStartE2EDuration="2.300462564s" totalImagesPullingTime="470.438633ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:39:24.298442987 +0000 UTC m=+1569.390624960" watchObservedRunningTime="2026-09-16 02:39:24.300462564 +0000 UTC m=+1569.392644575"
Sep 16 02:39:28.477415 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:28.477380    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:39:30.294526 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:30.294498    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7"
Sep 16 02:39:32.584902 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:32.584870    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-542ed5-599749c586-n8phb"]
Sep 16 02:39:32.585308 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:32.585127    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-542ed5-599749c586-n8phb" podUID="68d61ef3-a8d2-48b0-84b4-55abdace5cbb" containerName="maas-api" containerID="cri-o://61d6a8f28cd5067d8e4aebfc8d0cef0ac70bd4985386bd89d59d105a26643bbd" gracePeriod=30
Sep 16 02:39:32.831746 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:32.831714    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-542ed5-599749c586-n8phb"
Sep 16 02:39:33.019719 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:33.019643    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nnhnc\" (UniqueName: \"kubernetes.io/projected/68d61ef3-a8d2-48b0-84b4-55abdace5cbb-kube-api-access-nnhnc\") pod \"68d61ef3-a8d2-48b0-84b4-55abdace5cbb\" (UID: \"68d61ef3-a8d2-48b0-84b4-55abdace5cbb\") "
Sep 16 02:39:33.019719 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:33.019702    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68d61ef3-a8d2-48b0-84b4-55abdace5cbb-metrics-certs\") pod \"68d61ef3-a8d2-48b0-84b4-55abdace5cbb\" (UID: \"68d61ef3-a8d2-48b0-84b4-55abdace5cbb\") "
Sep 16 02:39:33.019962 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:33.019776    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68d61ef3-a8d2-48b0-84b4-55abdace5cbb-openshift-service-ca\") pod \"68d61ef3-a8d2-48b0-84b4-55abdace5cbb\" (UID: \"68d61ef3-a8d2-48b0-84b4-55abdace5cbb\") "
Sep 16 02:39:33.019962 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:33.019824    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68d61ef3-a8d2-48b0-84b4-55abdace5cbb-maas-api-tls\") pod \"68d61ef3-a8d2-48b0-84b4-55abdace5cbb\" (UID: \"68d61ef3-a8d2-48b0-84b4-55abdace5cbb\") "
Sep 16 02:39:33.020148 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:33.020118    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68d61ef3-a8d2-48b0-84b4-55abdace5cbb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "68d61ef3-a8d2-48b0-84b4-55abdace5cbb" (UID: "68d61ef3-a8d2-48b0-84b4-55abdace5cbb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:39:33.020255 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:33.020240    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68d61ef3-a8d2-48b0-84b4-55abdace5cbb-openshift-service-ca\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:39:33.022152 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:33.022008    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68d61ef3-a8d2-48b0-84b4-55abdace5cbb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "68d61ef3-a8d2-48b0-84b4-55abdace5cbb" (UID: "68d61ef3-a8d2-48b0-84b4-55abdace5cbb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:39:33.022152 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:33.022102    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68d61ef3-a8d2-48b0-84b4-55abdace5cbb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "68d61ef3-a8d2-48b0-84b4-55abdace5cbb" (UID: "68d61ef3-a8d2-48b0-84b4-55abdace5cbb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:39:33.022152 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:33.022124    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68d61ef3-a8d2-48b0-84b4-55abdace5cbb-kube-api-access-nnhnc" (OuterVolumeSpecName: "kube-api-access-nnhnc") pod "68d61ef3-a8d2-48b0-84b4-55abdace5cbb" (UID: "68d61ef3-a8d2-48b0-84b4-55abdace5cbb"). InnerVolumeSpecName "kube-api-access-nnhnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:39:33.120743 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:33.120712    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68d61ef3-a8d2-48b0-84b4-55abdace5cbb-metrics-certs\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:39:33.120743 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:33.120739    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68d61ef3-a8d2-48b0-84b4-55abdace5cbb-maas-api-tls\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:39:33.120743 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:33.120747    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnhnc\" (UniqueName: \"kubernetes.io/projected/68d61ef3-a8d2-48b0-84b4-55abdace5cbb-kube-api-access-nnhnc\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:39:33.341787 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:33.341751    2581 generic.go:356] "Generic (PLEG): container finished" podID="68d61ef3-a8d2-48b0-84b4-55abdace5cbb" containerID="61d6a8f28cd5067d8e4aebfc8d0cef0ac70bd4985386bd89d59d105a26643bbd" exitCode=0
Sep 16 02:39:33.342001 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:33.341810    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-542ed5-599749c586-n8phb"
Sep 16 02:39:33.342001 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:33.341875    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-542ed5-599749c586-n8phb" event={"ID":"68d61ef3-a8d2-48b0-84b4-55abdace5cbb","Type":"ContainerDied","Data":"61d6a8f28cd5067d8e4aebfc8d0cef0ac70bd4985386bd89d59d105a26643bbd"}
Sep 16 02:39:33.342001 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:33.341942    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-542ed5-599749c586-n8phb" event={"ID":"68d61ef3-a8d2-48b0-84b4-55abdace5cbb","Type":"ContainerDied","Data":"0568bec8d4d7f5f1b7dbaa28bfadad7eb029680c0bced1f0a0539058808eb668"}
Sep 16 02:39:33.342001 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:33.341972    2581 scope.go:117] "RemoveContainer" containerID="61d6a8f28cd5067d8e4aebfc8d0cef0ac70bd4985386bd89d59d105a26643bbd"
Sep 16 02:39:33.353124 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:33.353106    2581 scope.go:117] "RemoveContainer" containerID="61d6a8f28cd5067d8e4aebfc8d0cef0ac70bd4985386bd89d59d105a26643bbd"
Sep 16 02:39:33.353399 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:39:33.353380    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61d6a8f28cd5067d8e4aebfc8d0cef0ac70bd4985386bd89d59d105a26643bbd\": container with ID starting with 61d6a8f28cd5067d8e4aebfc8d0cef0ac70bd4985386bd89d59d105a26643bbd not found: ID does not exist" containerID="61d6a8f28cd5067d8e4aebfc8d0cef0ac70bd4985386bd89d59d105a26643bbd"
Sep 16 02:39:33.353456 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:33.353406    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61d6a8f28cd5067d8e4aebfc8d0cef0ac70bd4985386bd89d59d105a26643bbd"} err="failed to get container status \"61d6a8f28cd5067d8e4aebfc8d0cef0ac70bd4985386bd89d59d105a26643bbd\": rpc error: code = NotFound desc = could not find container \"61d6a8f28cd5067d8e4aebfc8d0cef0ac70bd4985386bd89d59d105a26643bbd\": container with ID starting with 61d6a8f28cd5067d8e4aebfc8d0cef0ac70bd4985386bd89d59d105a26643bbd not found: ID does not exist"
Sep 16 02:39:33.371879 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:33.370174    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-542ed5-599749c586-n8phb"]
Sep 16 02:39:33.383752 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:33.383728    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-542ed5-599749c586-n8phb"]
Sep 16 02:39:35.384038 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:35.383992    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68d61ef3-a8d2-48b0-84b4-55abdace5cbb" path="/var/lib/kubelet/pods/68d61ef3-a8d2-48b0-84b4-55abdace5cbb/volumes"
Sep 16 02:39:41.338257 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:41.338217    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"]
Sep 16 02:39:41.359560 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:41.359532    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"]
Sep 16 02:39:50.917789 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:50.917755    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b"]
Sep 16 02:39:50.918368 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:50.918006    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b" podUID="2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431" containerName="maas-api" containerID="cri-o://90591082349f90d8cc020d4d8fb3713c6d07a7a741245db37143fb24e02addfe" gracePeriod=30
Sep 16 02:39:51.168558 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:51.168500    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b"
Sep 16 02:39:51.292164 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:51.292137    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431-maas-api-tls\") pod \"2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431\" (UID: \"2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431\") "
Sep 16 02:39:51.292327 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:51.292194    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c875d\" (UniqueName: \"kubernetes.io/projected/2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431-kube-api-access-c875d\") pod \"2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431\" (UID: \"2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431\") "
Sep 16 02:39:51.292327 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:51.292284    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431-openshift-service-ca\") pod \"2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431\" (UID: \"2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431\") "
Sep 16 02:39:51.292327 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:51.292305    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431-metrics-certs\") pod \"2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431\" (UID: \"2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431\") "
Sep 16 02:39:51.292563 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:51.292541    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431" (UID: "2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:39:51.292671 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:51.292655    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431-openshift-service-ca\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:39:51.294487 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:51.294461    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431" (UID: "2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:39:51.294590 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:51.294485    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431" (UID: "2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:39:51.294648 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:51.294590    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431-kube-api-access-c875d" (OuterVolumeSpecName: "kube-api-access-c875d") pod "2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431" (UID: "2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431"). InnerVolumeSpecName "kube-api-access-c875d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:39:51.393882 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:51.393859    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431-maas-api-tls\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:39:51.393882 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:51.393881    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c875d\" (UniqueName: \"kubernetes.io/projected/2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431-kube-api-access-c875d\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:39:51.394018 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:51.393889    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431-metrics-certs\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:39:51.452617 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:51.452545    2581 generic.go:356] "Generic (PLEG): container finished" podID="2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431" containerID="90591082349f90d8cc020d4d8fb3713c6d07a7a741245db37143fb24e02addfe" exitCode=0
Sep 16 02:39:51.452617 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:51.452600    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b"
Sep 16 02:39:51.452780 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:51.452630    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b" event={"ID":"2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431","Type":"ContainerDied","Data":"90591082349f90d8cc020d4d8fb3713c6d07a7a741245db37143fb24e02addfe"}
Sep 16 02:39:51.452780 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:51.452683    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b" event={"ID":"2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431","Type":"ContainerDied","Data":"d5c3390c3eeab8ed6d20fcb9122f1b0fe89a031308a5ced1616354a341c9f912"}
Sep 16 02:39:51.452780 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:51.452705    2581 scope.go:117] "RemoveContainer" containerID="90591082349f90d8cc020d4d8fb3713c6d07a7a741245db37143fb24e02addfe"
Sep 16 02:39:51.461783 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:51.461768    2581 scope.go:117] "RemoveContainer" containerID="90591082349f90d8cc020d4d8fb3713c6d07a7a741245db37143fb24e02addfe"
Sep 16 02:39:51.462041 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:39:51.462023    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90591082349f90d8cc020d4d8fb3713c6d07a7a741245db37143fb24e02addfe\": container with ID starting with 90591082349f90d8cc020d4d8fb3713c6d07a7a741245db37143fb24e02addfe not found: ID does not exist" containerID="90591082349f90d8cc020d4d8fb3713c6d07a7a741245db37143fb24e02addfe"
Sep 16 02:39:51.462100 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:51.462050    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90591082349f90d8cc020d4d8fb3713c6d07a7a741245db37143fb24e02addfe"} err="failed to get container status \"90591082349f90d8cc020d4d8fb3713c6d07a7a741245db37143fb24e02addfe\": rpc error: code = NotFound desc = could not find container \"90591082349f90d8cc020d4d8fb3713c6d07a7a741245db37143fb24e02addfe\": container with ID starting with 90591082349f90d8cc020d4d8fb3713c6d07a7a741245db37143fb24e02addfe not found: ID does not exist"
Sep 16 02:39:51.470322 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:51.470303    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b"]
Sep 16 02:39:51.474225 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:51.474207    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-619550-5b85bc76f6-nxc4b"]
Sep 16 02:39:53.383049 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:53.383016    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431" path="/var/lib/kubelet/pods/2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431/volumes"
Sep 16 02:39:56.357695 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.357659    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p" podUID="224505ed-0f7b-4355-bbce-2e3090983a07" containerName="main" containerID="cri-o://a3f64fab76d965c4ffe85116f426de9be054cde446a8f430c110f465862ed2c0" gracePeriod=45
Sep 16 02:39:56.381224 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.381195    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p" podUID="898094b1-ac6f-443a-b3f3-1f2ee6aa3a99" containerName="main" containerID="cri-o://de1ef99a6fa982a4212fcfc0676fac8282e42edf44e484a6a5239ab48ba14199" gracePeriod=45
Sep 16 02:39:56.484546 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.484521    2581 generic.go:356] "Generic (PLEG): container finished" podID="224505ed-0f7b-4355-bbce-2e3090983a07" containerID="a3f64fab76d965c4ffe85116f426de9be054cde446a8f430c110f465862ed2c0" exitCode=0
Sep 16 02:39:56.484695 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.484595    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p" event={"ID":"224505ed-0f7b-4355-bbce-2e3090983a07","Type":"ContainerDied","Data":"a3f64fab76d965c4ffe85116f426de9be054cde446a8f430c110f465862ed2c0"}
Sep 16 02:39:56.628446 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.628421    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"
Sep 16 02:39:56.659917 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.658371    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"
Sep 16 02:39:56.747529 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.747498    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-model-cache\") pod \"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99\" (UID: \"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99\") "
Sep 16 02:39:56.747704 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.747543    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/224505ed-0f7b-4355-bbce-2e3090983a07-tls-certs\") pod \"224505ed-0f7b-4355-bbce-2e3090983a07\" (UID: \"224505ed-0f7b-4355-bbce-2e3090983a07\") "
Sep 16 02:39:56.747704 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.747564    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-tls-certs\") pod \"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99\" (UID: \"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99\") "
Sep 16 02:39:56.747704 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.747585    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/224505ed-0f7b-4355-bbce-2e3090983a07-dshm\") pod \"224505ed-0f7b-4355-bbce-2e3090983a07\" (UID: \"224505ed-0f7b-4355-bbce-2e3090983a07\") "
Sep 16 02:39:56.747704 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.747601    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/224505ed-0f7b-4355-bbce-2e3090983a07-model-cache\") pod \"224505ed-0f7b-4355-bbce-2e3090983a07\" (UID: \"224505ed-0f7b-4355-bbce-2e3090983a07\") "
Sep 16 02:39:56.747704 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.747669    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-tmp-dir\") pod \"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99\" (UID: \"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99\") "
Sep 16 02:39:56.748024 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.747720    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-dshm\") pod \"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99\" (UID: \"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99\") "
Sep 16 02:39:56.748024 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.747804    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/224505ed-0f7b-4355-bbce-2e3090983a07-model-cache" (OuterVolumeSpecName: "model-cache") pod "224505ed-0f7b-4355-bbce-2e3090983a07" (UID: "224505ed-0f7b-4355-bbce-2e3090983a07"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:39:56.748024 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.747819    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/224505ed-0f7b-4355-bbce-2e3090983a07-home\") pod \"224505ed-0f7b-4355-bbce-2e3090983a07\" (UID: \"224505ed-0f7b-4355-bbce-2e3090983a07\") "
Sep 16 02:39:56.748024 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.747825    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-model-cache" (OuterVolumeSpecName: "model-cache") pod "898094b1-ac6f-443a-b3f3-1f2ee6aa3a99" (UID: "898094b1-ac6f-443a-b3f3-1f2ee6aa3a99"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:39:56.748024 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.747879    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/224505ed-0f7b-4355-bbce-2e3090983a07-tmp-dir\") pod \"224505ed-0f7b-4355-bbce-2e3090983a07\" (UID: \"224505ed-0f7b-4355-bbce-2e3090983a07\") "
Sep 16 02:39:56.748024 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.747939    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74q46\" (UniqueName: \"kubernetes.io/projected/224505ed-0f7b-4355-bbce-2e3090983a07-kube-api-access-74q46\") pod \"224505ed-0f7b-4355-bbce-2e3090983a07\" (UID: \"224505ed-0f7b-4355-bbce-2e3090983a07\") "
Sep 16 02:39:56.748024 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.747982    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jxvz\" (UniqueName: \"kubernetes.io/projected/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-kube-api-access-6jxvz\") pod \"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99\" (UID: \"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99\") "
Sep 16 02:39:56.748024 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.748027    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-home\") pod \"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99\" (UID: \"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99\") "
Sep 16 02:39:56.748583 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.748038    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "898094b1-ac6f-443a-b3f3-1f2ee6aa3a99" (UID: "898094b1-ac6f-443a-b3f3-1f2ee6aa3a99"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:39:56.748583 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.748049    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/224505ed-0f7b-4355-bbce-2e3090983a07-home" (OuterVolumeSpecName: "home") pod "224505ed-0f7b-4355-bbce-2e3090983a07" (UID: "224505ed-0f7b-4355-bbce-2e3090983a07"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:39:56.748583 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.748133    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/224505ed-0f7b-4355-bbce-2e3090983a07-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "224505ed-0f7b-4355-bbce-2e3090983a07" (UID: "224505ed-0f7b-4355-bbce-2e3090983a07"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:39:56.748583 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.748307    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-home" (OuterVolumeSpecName: "home") pod "898094b1-ac6f-443a-b3f3-1f2ee6aa3a99" (UID: "898094b1-ac6f-443a-b3f3-1f2ee6aa3a99"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:39:56.748583 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.748530    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/224505ed-0f7b-4355-bbce-2e3090983a07-home\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:39:56.748583 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.748549    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/224505ed-0f7b-4355-bbce-2e3090983a07-tmp-dir\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:39:56.748583 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.748563    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-home\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:39:56.748583 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.748575    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-model-cache\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:39:56.748583 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.748586    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/224505ed-0f7b-4355-bbce-2e3090983a07-model-cache\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:39:56.749092 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.748599    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-tmp-dir\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:39:56.750005 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.749979    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/224505ed-0f7b-4355-bbce-2e3090983a07-dshm" (OuterVolumeSpecName: "dshm") pod "224505ed-0f7b-4355-bbce-2e3090983a07" (UID: "224505ed-0f7b-4355-bbce-2e3090983a07"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:39:56.750124 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.750033    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "898094b1-ac6f-443a-b3f3-1f2ee6aa3a99" (UID: "898094b1-ac6f-443a-b3f3-1f2ee6aa3a99"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:39:56.750361 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.750347    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-dshm" (OuterVolumeSpecName: "dshm") pod "898094b1-ac6f-443a-b3f3-1f2ee6aa3a99" (UID: "898094b1-ac6f-443a-b3f3-1f2ee6aa3a99"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:39:56.750460 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.750442    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/224505ed-0f7b-4355-bbce-2e3090983a07-kube-api-access-74q46" (OuterVolumeSpecName: "kube-api-access-74q46") pod "224505ed-0f7b-4355-bbce-2e3090983a07" (UID: "224505ed-0f7b-4355-bbce-2e3090983a07"). InnerVolumeSpecName "kube-api-access-74q46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:39:56.750595 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.750577    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/224505ed-0f7b-4355-bbce-2e3090983a07-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "224505ed-0f7b-4355-bbce-2e3090983a07" (UID: "224505ed-0f7b-4355-bbce-2e3090983a07"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:39:56.750595 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.750581    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-kube-api-access-6jxvz" (OuterVolumeSpecName: "kube-api-access-6jxvz") pod "898094b1-ac6f-443a-b3f3-1f2ee6aa3a99" (UID: "898094b1-ac6f-443a-b3f3-1f2ee6aa3a99"). InnerVolumeSpecName "kube-api-access-6jxvz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:39:56.849634 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.849611    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74q46\" (UniqueName: \"kubernetes.io/projected/224505ed-0f7b-4355-bbce-2e3090983a07-kube-api-access-74q46\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:39:56.849634 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.849634    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jxvz\" (UniqueName: \"kubernetes.io/projected/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-kube-api-access-6jxvz\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:39:56.849791 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.849644    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/224505ed-0f7b-4355-bbce-2e3090983a07-tls-certs\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:39:56.849791 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.849654    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-tls-certs\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:39:56.849791 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.849661    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/224505ed-0f7b-4355-bbce-2e3090983a07-dshm\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:39:56.849791 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:56.849669    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99-dshm\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:39:57.492877 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:57.492834    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"
Sep 16 02:39:57.492877 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:57.492864    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p" event={"ID":"224505ed-0f7b-4355-bbce-2e3090983a07","Type":"ContainerDied","Data":"76ab12cfa85a5a838028500bd719a764149ad8ca802904e1dc26e70a895efd19"}
Sep 16 02:39:57.493373 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:57.492906    2581 scope.go:117] "RemoveContainer" containerID="a3f64fab76d965c4ffe85116f426de9be054cde446a8f430c110f465862ed2c0"
Sep 16 02:39:57.494378 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:57.494351    2581 generic.go:356] "Generic (PLEG): container finished" podID="898094b1-ac6f-443a-b3f3-1f2ee6aa3a99" containerID="de1ef99a6fa982a4212fcfc0676fac8282e42edf44e484a6a5239ab48ba14199" exitCode=0
Sep 16 02:39:57.494490 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:57.494397    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"
Sep 16 02:39:57.494490 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:57.494450    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p" event={"ID":"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99","Type":"ContainerDied","Data":"de1ef99a6fa982a4212fcfc0676fac8282e42edf44e484a6a5239ab48ba14199"}
Sep 16 02:39:57.494490 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:57.494479    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p" event={"ID":"898094b1-ac6f-443a-b3f3-1f2ee6aa3a99","Type":"ContainerDied","Data":"a7bb8e20582100b4124344680fbfd72cf20293f684f1926d00eba38508e42ea4"}
Sep 16 02:39:57.502415 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:57.502398    2581 scope.go:117] "RemoveContainer" containerID="de1ef99a6fa982a4212fcfc0676fac8282e42edf44e484a6a5239ab48ba14199"
Sep 16 02:39:57.510762 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:57.510743    2581 scope.go:117] "RemoveContainer" containerID="de1ef99a6fa982a4212fcfc0676fac8282e42edf44e484a6a5239ab48ba14199"
Sep 16 02:39:57.511087 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:39:57.511068    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de1ef99a6fa982a4212fcfc0676fac8282e42edf44e484a6a5239ab48ba14199\": container with ID starting with de1ef99a6fa982a4212fcfc0676fac8282e42edf44e484a6a5239ab48ba14199 not found: ID does not exist" containerID="de1ef99a6fa982a4212fcfc0676fac8282e42edf44e484a6a5239ab48ba14199"
Sep 16 02:39:57.511172 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:57.511093    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de1ef99a6fa982a4212fcfc0676fac8282e42edf44e484a6a5239ab48ba14199"} err="failed to get container status \"de1ef99a6fa982a4212fcfc0676fac8282e42edf44e484a6a5239ab48ba14199\": rpc error: code = NotFound desc = could not find container \"de1ef99a6fa982a4212fcfc0676fac8282e42edf44e484a6a5239ab48ba14199\": container with ID starting with de1ef99a6fa982a4212fcfc0676fac8282e42edf44e484a6a5239ab48ba14199 not found: ID does not exist"
Sep 16 02:39:57.511247 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:57.511230    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"]
Sep 16 02:39:57.517986 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:57.517968    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-619550/premium-w0-619550-kserve-7c5b754458-d6v7p"]
Sep 16 02:39:57.528898 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:57.528841    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"]
Sep 16 02:39:57.531177 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:57.531151    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-619550/distinct-w0-619550-kserve-55d67bf69c-6cf6p"]
Sep 16 02:39:59.383586 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:59.383554    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="224505ed-0f7b-4355-bbce-2e3090983a07" path="/var/lib/kubelet/pods/224505ed-0f7b-4355-bbce-2e3090983a07/volumes"
Sep 16 02:39:59.383964 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:39:59.383933    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="898094b1-ac6f-443a-b3f3-1f2ee6aa3a99" path="/var/lib/kubelet/pods/898094b1-ac6f-443a-b3f3-1f2ee6aa3a99/volumes"
Sep 16 02:40:01.685267 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:01.685227    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7"]
Sep 16 02:40:01.685660 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:01.685519    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7" podUID="f418529a-0cfd-485f-8e1b-e88ae1b0f0f4" containerName="maas-api" containerID="cri-o://830599f7d5f9213a94751068cbc76b7ec7a017f38bec478c57cc8670e63b1410" gracePeriod=30
Sep 16 02:40:01.934372 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:01.934343    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7"
Sep 16 02:40:01.995365 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:01.995301    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f418529a-0cfd-485f-8e1b-e88ae1b0f0f4-maas-api-tls\") pod \"f418529a-0cfd-485f-8e1b-e88ae1b0f0f4\" (UID: \"f418529a-0cfd-485f-8e1b-e88ae1b0f0f4\") "
Sep 16 02:40:01.995365 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:01.995352    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f418529a-0cfd-485f-8e1b-e88ae1b0f0f4-openshift-service-ca\") pod \"f418529a-0cfd-485f-8e1b-e88ae1b0f0f4\" (UID: \"f418529a-0cfd-485f-8e1b-e88ae1b0f0f4\") "
Sep 16 02:40:01.995525 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:01.995444    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f418529a-0cfd-485f-8e1b-e88ae1b0f0f4-metrics-certs\") pod \"f418529a-0cfd-485f-8e1b-e88ae1b0f0f4\" (UID: \"f418529a-0cfd-485f-8e1b-e88ae1b0f0f4\") "
Sep 16 02:40:01.995525 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:01.995482    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqrsz\" (UniqueName: \"kubernetes.io/projected/f418529a-0cfd-485f-8e1b-e88ae1b0f0f4-kube-api-access-jqrsz\") pod \"f418529a-0cfd-485f-8e1b-e88ae1b0f0f4\" (UID: \"f418529a-0cfd-485f-8e1b-e88ae1b0f0f4\") "
Sep 16 02:40:01.995773 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:01.995749    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f418529a-0cfd-485f-8e1b-e88ae1b0f0f4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f418529a-0cfd-485f-8e1b-e88ae1b0f0f4" (UID: "f418529a-0cfd-485f-8e1b-e88ae1b0f0f4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:40:01.997428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:01.997402    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f418529a-0cfd-485f-8e1b-e88ae1b0f0f4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f418529a-0cfd-485f-8e1b-e88ae1b0f0f4" (UID: "f418529a-0cfd-485f-8e1b-e88ae1b0f0f4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:40:01.997525 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:01.997465    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f418529a-0cfd-485f-8e1b-e88ae1b0f0f4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f418529a-0cfd-485f-8e1b-e88ae1b0f0f4" (UID: "f418529a-0cfd-485f-8e1b-e88ae1b0f0f4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:40:01.997525 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:01.997501    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f418529a-0cfd-485f-8e1b-e88ae1b0f0f4-kube-api-access-jqrsz" (OuterVolumeSpecName: "kube-api-access-jqrsz") pod "f418529a-0cfd-485f-8e1b-e88ae1b0f0f4" (UID: "f418529a-0cfd-485f-8e1b-e88ae1b0f0f4"). InnerVolumeSpecName "kube-api-access-jqrsz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:40:02.096712 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:02.096673    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f418529a-0cfd-485f-8e1b-e88ae1b0f0f4-metrics-certs\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:40:02.096712 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:02.096711    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqrsz\" (UniqueName: \"kubernetes.io/projected/f418529a-0cfd-485f-8e1b-e88ae1b0f0f4-kube-api-access-jqrsz\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:40:02.096901 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:02.096727    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f418529a-0cfd-485f-8e1b-e88ae1b0f0f4-maas-api-tls\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:40:02.096901 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:02.096741    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f418529a-0cfd-485f-8e1b-e88ae1b0f0f4-openshift-service-ca\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:40:02.528422 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:02.528378    2581 generic.go:356] "Generic (PLEG): container finished" podID="f418529a-0cfd-485f-8e1b-e88ae1b0f0f4" containerID="830599f7d5f9213a94751068cbc76b7ec7a017f38bec478c57cc8670e63b1410" exitCode=0
Sep 16 02:40:02.528594 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:02.528422    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7"
Sep 16 02:40:02.528594 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:02.528467    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7" event={"ID":"f418529a-0cfd-485f-8e1b-e88ae1b0f0f4","Type":"ContainerDied","Data":"830599f7d5f9213a94751068cbc76b7ec7a017f38bec478c57cc8670e63b1410"}
Sep 16 02:40:02.528594 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:02.528532    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7" event={"ID":"f418529a-0cfd-485f-8e1b-e88ae1b0f0f4","Type":"ContainerDied","Data":"bf692c4f8734a19a4b8ff44353f08db91886fc4ebb17d03764d8efc189590202"}
Sep 16 02:40:02.528594 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:02.528562    2581 scope.go:117] "RemoveContainer" containerID="830599f7d5f9213a94751068cbc76b7ec7a017f38bec478c57cc8670e63b1410"
Sep 16 02:40:02.538763 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:02.538745    2581 scope.go:117] "RemoveContainer" containerID="830599f7d5f9213a94751068cbc76b7ec7a017f38bec478c57cc8670e63b1410"
Sep 16 02:40:02.539060 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:40:02.539044    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"830599f7d5f9213a94751068cbc76b7ec7a017f38bec478c57cc8670e63b1410\": container with ID starting with 830599f7d5f9213a94751068cbc76b7ec7a017f38bec478c57cc8670e63b1410 not found: ID does not exist" containerID="830599f7d5f9213a94751068cbc76b7ec7a017f38bec478c57cc8670e63b1410"
Sep 16 02:40:02.539108 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:02.539068    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"830599f7d5f9213a94751068cbc76b7ec7a017f38bec478c57cc8670e63b1410"} err="failed to get container status \"830599f7d5f9213a94751068cbc76b7ec7a017f38bec478c57cc8670e63b1410\": rpc error: code = NotFound desc = could not find container \"830599f7d5f9213a94751068cbc76b7ec7a017f38bec478c57cc8670e63b1410\": container with ID starting with 830599f7d5f9213a94751068cbc76b7ec7a017f38bec478c57cc8670e63b1410 not found: ID does not exist"
Sep 16 02:40:02.549237 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:02.549217    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7"]
Sep 16 02:40:02.552831 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:02.552812    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e415ca22-589cd4d7f4-wqsx7"]
Sep 16 02:40:03.382673 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:03.382640    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f418529a-0cfd-485f-8e1b-e88ae1b0f0f4" path="/var/lib/kubelet/pods/f418529a-0cfd-485f-8e1b-e88ae1b0f0f4/volumes"
Sep 16 02:40:03.876877 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:03.876834    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:40:19.980391 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:19.980355    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:40:26.383268 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.383234    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb"]
Sep 16 02:40:26.383826 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.383806    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68d61ef3-a8d2-48b0-84b4-55abdace5cbb" containerName="maas-api"
Sep 16 02:40:26.383934 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.383828    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="68d61ef3-a8d2-48b0-84b4-55abdace5cbb" containerName="maas-api"
Sep 16 02:40:26.383934 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.383861    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f418529a-0cfd-485f-8e1b-e88ae1b0f0f4" containerName="maas-api"
Sep 16 02:40:26.383934 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.383869    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f418529a-0cfd-485f-8e1b-e88ae1b0f0f4" containerName="maas-api"
Sep 16 02:40:26.383934 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.383898    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="224505ed-0f7b-4355-bbce-2e3090983a07" containerName="main"
Sep 16 02:40:26.383934 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.383907    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="224505ed-0f7b-4355-bbce-2e3090983a07" containerName="main"
Sep 16 02:40:26.383934 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.383924    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431" containerName="maas-api"
Sep 16 02:40:26.383934 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.383932    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431" containerName="maas-api"
Sep 16 02:40:26.384255 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.383943    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="898094b1-ac6f-443a-b3f3-1f2ee6aa3a99" containerName="main"
Sep 16 02:40:26.384255 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.383950    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="898094b1-ac6f-443a-b3f3-1f2ee6aa3a99" containerName="main"
Sep 16 02:40:26.384255 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.384057    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="224505ed-0f7b-4355-bbce-2e3090983a07" containerName="main"
Sep 16 02:40:26.384255 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.384068    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f418529a-0cfd-485f-8e1b-e88ae1b0f0f4" containerName="maas-api"
Sep 16 02:40:26.384255 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.384078    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="898094b1-ac6f-443a-b3f3-1f2ee6aa3a99" containerName="main"
Sep 16 02:40:26.384255 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.384086    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fd2f7bc-0cf5-4d4d-aaa0-2d4a7d228431" containerName="maas-api"
Sep 16 02:40:26.384255 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.384094    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="68d61ef3-a8d2-48b0-84b4-55abdace5cbb" containerName="maas-api"
Sep 16 02:40:26.388944 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.388920    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb"
Sep 16 02:40:26.398343 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.393082    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w1-bd0fb8-serving-cert\""
Sep 16 02:40:26.406050 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.404152    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb"]
Sep 16 02:40:26.410099 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.410069    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc7a7c86-ee45-4fd8-bb5d-950e4978f728-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb\" (UID: \"cc7a7c86-ee45-4fd8-bb5d-950e4978f728\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb"
Sep 16 02:40:26.410229 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.410169    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc7a7c86-ee45-4fd8-bb5d-950e4978f728-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb\" (UID: \"cc7a7c86-ee45-4fd8-bb5d-950e4978f728\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb"
Sep 16 02:40:26.410229 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.410210    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jk6t\" (UniqueName: \"kubernetes.io/projected/cc7a7c86-ee45-4fd8-bb5d-950e4978f728-kube-api-access-8jk6t\") pod \"maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb\" (UID: \"cc7a7c86-ee45-4fd8-bb5d-950e4978f728\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb"
Sep 16 02:40:26.410333 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.410272    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc7a7c86-ee45-4fd8-bb5d-950e4978f728-metrics-certs\") pod \"maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb\" (UID: \"cc7a7c86-ee45-4fd8-bb5d-950e4978f728\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb"
Sep 16 02:40:26.511283 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.511248    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc7a7c86-ee45-4fd8-bb5d-950e4978f728-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb\" (UID: \"cc7a7c86-ee45-4fd8-bb5d-950e4978f728\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb"
Sep 16 02:40:26.511283 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.511286    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jk6t\" (UniqueName: \"kubernetes.io/projected/cc7a7c86-ee45-4fd8-bb5d-950e4978f728-kube-api-access-8jk6t\") pod \"maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb\" (UID: \"cc7a7c86-ee45-4fd8-bb5d-950e4978f728\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb"
Sep 16 02:40:26.511537 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.511323    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc7a7c86-ee45-4fd8-bb5d-950e4978f728-metrics-certs\") pod \"maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb\" (UID: \"cc7a7c86-ee45-4fd8-bb5d-950e4978f728\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb"
Sep 16 02:40:26.511537 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.511359    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc7a7c86-ee45-4fd8-bb5d-950e4978f728-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb\" (UID: \"cc7a7c86-ee45-4fd8-bb5d-950e4978f728\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb"
Sep 16 02:40:26.511903 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.511880    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc7a7c86-ee45-4fd8-bb5d-950e4978f728-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb\" (UID: \"cc7a7c86-ee45-4fd8-bb5d-950e4978f728\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb"
Sep 16 02:40:26.513794 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.513770    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc7a7c86-ee45-4fd8-bb5d-950e4978f728-metrics-certs\") pod \"maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb\" (UID: \"cc7a7c86-ee45-4fd8-bb5d-950e4978f728\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb"
Sep 16 02:40:26.513896 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.513816    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc7a7c86-ee45-4fd8-bb5d-950e4978f728-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb\" (UID: \"cc7a7c86-ee45-4fd8-bb5d-950e4978f728\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb"
Sep 16 02:40:26.518324 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.518303    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jk6t\" (UniqueName: \"kubernetes.io/projected/cc7a7c86-ee45-4fd8-bb5d-950e4978f728-kube-api-access-8jk6t\") pod \"maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb\" (UID: \"cc7a7c86-ee45-4fd8-bb5d-950e4978f728\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb"
Sep 16 02:40:26.711092 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.711012    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb"
Sep 16 02:40:26.991730 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:26.991703    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb"]
Sep 16 02:40:26.992931 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:40:26.992899    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc7a7c86_ee45_4fd8_bb5d_950e4978f728.slice/crio-e60bbae62310da077fe1ba01e7cd7215a126a2c77af5a26525e4f007adad8744 WatchSource:0}: Error finding container e60bbae62310da077fe1ba01e7cd7215a126a2c77af5a26525e4f007adad8744: Status 404 returned error can't find the container with id e60bbae62310da077fe1ba01e7cd7215a126a2c77af5a26525e4f007adad8744
Sep 16 02:40:27.675234 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:27.675140    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb" event={"ID":"cc7a7c86-ee45-4fd8-bb5d-950e4978f728","Type":"ContainerStarted","Data":"89f2606160a8c45e57173260be8ff2ed22e6875ca0aa44e496f1f371b5a21e4e"}
Sep 16 02:40:27.675234 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:27.675196    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb" event={"ID":"cc7a7c86-ee45-4fd8-bb5d-950e4978f728","Type":"ContainerStarted","Data":"e60bbae62310da077fe1ba01e7cd7215a126a2c77af5a26525e4f007adad8744"}
Sep 16 02:40:27.675234 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:27.675231    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb"
Sep 16 02:40:27.690946 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:27.690895    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb" podStartSLOduration=1.3579504949999999 podStartE2EDuration="1.69088074s" totalImagesPullingTime="332.930245ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:40:27.68999041 +0000 UTC m=+1632.782172383" watchObservedRunningTime="2026-09-16 02:40:27.69088074 +0000 UTC m=+1632.783062712"
Sep 16 02:40:33.686081 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:33.686051    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb"
Sep 16 02:40:34.783916 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:34.783869    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:40:48.473252 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:48.473218    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:40:56.408558 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:56.408506    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx"]
Sep 16 02:40:56.412465 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:56.412446    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx"
Sep 16 02:40:56.414770 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:56.414749    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w1-8e10f1-serving-cert\""
Sep 16 02:40:56.421833 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:56.421815    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx"]
Sep 16 02:40:56.496472 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:56.496436    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5af76106-cb48-4c02-b748-0cf29ee8ed09-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx\" (UID: \"5af76106-cb48-4c02-b748-0cf29ee8ed09\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx"
Sep 16 02:40:56.496631 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:56.496493    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5af76106-cb48-4c02-b748-0cf29ee8ed09-maas-api-tls\") pod \"maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx\" (UID: \"5af76106-cb48-4c02-b748-0cf29ee8ed09\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx"
Sep 16 02:40:56.496631 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:56.496618    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5af76106-cb48-4c02-b748-0cf29ee8ed09-metrics-certs\") pod \"maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx\" (UID: \"5af76106-cb48-4c02-b748-0cf29ee8ed09\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx"
Sep 16 02:40:56.496740 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:56.496644    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmbbr\" (UniqueName: \"kubernetes.io/projected/5af76106-cb48-4c02-b748-0cf29ee8ed09-kube-api-access-tmbbr\") pod \"maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx\" (UID: \"5af76106-cb48-4c02-b748-0cf29ee8ed09\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx"
Sep 16 02:40:56.597134 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:56.597096    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmbbr\" (UniqueName: \"kubernetes.io/projected/5af76106-cb48-4c02-b748-0cf29ee8ed09-kube-api-access-tmbbr\") pod \"maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx\" (UID: \"5af76106-cb48-4c02-b748-0cf29ee8ed09\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx"
Sep 16 02:40:56.597320 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:56.597142    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5af76106-cb48-4c02-b748-0cf29ee8ed09-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx\" (UID: \"5af76106-cb48-4c02-b748-0cf29ee8ed09\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx"
Sep 16 02:40:56.597320 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:56.597190    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5af76106-cb48-4c02-b748-0cf29ee8ed09-maas-api-tls\") pod \"maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx\" (UID: \"5af76106-cb48-4c02-b748-0cf29ee8ed09\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx"
Sep 16 02:40:56.597320 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:56.597279    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5af76106-cb48-4c02-b748-0cf29ee8ed09-metrics-certs\") pod \"maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx\" (UID: \"5af76106-cb48-4c02-b748-0cf29ee8ed09\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx"
Sep 16 02:40:56.597478 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:40:56.597386    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-serving-cert: secret "maas-api-e2e-shared-b-w1-8e10f1-serving-cert" not found
Sep 16 02:40:56.597963 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:40:56.597938    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5af76106-cb48-4c02-b748-0cf29ee8ed09-maas-api-tls podName:5af76106-cb48-4c02-b748-0cf29ee8ed09 nodeName:}" failed. No retries permitted until 2026-09-16 02:40:57.097909079 +0000 UTC m=+1662.190091046 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5af76106-cb48-4c02-b748-0cf29ee8ed09-maas-api-tls") pod "maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx" (UID: "5af76106-cb48-4c02-b748-0cf29ee8ed09") : secret "maas-api-e2e-shared-b-w1-8e10f1-serving-cert" not found
Sep 16 02:40:56.601868 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:56.598302    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5af76106-cb48-4c02-b748-0cf29ee8ed09-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx\" (UID: \"5af76106-cb48-4c02-b748-0cf29ee8ed09\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx"
Sep 16 02:40:56.604179 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:56.604120    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5af76106-cb48-4c02-b748-0cf29ee8ed09-metrics-certs\") pod \"maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx\" (UID: \"5af76106-cb48-4c02-b748-0cf29ee8ed09\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx"
Sep 16 02:40:56.609299 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:56.609274    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmbbr\" (UniqueName: \"kubernetes.io/projected/5af76106-cb48-4c02-b748-0cf29ee8ed09-kube-api-access-tmbbr\") pod \"maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx\" (UID: \"5af76106-cb48-4c02-b748-0cf29ee8ed09\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx"
Sep 16 02:40:57.101689 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:57.101659    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5af76106-cb48-4c02-b748-0cf29ee8ed09-maas-api-tls\") pod \"maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx\" (UID: \"5af76106-cb48-4c02-b748-0cf29ee8ed09\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx"
Sep 16 02:40:57.104339 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:57.104317    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5af76106-cb48-4c02-b748-0cf29ee8ed09-maas-api-tls\") pod \"maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx\" (UID: \"5af76106-cb48-4c02-b748-0cf29ee8ed09\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx"
Sep 16 02:40:57.326942 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:57.326906    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx"
Sep 16 02:40:57.599764 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:57.599740    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx"]
Sep 16 02:40:57.601529 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:40:57.601503    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5af76106_cb48_4c02_b748_0cf29ee8ed09.slice/crio-115bef35a355891e5595f1cfef3272671e33dbd6f20f73f5a242d5c0b2a300c7 WatchSource:0}: Error finding container 115bef35a355891e5595f1cfef3272671e33dbd6f20f73f5a242d5c0b2a300c7: Status 404 returned error can't find the container with id 115bef35a355891e5595f1cfef3272671e33dbd6f20f73f5a242d5c0b2a300c7
Sep 16 02:40:57.864093 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:57.864056    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx" event={"ID":"5af76106-cb48-4c02-b748-0cf29ee8ed09","Type":"ContainerStarted","Data":"115bef35a355891e5595f1cfef3272671e33dbd6f20f73f5a242d5c0b2a300c7"}
Sep 16 02:40:58.871695 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:58.871647    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx" event={"ID":"5af76106-cb48-4c02-b748-0cf29ee8ed09","Type":"ContainerStarted","Data":"884a5dc59637b3180a7191471b456066fe1f2aec84a571c53d4eca3869339eae"}
Sep 16 02:40:58.872184 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:58.871789    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx"
Sep 16 02:40:58.889018 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:40:58.888970    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx" podStartSLOduration=2.438783205 podStartE2EDuration="2.888955063s" totalImagesPullingTime="450.171858ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:40:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:40:58.887784322 +0000 UTC m=+1663.979966295" watchObservedRunningTime="2026-09-16 02:40:58.888955063 +0000 UTC m=+1663.981137035"
Sep 16 02:41:03.290143 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:03.290105    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:41:04.884226 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:04.884201    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx"
Sep 16 02:41:11.787912 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:11.787878    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8876-e18c99"]
Sep 16 02:41:11.792546 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:11.792530    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8876-e18c99"
Sep 16 02:41:11.794888 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:11.794838    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-5sbqt\""
Sep 16 02:41:11.797223 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:11.797199    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8876-e18c99"]
Sep 16 02:41:11.835466 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:11.835439    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxqm7\" (UniqueName: \"kubernetes.io/projected/b20b1a03-7f01-49ed-8920-5f7a3b33a46d-kube-api-access-zxqm7\") pod \"test-curl-8876-e18c99\" (UID: \"b20b1a03-7f01-49ed-8920-5f7a3b33a46d\") " pod="opendatahub/test-curl-8876-e18c99"
Sep 16 02:41:11.936777 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:11.936747    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxqm7\" (UniqueName: \"kubernetes.io/projected/b20b1a03-7f01-49ed-8920-5f7a3b33a46d-kube-api-access-zxqm7\") pod \"test-curl-8876-e18c99\" (UID: \"b20b1a03-7f01-49ed-8920-5f7a3b33a46d\") " pod="opendatahub/test-curl-8876-e18c99"
Sep 16 02:41:11.944735 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:11.944713    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxqm7\" (UniqueName: \"kubernetes.io/projected/b20b1a03-7f01-49ed-8920-5f7a3b33a46d-kube-api-access-zxqm7\") pod \"test-curl-8876-e18c99\" (UID: \"b20b1a03-7f01-49ed-8920-5f7a3b33a46d\") " pod="opendatahub/test-curl-8876-e18c99"
Sep 16 02:41:12.104021 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:12.103948    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8876-e18c99"
Sep 16 02:41:12.372833 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:12.372810    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8876-e18c99"]
Sep 16 02:41:12.374300 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:41:12.374272    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb20b1a03_7f01_49ed_8920_5f7a3b33a46d.slice/crio-b2440de8a1171dcd9e377c8fed8b88c247f5b32c84160d9703189479619f24b4 WatchSource:0}: Error finding container b2440de8a1171dcd9e377c8fed8b88c247f5b32c84160d9703189479619f24b4: Status 404 returned error can't find the container with id b2440de8a1171dcd9e377c8fed8b88c247f5b32c84160d9703189479619f24b4
Sep 16 02:41:12.952891 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:12.952834    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8876-e18c99" event={"ID":"b20b1a03-7f01-49ed-8920-5f7a3b33a46d","Type":"ContainerStarted","Data":"e22eb193c282a7da334d45ebafe3fcee6212b0a852c9673086a35ee8d489b4e1"}
Sep 16 02:41:12.953318 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:12.952898    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8876-e18c99" event={"ID":"b20b1a03-7f01-49ed-8920-5f7a3b33a46d","Type":"ContainerStarted","Data":"b2440de8a1171dcd9e377c8fed8b88c247f5b32c84160d9703189479619f24b4"}
Sep 16 02:41:12.966301 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:12.966254    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-8876-e18c99" podStartSLOduration=1.966240086 podStartE2EDuration="1.966240086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:41:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:41:12.965227117 +0000 UTC m=+1678.057409091" watchObservedRunningTime="2026-09-16 02:41:12.966240086 +0000 UTC m=+1678.058422058"
Sep 16 02:41:13.606229 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:13.606189    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8876-e18c99"]
Sep 16 02:41:13.609572 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:13.609548    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8876-e18c99"]
Sep 16 02:41:13.961725 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:41:13.961698    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-8876-e18c99" container="test-curl-8876-e18c99"
Sep 16 02:41:14.967105 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:14.967067    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-8876-e18c99" podUID="b20b1a03-7f01-49ed-8920-5f7a3b33a46d" containerName="test-curl-8876-e18c99" containerID="cri-o://e22eb193c282a7da334d45ebafe3fcee6212b0a852c9673086a35ee8d489b4e1" gracePeriod=2
Sep 16 02:41:14.969071 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:41:14.969048    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8876-e18c99\" is forbidden: User \"system:node:ip-10-0-139-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-191.ec2.internal' and this object" podUID="b20b1a03-7f01-49ed-8920-5f7a3b33a46d" pod="opendatahub/test-curl-8876-e18c99"
Sep 16 02:41:15.380996 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:41:15.380965    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8876-e18c99\" is forbidden: User \"system:node:ip-10-0-139-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-191.ec2.internal' and this object" podUID="b20b1a03-7f01-49ed-8920-5f7a3b33a46d" pod="opendatahub/test-curl-8876-e18c99"
Sep 16 02:41:15.543040 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:15.543009    2581 scope.go:117] "RemoveContainer" containerID="0db323e18ecf11d6d5a882656f53d4f9f3ef2af757030328a93e6eb92263e5ef"
Sep 16 02:41:17.156400 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:17.156379    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8876-e18c99"
Sep 16 02:41:17.176610 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:17.176592    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxqm7\" (UniqueName: \"kubernetes.io/projected/b20b1a03-7f01-49ed-8920-5f7a3b33a46d-kube-api-access-zxqm7\") pod \"b20b1a03-7f01-49ed-8920-5f7a3b33a46d\" (UID: \"b20b1a03-7f01-49ed-8920-5f7a3b33a46d\") "
Sep 16 02:41:17.178593 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:17.178567    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b20b1a03-7f01-49ed-8920-5f7a3b33a46d-kube-api-access-zxqm7" (OuterVolumeSpecName: "kube-api-access-zxqm7") pod "b20b1a03-7f01-49ed-8920-5f7a3b33a46d" (UID: "b20b1a03-7f01-49ed-8920-5f7a3b33a46d"). InnerVolumeSpecName "kube-api-access-zxqm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:41:17.277201 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:17.277180    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxqm7\" (UniqueName: \"kubernetes.io/projected/b20b1a03-7f01-49ed-8920-5f7a3b33a46d-kube-api-access-zxqm7\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:41:17.382986 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:17.382957    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b20b1a03-7f01-49ed-8920-5f7a3b33a46d" path="/var/lib/kubelet/pods/b20b1a03-7f01-49ed-8920-5f7a3b33a46d/volumes"
Sep 16 02:41:17.987069 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:17.987037    2581 generic.go:356] "Generic (PLEG): container finished" podID="b20b1a03-7f01-49ed-8920-5f7a3b33a46d" containerID="e22eb193c282a7da334d45ebafe3fcee6212b0a852c9673086a35ee8d489b4e1" exitCode=137
Sep 16 02:41:17.987069 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:17.987078    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8876-e18c99"
Sep 16 02:41:17.987348 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:17.987140    2581 scope.go:117] "RemoveContainer" containerID="e22eb193c282a7da334d45ebafe3fcee6212b0a852c9673086a35ee8d489b4e1"
Sep 16 02:41:17.996003 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:17.995989    2581 scope.go:117] "RemoveContainer" containerID="e22eb193c282a7da334d45ebafe3fcee6212b0a852c9673086a35ee8d489b4e1"
Sep 16 02:41:17.996268 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:41:17.996247    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e22eb193c282a7da334d45ebafe3fcee6212b0a852c9673086a35ee8d489b4e1\": container with ID starting with e22eb193c282a7da334d45ebafe3fcee6212b0a852c9673086a35ee8d489b4e1 not found: ID does not exist" containerID="e22eb193c282a7da334d45ebafe3fcee6212b0a852c9673086a35ee8d489b4e1"
Sep 16 02:41:17.996337 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:17.996276    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e22eb193c282a7da334d45ebafe3fcee6212b0a852c9673086a35ee8d489b4e1"} err="failed to get container status \"e22eb193c282a7da334d45ebafe3fcee6212b0a852c9673086a35ee8d489b4e1\": rpc error: code = NotFound desc = could not find container \"e22eb193c282a7da334d45ebafe3fcee6212b0a852c9673086a35ee8d489b4e1\": container with ID starting with e22eb193c282a7da334d45ebafe3fcee6212b0a852c9673086a35ee8d489b4e1 not found: ID does not exist"
Sep 16 02:41:19.683533 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:19.683502    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:41:20.647191 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:20.647136    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8873-4f8006"]
Sep 16 02:41:20.647591 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:20.647579    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b20b1a03-7f01-49ed-8920-5f7a3b33a46d" containerName="test-curl-8876-e18c99"
Sep 16 02:41:20.647636 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:20.647594    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b20b1a03-7f01-49ed-8920-5f7a3b33a46d" containerName="test-curl-8876-e18c99"
Sep 16 02:41:20.647675 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:20.647668    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b20b1a03-7f01-49ed-8920-5f7a3b33a46d" containerName="test-curl-8876-e18c99"
Sep 16 02:41:20.652326 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:20.652306    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8873-4f8006"
Sep 16 02:41:20.654813 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:20.654793    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-5sbqt\""
Sep 16 02:41:20.657223 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:20.657186    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8873-4f8006"]
Sep 16 02:41:20.705052 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:20.705026    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4s9v\" (UniqueName: \"kubernetes.io/projected/a1be40b0-507e-4fbf-bd32-b5fcc6d1bed2-kube-api-access-g4s9v\") pod \"test-curl-8873-4f8006\" (UID: \"a1be40b0-507e-4fbf-bd32-b5fcc6d1bed2\") " pod="opendatahub/test-curl-8873-4f8006"
Sep 16 02:41:20.806252 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:20.806222    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4s9v\" (UniqueName: \"kubernetes.io/projected/a1be40b0-507e-4fbf-bd32-b5fcc6d1bed2-kube-api-access-g4s9v\") pod \"test-curl-8873-4f8006\" (UID: \"a1be40b0-507e-4fbf-bd32-b5fcc6d1bed2\") " pod="opendatahub/test-curl-8873-4f8006"
Sep 16 02:41:20.813320 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:20.813296    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4s9v\" (UniqueName: \"kubernetes.io/projected/a1be40b0-507e-4fbf-bd32-b5fcc6d1bed2-kube-api-access-g4s9v\") pod \"test-curl-8873-4f8006\" (UID: \"a1be40b0-507e-4fbf-bd32-b5fcc6d1bed2\") " pod="opendatahub/test-curl-8873-4f8006"
Sep 16 02:41:20.963299 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:20.963271    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8873-4f8006"
Sep 16 02:41:21.232578 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:21.232552    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8873-4f8006"]
Sep 16 02:41:21.233023 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:41:21.233002    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1be40b0_507e_4fbf_bd32_b5fcc6d1bed2.slice/crio-8e07dda0cde96ba28f7c560277e685e3969b0e0a7510bda797091bba033f4885 WatchSource:0}: Error finding container 8e07dda0cde96ba28f7c560277e685e3969b0e0a7510bda797091bba033f4885: Status 404 returned error can't find the container with id 8e07dda0cde96ba28f7c560277e685e3969b0e0a7510bda797091bba033f4885
Sep 16 02:41:22.016103 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:22.016072    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8873-4f8006" event={"ID":"a1be40b0-507e-4fbf-bd32-b5fcc6d1bed2","Type":"ContainerStarted","Data":"2684a24bee19d1de88e06b679150daa068b69439d8f6b0cdf32b646f0a66d465"}
Sep 16 02:41:22.016103 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:22.016110    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8873-4f8006" event={"ID":"a1be40b0-507e-4fbf-bd32-b5fcc6d1bed2","Type":"ContainerStarted","Data":"8e07dda0cde96ba28f7c560277e685e3969b0e0a7510bda797091bba033f4885"}
Sep 16 02:41:22.031120 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:22.031063    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-8873-4f8006" podStartSLOduration=2.031044071 podStartE2EDuration="2.031044071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:41:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:41:22.028795389 +0000 UTC m=+1687.120977364" watchObservedRunningTime="2026-09-16 02:41:22.031044071 +0000 UTC m=+1687.123226045"
Sep 16 02:41:22.705218 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:22.705177    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8873-4f8006"]
Sep 16 02:41:22.708386 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:22.708358    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8873-4f8006"]
Sep 16 02:41:22.855031 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:22.854998    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8873-4aabbe"]
Sep 16 02:41:22.855424 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:22.855411    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1be40b0-507e-4fbf-bd32-b5fcc6d1bed2" containerName="test-curl-8873-4f8006"
Sep 16 02:41:22.855479 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:22.855426    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1be40b0-507e-4fbf-bd32-b5fcc6d1bed2" containerName="test-curl-8873-4f8006"
Sep 16 02:41:22.855519 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:22.855513    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1be40b0-507e-4fbf-bd32-b5fcc6d1bed2" containerName="test-curl-8873-4f8006"
Sep 16 02:41:22.858630 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:22.858612    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8873-4aabbe"
Sep 16 02:41:22.863280 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:22.863256    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8873-4aabbe"]
Sep 16 02:41:22.921053 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:22.921026    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvt6n\" (UniqueName: \"kubernetes.io/projected/96025875-aae6-4631-b267-d17f00e103ae-kube-api-access-qvt6n\") pod \"test-curl-8873-4aabbe\" (UID: \"96025875-aae6-4631-b267-d17f00e103ae\") " pod="opendatahub/test-curl-8873-4aabbe"
Sep 16 02:41:23.022230 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:41:23.022191    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-8873-4f8006" container="test-curl-8873-4f8006"
Sep 16 02:41:23.022661 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:23.022440    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvt6n\" (UniqueName: \"kubernetes.io/projected/96025875-aae6-4631-b267-d17f00e103ae-kube-api-access-qvt6n\") pod \"test-curl-8873-4aabbe\" (UID: \"96025875-aae6-4631-b267-d17f00e103ae\") " pod="opendatahub/test-curl-8873-4aabbe"
Sep 16 02:41:23.030025 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:23.030004    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvt6n\" (UniqueName: \"kubernetes.io/projected/96025875-aae6-4631-b267-d17f00e103ae-kube-api-access-qvt6n\") pod \"test-curl-8873-4aabbe\" (UID: \"96025875-aae6-4631-b267-d17f00e103ae\") " pod="opendatahub/test-curl-8873-4aabbe"
Sep 16 02:41:23.169381 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:23.169315    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8873-4aabbe"
Sep 16 02:41:23.436948 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:23.436922    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8873-4aabbe"]
Sep 16 02:41:23.438501 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:41:23.438478    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96025875_aae6_4631_b267_d17f00e103ae.slice/crio-a297ec69d86c6daddc000dd337f451c53946651ab2f25437466211a5de9737fd WatchSource:0}: Error finding container a297ec69d86c6daddc000dd337f451c53946651ab2f25437466211a5de9737fd: Status 404 returned error can't find the container with id a297ec69d86c6daddc000dd337f451c53946651ab2f25437466211a5de9737fd
Sep 16 02:41:24.031139 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:24.031100    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8873-4aabbe" event={"ID":"96025875-aae6-4631-b267-d17f00e103ae","Type":"ContainerStarted","Data":"ead7c95fd8046c81e76ddd9a2f31e0573aee9c4e7ee5321101d2588e343e84da"}
Sep 16 02:41:24.031139 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:24.031151    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8873-4aabbe" event={"ID":"96025875-aae6-4631-b267-d17f00e103ae","Type":"ContainerStarted","Data":"a297ec69d86c6daddc000dd337f451c53946651ab2f25437466211a5de9737fd"}
Sep 16 02:41:24.031687 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:24.031147    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-8873-4f8006" podUID="a1be40b0-507e-4fbf-bd32-b5fcc6d1bed2" containerName="test-curl-8873-4f8006" containerID="cri-o://2684a24bee19d1de88e06b679150daa068b69439d8f6b0cdf32b646f0a66d465" gracePeriod=2
Sep 16 02:41:24.046039 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:24.045995    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-8873-4aabbe" podStartSLOduration=2.045981387 podStartE2EDuration="2.045981387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:41:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:41:24.043679576 +0000 UTC m=+1689.135861548" watchObservedRunningTime="2026-09-16 02:41:24.045981387 +0000 UTC m=+1689.138163387"
Sep 16 02:41:24.702253 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:24.702221    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8873-4aabbe"]
Sep 16 02:41:24.711109 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:24.709440    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8873-4aabbe"]
Sep 16 02:41:24.856470 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:24.856444    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8873-efcdfe"]
Sep 16 02:41:24.856893 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:24.856879    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96025875-aae6-4631-b267-d17f00e103ae" containerName="test-curl-8873-4aabbe"
Sep 16 02:41:24.856953 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:24.856894    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="96025875-aae6-4631-b267-d17f00e103ae" containerName="test-curl-8873-4aabbe"
Sep 16 02:41:24.856990 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:24.856973    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="96025875-aae6-4631-b267-d17f00e103ae" containerName="test-curl-8873-4aabbe"
Sep 16 02:41:24.860056 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:24.860043    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8873-efcdfe"
Sep 16 02:41:24.865715 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:24.865692    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8873-efcdfe"]
Sep 16 02:41:24.939636 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:24.939607    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdkws\" (UniqueName: \"kubernetes.io/projected/b9715178-fe75-4870-a14e-e597ce88dce0-kube-api-access-tdkws\") pod \"test-curl-8873-efcdfe\" (UID: \"b9715178-fe75-4870-a14e-e597ce88dce0\") " pod="opendatahub/test-curl-8873-efcdfe"
Sep 16 02:41:25.037432 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:41:25.037406    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-8873-4aabbe" container="test-curl-8873-4aabbe"
Sep 16 02:41:25.040289 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:25.040270    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdkws\" (UniqueName: \"kubernetes.io/projected/b9715178-fe75-4870-a14e-e597ce88dce0-kube-api-access-tdkws\") pod \"test-curl-8873-efcdfe\" (UID: \"b9715178-fe75-4870-a14e-e597ce88dce0\") " pod="opendatahub/test-curl-8873-efcdfe"
Sep 16 02:41:25.047498 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:25.047475    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdkws\" (UniqueName: \"kubernetes.io/projected/b9715178-fe75-4870-a14e-e597ce88dce0-kube-api-access-tdkws\") pod \"test-curl-8873-efcdfe\" (UID: \"b9715178-fe75-4870-a14e-e597ce88dce0\") " pod="opendatahub/test-curl-8873-efcdfe"
Sep 16 02:41:25.170613 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:25.170549    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8873-efcdfe"
Sep 16 02:41:25.437266 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:41:25.437237    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9715178_fe75_4870_a14e_e597ce88dce0.slice/crio-ba263541733304c6ad571e6327b42bfe8e1a505a4372b5495b6b7ea50179e81c WatchSource:0}: Error finding container ba263541733304c6ad571e6327b42bfe8e1a505a4372b5495b6b7ea50179e81c: Status 404 returned error can't find the container with id ba263541733304c6ad571e6327b42bfe8e1a505a4372b5495b6b7ea50179e81c
Sep 16 02:41:25.437371 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:25.437347    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8873-efcdfe"]
Sep 16 02:41:26.044886 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:26.044838    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8873-efcdfe" event={"ID":"b9715178-fe75-4870-a14e-e597ce88dce0","Type":"ContainerStarted","Data":"4f5be2b9c9967616113d4ef6bbdeb2708ae3575f8f56de7ec386fae2ea0c2076"}
Sep 16 02:41:26.045297 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:26.044875    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-8873-4aabbe" podUID="96025875-aae6-4631-b267-d17f00e103ae" containerName="test-curl-8873-4aabbe" containerID="cri-o://ead7c95fd8046c81e76ddd9a2f31e0573aee9c4e7ee5321101d2588e343e84da" gracePeriod=2
Sep 16 02:41:26.045297 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:26.044901    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8873-efcdfe" event={"ID":"b9715178-fe75-4870-a14e-e597ce88dce0","Type":"ContainerStarted","Data":"ba263541733304c6ad571e6327b42bfe8e1a505a4372b5495b6b7ea50179e81c"}
Sep 16 02:41:26.059759 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:26.059716    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-8873-efcdfe" podStartSLOduration=2.05970295 podStartE2EDuration="2.05970295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:41:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:41:26.057783697 +0000 UTC m=+1691.149965669" watchObservedRunningTime="2026-09-16 02:41:26.05970295 +0000 UTC m=+1691.151884960"
Sep 16 02:41:26.205281 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:26.205257    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8873-4f8006"
Sep 16 02:41:26.249181 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:26.249159    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4s9v\" (UniqueName: \"kubernetes.io/projected/a1be40b0-507e-4fbf-bd32-b5fcc6d1bed2-kube-api-access-g4s9v\") pod \"a1be40b0-507e-4fbf-bd32-b5fcc6d1bed2\" (UID: \"a1be40b0-507e-4fbf-bd32-b5fcc6d1bed2\") "
Sep 16 02:41:26.251225 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:26.251199    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1be40b0-507e-4fbf-bd32-b5fcc6d1bed2-kube-api-access-g4s9v" (OuterVolumeSpecName: "kube-api-access-g4s9v") pod "a1be40b0-507e-4fbf-bd32-b5fcc6d1bed2" (UID: "a1be40b0-507e-4fbf-bd32-b5fcc6d1bed2"). InnerVolumeSpecName "kube-api-access-g4s9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:41:26.350263 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:26.350199    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4s9v\" (UniqueName: \"kubernetes.io/projected/a1be40b0-507e-4fbf-bd32-b5fcc6d1bed2-kube-api-access-g4s9v\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:41:26.713123 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:26.713038    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8873-efcdfe"]
Sep 16 02:41:26.717074 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:26.717049    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8873-efcdfe"]
Sep 16 02:41:26.862353 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:26.862323    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8873-8378aa"]
Sep 16 02:41:26.862758 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:26.862746    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9715178-fe75-4870-a14e-e597ce88dce0" containerName="test-curl-8873-efcdfe"
Sep 16 02:41:26.862802 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:26.862760    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9715178-fe75-4870-a14e-e597ce88dce0" containerName="test-curl-8873-efcdfe"
Sep 16 02:41:26.862842 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:26.862832    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9715178-fe75-4870-a14e-e597ce88dce0" containerName="test-curl-8873-efcdfe"
Sep 16 02:41:26.865914 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:26.865899    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8873-8378aa"
Sep 16 02:41:26.870757 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:26.870733    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8873-8378aa"]
Sep 16 02:41:26.955486 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:26.955458    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69ps6\" (UniqueName: \"kubernetes.io/projected/06f06d27-3b37-4a0d-903d-2844d925125b-kube-api-access-69ps6\") pod \"test-curl-8873-8378aa\" (UID: \"06f06d27-3b37-4a0d-903d-2844d925125b\") " pod="opendatahub/test-curl-8873-8378aa"
Sep 16 02:41:27.054940 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:27.054822    2581 generic.go:356] "Generic (PLEG): container finished" podID="a1be40b0-507e-4fbf-bd32-b5fcc6d1bed2" containerID="2684a24bee19d1de88e06b679150daa068b69439d8f6b0cdf32b646f0a66d465" exitCode=137
Sep 16 02:41:27.055364 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:27.054894    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8873-4f8006"
Sep 16 02:41:27.055364 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:27.054900    2581 scope.go:117] "RemoveContainer" containerID="2684a24bee19d1de88e06b679150daa068b69439d8f6b0cdf32b646f0a66d465"
Sep 16 02:41:27.055489 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:41:27.055384    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-8873-efcdfe" container="test-curl-8873-efcdfe"
Sep 16 02:41:27.055976 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:27.055955    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69ps6\" (UniqueName: \"kubernetes.io/projected/06f06d27-3b37-4a0d-903d-2844d925125b-kube-api-access-69ps6\") pod \"test-curl-8873-8378aa\" (UID: \"06f06d27-3b37-4a0d-903d-2844d925125b\") " pod="opendatahub/test-curl-8873-8378aa"
Sep 16 02:41:27.063083 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:27.063066    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69ps6\" (UniqueName: \"kubernetes.io/projected/06f06d27-3b37-4a0d-903d-2844d925125b-kube-api-access-69ps6\") pod \"test-curl-8873-8378aa\" (UID: \"06f06d27-3b37-4a0d-903d-2844d925125b\") " pod="opendatahub/test-curl-8873-8378aa"
Sep 16 02:41:27.064785 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:27.064768    2581 scope.go:117] "RemoveContainer" containerID="2684a24bee19d1de88e06b679150daa068b69439d8f6b0cdf32b646f0a66d465"
Sep 16 02:41:27.065070 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:41:27.065052    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2684a24bee19d1de88e06b679150daa068b69439d8f6b0cdf32b646f0a66d465\": container with ID starting with 2684a24bee19d1de88e06b679150daa068b69439d8f6b0cdf32b646f0a66d465 not found: ID does not exist" containerID="2684a24bee19d1de88e06b679150daa068b69439d8f6b0cdf32b646f0a66d465"
Sep 16 02:41:27.065125 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:27.065079    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2684a24bee19d1de88e06b679150daa068b69439d8f6b0cdf32b646f0a66d465"} err="failed to get container status \"2684a24bee19d1de88e06b679150daa068b69439d8f6b0cdf32b646f0a66d465\": rpc error: code = NotFound desc = could not find container \"2684a24bee19d1de88e06b679150daa068b69439d8f6b0cdf32b646f0a66d465\": container with ID starting with 2684a24bee19d1de88e06b679150daa068b69439d8f6b0cdf32b646f0a66d465 not found: ID does not exist"
Sep 16 02:41:27.072607 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:41:27.072585    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8873-4f8006\" is forbidden: User \"system:node:ip-10-0-139-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-191.ec2.internal' and this object" podUID="a1be40b0-507e-4fbf-bd32-b5fcc6d1bed2" pod="opendatahub/test-curl-8873-4f8006"
Sep 16 02:41:27.175204 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:27.175160    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8873-8378aa"
Sep 16 02:41:27.382221 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:27.382140    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1be40b0-507e-4fbf-bd32-b5fcc6d1bed2" path="/var/lib/kubelet/pods/a1be40b0-507e-4fbf-bd32-b5fcc6d1bed2/volumes"
Sep 16 02:41:27.444303 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:27.444276    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8873-8378aa"]
Sep 16 02:41:27.445344 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:41:27.445315    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod06f06d27_3b37_4a0d_903d_2844d925125b.slice/crio-b565638913f775b4b4786f548cb230580e5caea1de70f8f133e9befad9ede854 WatchSource:0}: Error finding container b565638913f775b4b4786f548cb230580e5caea1de70f8f133e9befad9ede854: Status 404 returned error can't find the container with id b565638913f775b4b4786f548cb230580e5caea1de70f8f133e9befad9ede854
Sep 16 02:41:28.063169 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:28.063136    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8873-8378aa" event={"ID":"06f06d27-3b37-4a0d-903d-2844d925125b","Type":"ContainerStarted","Data":"200dcbd23033db9b0e1deb7125a97c5798ffdf7c828a44790fe071ebc90897e7"}
Sep 16 02:41:28.063553 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:28.063210    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8873-8378aa" event={"ID":"06f06d27-3b37-4a0d-903d-2844d925125b","Type":"ContainerStarted","Data":"b565638913f775b4b4786f548cb230580e5caea1de70f8f133e9befad9ede854"}
Sep 16 02:41:28.064436 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:28.064402    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-8873-efcdfe" podUID="b9715178-fe75-4870-a14e-e597ce88dce0" containerName="test-curl-8873-efcdfe" containerID="cri-o://4f5be2b9c9967616113d4ef6bbdeb2708ae3575f8f56de7ec386fae2ea0c2076" gracePeriod=2
Sep 16 02:41:28.080079 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:28.080023    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-8873-8378aa" podStartSLOduration=2.080003079 podStartE2EDuration="2.080003079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:41:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:41:28.075691959 +0000 UTC m=+1693.167873933" watchObservedRunningTime="2026-09-16 02:41:28.080003079 +0000 UTC m=+1693.172185053"
Sep 16 02:41:28.226149 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:28.226126    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8873-4aabbe"
Sep 16 02:41:28.267074 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:28.267053    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvt6n\" (UniqueName: \"kubernetes.io/projected/96025875-aae6-4631-b267-d17f00e103ae-kube-api-access-qvt6n\") pod \"96025875-aae6-4631-b267-d17f00e103ae\" (UID: \"96025875-aae6-4631-b267-d17f00e103ae\") "
Sep 16 02:41:28.269182 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:28.269160    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96025875-aae6-4631-b267-d17f00e103ae-kube-api-access-qvt6n" (OuterVolumeSpecName: "kube-api-access-qvt6n") pod "96025875-aae6-4631-b267-d17f00e103ae" (UID: "96025875-aae6-4631-b267-d17f00e103ae"). InnerVolumeSpecName "kube-api-access-qvt6n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:41:28.368502 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:28.368430    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvt6n\" (UniqueName: \"kubernetes.io/projected/96025875-aae6-4631-b267-d17f00e103ae-kube-api-access-qvt6n\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:41:28.745027 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:28.744946    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8873-8378aa"]
Sep 16 02:41:28.748904 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:28.748878    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8873-8378aa"]
Sep 16 02:41:29.071771 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:29.071739    2581 generic.go:356] "Generic (PLEG): container finished" podID="96025875-aae6-4631-b267-d17f00e103ae" containerID="ead7c95fd8046c81e76ddd9a2f31e0573aee9c4e7ee5321101d2588e343e84da" exitCode=137
Sep 16 02:41:29.072233 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:29.071792    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8873-4aabbe"
Sep 16 02:41:29.072233 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:29.071840    2581 scope.go:117] "RemoveContainer" containerID="ead7c95fd8046c81e76ddd9a2f31e0573aee9c4e7ee5321101d2588e343e84da"
Sep 16 02:41:29.072233 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:41:29.072116    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-8873-8378aa" container="test-curl-8873-8378aa"
Sep 16 02:41:29.081135 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:29.081113    2581 scope.go:117] "RemoveContainer" containerID="ead7c95fd8046c81e76ddd9a2f31e0573aee9c4e7ee5321101d2588e343e84da"
Sep 16 02:41:29.081387 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:41:29.081370    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ead7c95fd8046c81e76ddd9a2f31e0573aee9c4e7ee5321101d2588e343e84da\": container with ID starting with ead7c95fd8046c81e76ddd9a2f31e0573aee9c4e7ee5321101d2588e343e84da not found: ID does not exist" containerID="ead7c95fd8046c81e76ddd9a2f31e0573aee9c4e7ee5321101d2588e343e84da"
Sep 16 02:41:29.081432 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:29.081397    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ead7c95fd8046c81e76ddd9a2f31e0573aee9c4e7ee5321101d2588e343e84da"} err="failed to get container status \"ead7c95fd8046c81e76ddd9a2f31e0573aee9c4e7ee5321101d2588e343e84da\": rpc error: code = NotFound desc = could not find container \"ead7c95fd8046c81e76ddd9a2f31e0573aee9c4e7ee5321101d2588e343e84da\": container with ID starting with ead7c95fd8046c81e76ddd9a2f31e0573aee9c4e7ee5321101d2588e343e84da not found: ID does not exist"
Sep 16 02:41:29.082028 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:41:29.082005    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8873-4aabbe\" is forbidden: User \"system:node:ip-10-0-139-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-191.ec2.internal' and this object" podUID="96025875-aae6-4631-b267-d17f00e103ae" pod="opendatahub/test-curl-8873-4aabbe"
Sep 16 02:41:29.382204 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:29.382130    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96025875-aae6-4631-b267-d17f00e103ae" path="/var/lib/kubelet/pods/96025875-aae6-4631-b267-d17f00e103ae/volumes"
Sep 16 02:41:30.080502 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:30.080473    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-8873-8378aa" podUID="06f06d27-3b37-4a0d-903d-2844d925125b" containerName="test-curl-8873-8378aa" containerID="cri-o://200dcbd23033db9b0e1deb7125a97c5798ffdf7c828a44790fe071ebc90897e7" gracePeriod=2
Sep 16 02:41:30.254825 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:30.254792    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8873-efcdfe"
Sep 16 02:41:30.285964 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:30.285934    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdkws\" (UniqueName: \"kubernetes.io/projected/b9715178-fe75-4870-a14e-e597ce88dce0-kube-api-access-tdkws\") pod \"b9715178-fe75-4870-a14e-e597ce88dce0\" (UID: \"b9715178-fe75-4870-a14e-e597ce88dce0\") "
Sep 16 02:41:30.287976 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:30.287954    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9715178-fe75-4870-a14e-e597ce88dce0-kube-api-access-tdkws" (OuterVolumeSpecName: "kube-api-access-tdkws") pod "b9715178-fe75-4870-a14e-e597ce88dce0" (UID: "b9715178-fe75-4870-a14e-e597ce88dce0"). InnerVolumeSpecName "kube-api-access-tdkws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:41:30.387651 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:30.387584    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdkws\" (UniqueName: \"kubernetes.io/projected/b9715178-fe75-4870-a14e-e597ce88dce0-kube-api-access-tdkws\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:41:31.087961 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:31.087928    2581 generic.go:356] "Generic (PLEG): container finished" podID="b9715178-fe75-4870-a14e-e597ce88dce0" containerID="4f5be2b9c9967616113d4ef6bbdeb2708ae3575f8f56de7ec386fae2ea0c2076" exitCode=137
Sep 16 02:41:31.088379 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:31.087968    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8873-efcdfe"
Sep 16 02:41:31.088379 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:31.088038    2581 scope.go:117] "RemoveContainer" containerID="4f5be2b9c9967616113d4ef6bbdeb2708ae3575f8f56de7ec386fae2ea0c2076"
Sep 16 02:41:31.097448 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:31.097431    2581 scope.go:117] "RemoveContainer" containerID="4f5be2b9c9967616113d4ef6bbdeb2708ae3575f8f56de7ec386fae2ea0c2076"
Sep 16 02:41:31.097732 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:41:31.097712    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f5be2b9c9967616113d4ef6bbdeb2708ae3575f8f56de7ec386fae2ea0c2076\": container with ID starting with 4f5be2b9c9967616113d4ef6bbdeb2708ae3575f8f56de7ec386fae2ea0c2076 not found: ID does not exist" containerID="4f5be2b9c9967616113d4ef6bbdeb2708ae3575f8f56de7ec386fae2ea0c2076"
Sep 16 02:41:31.097802 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:31.097743    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f5be2b9c9967616113d4ef6bbdeb2708ae3575f8f56de7ec386fae2ea0c2076"} err="failed to get container status \"4f5be2b9c9967616113d4ef6bbdeb2708ae3575f8f56de7ec386fae2ea0c2076\": rpc error: code = NotFound desc = could not find container \"4f5be2b9c9967616113d4ef6bbdeb2708ae3575f8f56de7ec386fae2ea0c2076\": container with ID starting with 4f5be2b9c9967616113d4ef6bbdeb2708ae3575f8f56de7ec386fae2ea0c2076 not found: ID does not exist"
Sep 16 02:41:31.097970 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:41:31.097949    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8873-efcdfe\" is forbidden: User \"system:node:ip-10-0-139-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-191.ec2.internal' and this object" podUID="b9715178-fe75-4870-a14e-e597ce88dce0" pod="opendatahub/test-curl-8873-efcdfe"
Sep 16 02:41:31.382782 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:31.382698    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9715178-fe75-4870-a14e-e597ce88dce0" path="/var/lib/kubelet/pods/b9715178-fe75-4870-a14e-e597ce88dce0/volumes"
Sep 16 02:41:32.257757 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:32.257729    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8873-8378aa"
Sep 16 02:41:32.304799 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:32.304774    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69ps6\" (UniqueName: \"kubernetes.io/projected/06f06d27-3b37-4a0d-903d-2844d925125b-kube-api-access-69ps6\") pod \"06f06d27-3b37-4a0d-903d-2844d925125b\" (UID: \"06f06d27-3b37-4a0d-903d-2844d925125b\") "
Sep 16 02:41:32.306798 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:32.306778    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06f06d27-3b37-4a0d-903d-2844d925125b-kube-api-access-69ps6" (OuterVolumeSpecName: "kube-api-access-69ps6") pod "06f06d27-3b37-4a0d-903d-2844d925125b" (UID: "06f06d27-3b37-4a0d-903d-2844d925125b"). InnerVolumeSpecName "kube-api-access-69ps6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:41:32.405693 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:32.405615    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69ps6\" (UniqueName: \"kubernetes.io/projected/06f06d27-3b37-4a0d-903d-2844d925125b-kube-api-access-69ps6\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:41:33.102125 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:33.102095    2581 generic.go:356] "Generic (PLEG): container finished" podID="06f06d27-3b37-4a0d-903d-2844d925125b" containerID="200dcbd23033db9b0e1deb7125a97c5798ffdf7c828a44790fe071ebc90897e7" exitCode=137
Sep 16 02:41:33.102292 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:33.102137    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8873-8378aa"
Sep 16 02:41:33.102292 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:33.102201    2581 scope.go:117] "RemoveContainer" containerID="200dcbd23033db9b0e1deb7125a97c5798ffdf7c828a44790fe071ebc90897e7"
Sep 16 02:41:33.111237 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:33.111215    2581 scope.go:117] "RemoveContainer" containerID="200dcbd23033db9b0e1deb7125a97c5798ffdf7c828a44790fe071ebc90897e7"
Sep 16 02:41:33.111518 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:41:33.111500    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"200dcbd23033db9b0e1deb7125a97c5798ffdf7c828a44790fe071ebc90897e7\": container with ID starting with 200dcbd23033db9b0e1deb7125a97c5798ffdf7c828a44790fe071ebc90897e7 not found: ID does not exist" containerID="200dcbd23033db9b0e1deb7125a97c5798ffdf7c828a44790fe071ebc90897e7"
Sep 16 02:41:33.111573 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:33.111526    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"200dcbd23033db9b0e1deb7125a97c5798ffdf7c828a44790fe071ebc90897e7"} err="failed to get container status \"200dcbd23033db9b0e1deb7125a97c5798ffdf7c828a44790fe071ebc90897e7\": rpc error: code = NotFound desc = could not find container \"200dcbd23033db9b0e1deb7125a97c5798ffdf7c828a44790fe071ebc90897e7\": container with ID starting with 200dcbd23033db9b0e1deb7125a97c5798ffdf7c828a44790fe071ebc90897e7 not found: ID does not exist"
Sep 16 02:41:33.111831 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:41:33.111808    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8873-8378aa\" is forbidden: User \"system:node:ip-10-0-139-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-191.ec2.internal' and this object" podUID="06f06d27-3b37-4a0d-903d-2844d925125b" pod="opendatahub/test-curl-8873-8378aa"
Sep 16 02:41:33.382348 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:33.382268    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06f06d27-3b37-4a0d-903d-2844d925125b" path="/var/lib/kubelet/pods/06f06d27-3b37-4a0d-903d-2844d925125b/volumes"
Sep 16 02:41:34.276118 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:34.276087    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:41:35.205452 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:35.205421    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58"]
Sep 16 02:41:35.205829 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:35.205823    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06f06d27-3b37-4a0d-903d-2844d925125b" containerName="test-curl-8873-8378aa"
Sep 16 02:41:35.205916 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:35.205833    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="06f06d27-3b37-4a0d-903d-2844d925125b" containerName="test-curl-8873-8378aa"
Sep 16 02:41:35.205962 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:35.205949    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="06f06d27-3b37-4a0d-903d-2844d925125b" containerName="test-curl-8873-8378aa"
Sep 16 02:41:35.210330 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:35.210304    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58"
Sep 16 02:41:35.212637 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:35.212615    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-77f43ab3-serving-cert\""
Sep 16 02:41:35.217638 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:35.217617    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58"]
Sep 16 02:41:35.230374 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:35.230346    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/449000b8-9943-4d4a-83f0-7fdc41ab84b2-maas-api-tls\") pod \"maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58\" (UID: \"449000b8-9943-4d4a-83f0-7fdc41ab84b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58"
Sep 16 02:41:35.230515 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:35.230438    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/449000b8-9943-4d4a-83f0-7fdc41ab84b2-metrics-certs\") pod \"maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58\" (UID: \"449000b8-9943-4d4a-83f0-7fdc41ab84b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58"
Sep 16 02:41:35.230587 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:35.230512    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9zm6\" (UniqueName: \"kubernetes.io/projected/449000b8-9943-4d4a-83f0-7fdc41ab84b2-kube-api-access-d9zm6\") pod \"maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58\" (UID: \"449000b8-9943-4d4a-83f0-7fdc41ab84b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58"
Sep 16 02:41:35.230587 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:35.230551    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/449000b8-9943-4d4a-83f0-7fdc41ab84b2-openshift-service-ca\") pod \"maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58\" (UID: \"449000b8-9943-4d4a-83f0-7fdc41ab84b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58"
Sep 16 02:41:35.331196 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:35.331153    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/449000b8-9943-4d4a-83f0-7fdc41ab84b2-metrics-certs\") pod \"maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58\" (UID: \"449000b8-9943-4d4a-83f0-7fdc41ab84b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58"
Sep 16 02:41:35.331396 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:35.331261    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9zm6\" (UniqueName: \"kubernetes.io/projected/449000b8-9943-4d4a-83f0-7fdc41ab84b2-kube-api-access-d9zm6\") pod \"maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58\" (UID: \"449000b8-9943-4d4a-83f0-7fdc41ab84b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58"
Sep 16 02:41:35.331396 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:35.331306    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/449000b8-9943-4d4a-83f0-7fdc41ab84b2-openshift-service-ca\") pod \"maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58\" (UID: \"449000b8-9943-4d4a-83f0-7fdc41ab84b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58"
Sep 16 02:41:35.331396 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:35.331365    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/449000b8-9943-4d4a-83f0-7fdc41ab84b2-maas-api-tls\") pod \"maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58\" (UID: \"449000b8-9943-4d4a-83f0-7fdc41ab84b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58"
Sep 16 02:41:35.331784 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:41:35.331754    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-serving-cert: secret "maas-api-e2e-mt-77f43ab3-serving-cert" not found
Sep 16 02:41:35.331911 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:41:35.331842    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/449000b8-9943-4d4a-83f0-7fdc41ab84b2-maas-api-tls podName:449000b8-9943-4d4a-83f0-7fdc41ab84b2 nodeName:}" failed. No retries permitted until 2026-09-16 02:41:35.831820783 +0000 UTC m=+1700.924002736 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/449000b8-9943-4d4a-83f0-7fdc41ab84b2-maas-api-tls") pod "maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58" (UID: "449000b8-9943-4d4a-83f0-7fdc41ab84b2") : secret "maas-api-e2e-mt-77f43ab3-serving-cert" not found
Sep 16 02:41:35.332307 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:35.332286    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/449000b8-9943-4d4a-83f0-7fdc41ab84b2-openshift-service-ca\") pod \"maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58\" (UID: \"449000b8-9943-4d4a-83f0-7fdc41ab84b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58"
Sep 16 02:41:35.334133 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:35.334112    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/449000b8-9943-4d4a-83f0-7fdc41ab84b2-metrics-certs\") pod \"maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58\" (UID: \"449000b8-9943-4d4a-83f0-7fdc41ab84b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58"
Sep 16 02:41:35.340643 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:35.340624    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9zm6\" (UniqueName: \"kubernetes.io/projected/449000b8-9943-4d4a-83f0-7fdc41ab84b2-kube-api-access-d9zm6\") pod \"maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58\" (UID: \"449000b8-9943-4d4a-83f0-7fdc41ab84b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58"
Sep 16 02:41:35.837246 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:35.837218    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/449000b8-9943-4d4a-83f0-7fdc41ab84b2-maas-api-tls\") pod \"maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58\" (UID: \"449000b8-9943-4d4a-83f0-7fdc41ab84b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58"
Sep 16 02:41:35.839671 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:35.839646    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/449000b8-9943-4d4a-83f0-7fdc41ab84b2-maas-api-tls\") pod \"maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58\" (UID: \"449000b8-9943-4d4a-83f0-7fdc41ab84b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58"
Sep 16 02:41:36.124373 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:36.124296    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58"
Sep 16 02:41:36.397771 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:36.397740    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58"]
Sep 16 02:41:36.398454 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:41:36.398428    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod449000b8_9943_4d4a_83f0_7fdc41ab84b2.slice/crio-ce833ca2e27e59e386130989791937c5b14480364763d1cef4771f4c0b799fef WatchSource:0}: Error finding container ce833ca2e27e59e386130989791937c5b14480364763d1cef4771f4c0b799fef: Status 404 returned error can't find the container with id ce833ca2e27e59e386130989791937c5b14480364763d1cef4771f4c0b799fef
Sep 16 02:41:37.128611 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:37.128513    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58" event={"ID":"449000b8-9943-4d4a-83f0-7fdc41ab84b2","Type":"ContainerStarted","Data":"9b6e4a06d7521da732296bbc295c282c2dd6dfbd5b4ac0fb0e0458305810f0d7"}
Sep 16 02:41:37.128611 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:37.128574    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58" event={"ID":"449000b8-9943-4d4a-83f0-7fdc41ab84b2","Type":"ContainerStarted","Data":"ce833ca2e27e59e386130989791937c5b14480364763d1cef4771f4c0b799fef"}
Sep 16 02:41:37.128611 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:37.128600    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58"
Sep 16 02:41:37.149545 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:37.149496    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58" podStartSLOduration=1.715172358 podStartE2EDuration="2.149481114s" totalImagesPullingTime="434.308756ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:41:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:41:37.146724819 +0000 UTC m=+1702.238906792" watchObservedRunningTime="2026-09-16 02:41:37.149481114 +0000 UTC m=+1702.241663130"
Sep 16 02:41:43.140143 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:43.140111    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58"
Sep 16 02:41:47.786530 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:41:47.786497    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:42:09.883444 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:09.883406    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:42:31.876752 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:31.876718    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:42:51.475655 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:51.475619    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:42:54.281548 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:54.281512    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8876-6f134f"]
Sep 16 02:42:54.285334 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:54.285312    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8876-6f134f"
Sep 16 02:42:54.287298 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:54.287275    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-5sbqt\""
Sep 16 02:42:54.288906 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:54.288884    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8876-6f134f"]
Sep 16 02:42:54.446407 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:54.446375    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-965vm\" (UniqueName: \"kubernetes.io/projected/8b74aadc-0175-4adb-80f5-102b58d08dce-kube-api-access-965vm\") pod \"test-curl-8876-6f134f\" (UID: \"8b74aadc-0175-4adb-80f5-102b58d08dce\") " pod="opendatahub/test-curl-8876-6f134f"
Sep 16 02:42:54.546955 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:54.546879    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-965vm\" (UniqueName: \"kubernetes.io/projected/8b74aadc-0175-4adb-80f5-102b58d08dce-kube-api-access-965vm\") pod \"test-curl-8876-6f134f\" (UID: \"8b74aadc-0175-4adb-80f5-102b58d08dce\") " pod="opendatahub/test-curl-8876-6f134f"
Sep 16 02:42:54.553902 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:54.553874    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-965vm\" (UniqueName: \"kubernetes.io/projected/8b74aadc-0175-4adb-80f5-102b58d08dce-kube-api-access-965vm\") pod \"test-curl-8876-6f134f\" (UID: \"8b74aadc-0175-4adb-80f5-102b58d08dce\") " pod="opendatahub/test-curl-8876-6f134f"
Sep 16 02:42:54.595972 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:54.595935    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8876-6f134f"
Sep 16 02:42:54.865308 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:54.865285    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8876-6f134f"]
Sep 16 02:42:54.867644 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:42:54.867613    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b74aadc_0175_4adb_80f5_102b58d08dce.slice/crio-8fdb471d9c913a6f9afac789e5d74d27b6bda5e261929c82e86e8c866b0be3fd WatchSource:0}: Error finding container 8fdb471d9c913a6f9afac789e5d74d27b6bda5e261929c82e86e8c866b0be3fd: Status 404 returned error can't find the container with id 8fdb471d9c913a6f9afac789e5d74d27b6bda5e261929c82e86e8c866b0be3fd
Sep 16 02:42:55.593717 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:55.593678    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8876-6f134f" event={"ID":"8b74aadc-0175-4adb-80f5-102b58d08dce","Type":"ContainerStarted","Data":"963c12b2c7751506adc6c60fc7974a8bd07c4c6156642ce51105ffcaed4cdc33"}
Sep 16 02:42:55.594186 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:55.593727    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8876-6f134f" event={"ID":"8b74aadc-0175-4adb-80f5-102b58d08dce","Type":"ContainerStarted","Data":"8fdb471d9c913a6f9afac789e5d74d27b6bda5e261929c82e86e8c866b0be3fd"}
Sep 16 02:42:55.608194 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:55.608145    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-8876-6f134f" podStartSLOduration=1.608130179 podStartE2EDuration="1.608130179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:42:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:42:55.60690589 +0000 UTC m=+1780.699087865" watchObservedRunningTime="2026-09-16 02:42:55.608130179 +0000 UTC m=+1780.700312153"
Sep 16 02:42:56.157270 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:56.157234    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8876-6f134f"]
Sep 16 02:42:56.160213 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:56.160185    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8876-6f134f"]
Sep 16 02:42:56.277926 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:56.277898    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8876-89dbaa"]
Sep 16 02:42:56.278527 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:56.278511    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b74aadc-0175-4adb-80f5-102b58d08dce" containerName="test-curl-8876-6f134f"
Sep 16 02:42:56.278572 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:56.278532    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b74aadc-0175-4adb-80f5-102b58d08dce" containerName="test-curl-8876-6f134f"
Sep 16 02:42:56.278654 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:56.278643    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b74aadc-0175-4adb-80f5-102b58d08dce" containerName="test-curl-8876-6f134f"
Sep 16 02:42:56.282159 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:56.282137    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8876-89dbaa"
Sep 16 02:42:56.284710 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:56.284690    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8876-89dbaa"]
Sep 16 02:42:56.465411 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:56.465371    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfjcg\" (UniqueName: \"kubernetes.io/projected/08e4476a-8fde-49c2-9039-9defef047400-kube-api-access-cfjcg\") pod \"test-curl-8876-89dbaa\" (UID: \"08e4476a-8fde-49c2-9039-9defef047400\") " pod="opendatahub/test-curl-8876-89dbaa"
Sep 16 02:42:56.566967 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:56.566877    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfjcg\" (UniqueName: \"kubernetes.io/projected/08e4476a-8fde-49c2-9039-9defef047400-kube-api-access-cfjcg\") pod \"test-curl-8876-89dbaa\" (UID: \"08e4476a-8fde-49c2-9039-9defef047400\") " pod="opendatahub/test-curl-8876-89dbaa"
Sep 16 02:42:56.574773 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:56.574746    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfjcg\" (UniqueName: \"kubernetes.io/projected/08e4476a-8fde-49c2-9039-9defef047400-kube-api-access-cfjcg\") pod \"test-curl-8876-89dbaa\" (UID: \"08e4476a-8fde-49c2-9039-9defef047400\") " pod="opendatahub/test-curl-8876-89dbaa"
Sep 16 02:42:56.594757 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:56.594735    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8876-89dbaa"
Sep 16 02:42:56.600202 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:42:56.600175    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-8876-6f134f" container="test-curl-8876-6f134f"
Sep 16 02:42:56.864010 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:56.863983    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8876-89dbaa"]
Sep 16 02:42:56.865207 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:42:56.865178    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08e4476a_8fde_49c2_9039_9defef047400.slice/crio-c3f5d24b27a27855c9ee5473b55c65c9f63a64d77b8a23f2d99eb6d4159734d8 WatchSource:0}: Error finding container c3f5d24b27a27855c9ee5473b55c65c9f63a64d77b8a23f2d99eb6d4159734d8: Status 404 returned error can't find the container with id c3f5d24b27a27855c9ee5473b55c65c9f63a64d77b8a23f2d99eb6d4159734d8
Sep 16 02:42:57.607928 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:57.607894    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8876-89dbaa" event={"ID":"08e4476a-8fde-49c2-9039-9defef047400","Type":"ContainerStarted","Data":"bbf5b1830c57f45c07a42b50b4531e48df652e58e3cc6524787ff7c7cf79e7bb"}
Sep 16 02:42:57.607928 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:57.607938    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8876-89dbaa" event={"ID":"08e4476a-8fde-49c2-9039-9defef047400","Type":"ContainerStarted","Data":"c3f5d24b27a27855c9ee5473b55c65c9f63a64d77b8a23f2d99eb6d4159734d8"}
Sep 16 02:42:57.608436 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:57.608006    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-8876-6f134f" podUID="8b74aadc-0175-4adb-80f5-102b58d08dce" containerName="test-curl-8876-6f134f" containerID="cri-o://963c12b2c7751506adc6c60fc7974a8bd07c4c6156642ce51105ffcaed4cdc33" gracePeriod=2
Sep 16 02:42:57.621634 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:57.621589    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-8876-89dbaa" podStartSLOduration=1.621575309 podStartE2EDuration="1.621575309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:42:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:42:57.619229676 +0000 UTC m=+1782.711411647" watchObservedRunningTime="2026-09-16 02:42:57.621575309 +0000 UTC m=+1782.713757283"
Sep 16 02:42:58.185752 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:58.185719    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8876-89dbaa"]
Sep 16 02:42:58.189273 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:58.189248    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8876-89dbaa"]
Sep 16 02:42:58.614166 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:42:58.614137    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-8876-89dbaa" container="test-curl-8876-89dbaa"
Sep 16 02:42:59.620383 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:59.620350    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-8876-89dbaa" podUID="08e4476a-8fde-49c2-9039-9defef047400" containerName="test-curl-8876-89dbaa" containerID="cri-o://bbf5b1830c57f45c07a42b50b4531e48df652e58e3cc6524787ff7c7cf79e7bb" gracePeriod=2
Sep 16 02:42:59.800275 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:59.800251    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8876-6f134f"
Sep 16 02:42:59.899876 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:59.899783    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-965vm\" (UniqueName: \"kubernetes.io/projected/8b74aadc-0175-4adb-80f5-102b58d08dce-kube-api-access-965vm\") pod \"8b74aadc-0175-4adb-80f5-102b58d08dce\" (UID: \"8b74aadc-0175-4adb-80f5-102b58d08dce\") "
Sep 16 02:42:59.902026 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:42:59.901998    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b74aadc-0175-4adb-80f5-102b58d08dce-kube-api-access-965vm" (OuterVolumeSpecName: "kube-api-access-965vm") pod "8b74aadc-0175-4adb-80f5-102b58d08dce" (UID: "8b74aadc-0175-4adb-80f5-102b58d08dce"). InnerVolumeSpecName "kube-api-access-965vm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:43:00.001513 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:00.001480    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-965vm\" (UniqueName: \"kubernetes.io/projected/8b74aadc-0175-4adb-80f5-102b58d08dce-kube-api-access-965vm\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:43:00.628547 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:00.628511    2581 generic.go:356] "Generic (PLEG): container finished" podID="8b74aadc-0175-4adb-80f5-102b58d08dce" containerID="963c12b2c7751506adc6c60fc7974a8bd07c4c6156642ce51105ffcaed4cdc33" exitCode=137
Sep 16 02:43:00.628987 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:00.628576    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8876-6f134f"
Sep 16 02:43:00.628987 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:00.628625    2581 scope.go:117] "RemoveContainer" containerID="963c12b2c7751506adc6c60fc7974a8bd07c4c6156642ce51105ffcaed4cdc33"
Sep 16 02:43:00.638509 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:00.638493    2581 scope.go:117] "RemoveContainer" containerID="963c12b2c7751506adc6c60fc7974a8bd07c4c6156642ce51105ffcaed4cdc33"
Sep 16 02:43:00.638802 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:43:00.638781    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"963c12b2c7751506adc6c60fc7974a8bd07c4c6156642ce51105ffcaed4cdc33\": container with ID starting with 963c12b2c7751506adc6c60fc7974a8bd07c4c6156642ce51105ffcaed4cdc33 not found: ID does not exist" containerID="963c12b2c7751506adc6c60fc7974a8bd07c4c6156642ce51105ffcaed4cdc33"
Sep 16 02:43:00.638878 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:00.638821    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"963c12b2c7751506adc6c60fc7974a8bd07c4c6156642ce51105ffcaed4cdc33"} err="failed to get container status \"963c12b2c7751506adc6c60fc7974a8bd07c4c6156642ce51105ffcaed4cdc33\": rpc error: code = NotFound desc = could not find container \"963c12b2c7751506adc6c60fc7974a8bd07c4c6156642ce51105ffcaed4cdc33\": container with ID starting with 963c12b2c7751506adc6c60fc7974a8bd07c4c6156642ce51105ffcaed4cdc33 not found: ID does not exist"
Sep 16 02:43:00.639839 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:43:00.639818    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8876-6f134f\" is forbidden: User \"system:node:ip-10-0-139-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-191.ec2.internal' and this object" podUID="8b74aadc-0175-4adb-80f5-102b58d08dce" pod="opendatahub/test-curl-8876-6f134f"
Sep 16 02:43:01.384797 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:01.384765    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b74aadc-0175-4adb-80f5-102b58d08dce" path="/var/lib/kubelet/pods/8b74aadc-0175-4adb-80f5-102b58d08dce/volumes"
Sep 16 02:43:01.803706 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:01.803674    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8876-89dbaa"
Sep 16 02:43:01.818311 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:01.818285    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfjcg\" (UniqueName: \"kubernetes.io/projected/08e4476a-8fde-49c2-9039-9defef047400-kube-api-access-cfjcg\") pod \"08e4476a-8fde-49c2-9039-9defef047400\" (UID: \"08e4476a-8fde-49c2-9039-9defef047400\") "
Sep 16 02:43:01.820311 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:01.820289    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08e4476a-8fde-49c2-9039-9defef047400-kube-api-access-cfjcg" (OuterVolumeSpecName: "kube-api-access-cfjcg") pod "08e4476a-8fde-49c2-9039-9defef047400" (UID: "08e4476a-8fde-49c2-9039-9defef047400"). InnerVolumeSpecName "kube-api-access-cfjcg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:43:01.919296 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:01.919236    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfjcg\" (UniqueName: \"kubernetes.io/projected/08e4476a-8fde-49c2-9039-9defef047400-kube-api-access-cfjcg\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:43:02.645328 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:02.645295    2581 generic.go:356] "Generic (PLEG): container finished" podID="08e4476a-8fde-49c2-9039-9defef047400" containerID="bbf5b1830c57f45c07a42b50b4531e48df652e58e3cc6524787ff7c7cf79e7bb" exitCode=137
Sep 16 02:43:02.645506 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:02.645359    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8876-89dbaa"
Sep 16 02:43:02.645506 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:02.645393    2581 scope.go:117] "RemoveContainer" containerID="bbf5b1830c57f45c07a42b50b4531e48df652e58e3cc6524787ff7c7cf79e7bb"
Sep 16 02:43:02.655408 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:02.655386    2581 scope.go:117] "RemoveContainer" containerID="bbf5b1830c57f45c07a42b50b4531e48df652e58e3cc6524787ff7c7cf79e7bb"
Sep 16 02:43:02.655629 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:43:02.655591    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8876-89dbaa\" is forbidden: User \"system:node:ip-10-0-139-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-191.ec2.internal' and this object" podUID="08e4476a-8fde-49c2-9039-9defef047400" pod="opendatahub/test-curl-8876-89dbaa"
Sep 16 02:43:02.655716 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:43:02.655698    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbf5b1830c57f45c07a42b50b4531e48df652e58e3cc6524787ff7c7cf79e7bb\": container with ID starting with bbf5b1830c57f45c07a42b50b4531e48df652e58e3cc6524787ff7c7cf79e7bb not found: ID does not exist" containerID="bbf5b1830c57f45c07a42b50b4531e48df652e58e3cc6524787ff7c7cf79e7bb"
Sep 16 02:43:02.655761 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:02.655722    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbf5b1830c57f45c07a42b50b4531e48df652e58e3cc6524787ff7c7cf79e7bb"} err="failed to get container status \"bbf5b1830c57f45c07a42b50b4531e48df652e58e3cc6524787ff7c7cf79e7bb\": rpc error: code = NotFound desc = could not find container \"bbf5b1830c57f45c07a42b50b4531e48df652e58e3cc6524787ff7c7cf79e7bb\": container with ID starting with bbf5b1830c57f45c07a42b50b4531e48df652e58e3cc6524787ff7c7cf79e7bb not found: ID does not exist"
Sep 16 02:43:03.383520 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:03.383488    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08e4476a-8fde-49c2-9039-9defef047400" path="/var/lib/kubelet/pods/08e4476a-8fde-49c2-9039-9defef047400/volumes"
Sep 16 02:43:12.685750 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:12.685655    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:43:13.828088 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:13.828056    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58"]
Sep 16 02:43:13.828523 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:13.828321    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58" podUID="449000b8-9943-4d4a-83f0-7fdc41ab84b2" containerName="maas-api" containerID="cri-o://9b6e4a06d7521da732296bbc295c282c2dd6dfbd5b4ac0fb0e0458305810f0d7" gracePeriod=30
Sep 16 02:43:14.080671 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:14.080644    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58"
Sep 16 02:43:14.119951 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:14.119887    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/449000b8-9943-4d4a-83f0-7fdc41ab84b2-metrics-certs\") pod \"449000b8-9943-4d4a-83f0-7fdc41ab84b2\" (UID: \"449000b8-9943-4d4a-83f0-7fdc41ab84b2\") "
Sep 16 02:43:14.120166 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:14.120042    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/449000b8-9943-4d4a-83f0-7fdc41ab84b2-maas-api-tls\") pod \"449000b8-9943-4d4a-83f0-7fdc41ab84b2\" (UID: \"449000b8-9943-4d4a-83f0-7fdc41ab84b2\") "
Sep 16 02:43:14.120166 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:14.120078    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9zm6\" (UniqueName: \"kubernetes.io/projected/449000b8-9943-4d4a-83f0-7fdc41ab84b2-kube-api-access-d9zm6\") pod \"449000b8-9943-4d4a-83f0-7fdc41ab84b2\" (UID: \"449000b8-9943-4d4a-83f0-7fdc41ab84b2\") "
Sep 16 02:43:14.120166 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:14.120123    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/449000b8-9943-4d4a-83f0-7fdc41ab84b2-openshift-service-ca\") pod \"449000b8-9943-4d4a-83f0-7fdc41ab84b2\" (UID: \"449000b8-9943-4d4a-83f0-7fdc41ab84b2\") "
Sep 16 02:43:14.120670 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:14.120623    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/449000b8-9943-4d4a-83f0-7fdc41ab84b2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "449000b8-9943-4d4a-83f0-7fdc41ab84b2" (UID: "449000b8-9943-4d4a-83f0-7fdc41ab84b2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:43:14.122577 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:14.122546    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/449000b8-9943-4d4a-83f0-7fdc41ab84b2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "449000b8-9943-4d4a-83f0-7fdc41ab84b2" (UID: "449000b8-9943-4d4a-83f0-7fdc41ab84b2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:43:14.124772 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:14.124732    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/449000b8-9943-4d4a-83f0-7fdc41ab84b2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "449000b8-9943-4d4a-83f0-7fdc41ab84b2" (UID: "449000b8-9943-4d4a-83f0-7fdc41ab84b2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:43:14.124772 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:14.124738    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/449000b8-9943-4d4a-83f0-7fdc41ab84b2-kube-api-access-d9zm6" (OuterVolumeSpecName: "kube-api-access-d9zm6") pod "449000b8-9943-4d4a-83f0-7fdc41ab84b2" (UID: "449000b8-9943-4d4a-83f0-7fdc41ab84b2"). InnerVolumeSpecName "kube-api-access-d9zm6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:43:14.221366 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:14.221273    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/449000b8-9943-4d4a-83f0-7fdc41ab84b2-maas-api-tls\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:43:14.221366 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:14.221316    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9zm6\" (UniqueName: \"kubernetes.io/projected/449000b8-9943-4d4a-83f0-7fdc41ab84b2-kube-api-access-d9zm6\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:43:14.221366 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:14.221332    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/449000b8-9943-4d4a-83f0-7fdc41ab84b2-openshift-service-ca\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:43:14.221366 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:14.221346    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/449000b8-9943-4d4a-83f0-7fdc41ab84b2-metrics-certs\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:43:14.728466 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:14.728427    2581 generic.go:356] "Generic (PLEG): container finished" podID="449000b8-9943-4d4a-83f0-7fdc41ab84b2" containerID="9b6e4a06d7521da732296bbc295c282c2dd6dfbd5b4ac0fb0e0458305810f0d7" exitCode=0
Sep 16 02:43:14.728675 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:14.728485    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58" event={"ID":"449000b8-9943-4d4a-83f0-7fdc41ab84b2","Type":"ContainerDied","Data":"9b6e4a06d7521da732296bbc295c282c2dd6dfbd5b4ac0fb0e0458305810f0d7"}
Sep 16 02:43:14.728675 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:14.728498    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58"
Sep 16 02:43:14.728675 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:14.728574    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58" event={"ID":"449000b8-9943-4d4a-83f0-7fdc41ab84b2","Type":"ContainerDied","Data":"ce833ca2e27e59e386130989791937c5b14480364763d1cef4771f4c0b799fef"}
Sep 16 02:43:14.728675 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:14.728602    2581 scope.go:117] "RemoveContainer" containerID="9b6e4a06d7521da732296bbc295c282c2dd6dfbd5b4ac0fb0e0458305810f0d7"
Sep 16 02:43:14.739866 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:14.739829    2581 scope.go:117] "RemoveContainer" containerID="9b6e4a06d7521da732296bbc295c282c2dd6dfbd5b4ac0fb0e0458305810f0d7"
Sep 16 02:43:14.740156 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:43:14.740135    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b6e4a06d7521da732296bbc295c282c2dd6dfbd5b4ac0fb0e0458305810f0d7\": container with ID starting with 9b6e4a06d7521da732296bbc295c282c2dd6dfbd5b4ac0fb0e0458305810f0d7 not found: ID does not exist" containerID="9b6e4a06d7521da732296bbc295c282c2dd6dfbd5b4ac0fb0e0458305810f0d7"
Sep 16 02:43:14.740227 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:14.740165    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b6e4a06d7521da732296bbc295c282c2dd6dfbd5b4ac0fb0e0458305810f0d7"} err="failed to get container status \"9b6e4a06d7521da732296bbc295c282c2dd6dfbd5b4ac0fb0e0458305810f0d7\": rpc error: code = NotFound desc = could not find container \"9b6e4a06d7521da732296bbc295c282c2dd6dfbd5b4ac0fb0e0458305810f0d7\": container with ID starting with 9b6e4a06d7521da732296bbc295c282c2dd6dfbd5b4ac0fb0e0458305810f0d7 not found: ID does not exist"
Sep 16 02:43:14.752173 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:14.752144    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58"]
Sep 16 02:43:14.754926 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:14.754900    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-77f43ab3-7c8b4c7498-zgq58"]
Sep 16 02:43:15.382763 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:15.382731    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="449000b8-9943-4d4a-83f0-7fdc41ab84b2" path="/var/lib/kubelet/pods/449000b8-9943-4d4a-83f0-7fdc41ab84b2/volumes"
Sep 16 02:43:15.490016 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:15.489990    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g54gh_308f30e2-2871-442a-ba30-54ada02ad832/ovn-acl-logging/0.log"
Sep 16 02:43:15.498476 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:15.498458    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g54gh_308f30e2-2871-442a-ba30-54ada02ad832/ovn-acl-logging/0.log"
Sep 16 02:43:25.769771 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:25.769734    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:43:36.282393 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:36.282360    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:43:52.374185 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:43:52.374145    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:44:04.273545 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:04.273507    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:44:17.084257 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:17.084211    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:44:18.605432 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:18.605396    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg"]
Sep 16 02:44:18.606055 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:18.606040    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08e4476a-8fde-49c2-9039-9defef047400" containerName="test-curl-8876-89dbaa"
Sep 16 02:44:18.606114 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:18.606058    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="08e4476a-8fde-49c2-9039-9defef047400" containerName="test-curl-8876-89dbaa"
Sep 16 02:44:18.606114 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:18.606080    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="449000b8-9943-4d4a-83f0-7fdc41ab84b2" containerName="maas-api"
Sep 16 02:44:18.606114 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:18.606089    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="449000b8-9943-4d4a-83f0-7fdc41ab84b2" containerName="maas-api"
Sep 16 02:44:18.606217 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:18.606206    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="08e4476a-8fde-49c2-9039-9defef047400" containerName="test-curl-8876-89dbaa"
Sep 16 02:44:18.606253 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:18.606223    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="449000b8-9943-4d4a-83f0-7fdc41ab84b2" containerName="maas-api"
Sep 16 02:44:18.609578 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:18.609557    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg"
Sep 16 02:44:18.611657 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:18.611636    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-fd614e-serving-cert\""
Sep 16 02:44:18.618433 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:18.618410    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg"]
Sep 16 02:44:18.737257 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:18.737219    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg\" (UID: \"ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg"
Sep 16 02:44:18.737448 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:18.737268    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c-metrics-certs\") pod \"maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg\" (UID: \"ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg"
Sep 16 02:44:18.737448 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:18.737292    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk2w8\" (UniqueName: \"kubernetes.io/projected/ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c-kube-api-access-kk2w8\") pod \"maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg\" (UID: \"ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg"
Sep 16 02:44:18.737448 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:18.737344    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c-maas-api-tls\") pod \"maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg\" (UID: \"ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg"
Sep 16 02:44:18.838931 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:18.838885    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg\" (UID: \"ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg"
Sep 16 02:44:18.839143 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:18.838955    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c-metrics-certs\") pod \"maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg\" (UID: \"ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg"
Sep 16 02:44:18.839143 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:18.838986    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk2w8\" (UniqueName: \"kubernetes.io/projected/ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c-kube-api-access-kk2w8\") pod \"maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg\" (UID: \"ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg"
Sep 16 02:44:18.839143 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:18.839077    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c-maas-api-tls\") pod \"maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg\" (UID: \"ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg"
Sep 16 02:44:18.839313 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:44:18.839228    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-serving-cert: secret "maas-api-e2e-ipp-a-fd614e-serving-cert" not found
Sep 16 02:44:18.839313 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:44:18.839303    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c-maas-api-tls podName:ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c nodeName:}" failed. No retries permitted until 2026-09-16 02:44:19.339280209 +0000 UTC m=+1864.431462163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c-maas-api-tls") pod "maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg" (UID: "ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c") : secret "maas-api-e2e-ipp-a-fd614e-serving-cert" not found
Sep 16 02:44:18.839676 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:18.839654    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg\" (UID: \"ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg"
Sep 16 02:44:18.841601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:18.841572    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c-metrics-certs\") pod \"maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg\" (UID: \"ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg"
Sep 16 02:44:18.847102 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:18.847079    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk2w8\" (UniqueName: \"kubernetes.io/projected/ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c-kube-api-access-kk2w8\") pod \"maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg\" (UID: \"ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg"
Sep 16 02:44:19.344598 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:19.344564    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c-maas-api-tls\") pod \"maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg\" (UID: \"ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg"
Sep 16 02:44:19.347125 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:19.347104    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c-maas-api-tls\") pod \"maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg\" (UID: \"ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg"
Sep 16 02:44:19.525042 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:19.524993    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg"
Sep 16 02:44:19.798954 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:19.798925    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg"]
Sep 16 02:44:19.800632 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:44:19.800609    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca6f3aaa_20fa_4164_ac4c_e555bd0a1a9c.slice/crio-3daee0664d6030920d710e5c83c4bd8ee801f47cc5eb2cbf72eeb1482ae6076a WatchSource:0}: Error finding container 3daee0664d6030920d710e5c83c4bd8ee801f47cc5eb2cbf72eeb1482ae6076a: Status 404 returned error can't find the container with id 3daee0664d6030920d710e5c83c4bd8ee801f47cc5eb2cbf72eeb1482ae6076a
Sep 16 02:44:20.114358 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:20.114275    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg" event={"ID":"ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c","Type":"ContainerStarted","Data":"3daee0664d6030920d710e5c83c4bd8ee801f47cc5eb2cbf72eeb1482ae6076a"}
Sep 16 02:44:21.121742 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:21.121704    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg" event={"ID":"ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c","Type":"ContainerStarted","Data":"28e27f950e9e86b962ff5fec55d390f658b182699f2eefb1369eb85527bb4963"}
Sep 16 02:44:21.122230 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:21.121774    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg"
Sep 16 02:44:21.138837 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:21.138787    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg" podStartSLOduration=2.743018126 podStartE2EDuration="3.138773836s" totalImagesPullingTime="395.75571ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:44:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:44:21.137146899 +0000 UTC m=+1866.229328875" watchObservedRunningTime="2026-09-16 02:44:21.138773836 +0000 UTC m=+1866.230955810"
Sep 16 02:44:27.134101 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:27.134069    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg"
Sep 16 02:44:30.580989 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:30.580955    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:44:48.814232 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:48.814149    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6"]
Sep 16 02:44:48.818198 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:48.818177    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6"
Sep 16 02:44:48.820726 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:48.820706    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-d3d202-serving-cert\""
Sep 16 02:44:48.832122 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:48.832010    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6"]
Sep 16 02:44:48.920209 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:48.920160    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/180663e4-0ede-43d7-b449-986ab732f14a-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6\" (UID: \"180663e4-0ede-43d7-b449-986ab732f14a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6"
Sep 16 02:44:48.920391 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:48.920218    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9fkg\" (UniqueName: \"kubernetes.io/projected/180663e4-0ede-43d7-b449-986ab732f14a-kube-api-access-x9fkg\") pod \"maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6\" (UID: \"180663e4-0ede-43d7-b449-986ab732f14a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6"
Sep 16 02:44:48.920391 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:48.920328    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/180663e4-0ede-43d7-b449-986ab732f14a-metrics-certs\") pod \"maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6\" (UID: \"180663e4-0ede-43d7-b449-986ab732f14a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6"
Sep 16 02:44:48.920391 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:48.920366    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/180663e4-0ede-43d7-b449-986ab732f14a-maas-api-tls\") pod \"maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6\" (UID: \"180663e4-0ede-43d7-b449-986ab732f14a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6"
Sep 16 02:44:49.021701 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:49.021660    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/180663e4-0ede-43d7-b449-986ab732f14a-metrics-certs\") pod \"maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6\" (UID: \"180663e4-0ede-43d7-b449-986ab732f14a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6"
Sep 16 02:44:49.021701 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:49.021702    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/180663e4-0ede-43d7-b449-986ab732f14a-maas-api-tls\") pod \"maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6\" (UID: \"180663e4-0ede-43d7-b449-986ab732f14a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6"
Sep 16 02:44:49.021994 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:49.021756    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/180663e4-0ede-43d7-b449-986ab732f14a-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6\" (UID: \"180663e4-0ede-43d7-b449-986ab732f14a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6"
Sep 16 02:44:49.021994 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:49.021790    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9fkg\" (UniqueName: \"kubernetes.io/projected/180663e4-0ede-43d7-b449-986ab732f14a-kube-api-access-x9fkg\") pod \"maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6\" (UID: \"180663e4-0ede-43d7-b449-986ab732f14a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6"
Sep 16 02:44:49.022523 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:49.022496    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/180663e4-0ede-43d7-b449-986ab732f14a-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6\" (UID: \"180663e4-0ede-43d7-b449-986ab732f14a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6"
Sep 16 02:44:49.024391 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:49.024362    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/180663e4-0ede-43d7-b449-986ab732f14a-maas-api-tls\") pod \"maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6\" (UID: \"180663e4-0ede-43d7-b449-986ab732f14a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6"
Sep 16 02:44:49.024480 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:49.024414    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/180663e4-0ede-43d7-b449-986ab732f14a-metrics-certs\") pod \"maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6\" (UID: \"180663e4-0ede-43d7-b449-986ab732f14a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6"
Sep 16 02:44:49.029256 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:49.029234    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9fkg\" (UniqueName: \"kubernetes.io/projected/180663e4-0ede-43d7-b449-986ab732f14a-kube-api-access-x9fkg\") pod \"maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6\" (UID: \"180663e4-0ede-43d7-b449-986ab732f14a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6"
Sep 16 02:44:49.133108 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:49.133015    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6"
Sep 16 02:44:49.459160 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:49.459126    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6"]
Sep 16 02:44:49.462837 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:49.460889    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 02:44:50.300043 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:50.300008    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6" event={"ID":"180663e4-0ede-43d7-b449-986ab732f14a","Type":"ContainerStarted","Data":"e1e1ca7383961e71bd945216cadbf12344d71427492db5dca7e0777f8570ee8c"}
Sep 16 02:44:50.300436 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:50.300062    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6" event={"ID":"180663e4-0ede-43d7-b449-986ab732f14a","Type":"ContainerStarted","Data":"e63a8efeb10c0f63af17d034d632d05c0234e9d02ee688daee04007c323f72de"}
Sep 16 02:44:50.300436 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:50.300180    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6"
Sep 16 02:44:50.316477 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:50.316433    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6" podStartSLOduration=1.753422633 podStartE2EDuration="2.316418807s" totalImagesPullingTime="562.996174ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:44:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:44:50.3145458 +0000 UTC m=+1895.406727773" watchObservedRunningTime="2026-09-16 02:44:50.316418807 +0000 UTC m=+1895.408600812"
Sep 16 02:44:55.684473 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:55.684439    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:44:56.311971 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:44:56.311940    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6"
Sep 16 02:45:12.607442 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:12.607399    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9"]
Sep 16 02:45:12.612208 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:12.612191    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9"
Sep 16 02:45:12.614309 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:12.614288    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-7448c4-serving-cert\""
Sep 16 02:45:12.618050 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:12.618027    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9"]
Sep 16 02:45:12.634550 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:12.634523    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r2sz\" (UniqueName: \"kubernetes.io/projected/b3618de3-03bb-4642-8aa4-5d9bb220ce8e-kube-api-access-2r2sz\") pod \"maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9\" (UID: \"b3618de3-03bb-4642-8aa4-5d9bb220ce8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9"
Sep 16 02:45:12.634644 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:12.634561    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3618de3-03bb-4642-8aa4-5d9bb220ce8e-openshift-service-ca\") pod \"maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9\" (UID: \"b3618de3-03bb-4642-8aa4-5d9bb220ce8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9"
Sep 16 02:45:12.634644 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:12.634627    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3618de3-03bb-4642-8aa4-5d9bb220ce8e-metrics-certs\") pod \"maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9\" (UID: \"b3618de3-03bb-4642-8aa4-5d9bb220ce8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9"
Sep 16 02:45:12.634738 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:12.634647    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3618de3-03bb-4642-8aa4-5d9bb220ce8e-maas-api-tls\") pod \"maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9\" (UID: \"b3618de3-03bb-4642-8aa4-5d9bb220ce8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9"
Sep 16 02:45:12.735832 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:12.735798    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3618de3-03bb-4642-8aa4-5d9bb220ce8e-metrics-certs\") pod \"maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9\" (UID: \"b3618de3-03bb-4642-8aa4-5d9bb220ce8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9"
Sep 16 02:45:12.736030 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:12.735874    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3618de3-03bb-4642-8aa4-5d9bb220ce8e-maas-api-tls\") pod \"maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9\" (UID: \"b3618de3-03bb-4642-8aa4-5d9bb220ce8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9"
Sep 16 02:45:12.736030 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:12.735943    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r2sz\" (UniqueName: \"kubernetes.io/projected/b3618de3-03bb-4642-8aa4-5d9bb220ce8e-kube-api-access-2r2sz\") pod \"maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9\" (UID: \"b3618de3-03bb-4642-8aa4-5d9bb220ce8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9"
Sep 16 02:45:12.736030 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:12.735987    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3618de3-03bb-4642-8aa4-5d9bb220ce8e-openshift-service-ca\") pod \"maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9\" (UID: \"b3618de3-03bb-4642-8aa4-5d9bb220ce8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9"
Sep 16 02:45:12.736030 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:45:12.736002    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-serving-cert: secret "maas-api-e2e-api-a-7448c4-serving-cert" not found
Sep 16 02:45:12.736251 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:45:12.736097    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3618de3-03bb-4642-8aa4-5d9bb220ce8e-maas-api-tls podName:b3618de3-03bb-4642-8aa4-5d9bb220ce8e nodeName:}" failed. No retries permitted until 2026-09-16 02:45:13.236081284 +0000 UTC m=+1918.328263236 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b3618de3-03bb-4642-8aa4-5d9bb220ce8e-maas-api-tls") pod "maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9" (UID: "b3618de3-03bb-4642-8aa4-5d9bb220ce8e") : secret "maas-api-e2e-api-a-7448c4-serving-cert" not found
Sep 16 02:45:12.736720 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:12.736699    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3618de3-03bb-4642-8aa4-5d9bb220ce8e-openshift-service-ca\") pod \"maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9\" (UID: \"b3618de3-03bb-4642-8aa4-5d9bb220ce8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9"
Sep 16 02:45:12.738492 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:12.738471    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3618de3-03bb-4642-8aa4-5d9bb220ce8e-metrics-certs\") pod \"maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9\" (UID: \"b3618de3-03bb-4642-8aa4-5d9bb220ce8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9"
Sep 16 02:45:12.744210 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:12.744190    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r2sz\" (UniqueName: \"kubernetes.io/projected/b3618de3-03bb-4642-8aa4-5d9bb220ce8e-kube-api-access-2r2sz\") pod \"maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9\" (UID: \"b3618de3-03bb-4642-8aa4-5d9bb220ce8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9"
Sep 16 02:45:13.240364 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:13.240333    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3618de3-03bb-4642-8aa4-5d9bb220ce8e-maas-api-tls\") pod \"maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9\" (UID: \"b3618de3-03bb-4642-8aa4-5d9bb220ce8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9"
Sep 16 02:45:13.242912 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:13.242884    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3618de3-03bb-4642-8aa4-5d9bb220ce8e-maas-api-tls\") pod \"maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9\" (UID: \"b3618de3-03bb-4642-8aa4-5d9bb220ce8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9"
Sep 16 02:45:13.525267 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:13.525239    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9"
Sep 16 02:45:13.806811 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:13.801886    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9"]
Sep 16 02:45:14.449692 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:14.449591    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9" event={"ID":"b3618de3-03bb-4642-8aa4-5d9bb220ce8e","Type":"ContainerStarted","Data":"123c85895c2346964e832425ea1c45ffc2f281c2464a53a3478ded04e21dfbbb"}
Sep 16 02:45:14.449692 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:14.449658    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9" event={"ID":"b3618de3-03bb-4642-8aa4-5d9bb220ce8e","Type":"ContainerStarted","Data":"3789e55bae0b03742b38ba001c4a1ef12652349a3b0151312bfb851570e49632"}
Sep 16 02:45:14.450007 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:14.449768    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9"
Sep 16 02:45:14.467861 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:14.467809    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9" podStartSLOduration=2.157374936 podStartE2EDuration="2.467795958s" totalImagesPullingTime="310.421022ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:45:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:45:14.464793833 +0000 UTC m=+1919.556975807" watchObservedRunningTime="2026-09-16 02:45:14.467795958 +0000 UTC m=+1919.559977932"
Sep 16 02:45:20.090323 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:20.090283    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:45:20.461190 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:20.461110    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9"
Sep 16 02:45:47.240406 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:47.240367    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g"]
Sep 16 02:45:47.245343 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:47.245322    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g"
Sep 16 02:45:47.247290 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:47.247271    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-e21dae-serving-cert\""
Sep 16 02:45:47.254654 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:47.254482    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g"]
Sep 16 02:45:47.352957 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:47.352914    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a251c295-9eb7-4119-bbbe-20606f3f68db-maas-api-tls\") pod \"maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g\" (UID: \"a251c295-9eb7-4119-bbbe-20606f3f68db\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g"
Sep 16 02:45:47.353143 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:47.352991    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6rxq\" (UniqueName: \"kubernetes.io/projected/a251c295-9eb7-4119-bbbe-20606f3f68db-kube-api-access-l6rxq\") pod \"maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g\" (UID: \"a251c295-9eb7-4119-bbbe-20606f3f68db\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g"
Sep 16 02:45:47.353143 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:47.353115    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a251c295-9eb7-4119-bbbe-20606f3f68db-openshift-service-ca\") pod \"maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g\" (UID: \"a251c295-9eb7-4119-bbbe-20606f3f68db\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g"
Sep 16 02:45:47.353259 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:47.353161    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a251c295-9eb7-4119-bbbe-20606f3f68db-metrics-certs\") pod \"maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g\" (UID: \"a251c295-9eb7-4119-bbbe-20606f3f68db\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g"
Sep 16 02:45:47.454127 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:47.454094    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a251c295-9eb7-4119-bbbe-20606f3f68db-maas-api-tls\") pod \"maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g\" (UID: \"a251c295-9eb7-4119-bbbe-20606f3f68db\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g"
Sep 16 02:45:47.454311 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:47.454144    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6rxq\" (UniqueName: \"kubernetes.io/projected/a251c295-9eb7-4119-bbbe-20606f3f68db-kube-api-access-l6rxq\") pod \"maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g\" (UID: \"a251c295-9eb7-4119-bbbe-20606f3f68db\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g"
Sep 16 02:45:47.454311 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:47.454199    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a251c295-9eb7-4119-bbbe-20606f3f68db-openshift-service-ca\") pod \"maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g\" (UID: \"a251c295-9eb7-4119-bbbe-20606f3f68db\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g"
Sep 16 02:45:47.454311 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:47.454221    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a251c295-9eb7-4119-bbbe-20606f3f68db-metrics-certs\") pod \"maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g\" (UID: \"a251c295-9eb7-4119-bbbe-20606f3f68db\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g"
Sep 16 02:45:47.454823 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:47.454794    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a251c295-9eb7-4119-bbbe-20606f3f68db-openshift-service-ca\") pod \"maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g\" (UID: \"a251c295-9eb7-4119-bbbe-20606f3f68db\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g"
Sep 16 02:45:47.456836 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:47.456816    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a251c295-9eb7-4119-bbbe-20606f3f68db-maas-api-tls\") pod \"maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g\" (UID: \"a251c295-9eb7-4119-bbbe-20606f3f68db\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g"
Sep 16 02:45:47.456946 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:47.456861    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a251c295-9eb7-4119-bbbe-20606f3f68db-metrics-certs\") pod \"maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g\" (UID: \"a251c295-9eb7-4119-bbbe-20606f3f68db\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g"
Sep 16 02:45:47.461039 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:47.461023    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6rxq\" (UniqueName: \"kubernetes.io/projected/a251c295-9eb7-4119-bbbe-20606f3f68db-kube-api-access-l6rxq\") pod \"maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g\" (UID: \"a251c295-9eb7-4119-bbbe-20606f3f68db\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g"
Sep 16 02:45:47.560029 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:47.560000    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g"
Sep 16 02:45:47.836430 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:47.836396    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g"]
Sep 16 02:45:47.837775 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:45:47.837740    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda251c295_9eb7_4119_bbbe_20606f3f68db.slice/crio-d707b3b3de2153629bae7b1fb709db89e018ef3855bbfe2f0d1f427538ebc23d WatchSource:0}: Error finding container d707b3b3de2153629bae7b1fb709db89e018ef3855bbfe2f0d1f427538ebc23d: Status 404 returned error can't find the container with id d707b3b3de2153629bae7b1fb709db89e018ef3855bbfe2f0d1f427538ebc23d
Sep 16 02:45:48.658489 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:48.658457    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g" event={"ID":"a251c295-9eb7-4119-bbbe-20606f3f68db","Type":"ContainerStarted","Data":"1f4ca25ab32522e6e77f00363636f3a8f900530e5701321b556fcfef7221c995"}
Sep 16 02:45:48.658939 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:48.658511    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g" event={"ID":"a251c295-9eb7-4119-bbbe-20606f3f68db","Type":"ContainerStarted","Data":"d707b3b3de2153629bae7b1fb709db89e018ef3855bbfe2f0d1f427538ebc23d"}
Sep 16 02:45:48.658939 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:48.658538    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g"
Sep 16 02:45:48.676046 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:48.676004    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g" podStartSLOduration=1.053261694 podStartE2EDuration="1.675990567s" totalImagesPullingTime="622.728873ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:45:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:45:48.673589376 +0000 UTC m=+1953.765771351" watchObservedRunningTime="2026-09-16 02:45:48.675990567 +0000 UTC m=+1953.768172541"
Sep 16 02:45:54.677954 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:54.677922    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g"
Sep 16 02:45:55.986157 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:45:55.986123    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:46:10.474412 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:10.474336    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:46:24.383291 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:24.383260    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:46:31.620300 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:31.620267    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9"]
Sep 16 02:46:31.620785 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:31.620534    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9" podUID="b3618de3-03bb-4642-8aa4-5d9bb220ce8e" containerName="maas-api" containerID="cri-o://123c85895c2346964e832425ea1c45ffc2f281c2464a53a3478ded04e21dfbbb" gracePeriod=30
Sep 16 02:46:31.881333 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:31.881280    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9"
Sep 16 02:46:31.939033 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:31.939004    2581 generic.go:356] "Generic (PLEG): container finished" podID="b3618de3-03bb-4642-8aa4-5d9bb220ce8e" containerID="123c85895c2346964e832425ea1c45ffc2f281c2464a53a3478ded04e21dfbbb" exitCode=0
Sep 16 02:46:31.939202 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:31.939063    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9" event={"ID":"b3618de3-03bb-4642-8aa4-5d9bb220ce8e","Type":"ContainerDied","Data":"123c85895c2346964e832425ea1c45ffc2f281c2464a53a3478ded04e21dfbbb"}
Sep 16 02:46:31.939202 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:31.939067    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9"
Sep 16 02:46:31.939202 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:31.939104    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9" event={"ID":"b3618de3-03bb-4642-8aa4-5d9bb220ce8e","Type":"ContainerDied","Data":"3789e55bae0b03742b38ba001c4a1ef12652349a3b0151312bfb851570e49632"}
Sep 16 02:46:31.939202 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:31.939125    2581 scope.go:117] "RemoveContainer" containerID="123c85895c2346964e832425ea1c45ffc2f281c2464a53a3478ded04e21dfbbb"
Sep 16 02:46:31.948217 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:31.948201    2581 scope.go:117] "RemoveContainer" containerID="123c85895c2346964e832425ea1c45ffc2f281c2464a53a3478ded04e21dfbbb"
Sep 16 02:46:31.948531 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:46:31.948499    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"123c85895c2346964e832425ea1c45ffc2f281c2464a53a3478ded04e21dfbbb\": container with ID starting with 123c85895c2346964e832425ea1c45ffc2f281c2464a53a3478ded04e21dfbbb not found: ID does not exist" containerID="123c85895c2346964e832425ea1c45ffc2f281c2464a53a3478ded04e21dfbbb"
Sep 16 02:46:31.948639 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:31.948536    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"123c85895c2346964e832425ea1c45ffc2f281c2464a53a3478ded04e21dfbbb"} err="failed to get container status \"123c85895c2346964e832425ea1c45ffc2f281c2464a53a3478ded04e21dfbbb\": rpc error: code = NotFound desc = could not find container \"123c85895c2346964e832425ea1c45ffc2f281c2464a53a3478ded04e21dfbbb\": container with ID starting with 123c85895c2346964e832425ea1c45ffc2f281c2464a53a3478ded04e21dfbbb not found: ID does not exist"
Sep 16 02:46:31.960906 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:31.960884    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3618de3-03bb-4642-8aa4-5d9bb220ce8e-openshift-service-ca\") pod \"b3618de3-03bb-4642-8aa4-5d9bb220ce8e\" (UID: \"b3618de3-03bb-4642-8aa4-5d9bb220ce8e\") "
Sep 16 02:46:31.961003 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:31.960945    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2r2sz\" (UniqueName: \"kubernetes.io/projected/b3618de3-03bb-4642-8aa4-5d9bb220ce8e-kube-api-access-2r2sz\") pod \"b3618de3-03bb-4642-8aa4-5d9bb220ce8e\" (UID: \"b3618de3-03bb-4642-8aa4-5d9bb220ce8e\") "
Sep 16 02:46:31.961003 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:31.960975    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3618de3-03bb-4642-8aa4-5d9bb220ce8e-maas-api-tls\") pod \"b3618de3-03bb-4642-8aa4-5d9bb220ce8e\" (UID: \"b3618de3-03bb-4642-8aa4-5d9bb220ce8e\") "
Sep 16 02:46:31.961124 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:31.961018    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3618de3-03bb-4642-8aa4-5d9bb220ce8e-metrics-certs\") pod \"b3618de3-03bb-4642-8aa4-5d9bb220ce8e\" (UID: \"b3618de3-03bb-4642-8aa4-5d9bb220ce8e\") "
Sep 16 02:46:31.961260 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:31.961236    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3618de3-03bb-4642-8aa4-5d9bb220ce8e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b3618de3-03bb-4642-8aa4-5d9bb220ce8e" (UID: "b3618de3-03bb-4642-8aa4-5d9bb220ce8e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:46:31.963245 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:31.963218    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3618de3-03bb-4642-8aa4-5d9bb220ce8e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b3618de3-03bb-4642-8aa4-5d9bb220ce8e" (UID: "b3618de3-03bb-4642-8aa4-5d9bb220ce8e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:46:31.963245 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:31.963236    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3618de3-03bb-4642-8aa4-5d9bb220ce8e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b3618de3-03bb-4642-8aa4-5d9bb220ce8e" (UID: "b3618de3-03bb-4642-8aa4-5d9bb220ce8e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:46:31.963408 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:31.963244    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3618de3-03bb-4642-8aa4-5d9bb220ce8e-kube-api-access-2r2sz" (OuterVolumeSpecName: "kube-api-access-2r2sz") pod "b3618de3-03bb-4642-8aa4-5d9bb220ce8e" (UID: "b3618de3-03bb-4642-8aa4-5d9bb220ce8e"). InnerVolumeSpecName "kube-api-access-2r2sz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:46:32.062323 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:32.062291    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3618de3-03bb-4642-8aa4-5d9bb220ce8e-openshift-service-ca\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:46:32.062323 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:32.062319    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2r2sz\" (UniqueName: \"kubernetes.io/projected/b3618de3-03bb-4642-8aa4-5d9bb220ce8e-kube-api-access-2r2sz\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:46:32.062323 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:32.062329    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3618de3-03bb-4642-8aa4-5d9bb220ce8e-maas-api-tls\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:46:32.062547 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:32.062338    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3618de3-03bb-4642-8aa4-5d9bb220ce8e-metrics-certs\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:46:32.260610 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:32.260582    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9"]
Sep 16 02:46:32.264487 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:32.264463    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7448c4-65b787d88b-h5ww9"]
Sep 16 02:46:33.383270 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:33.383230    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3618de3-03bb-4642-8aa4-5d9bb220ce8e" path="/var/lib/kubelet/pods/b3618de3-03bb-4642-8aa4-5d9bb220ce8e/volumes"
Sep 16 02:46:37.724470 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:37.724435    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf"]
Sep 16 02:46:37.725152 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:37.725133    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3618de3-03bb-4642-8aa4-5d9bb220ce8e" containerName="maas-api"
Sep 16 02:46:37.725237 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:37.725154    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3618de3-03bb-4642-8aa4-5d9bb220ce8e" containerName="maas-api"
Sep 16 02:46:37.725294 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:37.725277    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3618de3-03bb-4642-8aa4-5d9bb220ce8e" containerName="maas-api"
Sep 16 02:46:37.730478 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:37.730377    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf"
Sep 16 02:46:37.732622 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:37.732599    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-5b136e-serving-cert\""
Sep 16 02:46:37.737468 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:37.737445    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf"]
Sep 16 02:46:37.816625 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:37.816596    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r6gc\" (UniqueName: \"kubernetes.io/projected/6a325563-d212-4c90-a8ac-a54336c6f76d-kube-api-access-6r6gc\") pod \"maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf\" (UID: \"6a325563-d212-4c90-a8ac-a54336c6f76d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf"
Sep 16 02:46:37.816777 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:37.816641    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a325563-d212-4c90-a8ac-a54336c6f76d-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf\" (UID: \"6a325563-d212-4c90-a8ac-a54336c6f76d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf"
Sep 16 02:46:37.816777 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:37.816724    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a325563-d212-4c90-a8ac-a54336c6f76d-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf\" (UID: \"6a325563-d212-4c90-a8ac-a54336c6f76d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf"
Sep 16 02:46:37.816885 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:37.816795    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a325563-d212-4c90-a8ac-a54336c6f76d-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf\" (UID: \"6a325563-d212-4c90-a8ac-a54336c6f76d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf"
Sep 16 02:46:37.917970 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:37.917935    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a325563-d212-4c90-a8ac-a54336c6f76d-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf\" (UID: \"6a325563-d212-4c90-a8ac-a54336c6f76d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf"
Sep 16 02:46:37.918142 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:37.917995    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a325563-d212-4c90-a8ac-a54336c6f76d-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf\" (UID: \"6a325563-d212-4c90-a8ac-a54336c6f76d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf"
Sep 16 02:46:37.918142 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:46:37.918090    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-serving-cert: secret "maas-api-e2e-ipp-cleanup-5b136e-serving-cert" not found
Sep 16 02:46:37.918261 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:37.918143    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r6gc\" (UniqueName: \"kubernetes.io/projected/6a325563-d212-4c90-a8ac-a54336c6f76d-kube-api-access-6r6gc\") pod \"maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf\" (UID: \"6a325563-d212-4c90-a8ac-a54336c6f76d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf"
Sep 16 02:46:37.918261 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:46:37.918159    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a325563-d212-4c90-a8ac-a54336c6f76d-maas-api-tls podName:6a325563-d212-4c90-a8ac-a54336c6f76d nodeName:}" failed. No retries permitted until 2026-09-16 02:46:38.418138215 +0000 UTC m=+2003.510320189 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6a325563-d212-4c90-a8ac-a54336c6f76d-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf" (UID: "6a325563-d212-4c90-a8ac-a54336c6f76d") : secret "maas-api-e2e-ipp-cleanup-5b136e-serving-cert" not found
Sep 16 02:46:37.918261 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:37.918218    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a325563-d212-4c90-a8ac-a54336c6f76d-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf\" (UID: \"6a325563-d212-4c90-a8ac-a54336c6f76d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf"
Sep 16 02:46:37.918698 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:37.918669    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a325563-d212-4c90-a8ac-a54336c6f76d-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf\" (UID: \"6a325563-d212-4c90-a8ac-a54336c6f76d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf"
Sep 16 02:46:37.920947 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:37.920928    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a325563-d212-4c90-a8ac-a54336c6f76d-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf\" (UID: \"6a325563-d212-4c90-a8ac-a54336c6f76d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf"
Sep 16 02:46:37.928549 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:37.928522    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r6gc\" (UniqueName: \"kubernetes.io/projected/6a325563-d212-4c90-a8ac-a54336c6f76d-kube-api-access-6r6gc\") pod \"maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf\" (UID: \"6a325563-d212-4c90-a8ac-a54336c6f76d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf"
Sep 16 02:46:38.422567 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:38.422536    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a325563-d212-4c90-a8ac-a54336c6f76d-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf\" (UID: \"6a325563-d212-4c90-a8ac-a54336c6f76d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf"
Sep 16 02:46:38.425339 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:38.425311    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a325563-d212-4c90-a8ac-a54336c6f76d-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf\" (UID: \"6a325563-d212-4c90-a8ac-a54336c6f76d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf"
Sep 16 02:46:38.593555 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:38.593519    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:46:38.644746 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:38.644712    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf"
Sep 16 02:46:38.923218 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:38.922712    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf"]
Sep 16 02:46:38.924185 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:46:38.924146    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a325563_d212_4c90_a8ac_a54336c6f76d.slice/crio-616a48fcba449bb146ac62989346b850a1dce99af4f33746dd573350536f1ebd WatchSource:0}: Error finding container 616a48fcba449bb146ac62989346b850a1dce99af4f33746dd573350536f1ebd: Status 404 returned error can't find the container with id 616a48fcba449bb146ac62989346b850a1dce99af4f33746dd573350536f1ebd
Sep 16 02:46:38.983200 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:38.983134    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf" event={"ID":"6a325563-d212-4c90-a8ac-a54336c6f76d","Type":"ContainerStarted","Data":"616a48fcba449bb146ac62989346b850a1dce99af4f33746dd573350536f1ebd"}
Sep 16 02:46:39.991019 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:39.990981    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf" event={"ID":"6a325563-d212-4c90-a8ac-a54336c6f76d","Type":"ContainerStarted","Data":"58a5498cdfca7b31a0256a5f8f736d823023cdef2353052722e2506f913be80c"}
Sep 16 02:46:39.991436 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:39.991111    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf"
Sep 16 02:46:40.008164 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:40.008122    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf" podStartSLOduration=2.659416023 podStartE2EDuration="3.008109486s" totalImagesPullingTime="348.693463ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:46:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:46:40.007014167 +0000 UTC m=+2005.099196142" watchObservedRunningTime="2026-09-16 02:46:40.008109486 +0000 UTC m=+2005.100291459"
Sep 16 02:46:46.003069 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:46.003043    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf"
Sep 16 02:46:55.200101 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:55.200064    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g"]
Sep 16 02:46:55.200694 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:55.200345    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g" podUID="a251c295-9eb7-4119-bbbe-20606f3f68db" containerName="maas-api" containerID="cri-o://1f4ca25ab32522e6e77f00363636f3a8f900530e5701321b556fcfef7221c995" gracePeriod=30
Sep 16 02:46:55.452700 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:55.452643    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g"
Sep 16 02:46:55.481285 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:55.481255    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a251c295-9eb7-4119-bbbe-20606f3f68db-maas-api-tls\") pod \"a251c295-9eb7-4119-bbbe-20606f3f68db\" (UID: \"a251c295-9eb7-4119-bbbe-20606f3f68db\") "
Sep 16 02:46:55.481420 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:55.481352    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6rxq\" (UniqueName: \"kubernetes.io/projected/a251c295-9eb7-4119-bbbe-20606f3f68db-kube-api-access-l6rxq\") pod \"a251c295-9eb7-4119-bbbe-20606f3f68db\" (UID: \"a251c295-9eb7-4119-bbbe-20606f3f68db\") "
Sep 16 02:46:55.481420 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:55.481393    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a251c295-9eb7-4119-bbbe-20606f3f68db-openshift-service-ca\") pod \"a251c295-9eb7-4119-bbbe-20606f3f68db\" (UID: \"a251c295-9eb7-4119-bbbe-20606f3f68db\") "
Sep 16 02:46:55.481521 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:55.481462    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a251c295-9eb7-4119-bbbe-20606f3f68db-metrics-certs\") pod \"a251c295-9eb7-4119-bbbe-20606f3f68db\" (UID: \"a251c295-9eb7-4119-bbbe-20606f3f68db\") "
Sep 16 02:46:55.481794 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:55.481759    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a251c295-9eb7-4119-bbbe-20606f3f68db-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a251c295-9eb7-4119-bbbe-20606f3f68db" (UID: "a251c295-9eb7-4119-bbbe-20606f3f68db"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:46:55.483535 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:55.483512    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a251c295-9eb7-4119-bbbe-20606f3f68db-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a251c295-9eb7-4119-bbbe-20606f3f68db" (UID: "a251c295-9eb7-4119-bbbe-20606f3f68db"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:46:55.483668 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:55.483647    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a251c295-9eb7-4119-bbbe-20606f3f68db-kube-api-access-l6rxq" (OuterVolumeSpecName: "kube-api-access-l6rxq") pod "a251c295-9eb7-4119-bbbe-20606f3f68db" (UID: "a251c295-9eb7-4119-bbbe-20606f3f68db"). InnerVolumeSpecName "kube-api-access-l6rxq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:46:55.483993 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:55.483978    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a251c295-9eb7-4119-bbbe-20606f3f68db-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a251c295-9eb7-4119-bbbe-20606f3f68db" (UID: "a251c295-9eb7-4119-bbbe-20606f3f68db"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:46:55.582931 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:55.582893    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a251c295-9eb7-4119-bbbe-20606f3f68db-maas-api-tls\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:46:55.582931 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:55.582928    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6rxq\" (UniqueName: \"kubernetes.io/projected/a251c295-9eb7-4119-bbbe-20606f3f68db-kube-api-access-l6rxq\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:46:55.583171 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:55.582943    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a251c295-9eb7-4119-bbbe-20606f3f68db-openshift-service-ca\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:46:55.583171 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:55.582956    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a251c295-9eb7-4119-bbbe-20606f3f68db-metrics-certs\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:46:56.095029 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:56.094990    2581 generic.go:356] "Generic (PLEG): container finished" podID="a251c295-9eb7-4119-bbbe-20606f3f68db" containerID="1f4ca25ab32522e6e77f00363636f3a8f900530e5701321b556fcfef7221c995" exitCode=0
Sep 16 02:46:56.095229 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:56.095044    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g"
Sep 16 02:46:56.095229 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:56.095073    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g" event={"ID":"a251c295-9eb7-4119-bbbe-20606f3f68db","Type":"ContainerDied","Data":"1f4ca25ab32522e6e77f00363636f3a8f900530e5701321b556fcfef7221c995"}
Sep 16 02:46:56.095229 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:56.095129    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g" event={"ID":"a251c295-9eb7-4119-bbbe-20606f3f68db","Type":"ContainerDied","Data":"d707b3b3de2153629bae7b1fb709db89e018ef3855bbfe2f0d1f427538ebc23d"}
Sep 16 02:46:56.095229 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:56.095150    2581 scope.go:117] "RemoveContainer" containerID="1f4ca25ab32522e6e77f00363636f3a8f900530e5701321b556fcfef7221c995"
Sep 16 02:46:56.105412 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:56.105395    2581 scope.go:117] "RemoveContainer" containerID="1f4ca25ab32522e6e77f00363636f3a8f900530e5701321b556fcfef7221c995"
Sep 16 02:46:56.105670 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:46:56.105655    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f4ca25ab32522e6e77f00363636f3a8f900530e5701321b556fcfef7221c995\": container with ID starting with 1f4ca25ab32522e6e77f00363636f3a8f900530e5701321b556fcfef7221c995 not found: ID does not exist" containerID="1f4ca25ab32522e6e77f00363636f3a8f900530e5701321b556fcfef7221c995"
Sep 16 02:46:56.105723 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:56.105679    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f4ca25ab32522e6e77f00363636f3a8f900530e5701321b556fcfef7221c995"} err="failed to get container status \"1f4ca25ab32522e6e77f00363636f3a8f900530e5701321b556fcfef7221c995\": rpc error: code = NotFound desc = could not find container \"1f4ca25ab32522e6e77f00363636f3a8f900530e5701321b556fcfef7221c995\": container with ID starting with 1f4ca25ab32522e6e77f00363636f3a8f900530e5701321b556fcfef7221c995 not found: ID does not exist"
Sep 16 02:46:56.118477 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:56.118457    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g"]
Sep 16 02:46:56.121086 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:56.121068    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e21dae-7dfcb89555-44n7g"]
Sep 16 02:46:57.383600 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:57.383567    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a251c295-9eb7-4119-bbbe-20606f3f68db" path="/var/lib/kubelet/pods/a251c295-9eb7-4119-bbbe-20606f3f68db/volumes"
Sep 16 02:46:57.874468 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:46:57.874429    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:47:13.316435 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:13.316391    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb"]
Sep 16 02:47:13.316806 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:13.316610    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb" podUID="cc7a7c86-ee45-4fd8-bb5d-950e4978f728" containerName="maas-api" containerID="cri-o://89f2606160a8c45e57173260be8ff2ed22e6875ca0aa44e496f1f371b5a21e4e" gracePeriod=30
Sep 16 02:47:13.573450 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:13.573380    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb"
Sep 16 02:47:13.662669 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:13.662635    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc7a7c86-ee45-4fd8-bb5d-950e4978f728-maas-api-tls\") pod \"cc7a7c86-ee45-4fd8-bb5d-950e4978f728\" (UID: \"cc7a7c86-ee45-4fd8-bb5d-950e4978f728\") "
Sep 16 02:47:13.662827 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:13.662755    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc7a7c86-ee45-4fd8-bb5d-950e4978f728-openshift-service-ca\") pod \"cc7a7c86-ee45-4fd8-bb5d-950e4978f728\" (UID: \"cc7a7c86-ee45-4fd8-bb5d-950e4978f728\") "
Sep 16 02:47:13.662925 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:13.662836    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jk6t\" (UniqueName: \"kubernetes.io/projected/cc7a7c86-ee45-4fd8-bb5d-950e4978f728-kube-api-access-8jk6t\") pod \"cc7a7c86-ee45-4fd8-bb5d-950e4978f728\" (UID: \"cc7a7c86-ee45-4fd8-bb5d-950e4978f728\") "
Sep 16 02:47:13.662925 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:13.662903    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc7a7c86-ee45-4fd8-bb5d-950e4978f728-metrics-certs\") pod \"cc7a7c86-ee45-4fd8-bb5d-950e4978f728\" (UID: \"cc7a7c86-ee45-4fd8-bb5d-950e4978f728\") "
Sep 16 02:47:13.663124 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:13.663096    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc7a7c86-ee45-4fd8-bb5d-950e4978f728-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cc7a7c86-ee45-4fd8-bb5d-950e4978f728" (UID: "cc7a7c86-ee45-4fd8-bb5d-950e4978f728"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:47:13.663256 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:13.663240    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc7a7c86-ee45-4fd8-bb5d-950e4978f728-openshift-service-ca\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:47:13.664909 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:13.664879    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc7a7c86-ee45-4fd8-bb5d-950e4978f728-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cc7a7c86-ee45-4fd8-bb5d-950e4978f728" (UID: "cc7a7c86-ee45-4fd8-bb5d-950e4978f728"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:47:13.665040 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:13.664990    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc7a7c86-ee45-4fd8-bb5d-950e4978f728-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "cc7a7c86-ee45-4fd8-bb5d-950e4978f728" (UID: "cc7a7c86-ee45-4fd8-bb5d-950e4978f728"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:47:13.665040 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:13.665020    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc7a7c86-ee45-4fd8-bb5d-950e4978f728-kube-api-access-8jk6t" (OuterVolumeSpecName: "kube-api-access-8jk6t") pod "cc7a7c86-ee45-4fd8-bb5d-950e4978f728" (UID: "cc7a7c86-ee45-4fd8-bb5d-950e4978f728"). InnerVolumeSpecName "kube-api-access-8jk6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:47:13.764219 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:13.764187    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jk6t\" (UniqueName: \"kubernetes.io/projected/cc7a7c86-ee45-4fd8-bb5d-950e4978f728-kube-api-access-8jk6t\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:47:13.764219 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:13.764218    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc7a7c86-ee45-4fd8-bb5d-950e4978f728-metrics-certs\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:47:13.764393 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:13.764230    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc7a7c86-ee45-4fd8-bb5d-950e4978f728-maas-api-tls\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:47:14.224372 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:14.224332    2581 generic.go:356] "Generic (PLEG): container finished" podID="cc7a7c86-ee45-4fd8-bb5d-950e4978f728" containerID="89f2606160a8c45e57173260be8ff2ed22e6875ca0aa44e496f1f371b5a21e4e" exitCode=0
Sep 16 02:47:14.224372 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:14.224373    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb"
Sep 16 02:47:14.224634 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:14.224423    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb" event={"ID":"cc7a7c86-ee45-4fd8-bb5d-950e4978f728","Type":"ContainerDied","Data":"89f2606160a8c45e57173260be8ff2ed22e6875ca0aa44e496f1f371b5a21e4e"}
Sep 16 02:47:14.224634 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:14.224490    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb" event={"ID":"cc7a7c86-ee45-4fd8-bb5d-950e4978f728","Type":"ContainerDied","Data":"e60bbae62310da077fe1ba01e7cd7215a126a2c77af5a26525e4f007adad8744"}
Sep 16 02:47:14.224634 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:14.224524    2581 scope.go:117] "RemoveContainer" containerID="89f2606160a8c45e57173260be8ff2ed22e6875ca0aa44e496f1f371b5a21e4e"
Sep 16 02:47:14.235754 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:14.235723    2581 scope.go:117] "RemoveContainer" containerID="89f2606160a8c45e57173260be8ff2ed22e6875ca0aa44e496f1f371b5a21e4e"
Sep 16 02:47:14.236123 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:47:14.236100    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89f2606160a8c45e57173260be8ff2ed22e6875ca0aa44e496f1f371b5a21e4e\": container with ID starting with 89f2606160a8c45e57173260be8ff2ed22e6875ca0aa44e496f1f371b5a21e4e not found: ID does not exist" containerID="89f2606160a8c45e57173260be8ff2ed22e6875ca0aa44e496f1f371b5a21e4e"
Sep 16 02:47:14.236248 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:14.236130    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89f2606160a8c45e57173260be8ff2ed22e6875ca0aa44e496f1f371b5a21e4e"} err="failed to get container status \"89f2606160a8c45e57173260be8ff2ed22e6875ca0aa44e496f1f371b5a21e4e\": rpc error: code = NotFound desc = could not find container \"89f2606160a8c45e57173260be8ff2ed22e6875ca0aa44e496f1f371b5a21e4e\": container with ID starting with 89f2606160a8c45e57173260be8ff2ed22e6875ca0aa44e496f1f371b5a21e4e not found: ID does not exist"
Sep 16 02:47:14.245786 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:14.245762    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb"]
Sep 16 02:47:14.248193 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:14.248174    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-bd0fb8-b976975bd-7ptfb"]
Sep 16 02:47:15.383303 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:15.383274    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc7a7c86-ee45-4fd8-bb5d-950e4978f728" path="/var/lib/kubelet/pods/cc7a7c86-ee45-4fd8-bb5d-950e4978f728/volumes"
Sep 16 02:47:17.685240 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:17.685201    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:47:17.860259 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:17.860221    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf"]
Sep 16 02:47:17.860559 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:17.860523    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf" podUID="6a325563-d212-4c90-a8ac-a54336c6f76d" containerName="maas-api" containerID="cri-o://58a5498cdfca7b31a0256a5f8f736d823023cdef2353052722e2506f913be80c" gracePeriod=30
Sep 16 02:47:18.112927 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:18.112904    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf"
Sep 16 02:47:18.206313 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:18.206276    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6r6gc\" (UniqueName: \"kubernetes.io/projected/6a325563-d212-4c90-a8ac-a54336c6f76d-kube-api-access-6r6gc\") pod \"6a325563-d212-4c90-a8ac-a54336c6f76d\" (UID: \"6a325563-d212-4c90-a8ac-a54336c6f76d\") "
Sep 16 02:47:18.206501 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:18.206366    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a325563-d212-4c90-a8ac-a54336c6f76d-openshift-service-ca\") pod \"6a325563-d212-4c90-a8ac-a54336c6f76d\" (UID: \"6a325563-d212-4c90-a8ac-a54336c6f76d\") "
Sep 16 02:47:18.206501 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:18.206446    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a325563-d212-4c90-a8ac-a54336c6f76d-metrics-certs\") pod \"6a325563-d212-4c90-a8ac-a54336c6f76d\" (UID: \"6a325563-d212-4c90-a8ac-a54336c6f76d\") "
Sep 16 02:47:18.206501 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:18.206483    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a325563-d212-4c90-a8ac-a54336c6f76d-maas-api-tls\") pod \"6a325563-d212-4c90-a8ac-a54336c6f76d\" (UID: \"6a325563-d212-4c90-a8ac-a54336c6f76d\") "
Sep 16 02:47:18.206763 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:18.206734    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a325563-d212-4c90-a8ac-a54336c6f76d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6a325563-d212-4c90-a8ac-a54336c6f76d" (UID: "6a325563-d212-4c90-a8ac-a54336c6f76d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:47:18.208609 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:18.208582    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a325563-d212-4c90-a8ac-a54336c6f76d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6a325563-d212-4c90-a8ac-a54336c6f76d" (UID: "6a325563-d212-4c90-a8ac-a54336c6f76d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:47:18.208718 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:18.208643    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a325563-d212-4c90-a8ac-a54336c6f76d-kube-api-access-6r6gc" (OuterVolumeSpecName: "kube-api-access-6r6gc") pod "6a325563-d212-4c90-a8ac-a54336c6f76d" (UID: "6a325563-d212-4c90-a8ac-a54336c6f76d"). InnerVolumeSpecName "kube-api-access-6r6gc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:47:18.208718 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:18.208682    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a325563-d212-4c90-a8ac-a54336c6f76d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6a325563-d212-4c90-a8ac-a54336c6f76d" (UID: "6a325563-d212-4c90-a8ac-a54336c6f76d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:47:18.248974 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:18.248903    2581 generic.go:356] "Generic (PLEG): container finished" podID="6a325563-d212-4c90-a8ac-a54336c6f76d" containerID="58a5498cdfca7b31a0256a5f8f736d823023cdef2353052722e2506f913be80c" exitCode=0
Sep 16 02:47:18.248974 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:18.248955    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf"
Sep 16 02:47:18.249137 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:18.248998    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf" event={"ID":"6a325563-d212-4c90-a8ac-a54336c6f76d","Type":"ContainerDied","Data":"58a5498cdfca7b31a0256a5f8f736d823023cdef2353052722e2506f913be80c"}
Sep 16 02:47:18.249137 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:18.249060    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf" event={"ID":"6a325563-d212-4c90-a8ac-a54336c6f76d","Type":"ContainerDied","Data":"616a48fcba449bb146ac62989346b850a1dce99af4f33746dd573350536f1ebd"}
Sep 16 02:47:18.249137 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:18.249084    2581 scope.go:117] "RemoveContainer" containerID="58a5498cdfca7b31a0256a5f8f736d823023cdef2353052722e2506f913be80c"
Sep 16 02:47:18.259997 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:18.259980    2581 scope.go:117] "RemoveContainer" containerID="58a5498cdfca7b31a0256a5f8f736d823023cdef2353052722e2506f913be80c"
Sep 16 02:47:18.260281 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:47:18.260263    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58a5498cdfca7b31a0256a5f8f736d823023cdef2353052722e2506f913be80c\": container with ID starting with 58a5498cdfca7b31a0256a5f8f736d823023cdef2353052722e2506f913be80c not found: ID does not exist" containerID="58a5498cdfca7b31a0256a5f8f736d823023cdef2353052722e2506f913be80c"
Sep 16 02:47:18.260346 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:18.260294    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58a5498cdfca7b31a0256a5f8f736d823023cdef2353052722e2506f913be80c"} err="failed to get container status \"58a5498cdfca7b31a0256a5f8f736d823023cdef2353052722e2506f913be80c\": rpc error: code = NotFound desc = could not find container \"58a5498cdfca7b31a0256a5f8f736d823023cdef2353052722e2506f913be80c\": container with ID starting with 58a5498cdfca7b31a0256a5f8f736d823023cdef2353052722e2506f913be80c not found: ID does not exist"
Sep 16 02:47:18.284397 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:18.284371    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf"]
Sep 16 02:47:18.301125 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:18.301098    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5b136e-6b6695d656-pfnbf"]
Sep 16 02:47:18.307834 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:18.307817    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a325563-d212-4c90-a8ac-a54336c6f76d-openshift-service-ca\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:47:18.307912 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:18.307837    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a325563-d212-4c90-a8ac-a54336c6f76d-metrics-certs\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:47:18.307912 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:18.307873    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a325563-d212-4c90-a8ac-a54336c6f76d-maas-api-tls\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:47:18.307912 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:18.307887    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6r6gc\" (UniqueName: \"kubernetes.io/projected/6a325563-d212-4c90-a8ac-a54336c6f76d-kube-api-access-6r6gc\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:47:19.382361 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:19.382330    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a325563-d212-4c90-a8ac-a54336c6f76d" path="/var/lib/kubelet/pods/6a325563-d212-4c90-a8ac-a54336c6f76d/volumes"
Sep 16 02:47:31.475059 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:31.475029    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:47:33.030266 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:33.030232    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx"]
Sep 16 02:47:33.032704 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:33.030967    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx" podUID="5af76106-cb48-4c02-b748-0cf29ee8ed09" containerName="maas-api" containerID="cri-o://884a5dc59637b3180a7191471b456066fe1f2aec84a571c53d4eca3869339eae" gracePeriod=30
Sep 16 02:47:33.283284 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:33.283223    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx"
Sep 16 02:47:33.342426 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:33.342393    2581 generic.go:356] "Generic (PLEG): container finished" podID="5af76106-cb48-4c02-b748-0cf29ee8ed09" containerID="884a5dc59637b3180a7191471b456066fe1f2aec84a571c53d4eca3869339eae" exitCode=0
Sep 16 02:47:33.342594 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:33.342439    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx"
Sep 16 02:47:33.342594 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:33.342473    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx" event={"ID":"5af76106-cb48-4c02-b748-0cf29ee8ed09","Type":"ContainerDied","Data":"884a5dc59637b3180a7191471b456066fe1f2aec84a571c53d4eca3869339eae"}
Sep 16 02:47:33.342594 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:33.342526    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx" event={"ID":"5af76106-cb48-4c02-b748-0cf29ee8ed09","Type":"ContainerDied","Data":"115bef35a355891e5595f1cfef3272671e33dbd6f20f73f5a242d5c0b2a300c7"}
Sep 16 02:47:33.342594 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:33.342551    2581 scope.go:117] "RemoveContainer" containerID="884a5dc59637b3180a7191471b456066fe1f2aec84a571c53d4eca3869339eae"
Sep 16 02:47:33.344749 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:33.344731    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5af76106-cb48-4c02-b748-0cf29ee8ed09-metrics-certs\") pod \"5af76106-cb48-4c02-b748-0cf29ee8ed09\" (UID: \"5af76106-cb48-4c02-b748-0cf29ee8ed09\") "
Sep 16 02:47:33.344868 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:33.344804    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmbbr\" (UniqueName: \"kubernetes.io/projected/5af76106-cb48-4c02-b748-0cf29ee8ed09-kube-api-access-tmbbr\") pod \"5af76106-cb48-4c02-b748-0cf29ee8ed09\" (UID: \"5af76106-cb48-4c02-b748-0cf29ee8ed09\") "
Sep 16 02:47:33.344936 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:33.344892    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5af76106-cb48-4c02-b748-0cf29ee8ed09-maas-api-tls\") pod \"5af76106-cb48-4c02-b748-0cf29ee8ed09\" (UID: \"5af76106-cb48-4c02-b748-0cf29ee8ed09\") "
Sep 16 02:47:33.344993 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:33.344951    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5af76106-cb48-4c02-b748-0cf29ee8ed09-openshift-service-ca\") pod \"5af76106-cb48-4c02-b748-0cf29ee8ed09\" (UID: \"5af76106-cb48-4c02-b748-0cf29ee8ed09\") "
Sep 16 02:47:33.345438 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:33.345410    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5af76106-cb48-4c02-b748-0cf29ee8ed09-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5af76106-cb48-4c02-b748-0cf29ee8ed09" (UID: "5af76106-cb48-4c02-b748-0cf29ee8ed09"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:47:33.347003 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:33.346981    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5af76106-cb48-4c02-b748-0cf29ee8ed09-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5af76106-cb48-4c02-b748-0cf29ee8ed09" (UID: "5af76106-cb48-4c02-b748-0cf29ee8ed09"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:47:33.347598 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:33.347576    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5af76106-cb48-4c02-b748-0cf29ee8ed09-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5af76106-cb48-4c02-b748-0cf29ee8ed09" (UID: "5af76106-cb48-4c02-b748-0cf29ee8ed09"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:47:33.347666 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:33.347595    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5af76106-cb48-4c02-b748-0cf29ee8ed09-kube-api-access-tmbbr" (OuterVolumeSpecName: "kube-api-access-tmbbr") pod "5af76106-cb48-4c02-b748-0cf29ee8ed09" (UID: "5af76106-cb48-4c02-b748-0cf29ee8ed09"). InnerVolumeSpecName "kube-api-access-tmbbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:47:33.370643 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:33.370619    2581 scope.go:117] "RemoveContainer" containerID="884a5dc59637b3180a7191471b456066fe1f2aec84a571c53d4eca3869339eae"
Sep 16 02:47:33.371058 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:47:33.371037    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"884a5dc59637b3180a7191471b456066fe1f2aec84a571c53d4eca3869339eae\": container with ID starting with 884a5dc59637b3180a7191471b456066fe1f2aec84a571c53d4eca3869339eae not found: ID does not exist" containerID="884a5dc59637b3180a7191471b456066fe1f2aec84a571c53d4eca3869339eae"
Sep 16 02:47:33.371142 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:33.371068    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"884a5dc59637b3180a7191471b456066fe1f2aec84a571c53d4eca3869339eae"} err="failed to get container status \"884a5dc59637b3180a7191471b456066fe1f2aec84a571c53d4eca3869339eae\": rpc error: code = NotFound desc = could not find container \"884a5dc59637b3180a7191471b456066fe1f2aec84a571c53d4eca3869339eae\": container with ID starting with 884a5dc59637b3180a7191471b456066fe1f2aec84a571c53d4eca3869339eae not found: ID does not exist"
Sep 16 02:47:33.446623 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:33.446587    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5af76106-cb48-4c02-b748-0cf29ee8ed09-metrics-certs\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:47:33.446623 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:33.446615    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmbbr\" (UniqueName: \"kubernetes.io/projected/5af76106-cb48-4c02-b748-0cf29ee8ed09-kube-api-access-tmbbr\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:47:33.446623 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:33.446628    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5af76106-cb48-4c02-b748-0cf29ee8ed09-maas-api-tls\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:47:33.446892 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:33.446640    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5af76106-cb48-4c02-b748-0cf29ee8ed09-openshift-service-ca\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:47:33.658331 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:33.658246    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx"]
Sep 16 02:47:33.661449 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:33.661426    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w1-8e10f1-5fbcccbb88-pcdwx"]
Sep 16 02:47:35.382340 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:35.382308    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5af76106-cb48-4c02-b748-0cf29ee8ed09" path="/var/lib/kubelet/pods/5af76106-cb48-4c02-b748-0cf29ee8ed09/volumes"
Sep 16 02:47:44.144290 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:44.144196    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg"]
Sep 16 02:47:44.144766 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:44.144452    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg" podUID="ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c" containerName="maas-api" containerID="cri-o://28e27f950e9e86b962ff5fec55d390f658b182699f2eefb1369eb85527bb4963" gracePeriod=30
Sep 16 02:47:44.393897 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:44.393872    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg"
Sep 16 02:47:44.414212 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:44.414150    2581 generic.go:356] "Generic (PLEG): container finished" podID="ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c" containerID="28e27f950e9e86b962ff5fec55d390f658b182699f2eefb1369eb85527bb4963" exitCode=0
Sep 16 02:47:44.414212 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:44.414197    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg"
Sep 16 02:47:44.414354 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:44.414241    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg" event={"ID":"ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c","Type":"ContainerDied","Data":"28e27f950e9e86b962ff5fec55d390f658b182699f2eefb1369eb85527bb4963"}
Sep 16 02:47:44.414354 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:44.414302    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg" event={"ID":"ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c","Type":"ContainerDied","Data":"3daee0664d6030920d710e5c83c4bd8ee801f47cc5eb2cbf72eeb1482ae6076a"}
Sep 16 02:47:44.414354 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:44.414332    2581 scope.go:117] "RemoveContainer" containerID="28e27f950e9e86b962ff5fec55d390f658b182699f2eefb1369eb85527bb4963"
Sep 16 02:47:44.425734 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:44.425714    2581 scope.go:117] "RemoveContainer" containerID="28e27f950e9e86b962ff5fec55d390f658b182699f2eefb1369eb85527bb4963"
Sep 16 02:47:44.426118 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:47:44.426086    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28e27f950e9e86b962ff5fec55d390f658b182699f2eefb1369eb85527bb4963\": container with ID starting with 28e27f950e9e86b962ff5fec55d390f658b182699f2eefb1369eb85527bb4963 not found: ID does not exist" containerID="28e27f950e9e86b962ff5fec55d390f658b182699f2eefb1369eb85527bb4963"
Sep 16 02:47:44.426246 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:44.426127    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28e27f950e9e86b962ff5fec55d390f658b182699f2eefb1369eb85527bb4963"} err="failed to get container status \"28e27f950e9e86b962ff5fec55d390f658b182699f2eefb1369eb85527bb4963\": rpc error: code = NotFound desc = could not find container \"28e27f950e9e86b962ff5fec55d390f658b182699f2eefb1369eb85527bb4963\": container with ID starting with 28e27f950e9e86b962ff5fec55d390f658b182699f2eefb1369eb85527bb4963 not found: ID does not exist"
Sep 16 02:47:44.444554 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:44.444533    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kk2w8\" (UniqueName: \"kubernetes.io/projected/ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c-kube-api-access-kk2w8\") pod \"ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c\" (UID: \"ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c\") "
Sep 16 02:47:44.444665 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:44.444586    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c-openshift-service-ca\") pod \"ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c\" (UID: \"ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c\") "
Sep 16 02:47:44.444665 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:44.444627    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c-maas-api-tls\") pod \"ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c\" (UID: \"ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c\") "
Sep 16 02:47:44.444788 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:44.444679    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c-metrics-certs\") pod \"ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c\" (UID: \"ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c\") "
Sep 16 02:47:44.445093 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:44.445065    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c" (UID: "ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:47:44.446876 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:44.446817    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c-kube-api-access-kk2w8" (OuterVolumeSpecName: "kube-api-access-kk2w8") pod "ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c" (UID: "ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c"). InnerVolumeSpecName "kube-api-access-kk2w8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:47:44.446981 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:44.446876    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c" (UID: "ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:47:44.446981 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:44.446905    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c" (UID: "ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:47:44.546174 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:44.546145    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kk2w8\" (UniqueName: \"kubernetes.io/projected/ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c-kube-api-access-kk2w8\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:47:44.546174 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:44.546172    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c-openshift-service-ca\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:47:44.546174 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:44.546181    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c-maas-api-tls\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:47:44.546389 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:44.546190    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c-metrics-certs\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:47:44.739410 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:44.739380    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg"]
Sep 16 02:47:44.743156 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:44.743132    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-fd614e-58d56cf845-nj6fg"]
Sep 16 02:47:44.889112 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:44.889080    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:47:45.384514 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:45.384479    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c" path="/var/lib/kubelet/pods/ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c/volumes"
Sep 16 02:47:54.684639 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:47:54.684604    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:48:15.529238 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:48:15.529210    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g54gh_308f30e2-2871-442a-ba30-54ada02ad832/ovn-acl-logging/0.log"
Sep 16 02:48:15.537896 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:48:15.537877    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g54gh_308f30e2-2871-442a-ba30-54ada02ad832/ovn-acl-logging/0.log"
Sep 16 02:48:57.846038 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:48:57.845985    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6"]
Sep 16 02:48:57.846875 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:48:57.846228    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6" podUID="180663e4-0ede-43d7-b449-986ab732f14a" containerName="maas-api" containerID="cri-o://e1e1ca7383961e71bd945216cadbf12344d71427492db5dca7e0777f8570ee8c" gracePeriod=30
Sep 16 02:48:58.102896 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:48:58.102802    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6"
Sep 16 02:48:58.107156 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:48:58.107132    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/180663e4-0ede-43d7-b449-986ab732f14a-metrics-certs\") pod \"180663e4-0ede-43d7-b449-986ab732f14a\" (UID: \"180663e4-0ede-43d7-b449-986ab732f14a\") "
Sep 16 02:48:58.107289 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:48:58.107174    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/180663e4-0ede-43d7-b449-986ab732f14a-openshift-service-ca\") pod \"180663e4-0ede-43d7-b449-986ab732f14a\" (UID: \"180663e4-0ede-43d7-b449-986ab732f14a\") "
Sep 16 02:48:58.107289 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:48:58.107199    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/180663e4-0ede-43d7-b449-986ab732f14a-maas-api-tls\") pod \"180663e4-0ede-43d7-b449-986ab732f14a\" (UID: \"180663e4-0ede-43d7-b449-986ab732f14a\") "
Sep 16 02:48:58.107404 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:48:58.107314    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9fkg\" (UniqueName: \"kubernetes.io/projected/180663e4-0ede-43d7-b449-986ab732f14a-kube-api-access-x9fkg\") pod \"180663e4-0ede-43d7-b449-986ab732f14a\" (UID: \"180663e4-0ede-43d7-b449-986ab732f14a\") "
Sep 16 02:48:58.107485 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:48:58.107461    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/180663e4-0ede-43d7-b449-986ab732f14a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "180663e4-0ede-43d7-b449-986ab732f14a" (UID: "180663e4-0ede-43d7-b449-986ab732f14a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:48:58.107572 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:48:58.107558    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/180663e4-0ede-43d7-b449-986ab732f14a-openshift-service-ca\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:48:58.109297 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:48:58.109278    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/180663e4-0ede-43d7-b449-986ab732f14a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "180663e4-0ede-43d7-b449-986ab732f14a" (UID: "180663e4-0ede-43d7-b449-986ab732f14a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:48:58.109368 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:48:58.109316    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/180663e4-0ede-43d7-b449-986ab732f14a-kube-api-access-x9fkg" (OuterVolumeSpecName: "kube-api-access-x9fkg") pod "180663e4-0ede-43d7-b449-986ab732f14a" (UID: "180663e4-0ede-43d7-b449-986ab732f14a"). InnerVolumeSpecName "kube-api-access-x9fkg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:48:58.109368 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:48:58.109361    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/180663e4-0ede-43d7-b449-986ab732f14a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "180663e4-0ede-43d7-b449-986ab732f14a" (UID: "180663e4-0ede-43d7-b449-986ab732f14a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:48:58.208162 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:48:58.208133    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/180663e4-0ede-43d7-b449-986ab732f14a-metrics-certs\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:48:58.208162 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:48:58.208160    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/180663e4-0ede-43d7-b449-986ab732f14a-maas-api-tls\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:48:58.208346 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:48:58.208172    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9fkg\" (UniqueName: \"kubernetes.io/projected/180663e4-0ede-43d7-b449-986ab732f14a-kube-api-access-x9fkg\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:48:58.846514 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:48:58.846476    2581 generic.go:356] "Generic (PLEG): container finished" podID="180663e4-0ede-43d7-b449-986ab732f14a" containerID="e1e1ca7383961e71bd945216cadbf12344d71427492db5dca7e0777f8570ee8c" exitCode=0
Sep 16 02:48:58.846930 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:48:58.846518    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6"
Sep 16 02:48:58.846930 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:48:58.846551    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6" event={"ID":"180663e4-0ede-43d7-b449-986ab732f14a","Type":"ContainerDied","Data":"e1e1ca7383961e71bd945216cadbf12344d71427492db5dca7e0777f8570ee8c"}
Sep 16 02:48:58.846930 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:48:58.846604    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6" event={"ID":"180663e4-0ede-43d7-b449-986ab732f14a","Type":"ContainerDied","Data":"e63a8efeb10c0f63af17d034d632d05c0234e9d02ee688daee04007c323f72de"}
Sep 16 02:48:58.846930 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:48:58.846624    2581 scope.go:117] "RemoveContainer" containerID="e1e1ca7383961e71bd945216cadbf12344d71427492db5dca7e0777f8570ee8c"
Sep 16 02:48:58.856830 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:48:58.856813    2581 scope.go:117] "RemoveContainer" containerID="e1e1ca7383961e71bd945216cadbf12344d71427492db5dca7e0777f8570ee8c"
Sep 16 02:48:58.857145 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:48:58.857124    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1e1ca7383961e71bd945216cadbf12344d71427492db5dca7e0777f8570ee8c\": container with ID starting with e1e1ca7383961e71bd945216cadbf12344d71427492db5dca7e0777f8570ee8c not found: ID does not exist" containerID="e1e1ca7383961e71bd945216cadbf12344d71427492db5dca7e0777f8570ee8c"
Sep 16 02:48:58.857204 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:48:58.857154    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1e1ca7383961e71bd945216cadbf12344d71427492db5dca7e0777f8570ee8c"} err="failed to get container status \"e1e1ca7383961e71bd945216cadbf12344d71427492db5dca7e0777f8570ee8c\": rpc error: code = NotFound desc = could not find container \"e1e1ca7383961e71bd945216cadbf12344d71427492db5dca7e0777f8570ee8c\": container with ID starting with e1e1ca7383961e71bd945216cadbf12344d71427492db5dca7e0777f8570ee8c not found: ID does not exist"
Sep 16 02:48:58.868462 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:48:58.868438    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6"]
Sep 16 02:48:58.874125 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:48:58.874107    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-d3d202-554f5c9d55-bpbz6"]
Sep 16 02:48:59.382726 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:48:59.382693    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="180663e4-0ede-43d7-b449-986ab732f14a" path="/var/lib/kubelet/pods/180663e4-0ede-43d7-b449-986ab732f14a/volumes"
Sep 16 02:49:01.082242 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:01.082203    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:49:15.206480 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:15.206329    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr"]
Sep 16 02:49:15.207290 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:15.206605    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr" podUID="fac8f915-7d33-47f2-8722-b173cedcf6d2" containerName="maas-api" containerID="cri-o://d72f6c412a115b57ed4c558ae99c6fd6b9a4e92f4fcfed713a22361c0ceaddcc" gracePeriod=30
Sep 16 02:49:15.463538 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:15.463479    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr"
Sep 16 02:49:15.549881 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:15.549839    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2q6wt\" (UniqueName: \"kubernetes.io/projected/fac8f915-7d33-47f2-8722-b173cedcf6d2-kube-api-access-2q6wt\") pod \"fac8f915-7d33-47f2-8722-b173cedcf6d2\" (UID: \"fac8f915-7d33-47f2-8722-b173cedcf6d2\") "
Sep 16 02:49:15.549881 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:15.549886    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fac8f915-7d33-47f2-8722-b173cedcf6d2-openshift-service-ca\") pod \"fac8f915-7d33-47f2-8722-b173cedcf6d2\" (UID: \"fac8f915-7d33-47f2-8722-b173cedcf6d2\") "
Sep 16 02:49:15.550088 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:15.549955    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac8f915-7d33-47f2-8722-b173cedcf6d2-metrics-certs\") pod \"fac8f915-7d33-47f2-8722-b173cedcf6d2\" (UID: \"fac8f915-7d33-47f2-8722-b173cedcf6d2\") "
Sep 16 02:49:15.550135 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:15.550093    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fac8f915-7d33-47f2-8722-b173cedcf6d2-maas-api-tls\") pod \"fac8f915-7d33-47f2-8722-b173cedcf6d2\" (UID: \"fac8f915-7d33-47f2-8722-b173cedcf6d2\") "
Sep 16 02:49:15.550370 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:15.550341    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fac8f915-7d33-47f2-8722-b173cedcf6d2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fac8f915-7d33-47f2-8722-b173cedcf6d2" (UID: "fac8f915-7d33-47f2-8722-b173cedcf6d2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:49:15.550508 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:15.550490    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fac8f915-7d33-47f2-8722-b173cedcf6d2-openshift-service-ca\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:49:15.552354 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:15.552331    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fac8f915-7d33-47f2-8722-b173cedcf6d2-kube-api-access-2q6wt" (OuterVolumeSpecName: "kube-api-access-2q6wt") pod "fac8f915-7d33-47f2-8722-b173cedcf6d2" (UID: "fac8f915-7d33-47f2-8722-b173cedcf6d2"). InnerVolumeSpecName "kube-api-access-2q6wt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:49:15.552764 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:15.552743    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fac8f915-7d33-47f2-8722-b173cedcf6d2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fac8f915-7d33-47f2-8722-b173cedcf6d2" (UID: "fac8f915-7d33-47f2-8722-b173cedcf6d2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:49:15.552764 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:15.552759    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fac8f915-7d33-47f2-8722-b173cedcf6d2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fac8f915-7d33-47f2-8722-b173cedcf6d2" (UID: "fac8f915-7d33-47f2-8722-b173cedcf6d2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:49:15.651163 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:15.651137    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2q6wt\" (UniqueName: \"kubernetes.io/projected/fac8f915-7d33-47f2-8722-b173cedcf6d2-kube-api-access-2q6wt\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:49:15.651163 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:15.651160    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac8f915-7d33-47f2-8722-b173cedcf6d2-metrics-certs\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:49:15.651163 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:15.651170    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fac8f915-7d33-47f2-8722-b173cedcf6d2-maas-api-tls\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:49:15.699574 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:15.699546    2581 scope.go:117] "RemoveContainer" containerID="d72f6c412a115b57ed4c558ae99c6fd6b9a4e92f4fcfed713a22361c0ceaddcc"
Sep 16 02:49:15.947208 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:15.947175    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr"
Sep 16 02:49:15.947390 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:15.947165    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr" event={"ID":"fac8f915-7d33-47f2-8722-b173cedcf6d2","Type":"ContainerDied","Data":"d72f6c412a115b57ed4c558ae99c6fd6b9a4e92f4fcfed713a22361c0ceaddcc"}
Sep 16 02:49:15.947390 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:15.947311    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr" event={"ID":"fac8f915-7d33-47f2-8722-b173cedcf6d2","Type":"ContainerDied","Data":"ddfa7d1c7d1674aea9e53a45ca30df04a71652a7eed2725c5ecaab52940b8a6f"}
Sep 16 02:49:15.975894 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:15.975825    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr"]
Sep 16 02:49:15.981204 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:15.981179    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-24aabe-6f655cc884-m2szr"]
Sep 16 02:49:17.382657 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:17.382626    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fac8f915-7d33-47f2-8722-b173cedcf6d2" path="/var/lib/kubelet/pods/fac8f915-7d33-47f2-8722-b173cedcf6d2/volumes"
Sep 16 02:49:18.078914 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:18.078877    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:49:22.021894 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:22.021834    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"]
Sep 16 02:49:22.022402 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:22.022131    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7" podUID="839d2afe-c2eb-4480-b9fa-3ef261b87fef" containerName="istio-proxy" containerID="cri-o://5addf3f6c0b936bebd08ca07f2326476b14567ff1b7e375f4efb57b358d6c0dd" gracePeriod=30
Sep 16 02:49:27.273989 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:27.273963    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:49:27.351592 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:27.351522    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/839d2afe-c2eb-4480-b9fa-3ef261b87fef-workload-socket\") pod \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") "
Sep 16 02:49:27.351592 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:27.351559    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/839d2afe-c2eb-4480-b9fa-3ef261b87fef-istiod-ca-cert\") pod \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") "
Sep 16 02:49:27.351592 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:27.351583    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/839d2afe-c2eb-4480-b9fa-3ef261b87fef-workload-certs\") pod \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") "
Sep 16 02:49:27.351876 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:27.351624    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/839d2afe-c2eb-4480-b9fa-3ef261b87fef-istio-podinfo\") pod \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") "
Sep 16 02:49:27.351876 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:27.351649    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/839d2afe-c2eb-4480-b9fa-3ef261b87fef-istio-token\") pod \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") "
Sep 16 02:49:27.351876 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:27.351706    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgwkw\" (UniqueName: \"kubernetes.io/projected/839d2afe-c2eb-4480-b9fa-3ef261b87fef-kube-api-access-lgwkw\") pod \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") "
Sep 16 02:49:27.351876 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:27.351734    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/839d2afe-c2eb-4480-b9fa-3ef261b87fef-istio-envoy\") pod \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") "
Sep 16 02:49:27.351876 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:27.351812    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/839d2afe-c2eb-4480-b9fa-3ef261b87fef-istio-data\") pod \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") "
Sep 16 02:49:27.351876 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:27.351812    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/839d2afe-c2eb-4480-b9fa-3ef261b87fef-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "839d2afe-c2eb-4480-b9fa-3ef261b87fef" (UID: "839d2afe-c2eb-4480-b9fa-3ef261b87fef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:49:27.352189 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:27.351886    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/839d2afe-c2eb-4480-b9fa-3ef261b87fef-credential-socket\") pod \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\" (UID: \"839d2afe-c2eb-4480-b9fa-3ef261b87fef\") "
Sep 16 02:49:27.352189 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:27.351975    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/839d2afe-c2eb-4480-b9fa-3ef261b87fef-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "839d2afe-c2eb-4480-b9fa-3ef261b87fef" (UID: "839d2afe-c2eb-4480-b9fa-3ef261b87fef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:49:27.352189 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:27.352110    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/839d2afe-c2eb-4480-b9fa-3ef261b87fef-istio-data" (OuterVolumeSpecName: "istio-data") pod "839d2afe-c2eb-4480-b9fa-3ef261b87fef" (UID: "839d2afe-c2eb-4480-b9fa-3ef261b87fef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:49:27.352189 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:27.352137    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/839d2afe-c2eb-4480-b9fa-3ef261b87fef-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "839d2afe-c2eb-4480-b9fa-3ef261b87fef" (UID: "839d2afe-c2eb-4480-b9fa-3ef261b87fef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:49:27.352189 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:27.352167    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/839d2afe-c2eb-4480-b9fa-3ef261b87fef-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "839d2afe-c2eb-4480-b9fa-3ef261b87fef" (UID: "839d2afe-c2eb-4480-b9fa-3ef261b87fef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:49:27.352625 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:27.352269    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/839d2afe-c2eb-4480-b9fa-3ef261b87fef-istio-data\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:49:27.352625 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:27.352284    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/839d2afe-c2eb-4480-b9fa-3ef261b87fef-credential-socket\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:49:27.352625 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:27.352296    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/839d2afe-c2eb-4480-b9fa-3ef261b87fef-workload-socket\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:49:27.352625 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:27.352306    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/839d2afe-c2eb-4480-b9fa-3ef261b87fef-istiod-ca-cert\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:49:27.352625 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:27.352314    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/839d2afe-c2eb-4480-b9fa-3ef261b87fef-workload-certs\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:49:27.354079 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:27.354050    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/839d2afe-c2eb-4480-b9fa-3ef261b87fef-kube-api-access-lgwkw" (OuterVolumeSpecName: "kube-api-access-lgwkw") pod "839d2afe-c2eb-4480-b9fa-3ef261b87fef" (UID: "839d2afe-c2eb-4480-b9fa-3ef261b87fef"). InnerVolumeSpecName "kube-api-access-lgwkw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:49:27.354079 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:27.354059    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/839d2afe-c2eb-4480-b9fa-3ef261b87fef-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "839d2afe-c2eb-4480-b9fa-3ef261b87fef" (UID: "839d2afe-c2eb-4480-b9fa-3ef261b87fef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 02:49:27.354219 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:27.354062    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/839d2afe-c2eb-4480-b9fa-3ef261b87fef-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "839d2afe-c2eb-4480-b9fa-3ef261b87fef" (UID: "839d2afe-c2eb-4480-b9fa-3ef261b87fef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:49:27.354219 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:27.354108    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/839d2afe-c2eb-4480-b9fa-3ef261b87fef-istio-token" (OuterVolumeSpecName: "istio-token") pod "839d2afe-c2eb-4480-b9fa-3ef261b87fef" (UID: "839d2afe-c2eb-4480-b9fa-3ef261b87fef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:49:27.453438 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:27.453416    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/839d2afe-c2eb-4480-b9fa-3ef261b87fef-istio-podinfo\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:49:27.453438 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:27.453435    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/839d2afe-c2eb-4480-b9fa-3ef261b87fef-istio-token\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:49:27.453578 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:27.453445    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgwkw\" (UniqueName: \"kubernetes.io/projected/839d2afe-c2eb-4480-b9fa-3ef261b87fef-kube-api-access-lgwkw\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:49:27.453578 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:27.453454    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/839d2afe-c2eb-4480-b9fa-3ef261b87fef-istio-envoy\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:49:28.022916 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:28.022879    2581 generic.go:356] "Generic (PLEG): container finished" podID="839d2afe-c2eb-4480-b9fa-3ef261b87fef" containerID="5addf3f6c0b936bebd08ca07f2326476b14567ff1b7e375f4efb57b358d6c0dd" exitCode=0
Sep 16 02:49:28.023124 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:28.022914    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7" event={"ID":"839d2afe-c2eb-4480-b9fa-3ef261b87fef","Type":"ContainerDied","Data":"5addf3f6c0b936bebd08ca07f2326476b14567ff1b7e375f4efb57b358d6c0dd"}
Sep 16 02:49:28.023124 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:28.022966    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"
Sep 16 02:49:28.023124 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:28.023013    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7" event={"ID":"839d2afe-c2eb-4480-b9fa-3ef261b87fef","Type":"ContainerDied","Data":"a2b1619c3012035b7404e7538132fd1b0ab430b2c970d6730817648ba49e7b4a"}
Sep 16 02:49:28.023124 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:28.023045    2581 scope.go:117] "RemoveContainer" containerID="5addf3f6c0b936bebd08ca07f2326476b14567ff1b7e375f4efb57b358d6c0dd"
Sep 16 02:49:28.032633 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:28.032616    2581 scope.go:117] "RemoveContainer" containerID="629030d00ecdfdd6a1f611a8804d1e914842c5ce84ffc8679489d8a24e5d8387"
Sep 16 02:49:28.040757 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:28.040689    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"]
Sep 16 02:49:28.043936 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:28.043910    2581 scope.go:117] "RemoveContainer" containerID="5addf3f6c0b936bebd08ca07f2326476b14567ff1b7e375f4efb57b358d6c0dd"
Sep 16 02:49:28.044232 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:49:28.044211    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5addf3f6c0b936bebd08ca07f2326476b14567ff1b7e375f4efb57b358d6c0dd\": container with ID starting with 5addf3f6c0b936bebd08ca07f2326476b14567ff1b7e375f4efb57b358d6c0dd not found: ID does not exist" containerID="5addf3f6c0b936bebd08ca07f2326476b14567ff1b7e375f4efb57b358d6c0dd"
Sep 16 02:49:28.044319 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:28.044242    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5addf3f6c0b936bebd08ca07f2326476b14567ff1b7e375f4efb57b358d6c0dd"} err="failed to get container status \"5addf3f6c0b936bebd08ca07f2326476b14567ff1b7e375f4efb57b358d6c0dd\": rpc error: code = NotFound desc = could not find container \"5addf3f6c0b936bebd08ca07f2326476b14567ff1b7e375f4efb57b358d6c0dd\": container with ID starting with 5addf3f6c0b936bebd08ca07f2326476b14567ff1b7e375f4efb57b358d6c0dd not found: ID does not exist"
Sep 16 02:49:28.044319 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:28.044263    2581 scope.go:117] "RemoveContainer" containerID="629030d00ecdfdd6a1f611a8804d1e914842c5ce84ffc8679489d8a24e5d8387"
Sep 16 02:49:28.044431 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:28.044337    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-24aabe-openshift-default-799dfb9848-szrk7"]
Sep 16 02:49:28.044515 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:49:28.044497    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"629030d00ecdfdd6a1f611a8804d1e914842c5ce84ffc8679489d8a24e5d8387\": container with ID starting with 629030d00ecdfdd6a1f611a8804d1e914842c5ce84ffc8679489d8a24e5d8387 not found: ID does not exist" containerID="629030d00ecdfdd6a1f611a8804d1e914842c5ce84ffc8679489d8a24e5d8387"
Sep 16 02:49:28.044558 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:28.044521    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"629030d00ecdfdd6a1f611a8804d1e914842c5ce84ffc8679489d8a24e5d8387"} err="failed to get container status \"629030d00ecdfdd6a1f611a8804d1e914842c5ce84ffc8679489d8a24e5d8387\": rpc error: code = NotFound desc = could not find container \"629030d00ecdfdd6a1f611a8804d1e914842c5ce84ffc8679489d8a24e5d8387\": container with ID starting with 629030d00ecdfdd6a1f611a8804d1e914842c5ce84ffc8679489d8a24e5d8387 not found: ID does not exist"
Sep 16 02:49:29.382414 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:29.382379    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="839d2afe-c2eb-4480-b9fa-3ef261b87fef" path="/var/lib/kubelet/pods/839d2afe-c2eb-4480-b9fa-3ef261b87fef/volumes"
Sep 16 02:49:32.873690 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:32.873656    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q"]
Sep 16 02:49:32.874150 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:32.873929    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q" podUID="77e1acd3-8ce3-4ab4-b109-5e03c3e447c0" containerName="maas-api" containerID="cri-o://4a26900ebf91cab4d7abaf6c840779d033472677dc31316b84e4120430baf8a5" gracePeriod=30
Sep 16 02:49:33.055409 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:33.055377    2581 generic.go:356] "Generic (PLEG): container finished" podID="77e1acd3-8ce3-4ab4-b109-5e03c3e447c0" containerID="4a26900ebf91cab4d7abaf6c840779d033472677dc31316b84e4120430baf8a5" exitCode=0
Sep 16 02:49:33.055574 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:33.055446    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q" event={"ID":"77e1acd3-8ce3-4ab4-b109-5e03c3e447c0","Type":"ContainerDied","Data":"4a26900ebf91cab4d7abaf6c840779d033472677dc31316b84e4120430baf8a5"}
Sep 16 02:49:33.133300 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:33.133238    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q"
Sep 16 02:49:33.205809 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:33.205772    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77e1acd3-8ce3-4ab4-b109-5e03c3e447c0-metrics-certs\") pod \"77e1acd3-8ce3-4ab4-b109-5e03c3e447c0\" (UID: \"77e1acd3-8ce3-4ab4-b109-5e03c3e447c0\") "
Sep 16 02:49:33.205809 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:33.205817    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77e1acd3-8ce3-4ab4-b109-5e03c3e447c0-maas-api-tls\") pod \"77e1acd3-8ce3-4ab4-b109-5e03c3e447c0\" (UID: \"77e1acd3-8ce3-4ab4-b109-5e03c3e447c0\") "
Sep 16 02:49:33.206077 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:33.205884    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77e1acd3-8ce3-4ab4-b109-5e03c3e447c0-openshift-service-ca\") pod \"77e1acd3-8ce3-4ab4-b109-5e03c3e447c0\" (UID: \"77e1acd3-8ce3-4ab4-b109-5e03c3e447c0\") "
Sep 16 02:49:33.206077 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:33.205956    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvjxb\" (UniqueName: \"kubernetes.io/projected/77e1acd3-8ce3-4ab4-b109-5e03c3e447c0-kube-api-access-rvjxb\") pod \"77e1acd3-8ce3-4ab4-b109-5e03c3e447c0\" (UID: \"77e1acd3-8ce3-4ab4-b109-5e03c3e447c0\") "
Sep 16 02:49:33.206378 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:33.206338    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77e1acd3-8ce3-4ab4-b109-5e03c3e447c0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "77e1acd3-8ce3-4ab4-b109-5e03c3e447c0" (UID: "77e1acd3-8ce3-4ab4-b109-5e03c3e447c0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 02:49:33.208304 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:33.208278    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77e1acd3-8ce3-4ab4-b109-5e03c3e447c0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "77e1acd3-8ce3-4ab4-b109-5e03c3e447c0" (UID: "77e1acd3-8ce3-4ab4-b109-5e03c3e447c0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:49:33.208304 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:33.208284    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77e1acd3-8ce3-4ab4-b109-5e03c3e447c0-kube-api-access-rvjxb" (OuterVolumeSpecName: "kube-api-access-rvjxb") pod "77e1acd3-8ce3-4ab4-b109-5e03c3e447c0" (UID: "77e1acd3-8ce3-4ab4-b109-5e03c3e447c0"). InnerVolumeSpecName "kube-api-access-rvjxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:49:33.208304 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:33.208298    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77e1acd3-8ce3-4ab4-b109-5e03c3e447c0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "77e1acd3-8ce3-4ab4-b109-5e03c3e447c0" (UID: "77e1acd3-8ce3-4ab4-b109-5e03c3e447c0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 02:49:33.307127 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:33.307077    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77e1acd3-8ce3-4ab4-b109-5e03c3e447c0-metrics-certs\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:49:33.307127 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:33.307119    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77e1acd3-8ce3-4ab4-b109-5e03c3e447c0-maas-api-tls\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:49:33.307127 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:33.307132    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77e1acd3-8ce3-4ab4-b109-5e03c3e447c0-openshift-service-ca\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:49:33.307375 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:33.307144    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvjxb\" (UniqueName: \"kubernetes.io/projected/77e1acd3-8ce3-4ab4-b109-5e03c3e447c0-kube-api-access-rvjxb\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:49:34.062522 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:34.062487    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q" event={"ID":"77e1acd3-8ce3-4ab4-b109-5e03c3e447c0","Type":"ContainerDied","Data":"bf478a1230260290ef6fd4960699001d11781e774e75e6c841921f74b3eeefbd"}
Sep 16 02:49:34.062980 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:34.062525    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q"
Sep 16 02:49:34.062980 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:34.062579    2581 scope.go:117] "RemoveContainer" containerID="4a26900ebf91cab4d7abaf6c840779d033472677dc31316b84e4120430baf8a5"
Sep 16 02:49:34.079052 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:34.079020    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q"]
Sep 16 02:49:34.084214 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:34.084184    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-a53a44-5667596dcd-sw74q"]
Sep 16 02:49:35.384178 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:35.384144    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77e1acd3-8ce3-4ab4-b109-5e03c3e447c0" path="/var/lib/kubelet/pods/77e1acd3-8ce3-4ab4-b109-5e03c3e447c0/volumes"
Sep 16 02:49:35.384645 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:35.384429    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:49:43.383731 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:49:43.383698    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:51:03.577264 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:51:03.577228    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:51:28.078170 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:51:28.078131    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:51:35.871311 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:51:35.871272    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:51:44.278224 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:51:44.278186    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:52:02.176725 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:52:02.176685    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:52:07.873898 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:52:07.873797    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lz9l5"]
Sep 16 02:52:07.874434 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:52:07.874019    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lz9l5" podUID="780a1810-d799-416f-b2dc-1dfa7a0bf830" containerName="manager" containerID="cri-o://34602c91c4b20c10db8e688a06d765d50075f1a5265fd7f574d77356a62a06c5" gracePeriod=10
Sep 16 02:52:09.725169 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:52:09.725144    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lz9l5"
Sep 16 02:52:09.824939 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:52:09.824911    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/780a1810-d799-416f-b2dc-1dfa7a0bf830-extensions-socket-volume\") pod \"780a1810-d799-416f-b2dc-1dfa7a0bf830\" (UID: \"780a1810-d799-416f-b2dc-1dfa7a0bf830\") "
Sep 16 02:52:09.825138 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:52:09.825052    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nk56c\" (UniqueName: \"kubernetes.io/projected/780a1810-d799-416f-b2dc-1dfa7a0bf830-kube-api-access-nk56c\") pod \"780a1810-d799-416f-b2dc-1dfa7a0bf830\" (UID: \"780a1810-d799-416f-b2dc-1dfa7a0bf830\") "
Sep 16 02:52:09.825285 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:52:09.825261    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/780a1810-d799-416f-b2dc-1dfa7a0bf830-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "780a1810-d799-416f-b2dc-1dfa7a0bf830" (UID: "780a1810-d799-416f-b2dc-1dfa7a0bf830"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 02:52:09.825363 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:52:09.825348    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/780a1810-d799-416f-b2dc-1dfa7a0bf830-extensions-socket-volume\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:52:09.827103 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:52:09.827078    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/780a1810-d799-416f-b2dc-1dfa7a0bf830-kube-api-access-nk56c" (OuterVolumeSpecName: "kube-api-access-nk56c") pod "780a1810-d799-416f-b2dc-1dfa7a0bf830" (UID: "780a1810-d799-416f-b2dc-1dfa7a0bf830"). InnerVolumeSpecName "kube-api-access-nk56c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 02:52:09.917946 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:52:09.917912    2581 generic.go:356] "Generic (PLEG): container finished" podID="780a1810-d799-416f-b2dc-1dfa7a0bf830" containerID="34602c91c4b20c10db8e688a06d765d50075f1a5265fd7f574d77356a62a06c5" exitCode=0
Sep 16 02:52:09.918083 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:52:09.917965    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lz9l5"
Sep 16 02:52:09.918083 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:52:09.918007    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lz9l5" event={"ID":"780a1810-d799-416f-b2dc-1dfa7a0bf830","Type":"ContainerDied","Data":"34602c91c4b20c10db8e688a06d765d50075f1a5265fd7f574d77356a62a06c5"}
Sep 16 02:52:09.918083 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:52:09.918060    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lz9l5" event={"ID":"780a1810-d799-416f-b2dc-1dfa7a0bf830","Type":"ContainerDied","Data":"990fec78d9266ddcc16ec126387626ac5ec7130e420a821a1ac82e697f34d7aa"}
Sep 16 02:52:09.918192 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:52:09.918087    2581 scope.go:117] "RemoveContainer" containerID="34602c91c4b20c10db8e688a06d765d50075f1a5265fd7f574d77356a62a06c5"
Sep 16 02:52:09.926021 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:52:09.926001    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nk56c\" (UniqueName: \"kubernetes.io/projected/780a1810-d799-416f-b2dc-1dfa7a0bf830-kube-api-access-nk56c\") on node \"ip-10-0-139-191.ec2.internal\" DevicePath \"\""
Sep 16 02:52:09.928061 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:52:09.928042    2581 scope.go:117] "RemoveContainer" containerID="34602c91c4b20c10db8e688a06d765d50075f1a5265fd7f574d77356a62a06c5"
Sep 16 02:52:09.928311 ip-10-0-139-191 kubenswrapper[2581]: E0916 02:52:09.928294    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34602c91c4b20c10db8e688a06d765d50075f1a5265fd7f574d77356a62a06c5\": container with ID starting with 34602c91c4b20c10db8e688a06d765d50075f1a5265fd7f574d77356a62a06c5 not found: ID does not exist" containerID="34602c91c4b20c10db8e688a06d765d50075f1a5265fd7f574d77356a62a06c5"
Sep 16 02:52:09.928363 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:52:09.928319    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34602c91c4b20c10db8e688a06d765d50075f1a5265fd7f574d77356a62a06c5"} err="failed to get container status \"34602c91c4b20c10db8e688a06d765d50075f1a5265fd7f574d77356a62a06c5\": rpc error: code = NotFound desc = could not find container \"34602c91c4b20c10db8e688a06d765d50075f1a5265fd7f574d77356a62a06c5\": container with ID starting with 34602c91c4b20c10db8e688a06d765d50075f1a5265fd7f574d77356a62a06c5 not found: ID does not exist"
Sep 16 02:52:09.938770 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:52:09.938748    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lz9l5"]
Sep 16 02:52:09.941902 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:52:09.941883    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lz9l5"]
Sep 16 02:52:11.382243 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:52:11.382211    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="780a1810-d799-416f-b2dc-1dfa7a0bf830" path="/var/lib/kubelet/pods/780a1810-d799-416f-b2dc-1dfa7a0bf830/volumes"
Sep 16 02:53:08.641004 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.640973    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snhbg"]
Sep 16 02:53:08.643428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.641331    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a325563-d212-4c90-a8ac-a54336c6f76d" containerName="maas-api"
Sep 16 02:53:08.643428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.641342    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a325563-d212-4c90-a8ac-a54336c6f76d" containerName="maas-api"
Sep 16 02:53:08.643428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.641356    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fac8f915-7d33-47f2-8722-b173cedcf6d2" containerName="maas-api"
Sep 16 02:53:08.643428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.641361    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fac8f915-7d33-47f2-8722-b173cedcf6d2" containerName="maas-api"
Sep 16 02:53:08.643428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.641370    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="839d2afe-c2eb-4480-b9fa-3ef261b87fef" containerName="istio-proxy"
Sep 16 02:53:08.643428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.641377    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="839d2afe-c2eb-4480-b9fa-3ef261b87fef" containerName="istio-proxy"
Sep 16 02:53:08.643428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.641386    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc7a7c86-ee45-4fd8-bb5d-950e4978f728" containerName="maas-api"
Sep 16 02:53:08.643428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.641391    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc7a7c86-ee45-4fd8-bb5d-950e4978f728" containerName="maas-api"
Sep 16 02:53:08.643428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.641398    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5af76106-cb48-4c02-b748-0cf29ee8ed09" containerName="maas-api"
Sep 16 02:53:08.643428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.641403    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5af76106-cb48-4c02-b748-0cf29ee8ed09" containerName="maas-api"
Sep 16 02:53:08.643428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.641410    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c" containerName="maas-api"
Sep 16 02:53:08.643428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.641415    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c" containerName="maas-api"
Sep 16 02:53:08.643428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.641421    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="180663e4-0ede-43d7-b449-986ab732f14a" containerName="maas-api"
Sep 16 02:53:08.643428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.641426    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="180663e4-0ede-43d7-b449-986ab732f14a" containerName="maas-api"
Sep 16 02:53:08.643428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.641437    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a251c295-9eb7-4119-bbbe-20606f3f68db" containerName="maas-api"
Sep 16 02:53:08.643428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.641442    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a251c295-9eb7-4119-bbbe-20606f3f68db" containerName="maas-api"
Sep 16 02:53:08.643428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.641450    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="780a1810-d799-416f-b2dc-1dfa7a0bf830" containerName="manager"
Sep 16 02:53:08.643428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.641456    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="780a1810-d799-416f-b2dc-1dfa7a0bf830" containerName="manager"
Sep 16 02:53:08.643428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.641462    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77e1acd3-8ce3-4ab4-b109-5e03c3e447c0" containerName="maas-api"
Sep 16 02:53:08.643428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.641467    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="77e1acd3-8ce3-4ab4-b109-5e03c3e447c0" containerName="maas-api"
Sep 16 02:53:08.643428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.641522    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="839d2afe-c2eb-4480-b9fa-3ef261b87fef" containerName="istio-proxy"
Sep 16 02:53:08.643428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.641528    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc7a7c86-ee45-4fd8-bb5d-950e4978f728" containerName="maas-api"
Sep 16 02:53:08.643428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.641533    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="839d2afe-c2eb-4480-b9fa-3ef261b87fef" containerName="istio-proxy"
Sep 16 02:53:08.643428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.641540    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="77e1acd3-8ce3-4ab4-b109-5e03c3e447c0" containerName="maas-api"
Sep 16 02:53:08.643428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.641545    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca6f3aaa-20fa-4164-ac4c-e555bd0a1a9c" containerName="maas-api"
Sep 16 02:53:08.643428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.641551    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5af76106-cb48-4c02-b748-0cf29ee8ed09" containerName="maas-api"
Sep 16 02:53:08.643428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.641557    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a251c295-9eb7-4119-bbbe-20606f3f68db" containerName="maas-api"
Sep 16 02:53:08.643428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.641562    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a325563-d212-4c90-a8ac-a54336c6f76d" containerName="maas-api"
Sep 16 02:53:08.643428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.641568    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="780a1810-d799-416f-b2dc-1dfa7a0bf830" containerName="manager"
Sep 16 02:53:08.643428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.641572    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fac8f915-7d33-47f2-8722-b173cedcf6d2" containerName="maas-api"
Sep 16 02:53:08.643428 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.641578    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="180663e4-0ede-43d7-b449-986ab732f14a" containerName="maas-api"
Sep 16 02:53:08.644389 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.644360    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snhbg"
Sep 16 02:53:08.647216 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.647198    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9967l\""
Sep 16 02:53:08.655994 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.655973    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snhbg"]
Sep 16 02:53:08.695710 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.695682    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f71a840b-4592-43b9-a316-8b27cf0f62db-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-snhbg\" (UID: \"f71a840b-4592-43b9-a316-8b27cf0f62db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snhbg"
Sep 16 02:53:08.695823 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.695786    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m45vr\" (UniqueName: \"kubernetes.io/projected/f71a840b-4592-43b9-a316-8b27cf0f62db-kube-api-access-m45vr\") pod \"kuadrant-operator-controller-manager-5769f99d9f-snhbg\" (UID: \"f71a840b-4592-43b9-a316-8b27cf0f62db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snhbg"
Sep 16 02:53:08.797049 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.797012    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f71a840b-4592-43b9-a316-8b27cf0f62db-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-snhbg\" (UID: \"f71a840b-4592-43b9-a316-8b27cf0f62db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snhbg"
Sep 16 02:53:08.797178 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.797110    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m45vr\" (UniqueName: \"kubernetes.io/projected/f71a840b-4592-43b9-a316-8b27cf0f62db-kube-api-access-m45vr\") pod \"kuadrant-operator-controller-manager-5769f99d9f-snhbg\" (UID: \"f71a840b-4592-43b9-a316-8b27cf0f62db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snhbg"
Sep 16 02:53:08.797395 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.797378    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f71a840b-4592-43b9-a316-8b27cf0f62db-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-snhbg\" (UID: \"f71a840b-4592-43b9-a316-8b27cf0f62db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snhbg"
Sep 16 02:53:08.808382 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.808353    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m45vr\" (UniqueName: \"kubernetes.io/projected/f71a840b-4592-43b9-a316-8b27cf0f62db-kube-api-access-m45vr\") pod \"kuadrant-operator-controller-manager-5769f99d9f-snhbg\" (UID: \"f71a840b-4592-43b9-a316-8b27cf0f62db\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snhbg"
Sep 16 02:53:08.955286 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:08.955211    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snhbg"
Sep 16 02:53:09.237183 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:09.237091    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snhbg"]
Sep 16 02:53:09.243267 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:53:09.243229    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf71a840b_4592_43b9_a316_8b27cf0f62db.slice/crio-38c82b302ac419b730611d9a3181b1da2c6558f12eb538b177b3cc90ee137b3c WatchSource:0}: Error finding container 38c82b302ac419b730611d9a3181b1da2c6558f12eb538b177b3cc90ee137b3c: Status 404 returned error can't find the container with id 38c82b302ac419b730611d9a3181b1da2c6558f12eb538b177b3cc90ee137b3c
Sep 16 02:53:10.237951 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:10.237913    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snhbg" event={"ID":"f71a840b-4592-43b9-a316-8b27cf0f62db","Type":"ContainerStarted","Data":"d1a2fcf0174d5e08fb43c1a15ae570269b35b96f73e1c2c30b2e5f7cb6858336"}
Sep 16 02:53:10.238333 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:10.237974    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snhbg" event={"ID":"f71a840b-4592-43b9-a316-8b27cf0f62db","Type":"ContainerStarted","Data":"38c82b302ac419b730611d9a3181b1da2c6558f12eb538b177b3cc90ee137b3c"}
Sep 16 02:53:10.238333 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:10.238118    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snhbg"
Sep 16 02:53:10.257368 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:10.257314    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snhbg" podStartSLOduration=2.257300323 podStartE2EDuration="2.257300323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 02:53:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:53:10.255104445 +0000 UTC m=+2395.347286418" watchObservedRunningTime="2026-09-16 02:53:10.257300323 +0000 UTC m=+2395.349482297"
Sep 16 02:53:15.565333 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:15.565305    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g54gh_308f30e2-2871-442a-ba30-54ada02ad832/ovn-acl-logging/0.log"
Sep 16 02:53:15.576273 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:15.576255    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g54gh_308f30e2-2871-442a-ba30-54ada02ad832/ovn-acl-logging/0.log"
Sep 16 02:53:21.246294 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:21.246214    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-snhbg"
Sep 16 02:53:28.476060 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:28.476026    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:53:34.377765 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:34.377729    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:53:41.571552 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:53:41.571473    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:54:06.578483 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:54:06.578441    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:54:13.682784 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:54:13.682753    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:54:51.468577 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:54:51.468540    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:55:00.474757 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:55:00.474722    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:55:07.471054 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:55:07.470973    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:55:14.185907 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:55:14.185863    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:58:15.603909 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:15.603880    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g54gh_308f30e2-2871-442a-ba30-54ada02ad832/ovn-acl-logging/0.log"
Sep 16 02:58:15.615860 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:15.615825    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g54gh_308f30e2-2871-442a-ba30-54ada02ad832/ovn-acl-logging/0.log"
Sep 16 02:58:20.270286 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:20.270257    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:58:26.979216 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:26.979179    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:58:33.074680 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:33.074639    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:58:39.974456 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:39.974414    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-w6lwt"]
Sep 16 02:58:45.891408 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:45.891382    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kpfqx_9360df26-7dcf-4632-b9b1-c3604a98a63e/global-pull-secret-syncer/0.log"
Sep 16 02:58:45.973281 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:45.973239    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-d8z97_ffcfd279-8633-452e-8c03-079e0618893d/konnectivity-agent/0.log"
Sep 16 02:58:46.055591 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:46.055563    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-191.ec2.internal_c33b9c404b3f92df51af027eb114ba62/haproxy/0.log"
Sep 16 02:58:50.123881 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:50.123835    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-5z4zb_53e79266-1f0f-4bb2-a50a-1f95bd4c750e/manager/0.log"
Sep 16 02:58:50.168613 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:50.168585    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-tgqmk_9142ad38-fd27-49f2-934c-e1824266ee2c/manager/0.log"
Sep 16 02:58:50.192064 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:50.192041    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-wbfpp_d0c480db-3e2e-46fa-8f32-35b50819abdc/kuadrant-console-plugin/0.log"
Sep 16 02:58:50.233693 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:50.233670    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-snhbg_f71a840b-4592-43b9-a316-8b27cf0f62db/manager/0.log"
Sep 16 02:58:50.261503 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:50.261482    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-w6lwt_7e10dfa3-de5f-4660-848a-3e26afec62f2/limitador/0.log"
Sep 16 02:58:50.328448 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:50.328424    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-rl8pw_1c50404d-bbb3-436c-8a11-6828296609d8/manager/0.log"
Sep 16 02:58:52.493533 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:52.493504    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-d6jm7_f4b263ed-2452-4743-a48c-3958f4231c96/monitoring-plugin/0.log"
Sep 16 02:58:52.613113 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:52.613086    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bzfmv_dbc96d3c-ca13-4725-b56b-ffb30e53d154/node-exporter/0.log"
Sep 16 02:58:52.631823 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:52.631805    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bzfmv_dbc96d3c-ca13-4725-b56b-ffb30e53d154/kube-rbac-proxy/0.log"
Sep 16 02:58:52.654738 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:52.654715    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bzfmv_dbc96d3c-ca13-4725-b56b-ffb30e53d154/init-textfile/0.log"
Sep 16 02:58:53.074540 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:53.074512    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75ddbf8bc9-ttmzm_5f438988-8046-4e10-a3ac-4db6511b218c/telemeter-client/0.log"
Sep 16 02:58:53.100958 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:53.100934    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75ddbf8bc9-ttmzm_5f438988-8046-4e10-a3ac-4db6511b218c/reload/0.log"
Sep 16 02:58:53.125917 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:53.125898    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75ddbf8bc9-ttmzm_5f438988-8046-4e10-a3ac-4db6511b218c/kube-rbac-proxy/0.log"
Sep 16 02:58:53.156506 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:53.156484    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f4d9954b6-6pbh5_601b7f19-d5d9-459b-9306-549195b4ce10/thanos-query/0.log"
Sep 16 02:58:53.178097 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:53.178076    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f4d9954b6-6pbh5_601b7f19-d5d9-459b-9306-549195b4ce10/kube-rbac-proxy-web/0.log"
Sep 16 02:58:53.204133 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:53.204112    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f4d9954b6-6pbh5_601b7f19-d5d9-459b-9306-549195b4ce10/kube-rbac-proxy/0.log"
Sep 16 02:58:53.224514 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:53.224488    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f4d9954b6-6pbh5_601b7f19-d5d9-459b-9306-549195b4ce10/prom-label-proxy/0.log"
Sep 16 02:58:53.244913 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:53.244888    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f4d9954b6-6pbh5_601b7f19-d5d9-459b-9306-549195b4ce10/kube-rbac-proxy-rules/0.log"
Sep 16 02:58:53.269934 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:53.269912    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f4d9954b6-6pbh5_601b7f19-d5d9-459b-9306-549195b4ce10/kube-rbac-proxy-metrics/0.log"
Sep 16 02:58:56.190114 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:56.190085    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75b88cdd65-wxfqx_3c71c03a-6d8f-45c0-b453-d0253eac9e8b/console/0.log"
Sep 16 02:58:56.570211 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:56.570173    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-x7gcl/perf-node-gather-daemonset-jlmmk"]
Sep 16 02:58:56.570807 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:56.570775    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="839d2afe-c2eb-4480-b9fa-3ef261b87fef" containerName="istio-proxy"
Sep 16 02:58:56.570807 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:56.570801    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="839d2afe-c2eb-4480-b9fa-3ef261b87fef" containerName="istio-proxy"
Sep 16 02:58:56.574065 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:56.574044    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x7gcl/perf-node-gather-daemonset-jlmmk"
Sep 16 02:58:56.576133 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:56.576117    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-x7gcl\"/\"default-dockercfg-zwm8t\""
Sep 16 02:58:56.576215 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:56.576153    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x7gcl\"/\"kube-root-ca.crt\""
Sep 16 02:58:56.576871 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:56.576835    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x7gcl\"/\"openshift-service-ca.crt\""
Sep 16 02:58:56.579800 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:56.579780    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x7gcl/perf-node-gather-daemonset-jlmmk"]
Sep 16 02:58:56.618156 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:56.618121    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8slxs\" (UniqueName: \"kubernetes.io/projected/4a1044fd-d993-452e-a924-09f74c22ea40-kube-api-access-8slxs\") pod \"perf-node-gather-daemonset-jlmmk\" (UID: \"4a1044fd-d993-452e-a924-09f74c22ea40\") " pod="openshift-must-gather-x7gcl/perf-node-gather-daemonset-jlmmk"
Sep 16 02:58:56.618329 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:56.618181    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4a1044fd-d993-452e-a924-09f74c22ea40-lib-modules\") pod \"perf-node-gather-daemonset-jlmmk\" (UID: \"4a1044fd-d993-452e-a924-09f74c22ea40\") " pod="openshift-must-gather-x7gcl/perf-node-gather-daemonset-jlmmk"
Sep 16 02:58:56.618329 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:56.618210    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4a1044fd-d993-452e-a924-09f74c22ea40-podres\") pod \"perf-node-gather-daemonset-jlmmk\" (UID: \"4a1044fd-d993-452e-a924-09f74c22ea40\") " pod="openshift-must-gather-x7gcl/perf-node-gather-daemonset-jlmmk"
Sep 16 02:58:56.618329 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:56.618234    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4a1044fd-d993-452e-a924-09f74c22ea40-proc\") pod \"perf-node-gather-daemonset-jlmmk\" (UID: \"4a1044fd-d993-452e-a924-09f74c22ea40\") " pod="openshift-must-gather-x7gcl/perf-node-gather-daemonset-jlmmk"
Sep 16 02:58:56.618329 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:56.618309    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a1044fd-d993-452e-a924-09f74c22ea40-sys\") pod \"perf-node-gather-daemonset-jlmmk\" (UID: \"4a1044fd-d993-452e-a924-09f74c22ea40\") " pod="openshift-must-gather-x7gcl/perf-node-gather-daemonset-jlmmk"
Sep 16 02:58:56.719171 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:56.719131    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4a1044fd-d993-452e-a924-09f74c22ea40-podres\") pod \"perf-node-gather-daemonset-jlmmk\" (UID: \"4a1044fd-d993-452e-a924-09f74c22ea40\") " pod="openshift-must-gather-x7gcl/perf-node-gather-daemonset-jlmmk"
Sep 16 02:58:56.719383 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:56.719183    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4a1044fd-d993-452e-a924-09f74c22ea40-proc\") pod \"perf-node-gather-daemonset-jlmmk\" (UID: \"4a1044fd-d993-452e-a924-09f74c22ea40\") " pod="openshift-must-gather-x7gcl/perf-node-gather-daemonset-jlmmk"
Sep 16 02:58:56.719383 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:56.719221    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a1044fd-d993-452e-a924-09f74c22ea40-sys\") pod \"perf-node-gather-daemonset-jlmmk\" (UID: \"4a1044fd-d993-452e-a924-09f74c22ea40\") " pod="openshift-must-gather-x7gcl/perf-node-gather-daemonset-jlmmk"
Sep 16 02:58:56.719383 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:56.719313    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4a1044fd-d993-452e-a924-09f74c22ea40-podres\") pod \"perf-node-gather-daemonset-jlmmk\" (UID: \"4a1044fd-d993-452e-a924-09f74c22ea40\") " pod="openshift-must-gather-x7gcl/perf-node-gather-daemonset-jlmmk"
Sep 16 02:58:56.719383 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:56.719334    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8slxs\" (UniqueName: \"kubernetes.io/projected/4a1044fd-d993-452e-a924-09f74c22ea40-kube-api-access-8slxs\") pod \"perf-node-gather-daemonset-jlmmk\" (UID: \"4a1044fd-d993-452e-a924-09f74c22ea40\") " pod="openshift-must-gather-x7gcl/perf-node-gather-daemonset-jlmmk"
Sep 16 02:58:56.719383 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:56.719315    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a1044fd-d993-452e-a924-09f74c22ea40-sys\") pod \"perf-node-gather-daemonset-jlmmk\" (UID: \"4a1044fd-d993-452e-a924-09f74c22ea40\") " pod="openshift-must-gather-x7gcl/perf-node-gather-daemonset-jlmmk"
Sep 16 02:58:56.719383 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:56.719316    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4a1044fd-d993-452e-a924-09f74c22ea40-proc\") pod \"perf-node-gather-daemonset-jlmmk\" (UID: \"4a1044fd-d993-452e-a924-09f74c22ea40\") " pod="openshift-must-gather-x7gcl/perf-node-gather-daemonset-jlmmk"
Sep 16 02:58:56.719623 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:56.719410    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4a1044fd-d993-452e-a924-09f74c22ea40-lib-modules\") pod \"perf-node-gather-daemonset-jlmmk\" (UID: \"4a1044fd-d993-452e-a924-09f74c22ea40\") " pod="openshift-must-gather-x7gcl/perf-node-gather-daemonset-jlmmk"
Sep 16 02:58:56.719623 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:56.719512    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4a1044fd-d993-452e-a924-09f74c22ea40-lib-modules\") pod \"perf-node-gather-daemonset-jlmmk\" (UID: \"4a1044fd-d993-452e-a924-09f74c22ea40\") " pod="openshift-must-gather-x7gcl/perf-node-gather-daemonset-jlmmk"
Sep 16 02:58:56.726607 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:56.726583    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8slxs\" (UniqueName: \"kubernetes.io/projected/4a1044fd-d993-452e-a924-09f74c22ea40-kube-api-access-8slxs\") pod \"perf-node-gather-daemonset-jlmmk\" (UID: \"4a1044fd-d993-452e-a924-09f74c22ea40\") " pod="openshift-must-gather-x7gcl/perf-node-gather-daemonset-jlmmk"
Sep 16 02:58:56.885422 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:56.885310    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x7gcl/perf-node-gather-daemonset-jlmmk"
Sep 16 02:58:56.962272 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:56.962244    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-z4ct8_bc562e96-0bb8-4523-82a3-4aed0b991ad6/volume-data-source-validator/0.log"
Sep 16 02:58:57.157568 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:57.157544    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x7gcl/perf-node-gather-daemonset-jlmmk"]
Sep 16 02:58:57.160065 ip-10-0-139-191 kubenswrapper[2581]: W0916 02:58:57.160039    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4a1044fd_d993_452e_a924_09f74c22ea40.slice/crio-8a00f489f5e591c2977bca3413aa31d1f54ca231ca92fab61b16a27074edff1c WatchSource:0}: Error finding container 8a00f489f5e591c2977bca3413aa31d1f54ca231ca92fab61b16a27074edff1c: Status 404 returned error can't find the container with id 8a00f489f5e591c2977bca3413aa31d1f54ca231ca92fab61b16a27074edff1c
Sep 16 02:58:58.167981 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:58.167951    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x7gcl/perf-node-gather-daemonset-jlmmk" event={"ID":"4a1044fd-d993-452e-a924-09f74c22ea40","Type":"ContainerStarted","Data":"6b838285fb7c2dd0e695871a92595c0e5adc8b7d4c8d20a243172fcfde6966af"}
Sep 16 02:58:58.168365 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:58.168005    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x7gcl/perf-node-gather-daemonset-jlmmk" event={"ID":"4a1044fd-d993-452e-a924-09f74c22ea40","Type":"ContainerStarted","Data":"8a00f489f5e591c2977bca3413aa31d1f54ca231ca92fab61b16a27074edff1c"}
Sep 16 02:58:58.168365 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:58.168040    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-x7gcl/perf-node-gather-daemonset-jlmmk"
Sep 16 02:58:58.182046 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:58.182002    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-x7gcl/perf-node-gather-daemonset-jlmmk" podStartSLOduration=2.181987806 podStartE2EDuration="2.181987806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 02:58:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 02:58:58.179989627 +0000 UTC m=+2743.272171602" watchObservedRunningTime="2026-09-16 02:58:58.181987806 +0000 UTC m=+2743.274169787"
Sep 16 02:58:58.235793 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:58.235770    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qz6zp_d8b0c607-1644-4679-8b1d-be6926f44c81/dns/0.log"
Sep 16 02:58:58.266085 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:58.266060    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qz6zp_d8b0c607-1644-4679-8b1d-be6926f44c81/kube-rbac-proxy/0.log"
Sep 16 02:58:58.315122 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:58.315101    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bbcpb_aa055700-1ef3-45cc-84a5-a00cc3497637/dns-node-resolver/0.log"
Sep 16 02:58:58.834535 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:58.834487    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-ff4fb7c64-l9ncd_2a51efbb-2aef-4c38-988c-14e67882d15b/registry/0.log"
Sep 16 02:58:58.853678 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:58:58.853654    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8wndx_b935ea44-096a-45f1-90b6-f178099dac5f/node-ca/0.log"
Sep 16 02:59:00.504027 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:59:00.503995    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cff6fbc6c-fgn5w_f8918289-f2aa-48aa-bd86-73619fb967f5/kube-auth-proxy/0.log"
Sep 16 02:59:01.515183 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:59:01.515155    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-65nfk_2178372a-7491-487a-881a-14567383f283/serve-healthcheck-canary/0.log"
Sep 16 02:59:02.091265 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:59:02.091228    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c5ng8_a93280ba-e14e-4362-a36a-44d64d0591bd/kube-rbac-proxy/0.log"
Sep 16 02:59:02.110821 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:59:02.110793    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c5ng8_a93280ba-e14e-4362-a36a-44d64d0591bd/exporter/0.log"
Sep 16 02:59:02.131085 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:59:02.131057    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c5ng8_a93280ba-e14e-4362-a36a-44d64d0591bd/extractor/0.log"
Sep 16 02:59:04.183048 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:59:04.183020    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-x7gcl/perf-node-gather-daemonset-jlmmk"
Sep 16 02:59:04.228462 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:59:04.228421    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-spc9b_1c66e3c9-15a5-4d10-b1ca-71d96ed1f2bb/manager/0.log"
Sep 16 02:59:04.452662 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:59:04.452588    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-8vzkc_51419f06-9d15-42fd-872a-7b5d99cc20df/manager/0.log"
Sep 16 02:59:04.533529 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:59:04.533499    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qdjzj_3403d7df-c4b4-47db-b0eb-061b59d6f889/server/0.log"
Sep 16 02:59:04.754597 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:59:04.754523    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74fbd865d6-5cmwz_d1e50091-37d5-4e5d-9dc0-83081aa8dbcd/manager/0.log"
Sep 16 02:59:04.770381 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:59:04.770363    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74fbd865d6-5cmwz_d1e50091-37d5-4e5d-9dc0-83081aa8dbcd/copy-manifests/0.log"
Sep 16 02:59:06.952369 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:59:06.952338    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cff6fbc6c-fgn5w_f8918289-f2aa-48aa-bd86-73619fb967f5/kube-auth-proxy/0.log"
Sep 16 02:59:09.183666 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:59:09.183636    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cff6fbc6c-fgn5w_f8918289-f2aa-48aa-bd86-73619fb967f5/kube-auth-proxy/0.log"
Sep 16 02:59:11.365417 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:59:11.365387    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-wb6s7_bd99b5e4-f2aa-4960-ac59-906648aa0aae/migrator/0.log"
Sep 16 02:59:11.383887 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:59:11.383862    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-wb6s7_bd99b5e4-f2aa-4960-ac59-906648aa0aae/graceful-termination/0.log"
Sep 16 02:59:11.714773 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:59:11.714700    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-wn6td_512baf29-25fe-4807-88bc-9ac46ae62b56/kube-storage-version-migrator-operator/1.log"
Sep 16 02:59:11.715750 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:59:11.715717    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-wn6td_512baf29-25fe-4807-88bc-9ac46ae62b56/kube-storage-version-migrator-operator/0.log"
Sep 16 02:59:12.659200 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:59:12.659168    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4wfvw_1a264618-840c-4828-8f10-c07e91c9d4f0/kube-multus/0.log"
Sep 16 02:59:12.734456 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:59:12.734427    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6tp4r_c7cab88e-5476-42c4-9458-bbbfa5a6848b/kube-multus-additional-cni-plugins/0.log"
Sep 16 02:59:12.754687 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:59:12.754657    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6tp4r_c7cab88e-5476-42c4-9458-bbbfa5a6848b/egress-router-binary-copy/0.log"
Sep 16 02:59:12.773924 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:59:12.773903    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6tp4r_c7cab88e-5476-42c4-9458-bbbfa5a6848b/cni-plugins/0.log"
Sep 16 02:59:12.793055 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:59:12.793030    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6tp4r_c7cab88e-5476-42c4-9458-bbbfa5a6848b/bond-cni-plugin/0.log"
Sep 16 02:59:12.812476 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:59:12.812431    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6tp4r_c7cab88e-5476-42c4-9458-bbbfa5a6848b/routeoverride-cni/0.log"
Sep 16 02:59:12.831905 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:59:12.831879    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6tp4r_c7cab88e-5476-42c4-9458-bbbfa5a6848b/whereabouts-cni-bincopy/0.log"
Sep 16 02:59:12.851656 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:59:12.851630    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6tp4r_c7cab88e-5476-42c4-9458-bbbfa5a6848b/whereabouts-cni/0.log"
Sep 16 02:59:13.222721 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:59:13.222685    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2b8mm_df380f84-e4cf-477f-b44f-86c7f533ce9c/network-metrics-daemon/0.log"
Sep 16 02:59:13.240601 ip-10-0-139-191 kubenswrapper[2581]: I0916 02:59:13.240578    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2b8mm_df380f84-e4cf-477f-b44f-86c7f533ce9c/kube-rbac-proxy/0.log"