Sep 08 14:32:08.254308 ip-10-0-142-20 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 08 14:32:08.254322 ip-10-0-142-20 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 08 14:32:08.254332 ip-10-0-142-20 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 08 14:32:08.254640 ip-10-0-142-20 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 08 14:32:18.373101 ip-10-0-142-20 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 08 14:32:18.373121 ip-10-0-142-20 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 03d487c2d0944c7e8e3da99a507e201b --
Sep 08 14:33:58.852758 ip-10-0-142-20 systemd[1]: Starting Kubernetes Kubelet...
Sep 08 14:33:59.281812 ip-10-0-142-20 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 14:33:59.281812 ip-10-0-142-20 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 08 14:33:59.281812 ip-10-0-142-20 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 14:33:59.281812 ip-10-0-142-20 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 08 14:33:59.281812 ip-10-0-142-20 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 14:33:59.282527 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.281880    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 08 14:33:59.285222 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285205    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 14:33:59.285222 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285222    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 14:33:59.285283 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285227    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 14:33:59.285283 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285230    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 14:33:59.285283 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285234    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 14:33:59.285283 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285236    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 14:33:59.285283 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285240    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 14:33:59.285283 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285243    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 14:33:59.285283 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285246    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 14:33:59.285283 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285249    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 14:33:59.285283 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285252    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 14:33:59.285283 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285255    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 14:33:59.285283 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285259    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 14:33:59.285283 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285261    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 14:33:59.285283 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285266    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 14:33:59.285283 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285269    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 14:33:59.285283 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285272    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 14:33:59.285283 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285275    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 14:33:59.285283 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285281    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 14:33:59.285283 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285283    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 14:33:59.285283 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285286    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 14:33:59.285751 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285289    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 14:33:59.285751 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285292    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 14:33:59.285751 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285295    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 14:33:59.285751 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285297    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 14:33:59.285751 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285300    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 14:33:59.285751 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285302    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 14:33:59.285751 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285305    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 14:33:59.285751 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285308    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 14:33:59.285751 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285311    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 14:33:59.285751 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285313    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 14:33:59.285751 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285316    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 14:33:59.285751 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285318    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 14:33:59.285751 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285321    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 14:33:59.285751 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285324    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 14:33:59.285751 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285326    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 14:33:59.285751 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285329    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 14:33:59.285751 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285331    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 14:33:59.285751 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285337    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 14:33:59.285751 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285340    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 14:33:59.285751 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285342    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 14:33:59.286238 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285345    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 14:33:59.286238 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285347    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 14:33:59.286238 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285350    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 14:33:59.286238 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285352    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 14:33:59.286238 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285354    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 14:33:59.286238 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285356    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 14:33:59.286238 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285359    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 14:33:59.286238 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285361    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 14:33:59.286238 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285364    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 14:33:59.286238 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285366    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 14:33:59.286238 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285368    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 14:33:59.286238 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285371    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 14:33:59.286238 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285373    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 14:33:59.286238 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285377    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 14:33:59.286238 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285380    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 14:33:59.286238 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285382    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 14:33:59.286238 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285385    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 14:33:59.286238 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285388    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 14:33:59.286238 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285390    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 14:33:59.286238 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285393    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 14:33:59.286853 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285395    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 14:33:59.286853 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285398    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 14:33:59.286853 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285400    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 14:33:59.286853 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285403    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 14:33:59.286853 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285405    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 14:33:59.286853 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285408    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 14:33:59.286853 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285410    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 14:33:59.286853 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285413    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 14:33:59.286853 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285415    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 14:33:59.286853 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285418    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 14:33:59.286853 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285421    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 14:33:59.286853 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285423    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 14:33:59.286853 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285426    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 14:33:59.286853 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285428    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 14:33:59.286853 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285430    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 14:33:59.286853 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285433    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 14:33:59.286853 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285435    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 14:33:59.286853 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285440    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 14:33:59.286853 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285443    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 14:33:59.287340 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285446    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 14:33:59.287340 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285448    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 14:33:59.287340 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285451    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 14:33:59.287340 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285454    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 14:33:59.287340 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285456    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 14:33:59.287340 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285458    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 14:33:59.287340 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285462    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 14:33:59.287340 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285478    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 14:33:59.287340 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285481    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 14:33:59.287340 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285483    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 14:33:59.287340 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285488    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 14:33:59.287340 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285491    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 14:33:59.287340 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285494    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 14:33:59.287340 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285497    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 14:33:59.287340 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285500    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 14:33:59.287340 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285503    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 14:33:59.287340 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285506    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 14:33:59.287340 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285508    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 14:33:59.287340 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.285510    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 14:33:59.287340 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287138    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 14:33:59.287826 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287148    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 14:33:59.287826 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287152    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 14:33:59.287826 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287155    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 14:33:59.287826 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287158    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 14:33:59.287826 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287162    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 14:33:59.287826 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287165    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 14:33:59.287826 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287167    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 14:33:59.287826 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287170    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 14:33:59.287826 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287173    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 14:33:59.287826 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287175    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 14:33:59.287826 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287178    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 14:33:59.287826 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287181    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 14:33:59.287826 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287183    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 14:33:59.287826 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287185    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 14:33:59.287826 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287188    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 14:33:59.287826 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287191    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 14:33:59.287826 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287193    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 14:33:59.287826 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287196    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 14:33:59.287826 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287199    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 14:33:59.287826 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287202    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 14:33:59.288420 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287204    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 14:33:59.288420 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287209    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 14:33:59.288420 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287213    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 14:33:59.288420 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287216    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 14:33:59.288420 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287219    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 14:33:59.288420 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287222    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 14:33:59.288420 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287224    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 14:33:59.288420 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287227    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 14:33:59.288420 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287230    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 14:33:59.288420 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287232    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 14:33:59.288420 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287235    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 14:33:59.288420 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287238    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 14:33:59.288420 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287240    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 14:33:59.288420 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287243    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 14:33:59.288420 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287249    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 14:33:59.288420 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287251    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 14:33:59.288420 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287254    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 14:33:59.288420 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287262    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 14:33:59.288420 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287264    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 14:33:59.288908 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287267    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 14:33:59.288908 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287269    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 14:33:59.288908 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287272    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 14:33:59.288908 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287274    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 14:33:59.288908 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287277    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 14:33:59.288908 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287279    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 14:33:59.288908 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287282    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 14:33:59.288908 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287284    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 14:33:59.288908 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287287    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 14:33:59.288908 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287290    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 14:33:59.288908 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287294    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 14:33:59.288908 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287297    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 14:33:59.288908 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287300    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 14:33:59.288908 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287303    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 14:33:59.288908 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287306    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 14:33:59.288908 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287308    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 14:33:59.288908 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287311    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 14:33:59.288908 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287313    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 14:33:59.288908 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287317    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 14:33:59.288908 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287320    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 14:33:59.289397 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287322    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 14:33:59.289397 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287325    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 14:33:59.289397 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287327    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 14:33:59.289397 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287330    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 14:33:59.289397 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287332    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 14:33:59.289397 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287335    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 14:33:59.289397 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287339    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 14:33:59.289397 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287341    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 14:33:59.289397 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287344    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 14:33:59.289397 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287349    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 14:33:59.289397 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287352    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 14:33:59.289397 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287358    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 14:33:59.289397 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287362    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 14:33:59.289397 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287365    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 14:33:59.289397 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287367    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 14:33:59.289397 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287370    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 14:33:59.289397 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287373    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 14:33:59.289397 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287376    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 14:33:59.289397 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287378    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 14:33:59.289863 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287381    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 14:33:59.289863 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287383    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 14:33:59.289863 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287387    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 14:33:59.289863 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287390    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 14:33:59.289863 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287408    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 14:33:59.289863 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287414    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 14:33:59.289863 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287417    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 14:33:59.289863 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287421    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 14:33:59.289863 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287425    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 14:33:59.289863 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287429    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 14:33:59.289863 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287432    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 14:33:59.289863 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287435    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 14:33:59.289863 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287439    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 14:33:59.289863 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287442    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 14:33:59.289863 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287444    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 14:33:59.289863 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287447    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 14:33:59.289863 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287449    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 14:33:59.289863 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287452    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 14:33:59.289863 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287454    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 14:33:59.290327 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287457    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 14:33:59.290327 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287854    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 14:33:59.290327 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287859    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 14:33:59.290327 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287862    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 14:33:59.290327 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287865    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 14:33:59.290327 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287868    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 14:33:59.290327 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287871    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 14:33:59.290327 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287874    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 14:33:59.290327 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287876    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 14:33:59.290327 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287879    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 14:33:59.290327 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287881    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 14:33:59.290327 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287884    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 14:33:59.290327 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287887    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 14:33:59.290327 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287890    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 14:33:59.290327 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287892    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 14:33:59.290327 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287895    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 14:33:59.290327 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287897    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 14:33:59.290327 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287900    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 14:33:59.290327 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287903    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 14:33:59.290327 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287905    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 14:33:59.290822 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287908    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 14:33:59.290822 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287912    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 14:33:59.290822 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287915    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 14:33:59.290822 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287918    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 14:33:59.290822 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287921    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 14:33:59.290822 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287925    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 14:33:59.290822 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287928    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 14:33:59.290822 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287931    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 14:33:59.290822 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287934    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 14:33:59.290822 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287937    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 14:33:59.290822 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287940    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 14:33:59.290822 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287943    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 14:33:59.290822 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287945    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 14:33:59.290822 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287948    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 14:33:59.290822 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287952    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 14:33:59.290822 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287955    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 14:33:59.290822 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287958    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 14:33:59.290822 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287960    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 14:33:59.290822 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287964    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 14:33:59.291275 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287967    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 14:33:59.291275 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287970    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 14:33:59.291275 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287973    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 14:33:59.291275 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287975    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 14:33:59.291275 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287979    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 14:33:59.291275 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287982    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 14:33:59.291275 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287984    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 14:33:59.291275 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287988    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 14:33:59.291275 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287990    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 14:33:59.291275 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287993    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 14:33:59.291275 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287996    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 14:33:59.291275 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.287999    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 14:33:59.291275 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288001    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 14:33:59.291275 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288003    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 14:33:59.291275 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288006    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 14:33:59.291275 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288008    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 14:33:59.291275 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288011    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 14:33:59.291275 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288013    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 14:33:59.291275 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288016    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 14:33:59.291275 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288019    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 14:33:59.291782 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288021    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 14:33:59.291782 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288024    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 14:33:59.291782 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288026    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 14:33:59.291782 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288029    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 14:33:59.291782 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288032    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 14:33:59.291782 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288034    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 14:33:59.291782 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288037    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 14:33:59.291782 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288039    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 14:33:59.291782 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288042    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 14:33:59.291782 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288044    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 14:33:59.291782 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288047    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 14:33:59.291782 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288049    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 14:33:59.291782 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288052    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 14:33:59.291782 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288055    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 14:33:59.291782 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288057    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 14:33:59.291782 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288059    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 14:33:59.291782 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288062    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 14:33:59.291782 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288065    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 14:33:59.291782 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288067    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 14:33:59.291782 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288070    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 14:33:59.292297 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288072    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 14:33:59.292297 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288075    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 14:33:59.292297 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288077    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 14:33:59.292297 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288080    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 14:33:59.292297 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288083    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 14:33:59.292297 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288085    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 14:33:59.292297 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288088    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 14:33:59.292297 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288090    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 14:33:59.292297 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288093    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 14:33:59.292297 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288096    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 14:33:59.292297 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288098    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 14:33:59.292297 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288101    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 14:33:59.292297 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288103    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 14:33:59.292297 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288106    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 14:33:59.292297 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288108    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 14:33:59.292297 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288111    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 14:33:59.292297 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288113    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 14:33:59.292297 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288115    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 14:33:59.292297 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288118    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 14:33:59.292297 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288120    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 14:33:59.292807 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288123    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 14:33:59.292807 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288207    2577 flags.go:64] FLAG: --address="0.0.0.0"
Sep 08 14:33:59.292807 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288257    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 08 14:33:59.292807 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288267    2577 flags.go:64] FLAG: --anonymous-auth="true"
Sep 08 14:33:59.292807 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288271    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 08 14:33:59.292807 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288277    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 08 14:33:59.292807 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288280    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 08 14:33:59.292807 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288285    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 08 14:33:59.292807 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288289    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 08 14:33:59.292807 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288293    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 08 14:33:59.292807 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288295    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 08 14:33:59.292807 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288299    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 08 14:33:59.292807 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288302    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 08 14:33:59.292807 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288305    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 08 14:33:59.292807 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288308    2577 flags.go:64] FLAG: --cgroup-root=""
Sep 08 14:33:59.292807 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288311    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 08 14:33:59.292807 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288313    2577 flags.go:64] FLAG: --client-ca-file=""
Sep 08 14:33:59.292807 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288316    2577 flags.go:64] FLAG: --cloud-provider="external"
Sep 08 14:33:59.292807 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288319    2577 flags.go:64] FLAG: --cluster-dns="[]"
Sep 08 14:33:59.292807 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288327    2577 flags.go:64] FLAG: --cluster-domain=""
Sep 08 14:33:59.292807 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288330    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 08 14:33:59.292807 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288333    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 08 14:33:59.292807 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288336    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 08 14:33:59.292807 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288339    2577 flags.go:64] FLAG: --container-log-max-files="5"
Sep 08 14:33:59.293380 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288343    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 08 14:33:59.293380 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288345    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 08 14:33:59.293380 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288348    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 08 14:33:59.293380 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288351    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 08 14:33:59.293380 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288354    2577 flags.go:64] FLAG: --contention-profiling="false"
Sep 08 14:33:59.293380 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288357    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 08 14:33:59.293380 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288360    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 08 14:33:59.293380 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288363    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 08 14:33:59.293380 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288366    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 08 14:33:59.293380 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288370    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 08 14:33:59.293380 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288373    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 08 14:33:59.293380 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288375    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 08 14:33:59.293380 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288378    2577 flags.go:64] FLAG: --enable-load-reader="false"
Sep 08 14:33:59.293380 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288380    2577 flags.go:64] FLAG: --enable-server="true"
Sep 08 14:33:59.293380 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288390    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 08 14:33:59.293380 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288396    2577 flags.go:64] FLAG: --event-burst="100"
Sep 08 14:33:59.293380 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288401    2577 flags.go:64] FLAG: --event-qps="50"
Sep 08 14:33:59.293380 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288404    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 08 14:33:59.293380 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288407    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 08 14:33:59.293380 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288410    2577 flags.go:64] FLAG: --eviction-hard=""
Sep 08 14:33:59.293380 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288414    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 08 14:33:59.293380 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288416    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 08 14:33:59.293380 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288419    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 08 14:33:59.293380 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288422    2577 flags.go:64] FLAG: --eviction-soft=""
Sep 08 14:33:59.293380 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288425    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 08 14:33:59.293980 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288428    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 08 14:33:59.293980 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288431    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 08 14:33:59.293980 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288435    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 08 14:33:59.293980 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288437    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 08 14:33:59.293980 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288440    2577 flags.go:64] FLAG: --fail-swap-on="true"
Sep 08 14:33:59.293980 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288443    2577 flags.go:64] FLAG: --feature-gates=""
Sep 08 14:33:59.293980 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288447    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 08 14:33:59.293980 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288450    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 08 14:33:59.293980 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288453    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 08 14:33:59.293980 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288456    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 08 14:33:59.293980 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288458    2577 flags.go:64] FLAG: --healthz-port="10248"
Sep 08 14:33:59.293980 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288461    2577 flags.go:64] FLAG: --help="false"
Sep 08 14:33:59.293980 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288477    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-142-20.ec2.internal"
Sep 08 14:33:59.293980 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288480    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 08 14:33:59.293980 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288483    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 08 14:33:59.293980 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288486    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 08 14:33:59.293980 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288490    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 08 14:33:59.293980 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288493    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 08 14:33:59.293980 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288496    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 08 14:33:59.293980 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288498    2577 flags.go:64] FLAG: --image-service-endpoint=""
Sep 08 14:33:59.293980 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288501    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 08 14:33:59.293980 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288504    2577 flags.go:64] FLAG: --kube-api-burst="100"
Sep 08 14:33:59.293980 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288512    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 08 14:33:59.294627 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288517    2577 flags.go:64] FLAG: --kube-api-qps="50"
Sep 08 14:33:59.294627 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288520    2577 flags.go:64] FLAG: --kube-reserved=""
Sep 08 14:33:59.294627 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288523    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 08 14:33:59.294627 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288525    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 08 14:33:59.294627 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288528    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 08 14:33:59.294627 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288531    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 08 14:33:59.294627 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288534    2577 flags.go:64] FLAG: --lock-file=""
Sep 08 14:33:59.294627 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288537    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 08 14:33:59.294627 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288540    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 08 14:33:59.294627 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288543    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 08 14:33:59.294627 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288548    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 08 14:33:59.294627 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288553    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 08 14:33:59.294627 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288556    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 08 14:33:59.294627 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288559    2577 flags.go:64] FLAG: --logging-format="text"
Sep 08 14:33:59.294627 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288561    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 08 14:33:59.294627 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288565    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 08 14:33:59.294627 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288567    2577 flags.go:64] FLAG: --manifest-url=""
Sep 08 14:33:59.294627 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288570    2577 flags.go:64] FLAG: --manifest-url-header=""
Sep 08 14:33:59.294627 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288574    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 08 14:33:59.294627 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288577    2577 flags.go:64] FLAG: --max-open-files="1000000"
Sep 08 14:33:59.294627 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288581    2577 flags.go:64] FLAG: --max-pods="110"
Sep 08 14:33:59.294627 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288584    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 08 14:33:59.294627 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288586    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 08 14:33:59.294627 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288589    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 08 14:33:59.294627 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288592    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 08 14:33:59.295246 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288595    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 08 14:33:59.295246 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288598    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 08 14:33:59.295246 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288600    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 08 14:33:59.295246 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288608    2577 flags.go:64] FLAG: --node-status-max-images="50"
Sep 08 14:33:59.295246 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288611    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 08 14:33:59.295246 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288613    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 08 14:33:59.295246 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288616    2577 flags.go:64] FLAG: --pod-cidr=""
Sep 08 14:33:59.295246 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288626    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 08 14:33:59.295246 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288631    2577 flags.go:64] FLAG: --pod-manifest-path=""
Sep 08 14:33:59.295246 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288634    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 08 14:33:59.295246 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288637    2577 flags.go:64] FLAG: --pods-per-core="0"
Sep 08 14:33:59.295246 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288640    2577 flags.go:64] FLAG: --port="10250"
Sep 08 14:33:59.295246 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288643    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 08 14:33:59.295246 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288646    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-039a6063d75a9387f"
Sep 08 14:33:59.295246 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288648    2577 flags.go:64] FLAG: --qos-reserved=""
Sep 08 14:33:59.295246 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288651    2577 flags.go:64] FLAG: --read-only-port="10255"
Sep 08 14:33:59.295246 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288654    2577 flags.go:64] FLAG: --register-node="true"
Sep 08 14:33:59.295246 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288657    2577 flags.go:64] FLAG: --register-with-taints=""
Sep 08 14:33:59.295246 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288662    2577 flags.go:64] FLAG: --registry-burst="10"
Sep 08 14:33:59.295246 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288664    2577 flags.go:64] FLAG: --registry-qps="5"
Sep 08 14:33:59.295246 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288667    2577 flags.go:64] FLAG: --reserved-cpus=""
Sep 08 14:33:59.295246 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288670    2577 flags.go:64] FLAG: --reserved-memory=""
Sep 08 14:33:59.295246 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288673    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 08 14:33:59.295246 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288676    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 08 14:33:59.295246 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288679    2577 flags.go:64] FLAG: --rotate-certificates="false"
Sep 08 14:33:59.295896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288682    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 08 14:33:59.295896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288684    2577 flags.go:64] FLAG: --runonce="false"
Sep 08 14:33:59.295896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288687    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 08 14:33:59.295896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288690    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 08 14:33:59.295896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288693    2577 flags.go:64] FLAG: --seccomp-default="false"
Sep 08 14:33:59.295896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288696    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 08 14:33:59.295896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288699    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 08 14:33:59.295896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288701    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 08 14:33:59.295896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288704    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 08 14:33:59.295896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288707    2577 flags.go:64] FLAG: --storage-driver-password="root"
Sep 08 14:33:59.295896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288710    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 08 14:33:59.295896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288713    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 08 14:33:59.295896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288715    2577 flags.go:64] FLAG: --storage-driver-user="root"
Sep 08 14:33:59.295896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288718    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 08 14:33:59.295896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288721    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 08 14:33:59.295896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288726    2577 flags.go:64] FLAG: --system-cgroups=""
Sep 08 14:33:59.295896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288729    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 08 14:33:59.295896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288734    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 08 14:33:59.295896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288736    2577 flags.go:64] FLAG: --tls-cert-file=""
Sep 08 14:33:59.295896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288739    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 08 14:33:59.295896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288743    2577 flags.go:64] FLAG: --tls-min-version=""
Sep 08 14:33:59.295896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288746    2577 flags.go:64] FLAG: --tls-private-key-file=""
Sep 08 14:33:59.295896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288748    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 08 14:33:59.295896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288751    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 08 14:33:59.295896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288754    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 08 14:33:59.296720 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288758    2577 flags.go:64] FLAG: --v="2"
Sep 08 14:33:59.296720 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288762    2577 flags.go:64] FLAG: --version="false"
Sep 08 14:33:59.296720 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288766    2577 flags.go:64] FLAG: --vmodule=""
Sep 08 14:33:59.296720 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288769    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 08 14:33:59.296720 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.288772    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 08 14:33:59.296720 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288906    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 14:33:59.296720 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288911    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 14:33:59.296720 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288914    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 14:33:59.296720 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288917    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 14:33:59.296720 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288920    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 14:33:59.296720 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288923    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 14:33:59.296720 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288928    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 14:33:59.296720 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288931    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 14:33:59.296720 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288934    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 14:33:59.296720 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288937    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 14:33:59.296720 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288940    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 14:33:59.296720 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288943    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 14:33:59.296720 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288946    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 14:33:59.296720 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288948    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 14:33:59.296720 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288951    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 14:33:59.296720 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288953    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 14:33:59.297652 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288956    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 14:33:59.297652 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288959    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 14:33:59.297652 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288967    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 14:33:59.297652 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288970    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 14:33:59.297652 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288973    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 14:33:59.297652 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288975    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 14:33:59.297652 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288978    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 14:33:59.297652 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288980    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 14:33:59.297652 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288983    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 14:33:59.297652 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288985    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 14:33:59.297652 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288988    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 14:33:59.297652 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288991    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 14:33:59.297652 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288994    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 14:33:59.297652 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288996    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 14:33:59.297652 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.288999    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 14:33:59.297652 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289001    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 14:33:59.297652 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289004    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 14:33:59.297652 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289006    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 14:33:59.297652 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289009    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 14:33:59.297652 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289011    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 14:33:59.298496 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289013    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 14:33:59.298496 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289016    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 14:33:59.298496 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289018    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 14:33:59.298496 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289021    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 14:33:59.298496 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289023    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 14:33:59.298496 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289031    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 14:33:59.298496 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289034    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 14:33:59.298496 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289036    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 14:33:59.298496 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289038    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 14:33:59.298496 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289041    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 14:33:59.298496 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289043    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 14:33:59.298496 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289045    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 14:33:59.298496 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289048    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 14:33:59.298496 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289052    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 14:33:59.298496 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289054    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 14:33:59.298496 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289062    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 14:33:59.298496 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289065    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 14:33:59.298496 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289068    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 14:33:59.298496 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289070    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 14:33:59.298496 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289073    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 14:33:59.299120 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289076    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 14:33:59.299120 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289078    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 14:33:59.299120 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289081    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 14:33:59.299120 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289084    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 14:33:59.299120 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289086    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 14:33:59.299120 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289088    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 14:33:59.299120 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289091    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 14:33:59.299120 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289094    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 14:33:59.299120 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289096    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 14:33:59.299120 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289099    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 14:33:59.299120 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289101    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 14:33:59.299120 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289104    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 14:33:59.299120 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289106    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 14:33:59.299120 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289108    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 14:33:59.299120 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289111    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 14:33:59.299120 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289114    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 14:33:59.299120 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289118    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 14:33:59.299120 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289120    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 14:33:59.299120 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289123    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 14:33:59.299618 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289125    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 14:33:59.299618 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289128    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 14:33:59.299618 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289131    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 14:33:59.299618 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289135    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 14:33:59.299618 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289138    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 14:33:59.299618 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289141    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 14:33:59.299618 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289145    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 14:33:59.299618 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289148    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 14:33:59.299618 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289150    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 14:33:59.299618 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289159    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 14:33:59.299618 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289162    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 14:33:59.299618 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289165    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 14:33:59.299618 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289167    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 14:33:59.299618 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289170    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 14:33:59.299618 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289172    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 14:33:59.299618 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289175    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 14:33:59.299618 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289177    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 14:33:59.299618 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289180    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 14:33:59.299618 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289182    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 14:33:59.300456 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289185    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 14:33:59.300456 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289188    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 14:33:59.300456 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289199    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 14:33:59.300456 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289201    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 14:33:59.300456 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.289204    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 14:33:59.300456 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.289941    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 14:33:59.300456 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.298763    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 08 14:33:59.300456 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.298781    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 08 14:33:59.300456 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.299698    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 08 14:33:59.300456 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.299711    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 08 14:33:59.300456 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299805    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 14:33:59.300456 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299813    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 14:33:59.300456 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299817    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 14:33:59.300456 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299822    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 14:33:59.300456 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299826    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 14:33:59.301145 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299831    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 14:33:59.301145 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299835    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 14:33:59.301145 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299839    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 14:33:59.301145 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299844    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 14:33:59.301145 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299848    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 14:33:59.301145 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299852    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 14:33:59.301145 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299856    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 14:33:59.301145 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299861    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 14:33:59.301145 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299866    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 14:33:59.301145 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299870    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 14:33:59.301145 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299874    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 14:33:59.301145 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299878    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 14:33:59.301145 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299882    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 14:33:59.301145 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299886    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 14:33:59.301145 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299890    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 14:33:59.301145 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299894    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 14:33:59.301145 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299899    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 14:33:59.301145 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299903    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 14:33:59.301145 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299907    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 14:33:59.301665 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299911    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 14:33:59.301665 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299915    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 14:33:59.301665 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299919    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 14:33:59.301665 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299923    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 14:33:59.301665 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299927    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 14:33:59.301665 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299932    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 14:33:59.301665 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299936    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 14:33:59.301665 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299940    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 14:33:59.301665 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299947    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 14:33:59.301665 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299952    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 14:33:59.301665 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299957    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 14:33:59.301665 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299962    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 14:33:59.301665 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299967    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 14:33:59.301665 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299971    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 14:33:59.301665 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299975    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 14:33:59.301665 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299979    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 14:33:59.301665 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299984    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 14:33:59.301665 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299988    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 14:33:59.301665 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299992    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 14:33:59.301665 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.299996    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 14:33:59.302239 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300000    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 14:33:59.302239 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300006    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 14:33:59.302239 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300011    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 14:33:59.302239 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300017    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 14:33:59.302239 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300024    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 14:33:59.302239 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300031    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 14:33:59.302239 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300035    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 14:33:59.302239 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300039    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 14:33:59.302239 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300043    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 14:33:59.302239 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300047    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 14:33:59.302239 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300052    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 14:33:59.302239 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300056    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 14:33:59.302239 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300060    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 14:33:59.302239 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300064    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 14:33:59.302239 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300068    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 14:33:59.302239 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300072    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 14:33:59.302239 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300076    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 14:33:59.302239 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300081    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 14:33:59.302239 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300085    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 14:33:59.302707 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300089    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 14:33:59.302707 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300093    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 14:33:59.302707 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300097    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 14:33:59.302707 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300101    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 14:33:59.302707 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300105    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 14:33:59.302707 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300109    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 14:33:59.302707 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300113    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 14:33:59.302707 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300117    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 14:33:59.302707 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300121    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 14:33:59.302707 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300125    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 14:33:59.302707 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300129    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 14:33:59.302707 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300133    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 14:33:59.302707 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300137    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 14:33:59.302707 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300141    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 14:33:59.302707 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300145    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 14:33:59.302707 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300150    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 14:33:59.302707 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300154    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 14:33:59.302707 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300159    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 14:33:59.302707 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300163    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 14:33:59.302707 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300166    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 14:33:59.303404 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300170    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 14:33:59.303404 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300174    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 14:33:59.303404 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300178    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 14:33:59.303404 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300181    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 14:33:59.303404 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300185    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 14:33:59.303404 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300189    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 14:33:59.303404 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300193    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 14:33:59.303404 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300197    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 14:33:59.303404 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300200    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 14:33:59.303404 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300205    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 14:33:59.303404 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300209    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 14:33:59.303404 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300213    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 14:33:59.303404 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300218    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 14:33:59.303404 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300223    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 14:33:59.303404 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300227    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 14:33:59.303404 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300232    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 14:33:59.304106 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.300240    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 14:33:59.304106 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300430    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 14:33:59.304106 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300438    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 14:33:59.304106 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300443    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 14:33:59.304106 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300447    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 14:33:59.304106 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300452    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 14:33:59.304106 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300455    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 14:33:59.304106 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300459    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 14:33:59.304106 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300484    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 14:33:59.304106 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300489    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 14:33:59.304106 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300493    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 14:33:59.304106 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300498    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 14:33:59.304106 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300502    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 14:33:59.304106 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300506    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 14:33:59.304106 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300510    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 14:33:59.304648 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300514    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 14:33:59.304648 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300518    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 14:33:59.304648 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300522    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 14:33:59.304648 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300526    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 14:33:59.304648 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300530    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 14:33:59.304648 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300534    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 14:33:59.304648 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300539    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 14:33:59.304648 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300543    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 14:33:59.304648 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300546    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 14:33:59.304648 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300552    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 14:33:59.304648 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300559    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 14:33:59.304648 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300563    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 14:33:59.304648 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300568    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 14:33:59.304648 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300572    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 14:33:59.304648 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300577    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 14:33:59.304648 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300582    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 14:33:59.304648 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300586    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 14:33:59.304648 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300590    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 14:33:59.304648 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300594    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 14:33:59.305149 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300598    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 14:33:59.305149 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300602    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 14:33:59.305149 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300607    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 14:33:59.305149 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300613    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 14:33:59.305149 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300618    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 14:33:59.305149 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300622    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 14:33:59.305149 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300626    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 14:33:59.305149 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300630    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 14:33:59.305149 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300634    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 14:33:59.305149 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300638    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 14:33:59.305149 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300642    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 14:33:59.305149 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300646    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 14:33:59.305149 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300651    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 14:33:59.305149 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300655    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 14:33:59.305149 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300659    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 14:33:59.305149 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300663    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 14:33:59.305149 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300667    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 14:33:59.305149 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300671    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 14:33:59.305149 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300675    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 14:33:59.305149 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300679    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 14:33:59.305762 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300683    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 14:33:59.305762 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300687    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 14:33:59.305762 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300691    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 14:33:59.305762 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300695    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 14:33:59.305762 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300699    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 14:33:59.305762 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300704    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 14:33:59.305762 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300709    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 14:33:59.305762 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300713    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 14:33:59.305762 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300717    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 14:33:59.305762 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300721    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 14:33:59.305762 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300725    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 14:33:59.305762 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300730    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 14:33:59.305762 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300734    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 14:33:59.305762 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300738    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 14:33:59.305762 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300742    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 14:33:59.305762 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300746    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 14:33:59.305762 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300750    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 14:33:59.305762 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300754    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 14:33:59.305762 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300759    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 14:33:59.305762 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300763    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 14:33:59.306247 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300767    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 14:33:59.306247 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300771    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 14:33:59.306247 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300781    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 14:33:59.306247 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300786    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 14:33:59.306247 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300791    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 14:33:59.306247 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300795    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 14:33:59.306247 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300799    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 14:33:59.306247 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300803    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 14:33:59.306247 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300807    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 14:33:59.306247 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300811    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 14:33:59.306247 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300815    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 14:33:59.306247 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300819    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 14:33:59.306247 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300824    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 14:33:59.306247 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300828    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 14:33:59.306247 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300832    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 14:33:59.306247 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300835    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 14:33:59.306247 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300839    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 14:33:59.306247 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300844    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 14:33:59.306247 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300848    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 14:33:59.306247 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300852    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 14:33:59.306815 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300856    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 14:33:59.306815 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300860    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 14:33:59.306815 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300864    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 14:33:59.306815 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300868    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 14:33:59.306815 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300873    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 14:33:59.306815 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:33:59.300879    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 14:33:59.306815 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.300887    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 14:33:59.306815 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.301034    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 08 14:33:59.306815 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.305190    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 08 14:33:59.306815 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.306303    2577 server.go:1019] "Starting client certificate rotation"
Sep 08 14:33:59.306815 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.306408    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 14:33:59.306815 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.306437    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 14:33:59.309112 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.309095    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 14:33:59.312923 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.312905    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 14:33:59.325773 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.325753    2577 log.go:25] "Validated CRI v1 runtime API"
Sep 08 14:33:59.329060 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.329042    2577 log.go:25] "Validated CRI v1 image API"
Sep 08 14:33:59.329973 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.329957    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 08 14:33:59.334916 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.334891    2577 fs.go:135] Filesystem UUIDs: map[302dc463-4490-421d-8734-a98d0505ae0a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a7dac576-7bec-4048-acec-ac01993eb4e9:/dev/nvme0n1p4]
Sep 08 14:33:59.334968 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.334917    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 08 14:33:59.339996 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.339894    2577 manager.go:216] Machine: {Timestamp:2026-09-08 14:33:59.338550291 +0000 UTC m=+0.376951205 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102200 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e4e9217ccf6a275ced0a616dabc45 SystemUUID:ec2e4e92-17cc-f6a2-75ce-d0a616dabc45 BootID:03d487c2-d094-4c7e-8e3d-a99a507e201b Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7b:8a:e9:61:eb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7b:8a:e9:61:eb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:dc:ac:a1:94:9f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 08 14:33:59.339996 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.339994    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 08 14:33:59.340106 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.340072    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 08 14:33:59.341946 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.341932    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 14:33:59.343647 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.343624    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 08 14:33:59.343786 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.343650    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-20.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 08 14:33:59.344496 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.344486    2577 topology_manager.go:138] "Creating topology manager with none policy"
Sep 08 14:33:59.344528 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.344499    2577 container_manager_linux.go:309] "Creating device plugin manager"
Sep 08 14:33:59.344528 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.344507    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 14:33:59.345314 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.345303    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 14:33:59.347171 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.347162    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 08 14:33:59.352741 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.352729    2577 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 14:33:59.352877 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.352867    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 08 14:33:59.352908 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.352897    2577 kubelet.go:486] "Attempting to sync node with API server"
Sep 08 14:33:59.352940 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.352917    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 08 14:33:59.352940 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.352938    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 08 14:33:59.353008 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.352950    2577 kubelet.go:398] "Adding apiserver pod source"
Sep 08 14:33:59.353008 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.352963    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 08 14:33:59.353301 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.353290    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 14:33:59.353332 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.353308    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 14:33:59.355791 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.355771    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 08 14:33:59.358623 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.358610    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 08 14:33:59.358695 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.358647    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 08 14:33:59.359552 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.359539    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 08 14:33:59.359595 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.359558    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 08 14:33:59.359595 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.359565    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 08 14:33:59.359595 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.359570    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 08 14:33:59.359595 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.359579    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 08 14:33:59.359595 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.359585    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 08 14:33:59.359729 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.359604    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 08 14:33:59.359729 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.359610    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 08 14:33:59.359729 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.359616    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 08 14:33:59.359729 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.359621    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 08 14:33:59.359729 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.359633    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 08 14:33:59.359729 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.359639    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 08 14:33:59.360568 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.360557    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 08 14:33:59.360568 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.360567    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 08 14:33:59.364546 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.364519    2577 server.go:1268] "Started kubelet"
Sep 08 14:33:59.364622 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.364582    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 08 14:33:59.364690 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.364608    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 08 14:33:59.364737 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.364688    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 08 14:33:59.365245 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.365226    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-20.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 08 14:33:59.365303 ip-10-0-142-20 systemd[1]: Started Kubernetes Kubelet.
Sep 08 14:33:59.365974 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:33:59.365726    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 08 14:33:59.365974 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:33:59.365797    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-20.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 08 14:33:59.369028 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.368942    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 08 14:33:59.369970 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.369950    2577 server.go:310] "Adding debug handlers to kubelet server"
Sep 08 14:33:59.372060 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:33:59.372024    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 08 14:33:59.373801 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:33:59.372704    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-20.ec2.internal.18d35f1952d14f38  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-20.ec2.internal,UID:ip-10-0-142-20.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-20.ec2.internal,},FirstTimestamp:2026-09-08 14:33:59.364489016 +0000 UTC m=+0.402889934,LastTimestamp:2026-09-08 14:33:59.364489016 +0000 UTC m=+0.402889934,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-20.ec2.internal,}"
Sep 08 14:33:59.374839 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.374650    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 08 14:33:59.375510 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.375443    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 08 14:33:59.375636 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:33:59.375617    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-20.ec2.internal\" not found"
Sep 08 14:33:59.376313 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.376258    2577 factory.go:55] Registering systemd factory
Sep 08 14:33:59.376313 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.376279    2577 factory.go:223] Registration of the systemd container factory successfully
Sep 08 14:33:59.376313 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.376318    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 08 14:33:59.376313 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.376335    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 08 14:33:59.376661 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.376440    2577 reconstruct.go:97] "Volume reconstruction finished"
Sep 08 14:33:59.376661 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.376448    2577 reconciler.go:29] "Reconciler: start to sync state"
Sep 08 14:33:59.376661 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.376498    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 08 14:33:59.376661 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.376558    2577 factory.go:153] Registering CRI-O factory
Sep 08 14:33:59.376661 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.376571    2577 factory.go:223] Registration of the crio container factory successfully
Sep 08 14:33:59.376661 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.376609    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 08 14:33:59.376661 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.376626    2577 factory.go:103] Registering Raw factory
Sep 08 14:33:59.376661 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.376635    2577 manager.go:1196] Started watching for new ooms in manager
Sep 08 14:33:59.377714 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.377697    2577 manager.go:349] Starting recovery of all containers
Sep 08 14:33:59.385257 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:33:59.385235    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 08 14:33:59.385345 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:33:59.385278    2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-20.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 08 14:33:59.387061 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.387045    2577 manager.go:354] Recovery completed
Sep 08 14:33:59.391309 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.391297    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:33:59.393245 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.393222    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-20.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:33:59.393323 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.393258    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-20.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:33:59.393323 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.393269    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-20.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:33:59.393903 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.393888    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 08 14:33:59.393903 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.393899    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 08 14:33:59.394038 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.393917    2577 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 14:33:59.394038 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.393934    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:33:59.394736 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.394723    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-20.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:33:59.394786 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.394748    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-20.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:33:59.394786 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.394757    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-20.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:33:59.396080 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.396064    2577 policy_none.go:49] "None policy: Start"
Sep 08 14:33:59.396080 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.396083    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 08 14:33:59.396168 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.396093    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 08 14:33:59.396977 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.396963    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fps8h"
Sep 08 14:33:59.398018 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.398007    2577 policy_none.go:47] "Start"
Sep 08 14:33:59.405008 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:33:59.404942    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-20.ec2.internal.18d35f195488162b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-20.ec2.internal,UID:ip-10-0-142-20.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-20.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-20.ec2.internal,},FirstTimestamp:2026-09-08 14:33:59.393244715 +0000 UTC m=+0.431645629,LastTimestamp:2026-09-08 14:33:59.393244715 +0000 UTC m=+0.431645629,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-20.ec2.internal,}"
Sep 08 14:33:59.409216 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.409090    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fps8h"
Sep 08 14:33:59.438901 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.438884    2577 manager.go:337] "Starting Device Plugin manager"
Sep 08 14:33:59.438984 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:33:59.438926    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 08 14:33:59.438984 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.438939    2577 server.go:87] "Starting device plugin registration server"
Sep 08 14:33:59.439194 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.439180    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 08 14:33:59.439251 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.439195    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 08 14:33:59.439296 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.439266    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 08 14:33:59.439347 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.439337    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 08 14:33:59.439389 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.439346    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 08 14:33:59.439946 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:33:59.439900    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 08 14:33:59.440030 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:33:59.439955    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-20.ec2.internal\" not found"
Sep 08 14:33:59.482576 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.482543    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 08 14:33:59.484833 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.483863    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 08 14:33:59.484833 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.483917    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 08 14:33:59.484833 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.483941    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 08 14:33:59.484833 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:33:59.483983    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 08 14:33:59.486595 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.486577    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 14:33:59.539764 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.539686    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:33:59.542481 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.542445    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-20.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:33:59.542560 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.542507    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-20.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:33:59.542560 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.542520    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-20.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:33:59.542560 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.542544    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-20.ec2.internal"
Sep 08 14:33:59.556627 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.556605    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-20.ec2.internal"
Sep 08 14:33:59.556627 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:33:59.556628    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-20.ec2.internal\": node \"ip-10-0-142-20.ec2.internal\" not found"
Sep 08 14:33:59.584647 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.584625    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-20.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-20.ec2.internal"]
Sep 08 14:33:59.584717 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.584679    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:33:59.586170 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.586154    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-20.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:33:59.586236 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.586183    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-20.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:33:59.586236 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.586196    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-20.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:33:59.588557 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.588545    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:33:59.588664 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.588651    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-20.ec2.internal"
Sep 08 14:33:59.588702 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.588688    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:33:59.589269 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.589254    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-20.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:33:59.589333 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.589278    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-20.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:33:59.589333 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.589291    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-20.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:33:59.589333 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.589305    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-20.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:33:59.589333 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.589327    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-20.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:33:59.589485 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.589339    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-20.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:33:59.591579 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.591564    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-20.ec2.internal"
Sep 08 14:33:59.591645 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.591595    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:33:59.591645 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:33:59.591603    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-20.ec2.internal\" not found"
Sep 08 14:33:59.592278 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.592262    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-20.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:33:59.592350 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.592290    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-20.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:33:59.592350 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.592302    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-20.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:33:59.605010 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:33:59.604988    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-20.ec2.internal\" not found" node="ip-10-0-142-20.ec2.internal"
Sep 08 14:33:59.608255 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:33:59.608238    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-20.ec2.internal\" not found" node="ip-10-0-142-20.ec2.internal"
Sep 08 14:33:59.678031 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.678005    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dc403cc24af90cbf61a5edf297685b42-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-20.ec2.internal\" (UID: \"dc403cc24af90cbf61a5edf297685b42\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-20.ec2.internal"
Sep 08 14:33:59.678031 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.678032    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc403cc24af90cbf61a5edf297685b42-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-20.ec2.internal\" (UID: \"dc403cc24af90cbf61a5edf297685b42\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-20.ec2.internal"
Sep 08 14:33:59.678165 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.678093    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e0bff5a7795653f306d187693d0b9c36-config\") pod \"kube-apiserver-proxy-ip-10-0-142-20.ec2.internal\" (UID: \"e0bff5a7795653f306d187693d0b9c36\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-20.ec2.internal"
Sep 08 14:33:59.691899 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:33:59.691881    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-20.ec2.internal\" not found"
Sep 08 14:33:59.779225 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.779197    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dc403cc24af90cbf61a5edf297685b42-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-20.ec2.internal\" (UID: \"dc403cc24af90cbf61a5edf297685b42\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-20.ec2.internal"
Sep 08 14:33:59.779313 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.779227    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc403cc24af90cbf61a5edf297685b42-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-20.ec2.internal\" (UID: \"dc403cc24af90cbf61a5edf297685b42\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-20.ec2.internal"
Sep 08 14:33:59.779313 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.779247    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e0bff5a7795653f306d187693d0b9c36-config\") pod \"kube-apiserver-proxy-ip-10-0-142-20.ec2.internal\" (UID: \"e0bff5a7795653f306d187693d0b9c36\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-20.ec2.internal"
Sep 08 14:33:59.779313 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.779297    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc403cc24af90cbf61a5edf297685b42-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-20.ec2.internal\" (UID: \"dc403cc24af90cbf61a5edf297685b42\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-20.ec2.internal"
Sep 08 14:33:59.779401 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.779304    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dc403cc24af90cbf61a5edf297685b42-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-20.ec2.internal\" (UID: \"dc403cc24af90cbf61a5edf297685b42\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-20.ec2.internal"
Sep 08 14:33:59.779401 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.779347    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e0bff5a7795653f306d187693d0b9c36-config\") pod \"kube-apiserver-proxy-ip-10-0-142-20.ec2.internal\" (UID: \"e0bff5a7795653f306d187693d0b9c36\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-20.ec2.internal"
Sep 08 14:33:59.792330 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:33:59.792283    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-20.ec2.internal\" not found"
Sep 08 14:33:59.893033 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:33:59.893003    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-20.ec2.internal\" not found"
Sep 08 14:33:59.908190 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.908172    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-20.ec2.internal"
Sep 08 14:33:59.911294 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:33:59.911280    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-20.ec2.internal"
Sep 08 14:33:59.993722 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:33:59.993692    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-20.ec2.internal\" not found"
Sep 08 14:34:00.094290 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:00.094228    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-20.ec2.internal\" not found"
Sep 08 14:34:00.194812 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:00.194782    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-20.ec2.internal\" not found"
Sep 08 14:34:00.295352 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:00.295321    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-20.ec2.internal\" not found"
Sep 08 14:34:00.306510 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:00.306485    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 08 14:34:00.306663 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:00.306646    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 14:34:00.395574 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:00.395513    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-20.ec2.internal\" not found"
Sep 08 14:34:00.412689 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:00.412652    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 14:28:59 +0000 UTC" deadline="2028-03-04 15:08:45.516449079 +0000 UTC"
Sep 08 14:34:00.412822 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:00.412682    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13032h34m45.103771696s"
Sep 08 14:34:00.424825 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:00.424805    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:34:00.426404 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:00.426388    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-20.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:34:00.426404 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:00.426419    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-20.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:34:00.426404 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:00.426428    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-20.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:34:00.496083 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:00.496047    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-20.ec2.internal\" not found"
Sep 08 14:34:00.548919 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:00.548890    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 14:34:00.596476 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:00.596445    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-20.ec2.internal\" not found"
Sep 08 14:34:00.622683 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:34:00.622656    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc403cc24af90cbf61a5edf297685b42.slice/crio-67ae3123c043448b2a6bace925856e077f335f947c194bf03127e864f52abba2 WatchSource:0}: Error finding container 67ae3123c043448b2a6bace925856e077f335f947c194bf03127e864f52abba2: Status 404 returned error can't find the container with id 67ae3123c043448b2a6bace925856e077f335f947c194bf03127e864f52abba2
Sep 08 14:34:00.623308 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:34:00.623286    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0bff5a7795653f306d187693d0b9c36.slice/crio-64771febda73b78bcb357cce366609307f05335c158ac8b46b3d3e094ab7fb09 WatchSource:0}: Error finding container 64771febda73b78bcb357cce366609307f05335c158ac8b46b3d3e094ab7fb09: Status 404 returned error can't find the container with id 64771febda73b78bcb357cce366609307f05335c158ac8b46b3d3e094ab7fb09
Sep 08 14:34:00.627189 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:00.627176    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 14:34:00.697264 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:00.697188    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-20.ec2.internal\" not found"
Sep 08 14:34:00.797699 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:00.797669    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-20.ec2.internal\" not found"
Sep 08 14:34:00.898482 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:00.898434    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-20.ec2.internal\" not found"
Sep 08 14:34:00.940402 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:00.940379    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 14:34:00.975733 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:00.975660    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-20.ec2.internal"
Sep 08 14:34:00.976095 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:00.976073    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 14:34:00.989903 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:00.989884    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 14:34:00.990942 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:00.990921    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-20.ec2.internal"
Sep 08 14:34:01.000620 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.000598    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 14:34:01.353941 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.353861    2577 apiserver.go:52] "Watching apiserver"
Sep 08 14:34:01.363721 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.363080    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 08 14:34:01.364929 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.364891    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99cmr","openshift-cluster-node-tuning-operator/tuned-cdrwc","openshift-dns/node-resolver-mjb8g","openshift-image-registry/node-ca-g9bkm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-20.ec2.internal","openshift-multus/multus-additional-cni-plugins-bm4ll","openshift-multus/network-metrics-daemon-v6nc9","kube-system/global-pull-secret-syncer-nzr7f","kube-system/kube-apiserver-proxy-ip-10-0-142-20.ec2.internal","openshift-multus/multus-v7lbx","openshift-network-diagnostics/network-check-target-5jsdf","openshift-network-operator/iptables-alerter-d5gtp","openshift-ovn-kubernetes/ovnkube-node-trsml","kube-system/konnectivity-agent-k87z4"]
Sep 08 14:34:01.368165 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.368140    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.370480 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.370456    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.371242 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.371220    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 08 14:34:01.371614 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.371519    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 08 14:34:01.371710 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.371680    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 08 14:34:01.371710 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.371696    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 08 14:34:01.371824 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.371755    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7glpg\""
Sep 08 14:34:01.372894 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.372791    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mjb8g"
Sep 08 14:34:01.373112 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.373096    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 08 14:34:01.373153 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.373132    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 08 14:34:01.373284 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.373270    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p84wr\""
Sep 08 14:34:01.374878 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.374848    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 08 14:34:01.375220 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.375199    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k87z4"
Sep 08 14:34:01.375986 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.375768    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-r4d8f\""
Sep 08 14:34:01.376084 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.376046    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 08 14:34:01.376233 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.376218    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 08 14:34:01.377665 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.377645    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:34:01.377750 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:01.377720    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6nc9" podUID="58b796b8-809f-4e12-8fba-b018a9af00c8"
Sep 08 14:34:01.378828 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.378808    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9s9wc\""
Sep 08 14:34:01.378923 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.378832    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 08 14:34:01.378990 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.378976    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 08 14:34:01.380311 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.380031    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jsdf"
Sep 08 14:34:01.380311 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:01.380092    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jsdf" podUID="e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0"
Sep 08 14:34:01.382653 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.382639    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.385147 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.385126    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bm4ll"
Sep 08 14:34:01.385798 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.385776    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 08 14:34:01.385894 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.385862    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 08 14:34:01.386037 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.386018    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 08 14:34:01.386102 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.386072    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 08 14:34:01.386102 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.386078    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fhgpg\""
Sep 08 14:34:01.386212 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.386143    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 08 14:34:01.386212 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.386165    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 08 14:34:01.386991 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.386975    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 14:34:01.387745 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.387724    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99cmr"
Sep 08 14:34:01.387830 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.387783    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zwmt4\""
Sep 08 14:34:01.387973 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.387955    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 08 14:34:01.388308 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.388282    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 08 14:34:01.388389 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.388288    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-system-cni-dir\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.388389 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.388350    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87b4044c-c2c8-437b-b227-79fd3821df6d-cni-binary-copy\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.388389 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.388380    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-host-run-netns\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.388524 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.388405    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-host-var-lib-cni-bin\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.388524 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.388441    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-etc-sysctl-conf\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.388524 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.388500    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-var-lib-kubelet\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.388688 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.388582    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t665z\" (UniqueName: \"kubernetes.io/projected/58b796b8-809f-4e12-8fba-b018a9af00c8-kube-api-access-t665z\") pod \"network-metrics-daemon-v6nc9\" (UID: \"58b796b8-809f-4e12-8fba-b018a9af00c8\") " pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:34:01.388688 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.388643    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87b4044c-c2c8-437b-b227-79fd3821df6d-multus-daemon-config\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.388688 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.388672    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-etc-modprobe-d\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.388848 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.388696    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-etc-kubernetes\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.388848 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.388720    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46vc4\" (UniqueName: \"kubernetes.io/projected/cab4bd52-c6c1-48e1-9b14-fde47ac2dc46-kube-api-access-46vc4\") pod \"node-resolver-mjb8g\" (UID: \"cab4bd52-c6c1-48e1-9b14-fde47ac2dc46\") " pod="openshift-dns/node-resolver-mjb8g"
Sep 08 14:34:01.388848 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.388746    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-multus-cni-dir\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.388848 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.388789    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-host-run-k8s-cni-cncf-io\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.388848 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.388830    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-host-run-multus-certs\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.389098 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.388859    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc6ck\" (UniqueName: \"kubernetes.io/projected/87b4044c-c2c8-437b-b227-79fd3821df6d-kube-api-access-qc6ck\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.389098 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.388887    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-tmp\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.389098 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.388915    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-host-var-lib-kubelet\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.389098 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.388965    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-hostroot\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.389098 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.388990    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-etc-systemd\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.389098 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.389013    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cab4bd52-c6c1-48e1-9b14-fde47ac2dc46-hosts-file\") pod \"node-resolver-mjb8g\" (UID: \"cab4bd52-c6c1-48e1-9b14-fde47ac2dc46\") " pod="openshift-dns/node-resolver-mjb8g"
Sep 08 14:34:01.389098 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.389037    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cab4bd52-c6c1-48e1-9b14-fde47ac2dc46-tmp-dir\") pod \"node-resolver-mjb8g\" (UID: \"cab4bd52-c6c1-48e1-9b14-fde47ac2dc46\") " pod="openshift-dns/node-resolver-mjb8g"
Sep 08 14:34:01.389098 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.389060    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-host\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.389098 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.389084    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7hm6\" (UniqueName: \"kubernetes.io/projected/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-kube-api-access-t7hm6\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.389534 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.389107    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5ea167eb-ecbe-47f0-afca-1d0d6bccda05-agent-certs\") pod \"konnectivity-agent-k87z4\" (UID: \"5ea167eb-ecbe-47f0-afca-1d0d6bccda05\") " pod="kube-system/konnectivity-agent-k87z4"
Sep 08 14:34:01.389534 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.389146    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-host-var-lib-cni-multus\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.389534 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.389194    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-etc-sysctl-d\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.389534 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.389228    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-run\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.389534 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.389260    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-etc-tuned\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.389534 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.389284    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58b796b8-809f-4e12-8fba-b018a9af00c8-metrics-certs\") pod \"network-metrics-daemon-v6nc9\" (UID: \"58b796b8-809f-4e12-8fba-b018a9af00c8\") " pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:34:01.389534 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.389312    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-multus-socket-dir-parent\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.389534 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.389337    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-etc-sysconfig\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.389534 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.389359    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5ea167eb-ecbe-47f0-afca-1d0d6bccda05-konnectivity-ca\") pod \"konnectivity-agent-k87z4\" (UID: \"5ea167eb-ecbe-47f0-afca-1d0d6bccda05\") " pod="kube-system/konnectivity-agent-k87z4"
Sep 08 14:34:01.389534 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.389388    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-cnibin\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.389534 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.389407    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-multus-conf-dir\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.389534 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.389421    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-etc-kubernetes\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.389534 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.389445    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-sys\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.389534 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.389480    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-lib-modules\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.390428 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.390411    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d5gtp"
Sep 08 14:34:01.390888 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.390870    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 08 14:34:01.391004 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.390910    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 08 14:34:01.391298 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.391279    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 08 14:34:01.391635 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.391618    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bmhmz\""
Sep 08 14:34:01.393002 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.392982    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-985fb\""
Sep 08 14:34:01.393077 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.393006    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 08 14:34:01.393077 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.393036    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 08 14:34:01.393938 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.393917    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 08 14:34:01.394854 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.394833    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:01.394946 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:01.394903    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nzr7f" podUID="85fae7c9-a2d7-44ee-b3b6-499f4d98cf35"
Sep 08 14:34:01.397377 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.397358    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g9bkm"
Sep 08 14:34:01.399791 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.399772    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 08 14:34:01.400804 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.400703    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 08 14:34:01.400804 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.400740    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 08 14:34:01.401016 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.400998    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wbdgd\""
Sep 08 14:34:01.418918 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.418883    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bkrh9"
Sep 08 14:34:01.426014 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.425987    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bkrh9"
Sep 08 14:34:01.477848 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.477816    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 08 14:34:01.489740 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.489709    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-etc-kubernetes\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.489922 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.489752    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-sys\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.489922 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.489786    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8c833587-71d4-41e7-9ac9-a68bea4f4f79-etc-selinux\") pod \"aws-ebs-csi-driver-node-99cmr\" (UID: \"8c833587-71d4-41e7-9ac9-a68bea4f4f79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99cmr"
Sep 08 14:34:01.489922 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.489846    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-system-cni-dir\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.489922 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.489870    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87b4044c-c2c8-437b-b227-79fd3821df6d-cni-binary-copy\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.489922 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.489898    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-host-run-netns\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.489922 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.489922    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-etc-sysctl-conf\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.490264 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.489944    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-var-lib-kubelet\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.490264 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.489971    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8c833587-71d4-41e7-9ac9-a68bea4f4f79-socket-dir\") pod \"aws-ebs-csi-driver-node-99cmr\" (UID: \"8c833587-71d4-41e7-9ac9-a68bea4f4f79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99cmr"
Sep 08 14:34:01.490264 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.489995    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8c833587-71d4-41e7-9ac9-a68bea4f4f79-registration-dir\") pod \"aws-ebs-csi-driver-node-99cmr\" (UID: \"8c833587-71d4-41e7-9ac9-a68bea4f4f79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99cmr"
Sep 08 14:34:01.490264 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490021    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87b4044c-c2c8-437b-b227-79fd3821df6d-multus-daemon-config\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.490264 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490045    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-etc-modprobe-d\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.490264 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490070    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-etc-kubernetes\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.490264 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490095    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46vc4\" (UniqueName: \"kubernetes.io/projected/cab4bd52-c6c1-48e1-9b14-fde47ac2dc46-kube-api-access-46vc4\") pod \"node-resolver-mjb8g\" (UID: \"cab4bd52-c6c1-48e1-9b14-fde47ac2dc46\") " pod="openshift-dns/node-resolver-mjb8g"
Sep 08 14:34:01.490264 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490119    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-host-run-ovn-kubernetes\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.490264 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490134    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-host-run-netns\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.490264 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490142    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/85fae7c9-a2d7-44ee-b3b6-499f4d98cf35-dbus\") pod \"global-pull-secret-syncer-nzr7f\" (UID: \"85fae7c9-a2d7-44ee-b3b6-499f4d98cf35\") " pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:01.490264 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490166    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-multus-cni-dir\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.490264 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490185    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-etc-kubernetes\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.490264 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490190    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-host-run-k8s-cni-cncf-io\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.490264 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490216    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-host-run-multus-certs\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.490264 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490235    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-sys\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.490264 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490244    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-tmp\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.490999 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490285    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-run-systemd\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.490999 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490305    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-system-cni-dir\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.490999 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490311    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn2gl\" (UniqueName: \"kubernetes.io/projected/e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0-kube-api-access-fn2gl\") pod \"network-check-target-5jsdf\" (UID: \"e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0\") " pod="openshift-network-diagnostics/network-check-target-5jsdf"
Sep 08 14:34:01.490999 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490338    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-hostroot\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.490999 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490361    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-etc-systemd\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.490999 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490382    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cab4bd52-c6c1-48e1-9b14-fde47ac2dc46-hosts-file\") pod \"node-resolver-mjb8g\" (UID: \"cab4bd52-c6c1-48e1-9b14-fde47ac2dc46\") " pod="openshift-dns/node-resolver-mjb8g"
Sep 08 14:34:01.490999 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490407    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cab4bd52-c6c1-48e1-9b14-fde47ac2dc46-tmp-dir\") pod \"node-resolver-mjb8g\" (UID: \"cab4bd52-c6c1-48e1-9b14-fde47ac2dc46\") " pod="openshift-dns/node-resolver-mjb8g"
Sep 08 14:34:01.490999 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490431    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.490999 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490469    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dec62c8d-71a8-4b6c-b083-732017b99319-system-cni-dir\") pod \"multus-additional-cni-plugins-bm4ll\" (UID: \"dec62c8d-71a8-4b6c-b083-732017b99319\") " pod="openshift-multus/multus-additional-cni-plugins-bm4ll"
Sep 08 14:34:01.490999 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490494    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85fae7c9-a2d7-44ee-b3b6-499f4d98cf35-original-pull-secret\") pod \"global-pull-secret-syncer-nzr7f\" (UID: \"85fae7c9-a2d7-44ee-b3b6-499f4d98cf35\") " pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:01.490999 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490524    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7hm6\" (UniqueName: \"kubernetes.io/projected/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-kube-api-access-t7hm6\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.490999 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490574    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5ea167eb-ecbe-47f0-afca-1d0d6bccda05-agent-certs\") pod \"konnectivity-agent-k87z4\" (UID: \"5ea167eb-ecbe-47f0-afca-1d0d6bccda05\") " pod="kube-system/konnectivity-agent-k87z4"
Sep 08 14:34:01.490999 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490612    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkk2m\" (UniqueName: \"kubernetes.io/projected/52df79ef-8ace-4ac1-877c-15c9b70e7700-kube-api-access-xkk2m\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.490999 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490636    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-run\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.490999 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490662    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58b796b8-809f-4e12-8fba-b018a9af00c8-metrics-certs\") pod \"network-metrics-daemon-v6nc9\" (UID: \"58b796b8-809f-4e12-8fba-b018a9af00c8\") " pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:34:01.490999 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490688    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-multus-socket-dir-parent\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.490999 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490715    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5ea167eb-ecbe-47f0-afca-1d0d6bccda05-konnectivity-ca\") pod \"konnectivity-agent-k87z4\" (UID: \"5ea167eb-ecbe-47f0-afca-1d0d6bccda05\") " pod="kube-system/konnectivity-agent-k87z4"
Sep 08 14:34:01.491531 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490744    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/52df79ef-8ace-4ac1-877c-15c9b70e7700-ovnkube-config\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.491531 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490771    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/52df79ef-8ace-4ac1-877c-15c9b70e7700-ovn-node-metrics-cert\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.491531 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490806    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-cnibin\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.491531 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490853    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-multus-conf-dir\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.491531 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490885    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-lib-modules\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.491531 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490911    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-host-kubelet\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.491531 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490939    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqvh5\" (UniqueName: \"kubernetes.io/projected/8c833587-71d4-41e7-9ac9-a68bea4f4f79-kube-api-access-cqvh5\") pod \"aws-ebs-csi-driver-node-99cmr\" (UID: \"8c833587-71d4-41e7-9ac9-a68bea4f4f79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99cmr"
Sep 08 14:34:01.491531 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490966    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/237e7003-b821-4063-9adf-1484e76814bf-host-slash\") pod \"iptables-alerter-d5gtp\" (UID: \"237e7003-b821-4063-9adf-1484e76814bf\") " pod="openshift-network-operator/iptables-alerter-d5gtp"
Sep 08 14:34:01.491531 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.490990    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8457\" (UniqueName: \"kubernetes.io/projected/3f89e9ca-0539-4ef8-9ee4-fa19dd2e939d-kube-api-access-n8457\") pod \"node-ca-g9bkm\" (UID: \"3f89e9ca-0539-4ef8-9ee4-fa19dd2e939d\") " pod="openshift-image-registry/node-ca-g9bkm"
Sep 08 14:34:01.491531 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.491018    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-host-var-lib-cni-bin\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.491531 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.491048    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t665z\" (UniqueName: \"kubernetes.io/projected/58b796b8-809f-4e12-8fba-b018a9af00c8-kube-api-access-t665z\") pod \"network-metrics-daemon-v6nc9\" (UID: \"58b796b8-809f-4e12-8fba-b018a9af00c8\") " pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:34:01.491531 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.491078    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtjm7\" (UniqueName: \"kubernetes.io/projected/dec62c8d-71a8-4b6c-b083-732017b99319-kube-api-access-qtjm7\") pod \"multus-additional-cni-plugins-bm4ll\" (UID: \"dec62c8d-71a8-4b6c-b083-732017b99319\") " pod="openshift-multus/multus-additional-cni-plugins-bm4ll"
Sep 08 14:34:01.491531 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.491104    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f89e9ca-0539-4ef8-9ee4-fa19dd2e939d-host\") pod \"node-ca-g9bkm\" (UID: \"3f89e9ca-0539-4ef8-9ee4-fa19dd2e939d\") " pod="openshift-image-registry/node-ca-g9bkm"
Sep 08 14:34:01.491531 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.491129    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-host-cni-bin\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.491531 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.491156    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/52df79ef-8ace-4ac1-877c-15c9b70e7700-ovnkube-script-lib\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.491531 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.491209    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dec62c8d-71a8-4b6c-b083-732017b99319-cni-binary-copy\") pod \"multus-additional-cni-plugins-bm4ll\" (UID: \"dec62c8d-71a8-4b6c-b083-732017b99319\") " pod="openshift-multus/multus-additional-cni-plugins-bm4ll"
Sep 08 14:34:01.492296 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.491237    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dec62c8d-71a8-4b6c-b083-732017b99319-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bm4ll\" (UID: \"dec62c8d-71a8-4b6c-b083-732017b99319\") " pod="openshift-multus/multus-additional-cni-plugins-bm4ll"
Sep 08 14:34:01.492296 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.491262    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8c833587-71d4-41e7-9ac9-a68bea4f4f79-device-dir\") pod \"aws-ebs-csi-driver-node-99cmr\" (UID: \"8c833587-71d4-41e7-9ac9-a68bea4f4f79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99cmr"
Sep 08 14:34:01.492296 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.491339    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc6ck\" (UniqueName: \"kubernetes.io/projected/87b4044c-c2c8-437b-b227-79fd3821df6d-kube-api-access-qc6ck\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.492296 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.491368    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-host-slash\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.492296 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.491395    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-host-run-netns\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.492296 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.491421    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-var-lib-openvswitch\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.492296 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.491446    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-node-log\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.492296 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.491475    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dec62c8d-71a8-4b6c-b083-732017b99319-cnibin\") pod \"multus-additional-cni-plugins-bm4ll\" (UID: \"dec62c8d-71a8-4b6c-b083-732017b99319\") " pod="openshift-multus/multus-additional-cni-plugins-bm4ll"
Sep 08 14:34:01.492296 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.491501    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9x9d\" (UniqueName: \"kubernetes.io/projected/237e7003-b821-4063-9adf-1484e76814bf-kube-api-access-x9x9d\") pod \"iptables-alerter-d5gtp\" (UID: \"237e7003-b821-4063-9adf-1484e76814bf\") " pod="openshift-network-operator/iptables-alerter-d5gtp"
Sep 08 14:34:01.492296 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.491527    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-host-var-lib-kubelet\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.492296 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.491576    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-etc-openvswitch\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.492296 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.491606    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-run-ovn\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.492296 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.491631    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-host-cni-netd\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.492296 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.491675    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-host\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.492296 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.491703    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-systemd-units\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.492296 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.491729    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/52df79ef-8ace-4ac1-877c-15c9b70e7700-env-overrides\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.492296 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.491737    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87b4044c-c2c8-437b-b227-79fd3821df6d-cni-binary-copy\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.493226 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.491756    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dec62c8d-71a8-4b6c-b083-732017b99319-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bm4ll\" (UID: \"dec62c8d-71a8-4b6c-b083-732017b99319\") " pod="openshift-multus/multus-additional-cni-plugins-bm4ll"
Sep 08 14:34:01.493226 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.491786    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8c833587-71d4-41e7-9ac9-a68bea4f4f79-sys-fs\") pod \"aws-ebs-csi-driver-node-99cmr\" (UID: \"8c833587-71d4-41e7-9ac9-a68bea4f4f79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99cmr"
Sep 08 14:34:01.493226 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.491812    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/85fae7c9-a2d7-44ee-b3b6-499f4d98cf35-kubelet-config\") pod \"global-pull-secret-syncer-nzr7f\" (UID: \"85fae7c9-a2d7-44ee-b3b6-499f4d98cf35\") " pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:01.493226 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.491842    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-host-var-lib-cni-multus\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.493226 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.492144    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-etc-sysctl-conf\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.493226 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.492196    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-var-lib-kubelet\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.493226 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.492238    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-etc-sysctl-d\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.493226 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.492269    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-etc-tuned\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.493226 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.492306    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-log-socket\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.493226 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.492336    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/237e7003-b821-4063-9adf-1484e76814bf-iptables-alerter-script\") pod \"iptables-alerter-d5gtp\" (UID: \"237e7003-b821-4063-9adf-1484e76814bf\") " pod="openshift-network-operator/iptables-alerter-d5gtp"
Sep 08 14:34:01.493226 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.492360    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3f89e9ca-0539-4ef8-9ee4-fa19dd2e939d-serviceca\") pod \"node-ca-g9bkm\" (UID: \"3f89e9ca-0539-4ef8-9ee4-fa19dd2e939d\") " pod="openshift-image-registry/node-ca-g9bkm"
Sep 08 14:34:01.493226 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.492384    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-etc-sysconfig\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.493226 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.492406    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-run-openvswitch\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.493226 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.492432    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dec62c8d-71a8-4b6c-b083-732017b99319-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bm4ll\" (UID: \"dec62c8d-71a8-4b6c-b083-732017b99319\") " pod="openshift-multus/multus-additional-cni-plugins-bm4ll"
Sep 08 14:34:01.493226 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.492446    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-run\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.493226 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.492461    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8c833587-71d4-41e7-9ac9-a68bea4f4f79-kubelet-dir\") pod \"aws-ebs-csi-driver-node-99cmr\" (UID: \"8c833587-71d4-41e7-9ac9-a68bea4f4f79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99cmr"
Sep 08 14:34:01.493226 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.492531    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-host-var-lib-cni-multus\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.494134 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:01.492539    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:34:01.494134 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:01.492627    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58b796b8-809f-4e12-8fba-b018a9af00c8-metrics-certs podName:58b796b8-809f-4e12-8fba-b018a9af00c8 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:01.992602546 +0000 UTC m=+3.031003449 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58b796b8-809f-4e12-8fba-b018a9af00c8-metrics-certs") pod "network-metrics-daemon-v6nc9" (UID: "58b796b8-809f-4e12-8fba-b018a9af00c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:34:01.494134 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.492856    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-multus-socket-dir-parent\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.494134 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.492918    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-cnibin\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.494134 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.493014    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-etc-modprobe-d\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.494134 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.493016    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-hostroot\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.494134 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.493069    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cab4bd52-c6c1-48e1-9b14-fde47ac2dc46-hosts-file\") pod \"node-resolver-mjb8g\" (UID: \"cab4bd52-c6c1-48e1-9b14-fde47ac2dc46\") " pod="openshift-dns/node-resolver-mjb8g"
Sep 08 14:34:01.494134 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.493077    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-host\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.494134 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.492303    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 08 14:34:01.494134 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.493086    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-multus-conf-dir\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.494134 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.493152    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-host-run-multus-certs\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.494134 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.493160    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-etc-kubernetes\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.494134 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.493174    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-etc-sysconfig\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.494134 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.493173    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5ea167eb-ecbe-47f0-afca-1d0d6bccda05-konnectivity-ca\") pod \"konnectivity-agent-k87z4\" (UID: \"5ea167eb-ecbe-47f0-afca-1d0d6bccda05\") " pod="kube-system/konnectivity-agent-k87z4"
Sep 08 14:34:01.494134 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.493215    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-host-run-k8s-cni-cncf-io\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.494134 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.493289    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-etc-sysctl-d\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.494134 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.493300    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-lib-modules\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.494134 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.493317    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cab4bd52-c6c1-48e1-9b14-fde47ac2dc46-tmp-dir\") pod \"node-resolver-mjb8g\" (UID: \"cab4bd52-c6c1-48e1-9b14-fde47ac2dc46\") " pod="openshift-dns/node-resolver-mjb8g"
Sep 08 14:34:01.495226 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.493370    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-host-var-lib-kubelet\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.495226 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.493427    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-host-var-lib-cni-bin\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.495226 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.493479    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-etc-systemd\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.495226 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.493583    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87b4044c-c2c8-437b-b227-79fd3821df6d-multus-cni-dir\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.495226 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.493770    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87b4044c-c2c8-437b-b227-79fd3821df6d-multus-daemon-config\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.497037 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.497016    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-etc-tuned\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.497153 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.497068    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-tmp\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.498264 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.498232    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5ea167eb-ecbe-47f0-afca-1d0d6bccda05-agent-certs\") pod \"konnectivity-agent-k87z4\" (UID: \"5ea167eb-ecbe-47f0-afca-1d0d6bccda05\") " pod="kube-system/konnectivity-agent-k87z4"
Sep 08 14:34:01.498534 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.498487    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-20.ec2.internal" event={"ID":"e0bff5a7795653f306d187693d0b9c36","Type":"ContainerStarted","Data":"64771febda73b78bcb357cce366609307f05335c158ac8b46b3d3e094ab7fb09"}
Sep 08 14:34:01.500953 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.500897    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-20.ec2.internal" event={"ID":"dc403cc24af90cbf61a5edf297685b42","Type":"ContainerStarted","Data":"67ae3123c043448b2a6bace925856e077f335f947c194bf03127e864f52abba2"}
Sep 08 14:34:01.507890 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.507846    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7hm6\" (UniqueName: \"kubernetes.io/projected/39ca315a-ad7a-40b8-9d3b-dc61691b0cc9-kube-api-access-t7hm6\") pod \"tuned-cdrwc\" (UID: \"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9\") " pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.508313 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.508290    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc6ck\" (UniqueName: \"kubernetes.io/projected/87b4044c-c2c8-437b-b227-79fd3821df6d-kube-api-access-qc6ck\") pod \"multus-v7lbx\" (UID: \"87b4044c-c2c8-437b-b227-79fd3821df6d\") " pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.509441 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.509411    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t665z\" (UniqueName: \"kubernetes.io/projected/58b796b8-809f-4e12-8fba-b018a9af00c8-kube-api-access-t665z\") pod \"network-metrics-daemon-v6nc9\" (UID: \"58b796b8-809f-4e12-8fba-b018a9af00c8\") " pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:34:01.511701 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.510788    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46vc4\" (UniqueName: \"kubernetes.io/projected/cab4bd52-c6c1-48e1-9b14-fde47ac2dc46-kube-api-access-46vc4\") pod \"node-resolver-mjb8g\" (UID: \"cab4bd52-c6c1-48e1-9b14-fde47ac2dc46\") " pod="openshift-dns/node-resolver-mjb8g"
Sep 08 14:34:01.587789 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.587753    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 14:34:01.592789 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.592756    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-run-systemd\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.592938 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.592797    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn2gl\" (UniqueName: \"kubernetes.io/projected/e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0-kube-api-access-fn2gl\") pod \"network-check-target-5jsdf\" (UID: \"e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0\") " pod="openshift-network-diagnostics/network-check-target-5jsdf"
Sep 08 14:34:01.592938 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.592829    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.592938 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.592883    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.592938 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.592891    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-run-systemd\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.593176 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.592944    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dec62c8d-71a8-4b6c-b083-732017b99319-system-cni-dir\") pod \"multus-additional-cni-plugins-bm4ll\" (UID: \"dec62c8d-71a8-4b6c-b083-732017b99319\") " pod="openshift-multus/multus-additional-cni-plugins-bm4ll"
Sep 08 14:34:01.593176 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.592977    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85fae7c9-a2d7-44ee-b3b6-499f4d98cf35-original-pull-secret\") pod \"global-pull-secret-syncer-nzr7f\" (UID: \"85fae7c9-a2d7-44ee-b3b6-499f4d98cf35\") " pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:01.593176 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593007    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkk2m\" (UniqueName: \"kubernetes.io/projected/52df79ef-8ace-4ac1-877c-15c9b70e7700-kube-api-access-xkk2m\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.593176 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593027    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dec62c8d-71a8-4b6c-b083-732017b99319-system-cni-dir\") pod \"multus-additional-cni-plugins-bm4ll\" (UID: \"dec62c8d-71a8-4b6c-b083-732017b99319\") " pod="openshift-multus/multus-additional-cni-plugins-bm4ll"
Sep 08 14:34:01.593176 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593050    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/52df79ef-8ace-4ac1-877c-15c9b70e7700-ovnkube-config\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.593176 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593075    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/52df79ef-8ace-4ac1-877c-15c9b70e7700-ovn-node-metrics-cert\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.593176 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593114    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-host-kubelet\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.593176 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:01.593128    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:34:01.593176 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593139    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqvh5\" (UniqueName: \"kubernetes.io/projected/8c833587-71d4-41e7-9ac9-a68bea4f4f79-kube-api-access-cqvh5\") pod \"aws-ebs-csi-driver-node-99cmr\" (UID: \"8c833587-71d4-41e7-9ac9-a68bea4f4f79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99cmr"
Sep 08 14:34:01.593176 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593164    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/237e7003-b821-4063-9adf-1484e76814bf-host-slash\") pod \"iptables-alerter-d5gtp\" (UID: \"237e7003-b821-4063-9adf-1484e76814bf\") " pod="openshift-network-operator/iptables-alerter-d5gtp"
Sep 08 14:34:01.593176 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:01.593177    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85fae7c9-a2d7-44ee-b3b6-499f4d98cf35-original-pull-secret podName:85fae7c9-a2d7-44ee-b3b6-499f4d98cf35 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:02.093160606 +0000 UTC m=+3.131561513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85fae7c9-a2d7-44ee-b3b6-499f4d98cf35-original-pull-secret") pod "global-pull-secret-syncer-nzr7f" (UID: "85fae7c9-a2d7-44ee-b3b6-499f4d98cf35") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:34:01.593797 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593220    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/237e7003-b821-4063-9adf-1484e76814bf-host-slash\") pod \"iptables-alerter-d5gtp\" (UID: \"237e7003-b821-4063-9adf-1484e76814bf\") " pod="openshift-network-operator/iptables-alerter-d5gtp"
Sep 08 14:34:01.593797 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593406    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8457\" (UniqueName: \"kubernetes.io/projected/3f89e9ca-0539-4ef8-9ee4-fa19dd2e939d-kube-api-access-n8457\") pod \"node-ca-g9bkm\" (UID: \"3f89e9ca-0539-4ef8-9ee4-fa19dd2e939d\") " pod="openshift-image-registry/node-ca-g9bkm"
Sep 08 14:34:01.593797 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593441    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtjm7\" (UniqueName: \"kubernetes.io/projected/dec62c8d-71a8-4b6c-b083-732017b99319-kube-api-access-qtjm7\") pod \"multus-additional-cni-plugins-bm4ll\" (UID: \"dec62c8d-71a8-4b6c-b083-732017b99319\") " pod="openshift-multus/multus-additional-cni-plugins-bm4ll"
Sep 08 14:34:01.593797 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593467    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f89e9ca-0539-4ef8-9ee4-fa19dd2e939d-host\") pod \"node-ca-g9bkm\" (UID: \"3f89e9ca-0539-4ef8-9ee4-fa19dd2e939d\") " pod="openshift-image-registry/node-ca-g9bkm"
Sep 08 14:34:01.593797 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593492    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-host-cni-bin\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.593797 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593517    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/52df79ef-8ace-4ac1-877c-15c9b70e7700-ovnkube-script-lib\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.593797 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593579    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dec62c8d-71a8-4b6c-b083-732017b99319-cni-binary-copy\") pod \"multus-additional-cni-plugins-bm4ll\" (UID: \"dec62c8d-71a8-4b6c-b083-732017b99319\") " pod="openshift-multus/multus-additional-cni-plugins-bm4ll"
Sep 08 14:34:01.593797 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593608    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dec62c8d-71a8-4b6c-b083-732017b99319-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bm4ll\" (UID: \"dec62c8d-71a8-4b6c-b083-732017b99319\") " pod="openshift-multus/multus-additional-cni-plugins-bm4ll"
Sep 08 14:34:01.593797 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593643    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8c833587-71d4-41e7-9ac9-a68bea4f4f79-device-dir\") pod \"aws-ebs-csi-driver-node-99cmr\" (UID: \"8c833587-71d4-41e7-9ac9-a68bea4f4f79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99cmr"
Sep 08 14:34:01.593797 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593670    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-host-slash\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.593797 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593675    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-host-kubelet\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.593797 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593694    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-host-run-netns\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.593797 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593719    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-var-lib-openvswitch\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.593797 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593743    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-node-log\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.593797 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593772    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dec62c8d-71a8-4b6c-b083-732017b99319-cnibin\") pod \"multus-additional-cni-plugins-bm4ll\" (UID: \"dec62c8d-71a8-4b6c-b083-732017b99319\") " pod="openshift-multus/multus-additional-cni-plugins-bm4ll"
Sep 08 14:34:01.593797 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593797    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9x9d\" (UniqueName: \"kubernetes.io/projected/237e7003-b821-4063-9adf-1484e76814bf-kube-api-access-x9x9d\") pod \"iptables-alerter-d5gtp\" (UID: \"237e7003-b821-4063-9adf-1484e76814bf\") " pod="openshift-network-operator/iptables-alerter-d5gtp"
Sep 08 14:34:01.594813 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593823    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-etc-openvswitch\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.594813 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593847    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-run-ovn\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.594813 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593870    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-host-cni-netd\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.594813 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593886    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8c833587-71d4-41e7-9ac9-a68bea4f4f79-device-dir\") pod \"aws-ebs-csi-driver-node-99cmr\" (UID: \"8c833587-71d4-41e7-9ac9-a68bea4f4f79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99cmr"
Sep 08 14:34:01.594813 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593902    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-systemd-units\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.594813 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593927    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/52df79ef-8ace-4ac1-877c-15c9b70e7700-env-overrides\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.594813 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593935    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f89e9ca-0539-4ef8-9ee4-fa19dd2e939d-host\") pod \"node-ca-g9bkm\" (UID: \"3f89e9ca-0539-4ef8-9ee4-fa19dd2e939d\") " pod="openshift-image-registry/node-ca-g9bkm"
Sep 08 14:34:01.594813 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593953    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dec62c8d-71a8-4b6c-b083-732017b99319-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bm4ll\" (UID: \"dec62c8d-71a8-4b6c-b083-732017b99319\") " pod="openshift-multus/multus-additional-cni-plugins-bm4ll"
Sep 08 14:34:01.594813 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593960    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/52df79ef-8ace-4ac1-877c-15c9b70e7700-ovnkube-config\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.594813 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593978    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8c833587-71d4-41e7-9ac9-a68bea4f4f79-sys-fs\") pod \"aws-ebs-csi-driver-node-99cmr\" (UID: \"8c833587-71d4-41e7-9ac9-a68bea4f4f79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99cmr"
Sep 08 14:34:01.594813 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.593981    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dec62c8d-71a8-4b6c-b083-732017b99319-cnibin\") pod \"multus-additional-cni-plugins-bm4ll\" (UID: \"dec62c8d-71a8-4b6c-b083-732017b99319\") " pod="openshift-multus/multus-additional-cni-plugins-bm4ll"
Sep 08 14:34:01.594813 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.594005    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/85fae7c9-a2d7-44ee-b3b6-499f4d98cf35-kubelet-config\") pod \"global-pull-secret-syncer-nzr7f\" (UID: \"85fae7c9-a2d7-44ee-b3b6-499f4d98cf35\") " pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:01.594813 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.594027    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-host-cni-bin\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.594813 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.594037    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-log-socket\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.594813 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.594041    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-host-cni-netd\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.594813 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.594064    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/237e7003-b821-4063-9adf-1484e76814bf-iptables-alerter-script\") pod \"iptables-alerter-d5gtp\" (UID: \"237e7003-b821-4063-9adf-1484e76814bf\") " pod="openshift-network-operator/iptables-alerter-d5gtp"
Sep 08 14:34:01.594813 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.594072    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-host-slash\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.595338 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.594090    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3f89e9ca-0539-4ef8-9ee4-fa19dd2e939d-serviceca\") pod \"node-ca-g9bkm\" (UID: \"3f89e9ca-0539-4ef8-9ee4-fa19dd2e939d\") " pod="openshift-image-registry/node-ca-g9bkm"
Sep 08 14:34:01.595338 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.594112    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-host-run-netns\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.595338 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.594115    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-run-openvswitch\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.595338 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.594153    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-run-openvswitch\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.595338 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.594153    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dec62c8d-71a8-4b6c-b083-732017b99319-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bm4ll\" (UID: \"dec62c8d-71a8-4b6c-b083-732017b99319\") " pod="openshift-multus/multus-additional-cni-plugins-bm4ll"
Sep 08 14:34:01.595338 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.594184    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8c833587-71d4-41e7-9ac9-a68bea4f4f79-kubelet-dir\") pod \"aws-ebs-csi-driver-node-99cmr\" (UID: \"8c833587-71d4-41e7-9ac9-a68bea4f4f79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99cmr"
Sep 08 14:34:01.595338 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.594217    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8c833587-71d4-41e7-9ac9-a68bea4f4f79-etc-selinux\") pod \"aws-ebs-csi-driver-node-99cmr\" (UID: \"8c833587-71d4-41e7-9ac9-a68bea4f4f79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99cmr"
Sep 08 14:34:01.595338 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.594251    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8c833587-71d4-41e7-9ac9-a68bea4f4f79-socket-dir\") pod \"aws-ebs-csi-driver-node-99cmr\" (UID: \"8c833587-71d4-41e7-9ac9-a68bea4f4f79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99cmr"
Sep 08 14:34:01.595338 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.594278    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8c833587-71d4-41e7-9ac9-a68bea4f4f79-registration-dir\") pod \"aws-ebs-csi-driver-node-99cmr\" (UID: \"8c833587-71d4-41e7-9ac9-a68bea4f4f79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99cmr"
Sep 08 14:34:01.595338 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.594305    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-etc-openvswitch\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.595338 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.594311    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-host-run-ovn-kubernetes\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.595338 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.594349    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-host-run-ovn-kubernetes\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.595338 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.594355    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/85fae7c9-a2d7-44ee-b3b6-499f4d98cf35-dbus\") pod \"global-pull-secret-syncer-nzr7f\" (UID: \"85fae7c9-a2d7-44ee-b3b6-499f4d98cf35\") " pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:01.595338 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.594396    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-var-lib-openvswitch\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.595338 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.594503    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/52df79ef-8ace-4ac1-877c-15c9b70e7700-env-overrides\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.595338 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.594519    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8c833587-71d4-41e7-9ac9-a68bea4f4f79-socket-dir\") pod \"aws-ebs-csi-driver-node-99cmr\" (UID: \"8c833587-71d4-41e7-9ac9-a68bea4f4f79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99cmr"
Sep 08 14:34:01.595338 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.594564    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8c833587-71d4-41e7-9ac9-a68bea4f4f79-etc-selinux\") pod \"aws-ebs-csi-driver-node-99cmr\" (UID: \"8c833587-71d4-41e7-9ac9-a68bea4f4f79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99cmr"
Sep 08 14:34:01.595919 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.594572    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/52df79ef-8ace-4ac1-877c-15c9b70e7700-ovnkube-script-lib\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.595919 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.594594    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8c833587-71d4-41e7-9ac9-a68bea4f4f79-sys-fs\") pod \"aws-ebs-csi-driver-node-99cmr\" (UID: \"8c833587-71d4-41e7-9ac9-a68bea4f4f79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99cmr"
Sep 08 14:34:01.595919 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.594638    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-run-ovn\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.595919 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.594665    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dec62c8d-71a8-4b6c-b083-732017b99319-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bm4ll\" (UID: \"dec62c8d-71a8-4b6c-b083-732017b99319\") " pod="openshift-multus/multus-additional-cni-plugins-bm4ll"
Sep 08 14:34:01.595919 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.594689    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/85fae7c9-a2d7-44ee-b3b6-499f4d98cf35-kubelet-config\") pod \"global-pull-secret-syncer-nzr7f\" (UID: \"85fae7c9-a2d7-44ee-b3b6-499f4d98cf35\") " pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:01.595919 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.594713    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-node-log\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.595919 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.594752    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/85fae7c9-a2d7-44ee-b3b6-499f4d98cf35-dbus\") pod \"global-pull-secret-syncer-nzr7f\" (UID: \"85fae7c9-a2d7-44ee-b3b6-499f4d98cf35\") " pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:01.595919 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.594775    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-systemd-units\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.595919 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.595196    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dec62c8d-71a8-4b6c-b083-732017b99319-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bm4ll\" (UID: \"dec62c8d-71a8-4b6c-b083-732017b99319\") " pod="openshift-multus/multus-additional-cni-plugins-bm4ll"
Sep 08 14:34:01.595919 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.595192    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dec62c8d-71a8-4b6c-b083-732017b99319-cni-binary-copy\") pod \"multus-additional-cni-plugins-bm4ll\" (UID: \"dec62c8d-71a8-4b6c-b083-732017b99319\") " pod="openshift-multus/multus-additional-cni-plugins-bm4ll"
Sep 08 14:34:01.595919 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.595250    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8c833587-71d4-41e7-9ac9-a68bea4f4f79-kubelet-dir\") pod \"aws-ebs-csi-driver-node-99cmr\" (UID: \"8c833587-71d4-41e7-9ac9-a68bea4f4f79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99cmr"
Sep 08 14:34:01.595919 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.595296    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8c833587-71d4-41e7-9ac9-a68bea4f4f79-registration-dir\") pod \"aws-ebs-csi-driver-node-99cmr\" (UID: \"8c833587-71d4-41e7-9ac9-a68bea4f4f79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99cmr"
Sep 08 14:34:01.595919 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.595325    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/52df79ef-8ace-4ac1-877c-15c9b70e7700-log-socket\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.595919 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.595352    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/237e7003-b821-4063-9adf-1484e76814bf-iptables-alerter-script\") pod \"iptables-alerter-d5gtp\" (UID: \"237e7003-b821-4063-9adf-1484e76814bf\") " pod="openshift-network-operator/iptables-alerter-d5gtp"
Sep 08 14:34:01.595919 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.595426    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dec62c8d-71a8-4b6c-b083-732017b99319-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bm4ll\" (UID: \"dec62c8d-71a8-4b6c-b083-732017b99319\") " pod="openshift-multus/multus-additional-cni-plugins-bm4ll"
Sep 08 14:34:01.595919 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.595688    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3f89e9ca-0539-4ef8-9ee4-fa19dd2e939d-serviceca\") pod \"node-ca-g9bkm\" (UID: \"3f89e9ca-0539-4ef8-9ee4-fa19dd2e939d\") " pod="openshift-image-registry/node-ca-g9bkm"
Sep 08 14:34:01.599592 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.599553    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/52df79ef-8ace-4ac1-877c-15c9b70e7700-ovn-node-metrics-cert\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.602733 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:01.602707    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:34:01.602855 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:01.602741    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:34:01.602855 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:01.602756    2577 projected.go:196] Error preparing data for projected volume kube-api-access-fn2gl for pod openshift-network-diagnostics/network-check-target-5jsdf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:34:01.602984 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:01.602836    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0-kube-api-access-fn2gl podName:e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:02.102808559 +0000 UTC m=+3.141209476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fn2gl" (UniqueName: "kubernetes.io/projected/e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0-kube-api-access-fn2gl") pod "network-check-target-5jsdf" (UID: "e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:34:01.605849 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.605766    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtjm7\" (UniqueName: \"kubernetes.io/projected/dec62c8d-71a8-4b6c-b083-732017b99319-kube-api-access-qtjm7\") pod \"multus-additional-cni-plugins-bm4ll\" (UID: \"dec62c8d-71a8-4b6c-b083-732017b99319\") " pod="openshift-multus/multus-additional-cni-plugins-bm4ll"
Sep 08 14:34:01.605968 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.605878    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8457\" (UniqueName: \"kubernetes.io/projected/3f89e9ca-0539-4ef8-9ee4-fa19dd2e939d-kube-api-access-n8457\") pod \"node-ca-g9bkm\" (UID: \"3f89e9ca-0539-4ef8-9ee4-fa19dd2e939d\") " pod="openshift-image-registry/node-ca-g9bkm"
Sep 08 14:34:01.606892 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.606868    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkk2m\" (UniqueName: \"kubernetes.io/projected/52df79ef-8ace-4ac1-877c-15c9b70e7700-kube-api-access-xkk2m\") pod \"ovnkube-node-trsml\" (UID: \"52df79ef-8ace-4ac1-877c-15c9b70e7700\") " pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.608431 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.608405    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9x9d\" (UniqueName: \"kubernetes.io/projected/237e7003-b821-4063-9adf-1484e76814bf-kube-api-access-x9x9d\") pod \"iptables-alerter-d5gtp\" (UID: \"237e7003-b821-4063-9adf-1484e76814bf\") " pod="openshift-network-operator/iptables-alerter-d5gtp"
Sep 08 14:34:01.608888 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.608865    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqvh5\" (UniqueName: \"kubernetes.io/projected/8c833587-71d4-41e7-9ac9-a68bea4f4f79-kube-api-access-cqvh5\") pod \"aws-ebs-csi-driver-node-99cmr\" (UID: \"8c833587-71d4-41e7-9ac9-a68bea4f4f79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99cmr"
Sep 08 14:34:01.681592 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.681562    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v7lbx"
Sep 08 14:34:01.689581 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.689556    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mjb8g"
Sep 08 14:34:01.695174 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:34:01.695147    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87b4044c_c2c8_437b_b227_79fd3821df6d.slice/crio-2bff7cca4a4ef84d3cd705d50225ac03677725d2641a2038c84aed9821300de8 WatchSource:0}: Error finding container 2bff7cca4a4ef84d3cd705d50225ac03677725d2641a2038c84aed9821300de8: Status 404 returned error can't find the container with id 2bff7cca4a4ef84d3cd705d50225ac03677725d2641a2038c84aed9821300de8
Sep 08 14:34:01.699298 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.699281    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cdrwc"
Sep 08 14:34:01.708756 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.708582    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k87z4"
Sep 08 14:34:01.709691 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:34:01.709655    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39ca315a_ad7a_40b8_9d3b_dc61691b0cc9.slice/crio-176ca6a38ebcb7ff35496647b9fa3b46241eae7c40c5b132e8df46cbbfedd39a WatchSource:0}: Error finding container 176ca6a38ebcb7ff35496647b9fa3b46241eae7c40c5b132e8df46cbbfedd39a: Status 404 returned error can't find the container with id 176ca6a38ebcb7ff35496647b9fa3b46241eae7c40c5b132e8df46cbbfedd39a
Sep 08 14:34:01.717420 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.717278    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:01.719287 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:34:01.719252    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ea167eb_ecbe_47f0_afca_1d0d6bccda05.slice/crio-41f73a2d149650ab60d19f7059f477735731883d470b073e7ca4e37114348fdd WatchSource:0}: Error finding container 41f73a2d149650ab60d19f7059f477735731883d470b073e7ca4e37114348fdd: Status 404 returned error can't find the container with id 41f73a2d149650ab60d19f7059f477735731883d470b073e7ca4e37114348fdd
Sep 08 14:34:01.725842 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.725819    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bm4ll"
Sep 08 14:34:01.726982 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:34:01.726959    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52df79ef_8ace_4ac1_877c_15c9b70e7700.slice/crio-2ce381a34d8de5359ebddbce51e35ce1b1186385f57c49f1d2a2ecaa08bdfaad WatchSource:0}: Error finding container 2ce381a34d8de5359ebddbce51e35ce1b1186385f57c49f1d2a2ecaa08bdfaad: Status 404 returned error can't find the container with id 2ce381a34d8de5359ebddbce51e35ce1b1186385f57c49f1d2a2ecaa08bdfaad
Sep 08 14:34:01.733511 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.733469    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99cmr"
Sep 08 14:34:01.737556 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:34:01.737524    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddec62c8d_71a8_4b6c_b083_732017b99319.slice/crio-38f9f67d00f80f081dc7dbd682fd5a261ef2a417ec5af9e38cd527d95569d2b9 WatchSource:0}: Error finding container 38f9f67d00f80f081dc7dbd682fd5a261ef2a417ec5af9e38cd527d95569d2b9: Status 404 returned error can't find the container with id 38f9f67d00f80f081dc7dbd682fd5a261ef2a417ec5af9e38cd527d95569d2b9
Sep 08 14:34:01.744284 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.744264    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d5gtp"
Sep 08 14:34:01.745806 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:34:01.745784    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c833587_71d4_41e7_9ac9_a68bea4f4f79.slice/crio-29d281d9e88d1916812082a7f17907964f244cb6c274e74e4253a43aefec1747 WatchSource:0}: Error finding container 29d281d9e88d1916812082a7f17907964f244cb6c274e74e4253a43aefec1747: Status 404 returned error can't find the container with id 29d281d9e88d1916812082a7f17907964f244cb6c274e74e4253a43aefec1747
Sep 08 14:34:01.750149 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.750123    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g9bkm"
Sep 08 14:34:01.762874 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:34:01.762846    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f89e9ca_0539_4ef8_9ee4_fa19dd2e939d.slice/crio-01a395ae4b96fc74f2441914ff973996fdec9743303722c4f77e2e0f35459433 WatchSource:0}: Error finding container 01a395ae4b96fc74f2441914ff973996fdec9743303722c4f77e2e0f35459433: Status 404 returned error can't find the container with id 01a395ae4b96fc74f2441914ff973996fdec9743303722c4f77e2e0f35459433
Sep 08 14:34:01.997654 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:01.997567    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58b796b8-809f-4e12-8fba-b018a9af00c8-metrics-certs\") pod \"network-metrics-daemon-v6nc9\" (UID: \"58b796b8-809f-4e12-8fba-b018a9af00c8\") " pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:34:01.997810 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:01.997739    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:34:01.997810 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:01.997809    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58b796b8-809f-4e12-8fba-b018a9af00c8-metrics-certs podName:58b796b8-809f-4e12-8fba-b018a9af00c8 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:02.997788562 +0000 UTC m=+4.036189469 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58b796b8-809f-4e12-8fba-b018a9af00c8-metrics-certs") pod "network-metrics-daemon-v6nc9" (UID: "58b796b8-809f-4e12-8fba-b018a9af00c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:34:02.098963 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:02.098933    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85fae7c9-a2d7-44ee-b3b6-499f4d98cf35-original-pull-secret\") pod \"global-pull-secret-syncer-nzr7f\" (UID: \"85fae7c9-a2d7-44ee-b3b6-499f4d98cf35\") " pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:02.099139 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:02.099118    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:34:02.099213 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:02.099201    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85fae7c9-a2d7-44ee-b3b6-499f4d98cf35-original-pull-secret podName:85fae7c9-a2d7-44ee-b3b6-499f4d98cf35 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:03.099179479 +0000 UTC m=+4.137580403 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85fae7c9-a2d7-44ee-b3b6-499f4d98cf35-original-pull-secret") pod "global-pull-secret-syncer-nzr7f" (UID: "85fae7c9-a2d7-44ee-b3b6-499f4d98cf35") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:34:02.199684 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:02.199651    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn2gl\" (UniqueName: \"kubernetes.io/projected/e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0-kube-api-access-fn2gl\") pod \"network-check-target-5jsdf\" (UID: \"e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0\") " pod="openshift-network-diagnostics/network-check-target-5jsdf"
Sep 08 14:34:02.199878 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:02.199857    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:34:02.199936 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:02.199886    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:34:02.199936 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:02.199896    2577 projected.go:196] Error preparing data for projected volume kube-api-access-fn2gl for pod openshift-network-diagnostics/network-check-target-5jsdf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:34:02.200019 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:02.199968    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0-kube-api-access-fn2gl podName:e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:03.199949984 +0000 UTC m=+4.238350905 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fn2gl" (UniqueName: "kubernetes.io/projected/e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0-kube-api-access-fn2gl") pod "network-check-target-5jsdf" (UID: "e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:34:02.429185 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:02.429098    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 14:29:01 +0000 UTC" deadline="2028-06-22 19:55:17.746255664 +0000 UTC"
Sep 08 14:34:02.429185 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:02.429138    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15677h21m15.317122444s"
Sep 08 14:34:02.484782 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:02.484745    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:34:02.484950 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:02.484893    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6nc9" podUID="58b796b8-809f-4e12-8fba-b018a9af00c8"
Sep 08 14:34:02.504364 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:02.504250    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g9bkm" event={"ID":"3f89e9ca-0539-4ef8-9ee4-fa19dd2e939d","Type":"ContainerStarted","Data":"01a395ae4b96fc74f2441914ff973996fdec9743303722c4f77e2e0f35459433"}
Sep 08 14:34:02.506272 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:02.506243    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d5gtp" event={"ID":"237e7003-b821-4063-9adf-1484e76814bf","Type":"ContainerStarted","Data":"262af25cb49cadcff01abeaf4b3a6eacfb9d4ddc82e4b258a7ddc8a70a286495"}
Sep 08 14:34:02.508792 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:02.508752    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99cmr" event={"ID":"8c833587-71d4-41e7-9ac9-a68bea4f4f79","Type":"ContainerStarted","Data":"29d281d9e88d1916812082a7f17907964f244cb6c274e74e4253a43aefec1747"}
Sep 08 14:34:02.510572 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:02.510547    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bm4ll" event={"ID":"dec62c8d-71a8-4b6c-b083-732017b99319","Type":"ContainerStarted","Data":"38f9f67d00f80f081dc7dbd682fd5a261ef2a417ec5af9e38cd527d95569d2b9"}
Sep 08 14:34:02.513870 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:02.513842    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trsml" event={"ID":"52df79ef-8ace-4ac1-877c-15c9b70e7700","Type":"ContainerStarted","Data":"2ce381a34d8de5359ebddbce51e35ce1b1186385f57c49f1d2a2ecaa08bdfaad"}
Sep 08 14:34:02.515540 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:02.515488    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k87z4" event={"ID":"5ea167eb-ecbe-47f0-afca-1d0d6bccda05","Type":"ContainerStarted","Data":"41f73a2d149650ab60d19f7059f477735731883d470b073e7ca4e37114348fdd"}
Sep 08 14:34:02.517373 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:02.517320    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mjb8g" event={"ID":"cab4bd52-c6c1-48e1-9b14-fde47ac2dc46","Type":"ContainerStarted","Data":"8584c3a0a355640a4be83d26a7b369ac5098c606156b9869a54bb8ea76016fae"}
Sep 08 14:34:02.519106 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:02.519043    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cdrwc" event={"ID":"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9","Type":"ContainerStarted","Data":"176ca6a38ebcb7ff35496647b9fa3b46241eae7c40c5b132e8df46cbbfedd39a"}
Sep 08 14:34:02.530134 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:02.524996    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v7lbx" event={"ID":"87b4044c-c2c8-437b-b227-79fd3821df6d","Type":"ContainerStarted","Data":"2bff7cca4a4ef84d3cd705d50225ac03677725d2641a2038c84aed9821300de8"}
Sep 08 14:34:03.005675 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:03.005636    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58b796b8-809f-4e12-8fba-b018a9af00c8-metrics-certs\") pod \"network-metrics-daemon-v6nc9\" (UID: \"58b796b8-809f-4e12-8fba-b018a9af00c8\") " pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:34:03.005882 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:03.005816    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:34:03.005882 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:03.005881    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58b796b8-809f-4e12-8fba-b018a9af00c8-metrics-certs podName:58b796b8-809f-4e12-8fba-b018a9af00c8 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:05.005862637 +0000 UTC m=+6.044263558 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58b796b8-809f-4e12-8fba-b018a9af00c8-metrics-certs") pod "network-metrics-daemon-v6nc9" (UID: "58b796b8-809f-4e12-8fba-b018a9af00c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:34:03.107695 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:03.107053    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85fae7c9-a2d7-44ee-b3b6-499f4d98cf35-original-pull-secret\") pod \"global-pull-secret-syncer-nzr7f\" (UID: \"85fae7c9-a2d7-44ee-b3b6-499f4d98cf35\") " pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:03.107695 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:03.107231    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:34:03.107695 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:03.107300    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85fae7c9-a2d7-44ee-b3b6-499f4d98cf35-original-pull-secret podName:85fae7c9-a2d7-44ee-b3b6-499f4d98cf35 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:05.107281029 +0000 UTC m=+6.145681956 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85fae7c9-a2d7-44ee-b3b6-499f4d98cf35-original-pull-secret") pod "global-pull-secret-syncer-nzr7f" (UID: "85fae7c9-a2d7-44ee-b3b6-499f4d98cf35") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:34:03.208217 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:03.208178    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn2gl\" (UniqueName: \"kubernetes.io/projected/e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0-kube-api-access-fn2gl\") pod \"network-check-target-5jsdf\" (UID: \"e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0\") " pod="openshift-network-diagnostics/network-check-target-5jsdf"
Sep 08 14:34:03.208435 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:03.208417    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:34:03.208519 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:03.208446    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:34:03.208519 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:03.208459    2577 projected.go:196] Error preparing data for projected volume kube-api-access-fn2gl for pod openshift-network-diagnostics/network-check-target-5jsdf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:34:03.208653 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:03.208559    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0-kube-api-access-fn2gl podName:e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:05.208529339 +0000 UTC m=+6.246930257 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fn2gl" (UniqueName: "kubernetes.io/projected/e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0-kube-api-access-fn2gl") pod "network-check-target-5jsdf" (UID: "e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:34:03.429624 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:03.429537    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 14:29:01 +0000 UTC" deadline="2028-04-24 03:15:20.271148639 +0000 UTC"
Sep 08 14:34:03.429624 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:03.429601    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14244h41m16.841553116s"
Sep 08 14:34:03.488233 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:03.487598    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jsdf"
Sep 08 14:34:03.488233 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:03.487723    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jsdf" podUID="e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0"
Sep 08 14:34:03.488233 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:03.488094    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:03.488233 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:03.488187    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nzr7f" podUID="85fae7c9-a2d7-44ee-b3b6-499f4d98cf35"
Sep 08 14:34:03.544132 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:03.543342    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-20.ec2.internal" event={"ID":"e0bff5a7795653f306d187693d0b9c36","Type":"ContainerStarted","Data":"8dee34f4a3b5f97d657d93adbcb299dc7de29d20fadc5886800e49011d8e7e65"}
Sep 08 14:34:04.484647 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:04.484569    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:34:04.485135 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:04.484710    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6nc9" podUID="58b796b8-809f-4e12-8fba-b018a9af00c8"
Sep 08 14:34:04.562518 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:04.562393    2577 generic.go:356] "Generic (PLEG): container finished" podID="dc403cc24af90cbf61a5edf297685b42" containerID="8de6fb90cae030fbb570f04d2d41f0b327430bce0ac3f04939fc99c3b70a369e" exitCode=0
Sep 08 14:34:04.562518 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:04.562495    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-20.ec2.internal" event={"ID":"dc403cc24af90cbf61a5edf297685b42","Type":"ContainerDied","Data":"8de6fb90cae030fbb570f04d2d41f0b327430bce0ac3f04939fc99c3b70a369e"}
Sep 08 14:34:04.582832 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:04.581886    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-20.ec2.internal" podStartSLOduration=3.581868103 podStartE2EDuration="3.581868103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:34:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:34:03.564449837 +0000 UTC m=+4.602850766" watchObservedRunningTime="2026-09-08 14:34:04.581868103 +0000 UTC m=+5.620269029"
Sep 08 14:34:05.026561 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:05.026525    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58b796b8-809f-4e12-8fba-b018a9af00c8-metrics-certs\") pod \"network-metrics-daemon-v6nc9\" (UID: \"58b796b8-809f-4e12-8fba-b018a9af00c8\") " pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:34:05.026753 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:05.026704    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:34:05.026815 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:05.026766    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58b796b8-809f-4e12-8fba-b018a9af00c8-metrics-certs podName:58b796b8-809f-4e12-8fba-b018a9af00c8 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:09.026747091 +0000 UTC m=+10.065148006 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58b796b8-809f-4e12-8fba-b018a9af00c8-metrics-certs") pod "network-metrics-daemon-v6nc9" (UID: "58b796b8-809f-4e12-8fba-b018a9af00c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:34:05.127428 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:05.127387    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85fae7c9-a2d7-44ee-b3b6-499f4d98cf35-original-pull-secret\") pod \"global-pull-secret-syncer-nzr7f\" (UID: \"85fae7c9-a2d7-44ee-b3b6-499f4d98cf35\") " pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:05.127618 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:05.127547    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:34:05.127618 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:05.127611    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85fae7c9-a2d7-44ee-b3b6-499f4d98cf35-original-pull-secret podName:85fae7c9-a2d7-44ee-b3b6-499f4d98cf35 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:09.12759455 +0000 UTC m=+10.165995468 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85fae7c9-a2d7-44ee-b3b6-499f4d98cf35-original-pull-secret") pod "global-pull-secret-syncer-nzr7f" (UID: "85fae7c9-a2d7-44ee-b3b6-499f4d98cf35") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:34:05.228293 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:05.228257    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn2gl\" (UniqueName: \"kubernetes.io/projected/e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0-kube-api-access-fn2gl\") pod \"network-check-target-5jsdf\" (UID: \"e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0\") " pod="openshift-network-diagnostics/network-check-target-5jsdf"
Sep 08 14:34:05.228509 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:05.228450    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:34:05.228509 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:05.228494    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:34:05.228509 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:05.228507    2577 projected.go:196] Error preparing data for projected volume kube-api-access-fn2gl for pod openshift-network-diagnostics/network-check-target-5jsdf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:34:05.228688 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:05.228565    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0-kube-api-access-fn2gl podName:e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:09.228546142 +0000 UTC m=+10.266947057 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fn2gl" (UniqueName: "kubernetes.io/projected/e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0-kube-api-access-fn2gl") pod "network-check-target-5jsdf" (UID: "e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:34:05.484694 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:05.484584    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jsdf"
Sep 08 14:34:05.485142 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:05.484711    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jsdf" podUID="e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0"
Sep 08 14:34:05.485142 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:05.484751    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:05.485142 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:05.484824    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nzr7f" podUID="85fae7c9-a2d7-44ee-b3b6-499f4d98cf35"
Sep 08 14:34:06.485134 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:06.484604    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:34:06.485134 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:06.484751    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6nc9" podUID="58b796b8-809f-4e12-8fba-b018a9af00c8"
Sep 08 14:34:07.485005 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:07.484971    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:07.485005 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:07.485014    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jsdf"
Sep 08 14:34:07.485904 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:07.485104    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nzr7f" podUID="85fae7c9-a2d7-44ee-b3b6-499f4d98cf35"
Sep 08 14:34:07.485904 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:07.485316    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jsdf" podUID="e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0"
Sep 08 14:34:08.484574 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:08.484503    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:34:08.484730 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:08.484620    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6nc9" podUID="58b796b8-809f-4e12-8fba-b018a9af00c8"
Sep 08 14:34:09.065058 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:09.065024    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58b796b8-809f-4e12-8fba-b018a9af00c8-metrics-certs\") pod \"network-metrics-daemon-v6nc9\" (UID: \"58b796b8-809f-4e12-8fba-b018a9af00c8\") " pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:34:09.065439 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:09.065174    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:34:09.065439 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:09.065245    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58b796b8-809f-4e12-8fba-b018a9af00c8-metrics-certs podName:58b796b8-809f-4e12-8fba-b018a9af00c8 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:17.065224559 +0000 UTC m=+18.103625464 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58b796b8-809f-4e12-8fba-b018a9af00c8-metrics-certs") pod "network-metrics-daemon-v6nc9" (UID: "58b796b8-809f-4e12-8fba-b018a9af00c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:34:09.165808 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:09.165771    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85fae7c9-a2d7-44ee-b3b6-499f4d98cf35-original-pull-secret\") pod \"global-pull-secret-syncer-nzr7f\" (UID: \"85fae7c9-a2d7-44ee-b3b6-499f4d98cf35\") " pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:09.165985 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:09.165939    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:34:09.166063 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:09.166006    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85fae7c9-a2d7-44ee-b3b6-499f4d98cf35-original-pull-secret podName:85fae7c9-a2d7-44ee-b3b6-499f4d98cf35 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:17.165986285 +0000 UTC m=+18.204387202 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85fae7c9-a2d7-44ee-b3b6-499f4d98cf35-original-pull-secret") pod "global-pull-secret-syncer-nzr7f" (UID: "85fae7c9-a2d7-44ee-b3b6-499f4d98cf35") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:34:09.266941 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:09.266905    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn2gl\" (UniqueName: \"kubernetes.io/projected/e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0-kube-api-access-fn2gl\") pod \"network-check-target-5jsdf\" (UID: \"e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0\") " pod="openshift-network-diagnostics/network-check-target-5jsdf"
Sep 08 14:34:09.267118 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:09.267095    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:34:09.267164 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:09.267132    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:34:09.267164 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:09.267147    2577 projected.go:196] Error preparing data for projected volume kube-api-access-fn2gl for pod openshift-network-diagnostics/network-check-target-5jsdf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:34:09.267222 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:09.267214    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0-kube-api-access-fn2gl podName:e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:17.267194115 +0000 UTC m=+18.305595017 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fn2gl" (UniqueName: "kubernetes.io/projected/e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0-kube-api-access-fn2gl") pod "network-check-target-5jsdf" (UID: "e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:34:09.485690 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:09.485594    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:09.486487 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:09.486403    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jsdf"
Sep 08 14:34:09.486625 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:09.486555    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nzr7f" podUID="85fae7c9-a2d7-44ee-b3b6-499f4d98cf35"
Sep 08 14:34:09.486852 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:09.486796    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jsdf" podUID="e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0"
Sep 08 14:34:10.484427 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:10.484394    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:34:10.484924 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:10.484556    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6nc9" podUID="58b796b8-809f-4e12-8fba-b018a9af00c8"
Sep 08 14:34:11.484443 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:11.484410    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:11.485042 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:11.484565    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nzr7f" podUID="85fae7c9-a2d7-44ee-b3b6-499f4d98cf35"
Sep 08 14:34:11.485042 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:11.484960    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jsdf"
Sep 08 14:34:11.485170 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:11.485060    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jsdf" podUID="e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0"
Sep 08 14:34:12.485217 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:12.485142    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:34:12.485629 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:12.485262    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6nc9" podUID="58b796b8-809f-4e12-8fba-b018a9af00c8"
Sep 08 14:34:13.485658 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:13.485574    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:13.486119 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:13.485701    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nzr7f" podUID="85fae7c9-a2d7-44ee-b3b6-499f4d98cf35"
Sep 08 14:34:13.486119 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:13.485762    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jsdf"
Sep 08 14:34:13.486119 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:13.485880    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jsdf" podUID="e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0"
Sep 08 14:34:14.484389 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:14.484360    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:34:14.484588 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:14.484493    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6nc9" podUID="58b796b8-809f-4e12-8fba-b018a9af00c8"
Sep 08 14:34:15.484647 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:15.484614    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jsdf"
Sep 08 14:34:15.485044 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:15.484617    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:15.485044 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:15.484740    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jsdf" podUID="e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0"
Sep 08 14:34:15.485044 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:15.484835    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nzr7f" podUID="85fae7c9-a2d7-44ee-b3b6-499f4d98cf35"
Sep 08 14:34:16.485157 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:16.485124    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:34:16.485734 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:16.485253    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6nc9" podUID="58b796b8-809f-4e12-8fba-b018a9af00c8"
Sep 08 14:34:17.122713 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:17.122679    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58b796b8-809f-4e12-8fba-b018a9af00c8-metrics-certs\") pod \"network-metrics-daemon-v6nc9\" (UID: \"58b796b8-809f-4e12-8fba-b018a9af00c8\") " pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:34:17.122912 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:17.122834    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:34:17.122912 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:17.122902    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58b796b8-809f-4e12-8fba-b018a9af00c8-metrics-certs podName:58b796b8-809f-4e12-8fba-b018a9af00c8 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:33.122882036 +0000 UTC m=+34.161282956 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58b796b8-809f-4e12-8fba-b018a9af00c8-metrics-certs") pod "network-metrics-daemon-v6nc9" (UID: "58b796b8-809f-4e12-8fba-b018a9af00c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:34:17.223364 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:17.223336    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85fae7c9-a2d7-44ee-b3b6-499f4d98cf35-original-pull-secret\") pod \"global-pull-secret-syncer-nzr7f\" (UID: \"85fae7c9-a2d7-44ee-b3b6-499f4d98cf35\") " pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:17.223557 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:17.223519    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:34:17.223611 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:17.223592    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85fae7c9-a2d7-44ee-b3b6-499f4d98cf35-original-pull-secret podName:85fae7c9-a2d7-44ee-b3b6-499f4d98cf35 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:33.223573028 +0000 UTC m=+34.261973933 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85fae7c9-a2d7-44ee-b3b6-499f4d98cf35-original-pull-secret") pod "global-pull-secret-syncer-nzr7f" (UID: "85fae7c9-a2d7-44ee-b3b6-499f4d98cf35") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:34:17.323771 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:17.323735    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn2gl\" (UniqueName: \"kubernetes.io/projected/e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0-kube-api-access-fn2gl\") pod \"network-check-target-5jsdf\" (UID: \"e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0\") " pod="openshift-network-diagnostics/network-check-target-5jsdf"
Sep 08 14:34:17.323951 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:17.323932    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:34:17.324024 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:17.323965    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:34:17.324024 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:17.323978    2577 projected.go:196] Error preparing data for projected volume kube-api-access-fn2gl for pod openshift-network-diagnostics/network-check-target-5jsdf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:34:17.326583 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:17.324364    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0-kube-api-access-fn2gl podName:e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:33.32433977 +0000 UTC m=+34.362740676 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fn2gl" (UniqueName: "kubernetes.io/projected/e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0-kube-api-access-fn2gl") pod "network-check-target-5jsdf" (UID: "e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:34:17.484891 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:17.484843    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:17.485067 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:17.484979    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nzr7f" podUID="85fae7c9-a2d7-44ee-b3b6-499f4d98cf35"
Sep 08 14:34:17.485067 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:17.485038    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jsdf"
Sep 08 14:34:17.485187 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:17.485132    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jsdf" podUID="e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0"
Sep 08 14:34:18.485187 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:18.485154    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:34:18.485698 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:18.485290    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6nc9" podUID="58b796b8-809f-4e12-8fba-b018a9af00c8"
Sep 08 14:34:19.484804 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:19.484774    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:19.484989 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:19.484868    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nzr7f" podUID="85fae7c9-a2d7-44ee-b3b6-499f4d98cf35"
Sep 08 14:34:19.484989 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:19.484945    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jsdf"
Sep 08 14:34:19.485100 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:19.485035    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jsdf" podUID="e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0"
Sep 08 14:34:20.485123 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:20.484650    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:34:20.485123 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:20.484982    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6nc9" podUID="58b796b8-809f-4e12-8fba-b018a9af00c8"
Sep 08 14:34:20.598434 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:20.597497    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-20.ec2.internal" event={"ID":"dc403cc24af90cbf61a5edf297685b42","Type":"ContainerStarted","Data":"7a1196cb78eb99c46e3dc1b69ceed18e2257f9e25444dfc8beab2b45c4a2760b"}
Sep 08 14:34:20.599421 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:20.599392    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g9bkm" event={"ID":"3f89e9ca-0539-4ef8-9ee4-fa19dd2e939d","Type":"ContainerStarted","Data":"bce6bf1df794c4aaa717ad6fb570dd0ef48080ea966542578ade53f471064b34"}
Sep 08 14:34:20.602100 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:20.602070    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99cmr" event={"ID":"8c833587-71d4-41e7-9ac9-a68bea4f4f79","Type":"ContainerStarted","Data":"75b30bd37c369ffc06effeb66f553806cb65f7ff719eeb4dbafd5f93a7f894ab"}
Sep 08 14:34:20.603789 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:20.603756    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bm4ll" event={"ID":"dec62c8d-71a8-4b6c-b083-732017b99319","Type":"ContainerStarted","Data":"f10fcf0a93386e9f5d480efb59280aae44d51a38f367379dbd35d78f6e5f7857"}
Sep 08 14:34:20.606426 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:20.606060    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trsml" event={"ID":"52df79ef-8ace-4ac1-877c-15c9b70e7700","Type":"ContainerStarted","Data":"79774f0cb41fd811d60c8fe9edc39075f055e3f9cde291d70d7844620ae3e819"}
Sep 08 14:34:20.606426 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:20.606129    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trsml" event={"ID":"52df79ef-8ace-4ac1-877c-15c9b70e7700","Type":"ContainerStarted","Data":"dfb04b0901d2a5f2e0c414eadaca8db3473f79569f42039542b0a67c82ed9bff"}
Sep 08 14:34:20.608060 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:20.608036    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k87z4" event={"ID":"5ea167eb-ecbe-47f0-afca-1d0d6bccda05","Type":"ContainerStarted","Data":"4f34f190cc1446bc22d8296149bd3250f7548687a98afa56fd877b25bfc84741"}
Sep 08 14:34:20.609493 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:20.609446    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mjb8g" event={"ID":"cab4bd52-c6c1-48e1-9b14-fde47ac2dc46","Type":"ContainerStarted","Data":"fb9fe5888fd788419ee6d7fb46ce64804fcb65b9fa4681de34a3a44229a23f30"}
Sep 08 14:34:20.610797 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:20.610776    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cdrwc" event={"ID":"39ca315a-ad7a-40b8-9d3b-dc61691b0cc9","Type":"ContainerStarted","Data":"b12fba9789ffa75224b951f85091ecc24be9980714a6acdce34fe40c28873aa0"}
Sep 08 14:34:20.612748 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:20.612726    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v7lbx" event={"ID":"87b4044c-c2c8-437b-b227-79fd3821df6d","Type":"ContainerStarted","Data":"e1bc28d9cf815ea16b2b033e69685b713338ec2f3bb53e3f441be62d267fe355"}
Sep 08 14:34:20.614453 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:20.614412    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-20.ec2.internal" podStartSLOduration=19.61440152 podStartE2EDuration="19.61440152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:34:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:34:20.613940262 +0000 UTC m=+21.652341186" watchObservedRunningTime="2026-09-08 14:34:20.61440152 +0000 UTC m=+21.652802444"
Sep 08 14:34:20.630068 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:20.630030    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-g9bkm" podStartSLOduration=2.097664238 podStartE2EDuration="20.630014567s" totalImagesPullingTime="18.532350329s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:34:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:34:20.629889722 +0000 UTC m=+21.668290637" watchObservedRunningTime="2026-09-08 14:34:20.630014567 +0000 UTC m=+21.668415489"
Sep 08 14:34:20.651158 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:20.651111    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v7lbx" podStartSLOduration=2.995655319 podStartE2EDuration="21.651098539s" totalImagesPullingTime="18.65544322s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:33:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:34:20.65063584 +0000 UTC m=+21.689036765" watchObservedRunningTime="2026-09-08 14:34:20.651098539 +0000 UTC m=+21.689499462"
Sep 08 14:34:20.668050 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:20.667996    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mjb8g" podStartSLOduration=3.067560315 podStartE2EDuration="21.667979846s" totalImagesPullingTime="18.600419531s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:33:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:34:20.667847168 +0000 UTC m=+21.706248090" watchObservedRunningTime="2026-09-08 14:34:20.667979846 +0000 UTC m=+21.706380769"
Sep 08 14:34:20.722843 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:20.722799    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-k87z4" podStartSLOduration=6.853084966 podStartE2EDuration="21.722782779s" totalImagesPullingTime="14.869697813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:33:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:34:20.685569811 +0000 UTC m=+21.723970735" watchObservedRunningTime="2026-09-08 14:34:20.722782779 +0000 UTC m=+21.761183702"
Sep 08 14:34:20.723008 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:20.722979    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cdrwc" podStartSLOduration=3.136801529 podStartE2EDuration="21.722972717s" totalImagesPullingTime="18.586171188s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:33:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:34:20.722445092 +0000 UTC m=+21.760846018" watchObservedRunningTime="2026-09-08 14:34:20.722972717 +0000 UTC m=+21.761373631"
Sep 08 14:34:21.484452 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:21.484422    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jsdf"
Sep 08 14:34:21.484662 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:21.484531    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jsdf" podUID="e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0"
Sep 08 14:34:21.484662 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:21.484627    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:21.484793 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:21.484771    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nzr7f" podUID="85fae7c9-a2d7-44ee-b3b6-499f4d98cf35"
Sep 08 14:34:21.563041 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:21.563017    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-k87z4"
Sep 08 14:34:21.618250 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:21.618216    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trsml" event={"ID":"52df79ef-8ace-4ac1-877c-15c9b70e7700","Type":"ContainerStarted","Data":"ae4faa67a239d18fce0a645a3a0f6f76e27c14edeae3ab5847ebb9a59c518d89"}
Sep 08 14:34:21.618400 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:21.618305    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trsml" event={"ID":"52df79ef-8ace-4ac1-877c-15c9b70e7700","Type":"ContainerStarted","Data":"8370f7eaef228799a124dc0f0ccb9503522ae1135ee44eac64090730520adeae"}
Sep 08 14:34:21.618400 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:21.618352    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trsml" event={"ID":"52df79ef-8ace-4ac1-877c-15c9b70e7700","Type":"ContainerStarted","Data":"0522f0716bc67c9cbf91b0c72f04b04376d7a99fe30df75b85fcb3529efd8673"}
Sep 08 14:34:21.618543 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:21.618400    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trsml" event={"ID":"52df79ef-8ace-4ac1-877c-15c9b70e7700","Type":"ContainerStarted","Data":"e2ea20c6212de8e139921a650e62b60be6094b172925200dd44d7e67227a2020"}
Sep 08 14:34:21.619719 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:21.619693    2577 generic.go:356] "Generic (PLEG): container finished" podID="dec62c8d-71a8-4b6c-b083-732017b99319" containerID="f10fcf0a93386e9f5d480efb59280aae44d51a38f367379dbd35d78f6e5f7857" exitCode=0
Sep 08 14:34:21.619844 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:21.619800    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bm4ll" event={"ID":"dec62c8d-71a8-4b6c-b083-732017b99319","Type":"ContainerDied","Data":"f10fcf0a93386e9f5d480efb59280aae44d51a38f367379dbd35d78f6e5f7857"}
Sep 08 14:34:22.260390 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:22.260366    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 08 14:34:22.455115 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:22.454988    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T14:34:22.260386979Z","UUID":"1af70174-ef0f-4ae8-8096-dcb2b17ff003","Handler":null,"Name":"","Endpoint":""}
Sep 08 14:34:22.456590 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:22.456572    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 08 14:34:22.456716 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:22.456604    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 08 14:34:22.484632 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:22.484608    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:34:22.484772 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:22.484742    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6nc9" podUID="58b796b8-809f-4e12-8fba-b018a9af00c8"
Sep 08 14:34:22.624539 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:22.624504    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d5gtp" event={"ID":"237e7003-b821-4063-9adf-1484e76814bf","Type":"ContainerStarted","Data":"ad921a224adc2b0a636ea41ca1646579d907355a458211723833314e09cbd29d"}
Sep 08 14:34:22.626934 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:22.626911    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99cmr" event={"ID":"8c833587-71d4-41e7-9ac9-a68bea4f4f79","Type":"ContainerStarted","Data":"79c8e86cceabda04907e812368e2ac94866a42d44366dbf3553e0ecdd1859711"}
Sep 08 14:34:22.641431 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:22.641393    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-d5gtp" podStartSLOduration=4.102581166 podStartE2EDuration="22.641376162s" totalImagesPullingTime="18.538794996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:34:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:34:22.641054472 +0000 UTC m=+23.679455395" watchObservedRunningTime="2026-09-08 14:34:22.641376162 +0000 UTC m=+23.679777084"
Sep 08 14:34:23.485021 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:23.484989    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jsdf"
Sep 08 14:34:23.485181 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:23.485120    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jsdf" podUID="e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0"
Sep 08 14:34:23.485181 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:23.485170    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:23.485282 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:23.485263    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nzr7f" podUID="85fae7c9-a2d7-44ee-b3b6-499f4d98cf35"
Sep 08 14:34:23.633108 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:23.633020    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trsml" event={"ID":"52df79ef-8ace-4ac1-877c-15c9b70e7700","Type":"ContainerStarted","Data":"c81c4f25865eb4829eb9a8b6fe14a13b8cc819e843406defa72bfc93c16c01c9"}
Sep 08 14:34:24.484483 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:24.484433    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:34:24.484660 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:24.484581    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6nc9" podUID="58b796b8-809f-4e12-8fba-b018a9af00c8"
Sep 08 14:34:24.638341 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:24.638286    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99cmr" event={"ID":"8c833587-71d4-41e7-9ac9-a68bea4f4f79","Type":"ContainerStarted","Data":"8745eb2f133e3155b66d0bbb34d2793b17f861883977249ab5fd5e8c6a02fb87"}
Sep 08 14:34:24.658168 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:24.658111    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99cmr" podStartSLOduration=3.240141741 podStartE2EDuration="24.658092981s" totalImagesPullingTime="21.41795124s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:34:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:34:24.657292908 +0000 UTC m=+25.695693833" watchObservedRunningTime="2026-09-08 14:34:24.658092981 +0000 UTC m=+25.696493908"
Sep 08 14:34:24.688588 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:24.688562    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-k87z4"
Sep 08 14:34:24.689082 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:24.689066    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-k87z4"
Sep 08 14:34:25.484925 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:25.484890    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jsdf"
Sep 08 14:34:25.485113 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:25.485041    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jsdf" podUID="e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0"
Sep 08 14:34:25.485390 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:25.485368    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:25.485505 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:25.485462    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nzr7f" podUID="85fae7c9-a2d7-44ee-b3b6-499f4d98cf35"
Sep 08 14:34:25.641400 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:25.641367    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-k87z4"
Sep 08 14:34:26.484413 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:26.484238    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:34:26.484584 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:26.484557    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6nc9" podUID="58b796b8-809f-4e12-8fba-b018a9af00c8"
Sep 08 14:34:26.650608 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:26.650573    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-trsml" event={"ID":"52df79ef-8ace-4ac1-877c-15c9b70e7700","Type":"ContainerStarted","Data":"fcf05e9171a839702bcc098a26515871fcebcaca45af4faf5ea2acf1f2a2bdc6"}
Sep 08 14:34:26.679506 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:26.679441    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-trsml" podStartSLOduration=8.046682435 podStartE2EDuration="26.679424589s" totalImagesPullingTime="18.632742154s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:34:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:34:26.677948996 +0000 UTC m=+27.716349933" watchObservedRunningTime="2026-09-08 14:34:26.679424589 +0000 UTC m=+27.717825512"
Sep 08 14:34:27.484221 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:27.484194    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:27.484386 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:27.484318    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nzr7f" podUID="85fae7c9-a2d7-44ee-b3b6-499f4d98cf35"
Sep 08 14:34:27.484386 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:27.484368    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jsdf"
Sep 08 14:34:27.484499 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:27.484455    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jsdf" podUID="e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0"
Sep 08 14:34:27.654704 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:27.654670    2577 generic.go:356] "Generic (PLEG): container finished" podID="dec62c8d-71a8-4b6c-b083-732017b99319" containerID="2aeb485133a04f837a3ba1fe48eabb357e43f94bc2cd1a2c1712cb357e9569e4" exitCode=0
Sep 08 14:34:27.655284 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:27.654757    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bm4ll" event={"ID":"dec62c8d-71a8-4b6c-b083-732017b99319","Type":"ContainerDied","Data":"2aeb485133a04f837a3ba1fe48eabb357e43f94bc2cd1a2c1712cb357e9569e4"}
Sep 08 14:34:27.655331 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:27.655292    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:27.655428 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:27.655365    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:27.655428 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:27.655412    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:27.670920 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:27.670893    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:27.671062 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:27.671045    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:28.484958 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:28.484926    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:34:28.485109 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:28.485084    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6nc9" podUID="58b796b8-809f-4e12-8fba-b018a9af00c8"
Sep 08 14:34:28.545175 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:28.544940    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nzr7f"]
Sep 08 14:34:28.545313 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:28.545262    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:28.545395 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:28.545374    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nzr7f" podUID="85fae7c9-a2d7-44ee-b3b6-499f4d98cf35"
Sep 08 14:34:28.547379 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:28.547352    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5jsdf"]
Sep 08 14:34:28.547525 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:28.547435    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jsdf"
Sep 08 14:34:28.547632 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:28.547542    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jsdf" podUID="e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0"
Sep 08 14:34:28.550594 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:28.550559    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v6nc9"]
Sep 08 14:34:28.656676 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:28.656651    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:34:28.657008 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:28.656755    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6nc9" podUID="58b796b8-809f-4e12-8fba-b018a9af00c8"
Sep 08 14:34:29.661075 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:29.661041    2577 generic.go:356] "Generic (PLEG): container finished" podID="dec62c8d-71a8-4b6c-b083-732017b99319" containerID="66dd25d59e228461cf6c6a47c25e6dc01c430dfd3830def14f5534e46ca3d111" exitCode=0
Sep 08 14:34:29.661451 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:29.661122    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bm4ll" event={"ID":"dec62c8d-71a8-4b6c-b083-732017b99319","Type":"ContainerDied","Data":"66dd25d59e228461cf6c6a47c25e6dc01c430dfd3830def14f5534e46ca3d111"}
Sep 08 14:34:30.484892 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:30.484854    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jsdf"
Sep 08 14:34:30.485094 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:30.484981    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:34:30.485094 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:30.484991    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:30.485094 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:30.484987    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jsdf" podUID="e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0"
Sep 08 14:34:30.485282 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:30.485108    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6nc9" podUID="58b796b8-809f-4e12-8fba-b018a9af00c8"
Sep 08 14:34:30.485282 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:30.485199    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nzr7f" podUID="85fae7c9-a2d7-44ee-b3b6-499f4d98cf35"
Sep 08 14:34:31.668358 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:31.668325    2577 generic.go:356] "Generic (PLEG): container finished" podID="dec62c8d-71a8-4b6c-b083-732017b99319" containerID="bb4f069dce6c3fca28950c36b7dc099fd1298e7adcda99dd53ed4d1814f2bb0b" exitCode=0
Sep 08 14:34:31.668741 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:31.668389    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bm4ll" event={"ID":"dec62c8d-71a8-4b6c-b083-732017b99319","Type":"ContainerDied","Data":"bb4f069dce6c3fca28950c36b7dc099fd1298e7adcda99dd53ed4d1814f2bb0b"}
Sep 08 14:34:32.484710 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:32.484678    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jsdf"
Sep 08 14:34:32.484905 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:32.484686    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:32.484905 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:32.484794    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jsdf" podUID="e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0"
Sep 08 14:34:32.484905 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:32.484686    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:34:32.484905 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:32.484868    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nzr7f" podUID="85fae7c9-a2d7-44ee-b3b6-499f4d98cf35"
Sep 08 14:34:32.485095 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:32.484980    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6nc9" podUID="58b796b8-809f-4e12-8fba-b018a9af00c8"
Sep 08 14:34:33.147432 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:33.147397    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58b796b8-809f-4e12-8fba-b018a9af00c8-metrics-certs\") pod \"network-metrics-daemon-v6nc9\" (UID: \"58b796b8-809f-4e12-8fba-b018a9af00c8\") " pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:34:33.147975 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:33.147571    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:34:33.147975 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:33.147641    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58b796b8-809f-4e12-8fba-b018a9af00c8-metrics-certs podName:58b796b8-809f-4e12-8fba-b018a9af00c8 nodeName:}" failed. No retries permitted until 2026-09-08 14:35:05.147621506 +0000 UTC m=+66.186022420 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58b796b8-809f-4e12-8fba-b018a9af00c8-metrics-certs") pod "network-metrics-daemon-v6nc9" (UID: "58b796b8-809f-4e12-8fba-b018a9af00c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:34:33.248454 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:33.248422    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85fae7c9-a2d7-44ee-b3b6-499f4d98cf35-original-pull-secret\") pod \"global-pull-secret-syncer-nzr7f\" (UID: \"85fae7c9-a2d7-44ee-b3b6-499f4d98cf35\") " pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:33.248613 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:33.248554    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:34:33.248613 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:33.248607    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85fae7c9-a2d7-44ee-b3b6-499f4d98cf35-original-pull-secret podName:85fae7c9-a2d7-44ee-b3b6-499f4d98cf35 nodeName:}" failed. No retries permitted until 2026-09-08 14:35:05.248593793 +0000 UTC m=+66.286994694 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85fae7c9-a2d7-44ee-b3b6-499f4d98cf35-original-pull-secret") pod "global-pull-secret-syncer-nzr7f" (UID: "85fae7c9-a2d7-44ee-b3b6-499f4d98cf35") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:34:33.349343 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:33.349303    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn2gl\" (UniqueName: \"kubernetes.io/projected/e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0-kube-api-access-fn2gl\") pod \"network-check-target-5jsdf\" (UID: \"e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0\") " pod="openshift-network-diagnostics/network-check-target-5jsdf"
Sep 08 14:34:33.349525 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:33.349500    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:34:33.349577 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:33.349525    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:34:33.349577 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:33.349539    2577 projected.go:196] Error preparing data for projected volume kube-api-access-fn2gl for pod openshift-network-diagnostics/network-check-target-5jsdf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:34:33.349648 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:33.349604    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0-kube-api-access-fn2gl podName:e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0 nodeName:}" failed. No retries permitted until 2026-09-08 14:35:05.349584634 +0000 UTC m=+66.387985540 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fn2gl" (UniqueName: "kubernetes.io/projected/e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0-kube-api-access-fn2gl") pod "network-check-target-5jsdf" (UID: "e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:34:34.276803 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.276773    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-20.ec2.internal" event="NodeReady"
Sep 08 14:34:34.277183 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.276886    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 08 14:34:34.314736 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.314696    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54458ddb6b-qxnrt"]
Sep 08 14:34:34.354207 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.354008    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vvtk9"]
Sep 08 14:34:34.354207 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.354151    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:34:34.358666 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.358623    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 08 14:34:34.359353 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.359244    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7gv8x\""
Sep 08 14:34:34.361393 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.361371    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 08 14:34:34.361563 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.361540    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 08 14:34:34.366258 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.366238    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 08 14:34:34.373216 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.373195    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54458ddb6b-qxnrt"]
Sep 08 14:34:34.373302 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.373228    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bl4qh"]
Sep 08 14:34:34.373357 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.373315    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vvtk9"
Sep 08 14:34:34.376774 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.376757    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 08 14:34:34.376996 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.376773    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xpbhp\""
Sep 08 14:34:34.377076 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.377008    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 08 14:34:34.377076 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.377048    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 08 14:34:34.393366 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.393338    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vvtk9"]
Sep 08 14:34:34.393451 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.393371    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bl4qh"]
Sep 08 14:34:34.393451 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.393443    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bl4qh"
Sep 08 14:34:34.396151 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.396127    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 08 14:34:34.396248 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.396181    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rsnws\""
Sep 08 14:34:34.396395 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.396377    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 08 14:34:34.462615 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.462576    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-bound-sa-token\") pod \"image-registry-54458ddb6b-qxnrt\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") " pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:34:34.462781 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.462639    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/67dab4b4-b501-487d-8df6-89b7c715fa80-ca-trust-extracted\") pod \"image-registry-54458ddb6b-qxnrt\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") " pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:34:34.462781 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.462672    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-certificates\") pod \"image-registry-54458ddb6b-qxnrt\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") " pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:34:34.462781 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.462703    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/67dab4b4-b501-487d-8df6-89b7c715fa80-image-registry-private-configuration\") pod \"image-registry-54458ddb6b-qxnrt\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") " pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:34:34.462781 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.462734    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b275d6c-b08b-43d0-9988-e35e6657baeb-cert\") pod \"ingress-canary-vvtk9\" (UID: \"1b275d6c-b08b-43d0-9988-e35e6657baeb\") " pod="openshift-ingress-canary/ingress-canary-vvtk9"
Sep 08 14:34:34.462976 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.462825    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-tls\") pod \"image-registry-54458ddb6b-qxnrt\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") " pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:34:34.462976 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.462853    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vw7n\" (UniqueName: \"kubernetes.io/projected/1b275d6c-b08b-43d0-9988-e35e6657baeb-kube-api-access-8vw7n\") pod \"ingress-canary-vvtk9\" (UID: \"1b275d6c-b08b-43d0-9988-e35e6657baeb\") " pod="openshift-ingress-canary/ingress-canary-vvtk9"
Sep 08 14:34:34.462976 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.462889    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtb84\" (UniqueName: \"kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-kube-api-access-qtb84\") pod \"image-registry-54458ddb6b-qxnrt\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") " pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:34:34.462976 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.462956    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/67dab4b4-b501-487d-8df6-89b7c715fa80-installation-pull-secrets\") pod \"image-registry-54458ddb6b-qxnrt\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") " pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:34:34.463170 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.462993    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67dab4b4-b501-487d-8df6-89b7c715fa80-trusted-ca\") pod \"image-registry-54458ddb6b-qxnrt\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") " pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:34:34.484876 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.484840    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:34:34.485026 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.484840    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:34:34.485026 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.484844    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jsdf"
Sep 08 14:34:34.488508 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.488462    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-42kmv\""
Sep 08 14:34:34.488816 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.488797    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 14:34:34.488979 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.488864    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 14:34:34.488979 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.488932    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nvk2x\""
Sep 08 14:34:34.488979 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.488805    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 14:34:34.489198 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.489159    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 14:34:34.563859 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.563781    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee765ac4-29fe-4529-8f78-23d2f886aa15-tmp-dir\") pod \"dns-default-bl4qh\" (UID: \"ee765ac4-29fe-4529-8f78-23d2f886aa15\") " pod="openshift-dns/dns-default-bl4qh"
Sep 08 14:34:34.563859 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.563827    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vlfg\" (UniqueName: \"kubernetes.io/projected/ee765ac4-29fe-4529-8f78-23d2f886aa15-kube-api-access-4vlfg\") pod \"dns-default-bl4qh\" (UID: \"ee765ac4-29fe-4529-8f78-23d2f886aa15\") " pod="openshift-dns/dns-default-bl4qh"
Sep 08 14:34:34.564071 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.563863    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/67dab4b4-b501-487d-8df6-89b7c715fa80-installation-pull-secrets\") pod \"image-registry-54458ddb6b-qxnrt\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") " pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:34:34.564071 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.563892    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67dab4b4-b501-487d-8df6-89b7c715fa80-trusted-ca\") pod \"image-registry-54458ddb6b-qxnrt\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") " pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:34:34.564071 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.563913    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-bound-sa-token\") pod \"image-registry-54458ddb6b-qxnrt\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") " pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:34:34.564071 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.563941    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee765ac4-29fe-4529-8f78-23d2f886aa15-metrics-tls\") pod \"dns-default-bl4qh\" (UID: \"ee765ac4-29fe-4529-8f78-23d2f886aa15\") " pod="openshift-dns/dns-default-bl4qh"
Sep 08 14:34:34.564071 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.563968    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/67dab4b4-b501-487d-8df6-89b7c715fa80-ca-trust-extracted\") pod \"image-registry-54458ddb6b-qxnrt\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") " pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:34:34.564071 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.564036    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-certificates\") pod \"image-registry-54458ddb6b-qxnrt\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") " pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:34:34.564374 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.564084    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/67dab4b4-b501-487d-8df6-89b7c715fa80-image-registry-private-configuration\") pod \"image-registry-54458ddb6b-qxnrt\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") " pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:34:34.564374 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.564117    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b275d6c-b08b-43d0-9988-e35e6657baeb-cert\") pod \"ingress-canary-vvtk9\" (UID: \"1b275d6c-b08b-43d0-9988-e35e6657baeb\") " pod="openshift-ingress-canary/ingress-canary-vvtk9"
Sep 08 14:34:34.564374 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.564158    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ee765ac4-29fe-4529-8f78-23d2f886aa15-config-volume\") pod \"dns-default-bl4qh\" (UID: \"ee765ac4-29fe-4529-8f78-23d2f886aa15\") " pod="openshift-dns/dns-default-bl4qh"
Sep 08 14:34:34.564374 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.564241    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-tls\") pod \"image-registry-54458ddb6b-qxnrt\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") " pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:34:34.564374 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.564271    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vw7n\" (UniqueName: \"kubernetes.io/projected/1b275d6c-b08b-43d0-9988-e35e6657baeb-kube-api-access-8vw7n\") pod \"ingress-canary-vvtk9\" (UID: \"1b275d6c-b08b-43d0-9988-e35e6657baeb\") " pod="openshift-ingress-canary/ingress-canary-vvtk9"
Sep 08 14:34:34.564374 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.564316    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtb84\" (UniqueName: \"kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-kube-api-access-qtb84\") pod \"image-registry-54458ddb6b-qxnrt\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") " pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:34:34.564704 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.564417    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/67dab4b4-b501-487d-8df6-89b7c715fa80-ca-trust-extracted\") pod \"image-registry-54458ddb6b-qxnrt\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") " pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:34:34.564704 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:34.564571    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 14:34:34.564704 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:34.564590    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54458ddb6b-qxnrt: secret "image-registry-tls" not found
Sep 08 14:34:34.564704 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:34.564656    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-tls podName:67dab4b4-b501-487d-8df6-89b7c715fa80 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:35.064632504 +0000 UTC m=+36.103033434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-tls") pod "image-registry-54458ddb6b-qxnrt" (UID: "67dab4b4-b501-487d-8df6-89b7c715fa80") : secret "image-registry-tls" not found
Sep 08 14:34:34.564899 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.564742    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-certificates\") pod \"image-registry-54458ddb6b-qxnrt\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") " pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:34:34.565511 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.565486    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67dab4b4-b501-487d-8df6-89b7c715fa80-trusted-ca\") pod \"image-registry-54458ddb6b-qxnrt\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") " pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:34:34.568225 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.568199    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/67dab4b4-b501-487d-8df6-89b7c715fa80-image-registry-private-configuration\") pod \"image-registry-54458ddb6b-qxnrt\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") " pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:34:34.568302 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.568211    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b275d6c-b08b-43d0-9988-e35e6657baeb-cert\") pod \"ingress-canary-vvtk9\" (UID: \"1b275d6c-b08b-43d0-9988-e35e6657baeb\") " pod="openshift-ingress-canary/ingress-canary-vvtk9"
Sep 08 14:34:34.568302 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.568211    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/67dab4b4-b501-487d-8df6-89b7c715fa80-installation-pull-secrets\") pod \"image-registry-54458ddb6b-qxnrt\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") " pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:34:34.576177 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.576148    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-bound-sa-token\") pod \"image-registry-54458ddb6b-qxnrt\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") " pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:34:34.576252 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.576188    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vw7n\" (UniqueName: \"kubernetes.io/projected/1b275d6c-b08b-43d0-9988-e35e6657baeb-kube-api-access-8vw7n\") pod \"ingress-canary-vvtk9\" (UID: \"1b275d6c-b08b-43d0-9988-e35e6657baeb\") " pod="openshift-ingress-canary/ingress-canary-vvtk9"
Sep 08 14:34:34.576730 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.576713    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtb84\" (UniqueName: \"kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-kube-api-access-qtb84\") pod \"image-registry-54458ddb6b-qxnrt\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") " pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:34:34.664903 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.664865    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ee765ac4-29fe-4529-8f78-23d2f886aa15-config-volume\") pod \"dns-default-bl4qh\" (UID: \"ee765ac4-29fe-4529-8f78-23d2f886aa15\") " pod="openshift-dns/dns-default-bl4qh"
Sep 08 14:34:34.665099 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.664977    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee765ac4-29fe-4529-8f78-23d2f886aa15-tmp-dir\") pod \"dns-default-bl4qh\" (UID: \"ee765ac4-29fe-4529-8f78-23d2f886aa15\") " pod="openshift-dns/dns-default-bl4qh"
Sep 08 14:34:34.665099 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.665028    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vlfg\" (UniqueName: \"kubernetes.io/projected/ee765ac4-29fe-4529-8f78-23d2f886aa15-kube-api-access-4vlfg\") pod \"dns-default-bl4qh\" (UID: \"ee765ac4-29fe-4529-8f78-23d2f886aa15\") " pod="openshift-dns/dns-default-bl4qh"
Sep 08 14:34:34.665099 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.665065    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee765ac4-29fe-4529-8f78-23d2f886aa15-metrics-tls\") pod \"dns-default-bl4qh\" (UID: \"ee765ac4-29fe-4529-8f78-23d2f886aa15\") " pod="openshift-dns/dns-default-bl4qh"
Sep 08 14:34:34.665241 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:34.665183    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 14:34:34.665293 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:34.665245    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee765ac4-29fe-4529-8f78-23d2f886aa15-metrics-tls podName:ee765ac4-29fe-4529-8f78-23d2f886aa15 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:35.16522529 +0000 UTC m=+36.203626206 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ee765ac4-29fe-4529-8f78-23d2f886aa15-metrics-tls") pod "dns-default-bl4qh" (UID: "ee765ac4-29fe-4529-8f78-23d2f886aa15") : secret "dns-default-metrics-tls" not found
Sep 08 14:34:34.665399 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.665308    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee765ac4-29fe-4529-8f78-23d2f886aa15-tmp-dir\") pod \"dns-default-bl4qh\" (UID: \"ee765ac4-29fe-4529-8f78-23d2f886aa15\") " pod="openshift-dns/dns-default-bl4qh"
Sep 08 14:34:34.665546 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.665519    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ee765ac4-29fe-4529-8f78-23d2f886aa15-config-volume\") pod \"dns-default-bl4qh\" (UID: \"ee765ac4-29fe-4529-8f78-23d2f886aa15\") " pod="openshift-dns/dns-default-bl4qh"
Sep 08 14:34:34.682858 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.682836    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vlfg\" (UniqueName: \"kubernetes.io/projected/ee765ac4-29fe-4529-8f78-23d2f886aa15-kube-api-access-4vlfg\") pod \"dns-default-bl4qh\" (UID: \"ee765ac4-29fe-4529-8f78-23d2f886aa15\") " pod="openshift-dns/dns-default-bl4qh"
Sep 08 14:34:34.682961 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:34.682902    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vvtk9"
Sep 08 14:34:35.068565 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:35.068529    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-tls\") pod \"image-registry-54458ddb6b-qxnrt\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") " pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:34:35.068797 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:35.068677    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 14:34:35.068797 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:35.068695    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54458ddb6b-qxnrt: secret "image-registry-tls" not found
Sep 08 14:34:35.068797 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:35.068758    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-tls podName:67dab4b4-b501-487d-8df6-89b7c715fa80 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:36.068736137 +0000 UTC m=+37.107137054 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-tls") pod "image-registry-54458ddb6b-qxnrt" (UID: "67dab4b4-b501-487d-8df6-89b7c715fa80") : secret "image-registry-tls" not found
Sep 08 14:34:35.169179 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:35.169136    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee765ac4-29fe-4529-8f78-23d2f886aa15-metrics-tls\") pod \"dns-default-bl4qh\" (UID: \"ee765ac4-29fe-4529-8f78-23d2f886aa15\") " pod="openshift-dns/dns-default-bl4qh"
Sep 08 14:34:35.169352 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:35.169313    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 14:34:35.169418 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:35.169381    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee765ac4-29fe-4529-8f78-23d2f886aa15-metrics-tls podName:ee765ac4-29fe-4529-8f78-23d2f886aa15 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:36.169362755 +0000 UTC m=+37.207763863 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ee765ac4-29fe-4529-8f78-23d2f886aa15-metrics-tls") pod "dns-default-bl4qh" (UID: "ee765ac4-29fe-4529-8f78-23d2f886aa15") : secret "dns-default-metrics-tls" not found
Sep 08 14:34:36.075463 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:36.075428    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-tls\") pod \"image-registry-54458ddb6b-qxnrt\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") " pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:34:36.075952 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:36.075618    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 14:34:36.075952 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:36.075639    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54458ddb6b-qxnrt: secret "image-registry-tls" not found
Sep 08 14:34:36.075952 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:36.075697    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-tls podName:67dab4b4-b501-487d-8df6-89b7c715fa80 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:38.075681327 +0000 UTC m=+39.114082232 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-tls") pod "image-registry-54458ddb6b-qxnrt" (UID: "67dab4b4-b501-487d-8df6-89b7c715fa80") : secret "image-registry-tls" not found
Sep 08 14:34:36.176221 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:36.176185    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee765ac4-29fe-4529-8f78-23d2f886aa15-metrics-tls\") pod \"dns-default-bl4qh\" (UID: \"ee765ac4-29fe-4529-8f78-23d2f886aa15\") " pod="openshift-dns/dns-default-bl4qh"
Sep 08 14:34:36.176383 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:36.176358    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 14:34:36.176463 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:36.176451    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee765ac4-29fe-4529-8f78-23d2f886aa15-metrics-tls podName:ee765ac4-29fe-4529-8f78-23d2f886aa15 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:38.17642768 +0000 UTC m=+39.214828599 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ee765ac4-29fe-4529-8f78-23d2f886aa15-metrics-tls") pod "dns-default-bl4qh" (UID: "ee765ac4-29fe-4529-8f78-23d2f886aa15") : secret "dns-default-metrics-tls" not found
Sep 08 14:34:36.388749 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:36.388718    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vvtk9"]
Sep 08 14:34:36.391936 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:34:36.391906    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b275d6c_b08b_43d0_9988_e35e6657baeb.slice/crio-a99617225a5d5a0fe28dd036694162785ef185252ef13792ac613d3775208d94 WatchSource:0}: Error finding container a99617225a5d5a0fe28dd036694162785ef185252ef13792ac613d3775208d94: Status 404 returned error can't find the container with id a99617225a5d5a0fe28dd036694162785ef185252ef13792ac613d3775208d94
Sep 08 14:34:36.681972 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:36.681942    2577 generic.go:356] "Generic (PLEG): container finished" podID="dec62c8d-71a8-4b6c-b083-732017b99319" containerID="8565f6eebc8bea230657a154fa0ea0b87d78d999432bb915c327cb37f6066d35" exitCode=0
Sep 08 14:34:36.682150 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:36.682024    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bm4ll" event={"ID":"dec62c8d-71a8-4b6c-b083-732017b99319","Type":"ContainerDied","Data":"8565f6eebc8bea230657a154fa0ea0b87d78d999432bb915c327cb37f6066d35"}
Sep 08 14:34:36.683189 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:36.683167    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vvtk9" event={"ID":"1b275d6c-b08b-43d0-9988-e35e6657baeb","Type":"ContainerStarted","Data":"a99617225a5d5a0fe28dd036694162785ef185252ef13792ac613d3775208d94"}
Sep 08 14:34:37.688553 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:37.688363    2577 generic.go:356] "Generic (PLEG): container finished" podID="dec62c8d-71a8-4b6c-b083-732017b99319" containerID="b3a354bcb77204b0cc28b7a91d31a8b3068f71b71ed57e0be95448c4b6d54b07" exitCode=0
Sep 08 14:34:37.689242 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:37.688438    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bm4ll" event={"ID":"dec62c8d-71a8-4b6c-b083-732017b99319","Type":"ContainerDied","Data":"b3a354bcb77204b0cc28b7a91d31a8b3068f71b71ed57e0be95448c4b6d54b07"}
Sep 08 14:34:38.088803 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:38.088720    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-tls\") pod \"image-registry-54458ddb6b-qxnrt\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") " pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:34:38.088940 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:38.088883    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 14:34:38.088940 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:38.088902    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54458ddb6b-qxnrt: secret "image-registry-tls" not found
Sep 08 14:34:38.089025 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:38.088961    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-tls podName:67dab4b4-b501-487d-8df6-89b7c715fa80 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:42.088943455 +0000 UTC m=+43.127344385 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-tls") pod "image-registry-54458ddb6b-qxnrt" (UID: "67dab4b4-b501-487d-8df6-89b7c715fa80") : secret "image-registry-tls" not found
Sep 08 14:34:38.189622 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:38.189588    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee765ac4-29fe-4529-8f78-23d2f886aa15-metrics-tls\") pod \"dns-default-bl4qh\" (UID: \"ee765ac4-29fe-4529-8f78-23d2f886aa15\") " pod="openshift-dns/dns-default-bl4qh"
Sep 08 14:34:38.189759 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:38.189707    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 14:34:38.189759 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:38.189755    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee765ac4-29fe-4529-8f78-23d2f886aa15-metrics-tls podName:ee765ac4-29fe-4529-8f78-23d2f886aa15 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:42.189742363 +0000 UTC m=+43.228143263 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ee765ac4-29fe-4529-8f78-23d2f886aa15-metrics-tls") pod "dns-default-bl4qh" (UID: "ee765ac4-29fe-4529-8f78-23d2f886aa15") : secret "dns-default-metrics-tls" not found
Sep 08 14:34:38.695127 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:38.695092    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bm4ll" event={"ID":"dec62c8d-71a8-4b6c-b083-732017b99319","Type":"ContainerStarted","Data":"7b4887ed11c0faa4ee26b0306724a5719ff9cbcb0604ac91c7f1f4d56b7719f3"}
Sep 08 14:34:40.702216 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:40.702135    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vvtk9" event={"ID":"1b275d6c-b08b-43d0-9988-e35e6657baeb","Type":"ContainerStarted","Data":"850a0f3d5652e6237069f44b82eb53080c9f9e23263afc046f9a82185ec02a73"}
Sep 08 14:34:40.720151 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:40.720087    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vvtk9" podStartSLOduration=2.686123749 podStartE2EDuration="6.720069119s" totalImagesPullingTime="4.03394537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:34:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:34:40.719809305 +0000 UTC m=+41.758210227" watchObservedRunningTime="2026-09-08 14:34:40.720069119 +0000 UTC m=+41.758470043"
Sep 08 14:34:40.720455 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:40.720431    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bm4ll" podStartSLOduration=9.960612959 podStartE2EDuration="40.720419522s" totalImagesPullingTime="30.759806563s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:34:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:34:38.732724549 +0000 UTC m=+39.771125505" watchObservedRunningTime="2026-09-08 14:34:40.720419522 +0000 UTC m=+41.758820444"
Sep 08 14:34:42.121508 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:42.121450    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-tls\") pod \"image-registry-54458ddb6b-qxnrt\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") " pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:34:42.121877 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:42.121604    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 14:34:42.121877 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:42.121623    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54458ddb6b-qxnrt: secret "image-registry-tls" not found
Sep 08 14:34:42.121877 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:42.121674    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-tls podName:67dab4b4-b501-487d-8df6-89b7c715fa80 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:50.121660879 +0000 UTC m=+51.160061811 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-tls") pod "image-registry-54458ddb6b-qxnrt" (UID: "67dab4b4-b501-487d-8df6-89b7c715fa80") : secret "image-registry-tls" not found
Sep 08 14:34:42.222324 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:42.222294    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee765ac4-29fe-4529-8f78-23d2f886aa15-metrics-tls\") pod \"dns-default-bl4qh\" (UID: \"ee765ac4-29fe-4529-8f78-23d2f886aa15\") " pod="openshift-dns/dns-default-bl4qh"
Sep 08 14:34:42.222484 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:42.222398    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 14:34:42.222484 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:42.222458    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee765ac4-29fe-4529-8f78-23d2f886aa15-metrics-tls podName:ee765ac4-29fe-4529-8f78-23d2f886aa15 nodeName:}" failed. No retries permitted until 2026-09-08 14:34:50.222444819 +0000 UTC m=+51.260845720 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ee765ac4-29fe-4529-8f78-23d2f886aa15-metrics-tls") pod "dns-default-bl4qh" (UID: "ee765ac4-29fe-4529-8f78-23d2f886aa15") : secret "dns-default-metrics-tls" not found
Sep 08 14:34:50.177505 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:50.177455    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-tls\") pod \"image-registry-54458ddb6b-qxnrt\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") " pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:34:50.177939 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:50.177615    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 14:34:50.177939 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:50.177634    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54458ddb6b-qxnrt: secret "image-registry-tls" not found
Sep 08 14:34:50.177939 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:50.177707    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-tls podName:67dab4b4-b501-487d-8df6-89b7c715fa80 nodeName:}" failed. No retries permitted until 2026-09-08 14:35:06.177689829 +0000 UTC m=+67.216090729 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-tls") pod "image-registry-54458ddb6b-qxnrt" (UID: "67dab4b4-b501-487d-8df6-89b7c715fa80") : secret "image-registry-tls" not found
Sep 08 14:34:50.278194 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:50.278158    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee765ac4-29fe-4529-8f78-23d2f886aa15-metrics-tls\") pod \"dns-default-bl4qh\" (UID: \"ee765ac4-29fe-4529-8f78-23d2f886aa15\") " pod="openshift-dns/dns-default-bl4qh"
Sep 08 14:34:50.278315 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:50.278301    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 14:34:50.278380 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:34:50.278371    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee765ac4-29fe-4529-8f78-23d2f886aa15-metrics-tls podName:ee765ac4-29fe-4529-8f78-23d2f886aa15 nodeName:}" failed. No retries permitted until 2026-09-08 14:35:06.278351731 +0000 UTC m=+67.316752633 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ee765ac4-29fe-4529-8f78-23d2f886aa15-metrics-tls") pod "dns-default-bl4qh" (UID: "ee765ac4-29fe-4529-8f78-23d2f886aa15") : secret "dns-default-metrics-tls" not found
Sep 08 14:34:55.927479 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:55.927435    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-9f956"]
Sep 08 14:34:55.932581 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:55.932553    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9f956"
Sep 08 14:34:55.935610 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:55.935588    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 08 14:34:55.936057 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:55.936042    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-mkdtw\""
Sep 08 14:34:55.936771 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:55.936756    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 08 14:34:55.936829 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:55.936817    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 08 14:34:55.943734 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:55.943713    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-9f956"]
Sep 08 14:34:55.945942 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:55.945925    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 08 14:34:56.019416 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.019390    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtfkb\" (UniqueName: \"kubernetes.io/projected/8cafbda6-6a6f-4ef1-999c-da76dfd7dc6d-kube-api-access-gtfkb\") pod \"service-ca-operator-859f94c4b-9f956\" (UID: \"8cafbda6-6a6f-4ef1-999c-da76dfd7dc6d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9f956"
Sep 08 14:34:56.019516 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.019435    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8cafbda6-6a6f-4ef1-999c-da76dfd7dc6d-config\") pod \"service-ca-operator-859f94c4b-9f956\" (UID: \"8cafbda6-6a6f-4ef1-999c-da76dfd7dc6d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9f956"
Sep 08 14:34:56.019516 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.019460    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8cafbda6-6a6f-4ef1-999c-da76dfd7dc6d-serving-cert\") pod \"service-ca-operator-859f94c4b-9f956\" (UID: \"8cafbda6-6a6f-4ef1-999c-da76dfd7dc6d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9f956"
Sep 08 14:34:56.120189 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.120110    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8cafbda6-6a6f-4ef1-999c-da76dfd7dc6d-config\") pod \"service-ca-operator-859f94c4b-9f956\" (UID: \"8cafbda6-6a6f-4ef1-999c-da76dfd7dc6d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9f956"
Sep 08 14:34:56.120189 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.120143    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8cafbda6-6a6f-4ef1-999c-da76dfd7dc6d-serving-cert\") pod \"service-ca-operator-859f94c4b-9f956\" (UID: \"8cafbda6-6a6f-4ef1-999c-da76dfd7dc6d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9f956"
Sep 08 14:34:56.120434 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.120416    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtfkb\" (UniqueName: \"kubernetes.io/projected/8cafbda6-6a6f-4ef1-999c-da76dfd7dc6d-kube-api-access-gtfkb\") pod \"service-ca-operator-859f94c4b-9f956\" (UID: \"8cafbda6-6a6f-4ef1-999c-da76dfd7dc6d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9f956"
Sep 08 14:34:56.120747 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.120730    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8cafbda6-6a6f-4ef1-999c-da76dfd7dc6d-config\") pod \"service-ca-operator-859f94c4b-9f956\" (UID: \"8cafbda6-6a6f-4ef1-999c-da76dfd7dc6d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9f956"
Sep 08 14:34:56.123658 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.123639    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8cafbda6-6a6f-4ef1-999c-da76dfd7dc6d-serving-cert\") pod \"service-ca-operator-859f94c4b-9f956\" (UID: \"8cafbda6-6a6f-4ef1-999c-da76dfd7dc6d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9f956"
Sep 08 14:34:56.132915 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.132896    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fhk8t"]
Sep 08 14:34:56.136748 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.136735    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fhk8t"
Sep 08 14:34:56.139936 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.139909    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 08 14:34:56.140018 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.139968    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 08 14:34:56.140068 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.139968    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 08 14:34:56.140283 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.140268    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 08 14:34:56.140345 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.140279    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8dlzn\""
Sep 08 14:34:56.143908 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.143887    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtfkb\" (UniqueName: \"kubernetes.io/projected/8cafbda6-6a6f-4ef1-999c-da76dfd7dc6d-kube-api-access-gtfkb\") pod \"service-ca-operator-859f94c4b-9f956\" (UID: \"8cafbda6-6a6f-4ef1-999c-da76dfd7dc6d\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9f956"
Sep 08 14:34:56.147520 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.147501    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fhk8t"]
Sep 08 14:34:56.221619 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.221591    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2abb23b6-32c5-4ac9-bdb1-94950de2206c-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-fhk8t\" (UID: \"2abb23b6-32c5-4ac9-bdb1-94950de2206c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fhk8t"
Sep 08 14:34:56.221780 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.221654    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2abb23b6-32c5-4ac9-bdb1-94950de2206c-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-fhk8t\" (UID: \"2abb23b6-32c5-4ac9-bdb1-94950de2206c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fhk8t"
Sep 08 14:34:56.221780 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.221692    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv8p4\" (UniqueName: \"kubernetes.io/projected/2abb23b6-32c5-4ac9-bdb1-94950de2206c-kube-api-access-lv8p4\") pod \"kube-storage-version-migrator-operator-8d7dd4675-fhk8t\" (UID: \"2abb23b6-32c5-4ac9-bdb1-94950de2206c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fhk8t"
Sep 08 14:34:56.241597 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.241572    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9f956"
Sep 08 14:34:56.322890 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.322862    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2abb23b6-32c5-4ac9-bdb1-94950de2206c-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-fhk8t\" (UID: \"2abb23b6-32c5-4ac9-bdb1-94950de2206c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fhk8t"
Sep 08 14:34:56.323010 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.322899    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv8p4\" (UniqueName: \"kubernetes.io/projected/2abb23b6-32c5-4ac9-bdb1-94950de2206c-kube-api-access-lv8p4\") pod \"kube-storage-version-migrator-operator-8d7dd4675-fhk8t\" (UID: \"2abb23b6-32c5-4ac9-bdb1-94950de2206c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fhk8t"
Sep 08 14:34:56.323072 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.323054    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2abb23b6-32c5-4ac9-bdb1-94950de2206c-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-fhk8t\" (UID: \"2abb23b6-32c5-4ac9-bdb1-94950de2206c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fhk8t"
Sep 08 14:34:56.323584 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.323503    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2abb23b6-32c5-4ac9-bdb1-94950de2206c-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-fhk8t\" (UID: \"2abb23b6-32c5-4ac9-bdb1-94950de2206c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fhk8t"
Sep 08 14:34:56.325119 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.325098    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2abb23b6-32c5-4ac9-bdb1-94950de2206c-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-fhk8t\" (UID: \"2abb23b6-32c5-4ac9-bdb1-94950de2206c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fhk8t"
Sep 08 14:34:56.331096 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.331069    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv8p4\" (UniqueName: \"kubernetes.io/projected/2abb23b6-32c5-4ac9-bdb1-94950de2206c-kube-api-access-lv8p4\") pod \"kube-storage-version-migrator-operator-8d7dd4675-fhk8t\" (UID: \"2abb23b6-32c5-4ac9-bdb1-94950de2206c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fhk8t"
Sep 08 14:34:56.445714 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.445691    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fhk8t"
Sep 08 14:34:56.522999 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.522972    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-9f956"]
Sep 08 14:34:56.526123 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:34:56.526102    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cafbda6_6a6f_4ef1_999c_da76dfd7dc6d.slice/crio-e916ddb745782241718d3f7cf3fb4aac372c2b2cc1d09d0dd8b2758de7de4edc WatchSource:0}: Error finding container e916ddb745782241718d3f7cf3fb4aac372c2b2cc1d09d0dd8b2758de7de4edc: Status 404 returned error can't find the container with id e916ddb745782241718d3f7cf3fb4aac372c2b2cc1d09d0dd8b2758de7de4edc
Sep 08 14:34:56.715034 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.714972    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fhk8t"]
Sep 08 14:34:56.718325 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:34:56.718303    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2abb23b6_32c5_4ac9_bdb1_94950de2206c.slice/crio-33cb095633c3514dc273735b5ac9128af9647f00b9f7ca0f78cf8bf9e32cd77f WatchSource:0}: Error finding container 33cb095633c3514dc273735b5ac9128af9647f00b9f7ca0f78cf8bf9e32cd77f: Status 404 returned error can't find the container with id 33cb095633c3514dc273735b5ac9128af9647f00b9f7ca0f78cf8bf9e32cd77f
Sep 08 14:34:56.736138 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.736110    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fhk8t" event={"ID":"2abb23b6-32c5-4ac9-bdb1-94950de2206c","Type":"ContainerStarted","Data":"33cb095633c3514dc273735b5ac9128af9647f00b9f7ca0f78cf8bf9e32cd77f"}
Sep 08 14:34:56.737101 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:56.737084    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9f956" event={"ID":"8cafbda6-6a6f-4ef1-999c-da76dfd7dc6d","Type":"ContainerStarted","Data":"e916ddb745782241718d3f7cf3fb4aac372c2b2cc1d09d0dd8b2758de7de4edc"}
Sep 08 14:34:59.672025 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:59.671995    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-trsml"
Sep 08 14:34:59.747369 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:59.747333    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fhk8t" event={"ID":"2abb23b6-32c5-4ac9-bdb1-94950de2206c","Type":"ContainerStarted","Data":"c0ae697979b488740c8534df06a2ce9211cb9c7cc6dcd6d3a586e813ad931f48"}
Sep 08 14:34:59.749033 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:59.749005    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9f956" event={"ID":"8cafbda6-6a6f-4ef1-999c-da76dfd7dc6d","Type":"ContainerStarted","Data":"a288953267ad0ee220bfb9d5506903c034b33df767656f325fe78e942020a1a9"}
Sep 08 14:34:59.765986 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:59.765937    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fhk8t" podStartSLOduration=0.948825913 podStartE2EDuration="3.765918254s" totalImagesPullingTime="2.817092341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:34:59.76573276 +0000 UTC m=+60.804133682" watchObservedRunningTime="2026-09-08 14:34:59.765918254 +0000 UTC m=+60.804319178"
Sep 08 14:34:59.782652 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:34:59.782604    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9f956" podStartSLOduration=1.775002657 podStartE2EDuration="4.782584967s" totalImagesPullingTime="3.00758231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:34:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:34:59.782229821 +0000 UTC m=+60.820630743" watchObservedRunningTime="2026-09-08 14:34:59.782584967 +0000 UTC m=+60.820985891"
Sep 08 14:35:01.500958 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:01.500930    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nxh6k"]
Sep 08 14:35:01.504114 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:01.504095    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nxh6k"
Sep 08 14:35:01.506629 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:01.506609    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 08 14:35:01.506776 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:01.506758    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 08 14:35:01.506828 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:01.506801    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 08 14:35:01.507023 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:01.507010    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7h2nw\""
Sep 08 14:35:01.507197 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:01.507185    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 08 14:35:01.517273 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:01.517249    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nxh6k"]
Sep 08 14:35:01.564199 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:01.564165    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/767124fd-f9fe-4100-afd8-1a60106e384c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxh6k\" (UID: \"767124fd-f9fe-4100-afd8-1a60106e384c\") " pod="openshift-insights/insights-runtime-extractor-nxh6k"
Sep 08 14:35:01.564341 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:01.564216    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d99vq\" (UniqueName: \"kubernetes.io/projected/767124fd-f9fe-4100-afd8-1a60106e384c-kube-api-access-d99vq\") pod \"insights-runtime-extractor-nxh6k\" (UID: \"767124fd-f9fe-4100-afd8-1a60106e384c\") " pod="openshift-insights/insights-runtime-extractor-nxh6k"
Sep 08 14:35:01.564341 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:01.564315    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/767124fd-f9fe-4100-afd8-1a60106e384c-data-volume\") pod \"insights-runtime-extractor-nxh6k\" (UID: \"767124fd-f9fe-4100-afd8-1a60106e384c\") " pod="openshift-insights/insights-runtime-extractor-nxh6k"
Sep 08 14:35:01.564433 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:01.564356    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/767124fd-f9fe-4100-afd8-1a60106e384c-crio-socket\") pod \"insights-runtime-extractor-nxh6k\" (UID: \"767124fd-f9fe-4100-afd8-1a60106e384c\") " pod="openshift-insights/insights-runtime-extractor-nxh6k"
Sep 08 14:35:01.564433 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:01.564389    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/767124fd-f9fe-4100-afd8-1a60106e384c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxh6k\" (UID: \"767124fd-f9fe-4100-afd8-1a60106e384c\") " pod="openshift-insights/insights-runtime-extractor-nxh6k"
Sep 08 14:35:01.665561 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:01.665529    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/767124fd-f9fe-4100-afd8-1a60106e384c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxh6k\" (UID: \"767124fd-f9fe-4100-afd8-1a60106e384c\") " pod="openshift-insights/insights-runtime-extractor-nxh6k"
Sep 08 14:35:01.665711 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:01.665568    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/767124fd-f9fe-4100-afd8-1a60106e384c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxh6k\" (UID: \"767124fd-f9fe-4100-afd8-1a60106e384c\") " pod="openshift-insights/insights-runtime-extractor-nxh6k"
Sep 08 14:35:01.665711 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:01.665619    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d99vq\" (UniqueName: \"kubernetes.io/projected/767124fd-f9fe-4100-afd8-1a60106e384c-kube-api-access-d99vq\") pod \"insights-runtime-extractor-nxh6k\" (UID: \"767124fd-f9fe-4100-afd8-1a60106e384c\") " pod="openshift-insights/insights-runtime-extractor-nxh6k"
Sep 08 14:35:01.665711 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:35:01.665690    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 14:35:01.665711 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:01.665704    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/767124fd-f9fe-4100-afd8-1a60106e384c-data-volume\") pod \"insights-runtime-extractor-nxh6k\" (UID: \"767124fd-f9fe-4100-afd8-1a60106e384c\") " pod="openshift-insights/insights-runtime-extractor-nxh6k"
Sep 08 14:35:01.665898 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:35:01.665716    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 14:35:01.665898 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:01.665738    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/767124fd-f9fe-4100-afd8-1a60106e384c-crio-socket\") pod \"insights-runtime-extractor-nxh6k\" (UID: \"767124fd-f9fe-4100-afd8-1a60106e384c\") " pod="openshift-insights/insights-runtime-extractor-nxh6k"
Sep 08 14:35:01.665898 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:35:01.665782    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767124fd-f9fe-4100-afd8-1a60106e384c-insights-runtime-extractor-tls podName:767124fd-f9fe-4100-afd8-1a60106e384c nodeName:}" failed. No retries permitted until 2026-09-08 14:35:02.165763802 +0000 UTC m=+63.204164706 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/767124fd-f9fe-4100-afd8-1a60106e384c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nxh6k" (UID: "767124fd-f9fe-4100-afd8-1a60106e384c") : secret "insights-runtime-extractor-tls" not found
Sep 08 14:35:01.665898 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:35:01.665801    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/767124fd-f9fe-4100-afd8-1a60106e384c-kube-rbac-proxy-cm podName:767124fd-f9fe-4100-afd8-1a60106e384c nodeName:}" failed. No retries permitted until 2026-09-08 14:35:02.165791787 +0000 UTC m=+63.204192691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/767124fd-f9fe-4100-afd8-1a60106e384c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nxh6k" (UID: "767124fd-f9fe-4100-afd8-1a60106e384c") : configmap "kube-rbac-proxy" not found
Sep 08 14:35:01.665898 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:01.665815    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/767124fd-f9fe-4100-afd8-1a60106e384c-crio-socket\") pod \"insights-runtime-extractor-nxh6k\" (UID: \"767124fd-f9fe-4100-afd8-1a60106e384c\") " pod="openshift-insights/insights-runtime-extractor-nxh6k"
Sep 08 14:35:01.666091 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:01.666022    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/767124fd-f9fe-4100-afd8-1a60106e384c-data-volume\") pod \"insights-runtime-extractor-nxh6k\" (UID: \"767124fd-f9fe-4100-afd8-1a60106e384c\") " pod="openshift-insights/insights-runtime-extractor-nxh6k"
Sep 08 14:35:01.678830 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:01.678803    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d99vq\" (UniqueName: \"kubernetes.io/projected/767124fd-f9fe-4100-afd8-1a60106e384c-kube-api-access-d99vq\") pod \"insights-runtime-extractor-nxh6k\" (UID: \"767124fd-f9fe-4100-afd8-1a60106e384c\") " pod="openshift-insights/insights-runtime-extractor-nxh6k"
Sep 08 14:35:02.029192 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:02.029157    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ggxgg"]
Sep 08 14:35:02.032319 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:02.032296    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ggxgg"
Sep 08 14:35:02.035913 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:02.035888    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-5z5c8\""
Sep 08 14:35:02.036049 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:02.036032    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 08 14:35:02.036227 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:02.036211    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 08 14:35:02.049577 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:02.049554    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ggxgg"]
Sep 08 14:35:02.069046 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:02.069023    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqh9v\" (UniqueName: \"kubernetes.io/projected/4d5e40cf-4b1c-4b35-a663-71e8dff74215-kube-api-access-wqh9v\") pod \"migrator-fdbb8fdff-ggxgg\" (UID: \"4d5e40cf-4b1c-4b35-a663-71e8dff74215\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ggxgg"
Sep 08 14:35:02.169340 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:02.169310    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/767124fd-f9fe-4100-afd8-1a60106e384c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxh6k\" (UID: \"767124fd-f9fe-4100-afd8-1a60106e384c\") " pod="openshift-insights/insights-runtime-extractor-nxh6k"
Sep 08 14:35:02.169500 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:02.169347    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/767124fd-f9fe-4100-afd8-1a60106e384c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxh6k\" (UID: \"767124fd-f9fe-4100-afd8-1a60106e384c\") " pod="openshift-insights/insights-runtime-extractor-nxh6k"
Sep 08 14:35:02.169500 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:02.169366    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqh9v\" (UniqueName: \"kubernetes.io/projected/4d5e40cf-4b1c-4b35-a663-71e8dff74215-kube-api-access-wqh9v\") pod \"migrator-fdbb8fdff-ggxgg\" (UID: \"4d5e40cf-4b1c-4b35-a663-71e8dff74215\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ggxgg"
Sep 08 14:35:02.169500 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:35:02.169456    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 14:35:02.169612 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:35:02.169538    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 14:35:02.169612 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:35:02.169562    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/767124fd-f9fe-4100-afd8-1a60106e384c-kube-rbac-proxy-cm podName:767124fd-f9fe-4100-afd8-1a60106e384c nodeName:}" failed. No retries permitted until 2026-09-08 14:35:03.169540898 +0000 UTC m=+64.207941827 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/767124fd-f9fe-4100-afd8-1a60106e384c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nxh6k" (UID: "767124fd-f9fe-4100-afd8-1a60106e384c") : configmap "kube-rbac-proxy" not found
Sep 08 14:35:02.169612 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:35:02.169581    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767124fd-f9fe-4100-afd8-1a60106e384c-insights-runtime-extractor-tls podName:767124fd-f9fe-4100-afd8-1a60106e384c nodeName:}" failed. No retries permitted until 2026-09-08 14:35:03.169573036 +0000 UTC m=+64.207973937 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/767124fd-f9fe-4100-afd8-1a60106e384c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nxh6k" (UID: "767124fd-f9fe-4100-afd8-1a60106e384c") : secret "insights-runtime-extractor-tls" not found
Sep 08 14:35:02.180321 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:02.180293    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqh9v\" (UniqueName: \"kubernetes.io/projected/4d5e40cf-4b1c-4b35-a663-71e8dff74215-kube-api-access-wqh9v\") pod \"migrator-fdbb8fdff-ggxgg\" (UID: \"4d5e40cf-4b1c-4b35-a663-71e8dff74215\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ggxgg"
Sep 08 14:35:02.341591 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:02.341519    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ggxgg"
Sep 08 14:35:02.618259 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:02.618191    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ggxgg"]
Sep 08 14:35:02.621417 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:35:02.621388    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d5e40cf_4b1c_4b35_a663_71e8dff74215.slice/crio-c35ac783cf5af8c7a986a56e13ffe24b2fcefeb93d6bbd1a1762fee4e49dcec9 WatchSource:0}: Error finding container c35ac783cf5af8c7a986a56e13ffe24b2fcefeb93d6bbd1a1762fee4e49dcec9: Status 404 returned error can't find the container with id c35ac783cf5af8c7a986a56e13ffe24b2fcefeb93d6bbd1a1762fee4e49dcec9
Sep 08 14:35:02.758213 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:02.758176    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ggxgg" event={"ID":"4d5e40cf-4b1c-4b35-a663-71e8dff74215","Type":"ContainerStarted","Data":"c35ac783cf5af8c7a986a56e13ffe24b2fcefeb93d6bbd1a1762fee4e49dcec9"}
Sep 08 14:35:03.178239 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:03.178195    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/767124fd-f9fe-4100-afd8-1a60106e384c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxh6k\" (UID: \"767124fd-f9fe-4100-afd8-1a60106e384c\") " pod="openshift-insights/insights-runtime-extractor-nxh6k"
Sep 08 14:35:03.178458 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:03.178254    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/767124fd-f9fe-4100-afd8-1a60106e384c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxh6k\" (UID: \"767124fd-f9fe-4100-afd8-1a60106e384c\") " pod="openshift-insights/insights-runtime-extractor-nxh6k"
Sep 08 14:35:03.178458 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:35:03.178332    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 14:35:03.178458 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:35:03.178354    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 14:35:03.178458 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:35:03.178411    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/767124fd-f9fe-4100-afd8-1a60106e384c-kube-rbac-proxy-cm podName:767124fd-f9fe-4100-afd8-1a60106e384c nodeName:}" failed. No retries permitted until 2026-09-08 14:35:05.178394967 +0000 UTC m=+66.216795885 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/767124fd-f9fe-4100-afd8-1a60106e384c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nxh6k" (UID: "767124fd-f9fe-4100-afd8-1a60106e384c") : configmap "kube-rbac-proxy" not found
Sep 08 14:35:03.178458 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:35:03.178425    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767124fd-f9fe-4100-afd8-1a60106e384c-insights-runtime-extractor-tls podName:767124fd-f9fe-4100-afd8-1a60106e384c nodeName:}" failed. No retries permitted until 2026-09-08 14:35:05.17841894 +0000 UTC m=+66.216819841 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/767124fd-f9fe-4100-afd8-1a60106e384c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nxh6k" (UID: "767124fd-f9fe-4100-afd8-1a60106e384c") : secret "insights-runtime-extractor-tls" not found
Sep 08 14:35:03.446118 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:03.446041    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mjb8g_cab4bd52-c6c1-48e1-9b14-fde47ac2dc46/dns-node-resolver/0.log"
Sep 08 14:35:04.445693 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:04.445666    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g9bkm_3f89e9ca-0539-4ef8-9ee4-fa19dd2e939d/node-ca/0.log"
Sep 08 14:35:04.764285 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:04.764191    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ggxgg" event={"ID":"4d5e40cf-4b1c-4b35-a663-71e8dff74215","Type":"ContainerStarted","Data":"cf3a952e8ec0cad708f297dea45d09fe0fa23d0ab725741f0e81b94a076ad64f"}
Sep 08 14:35:04.764285 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:04.764283    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ggxgg" event={"ID":"4d5e40cf-4b1c-4b35-a663-71e8dff74215","Type":"ContainerStarted","Data":"ef7faa680bab7129c28276ac1ae32362caeb9b8540ab05808bb3fb72d82f36b5"}
Sep 08 14:35:05.192953 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:05.192921    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58b796b8-809f-4e12-8fba-b018a9af00c8-metrics-certs\") pod \"network-metrics-daemon-v6nc9\" (UID: \"58b796b8-809f-4e12-8fba-b018a9af00c8\") " pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:35:05.193139 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:05.192972    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/767124fd-f9fe-4100-afd8-1a60106e384c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxh6k\" (UID: \"767124fd-f9fe-4100-afd8-1a60106e384c\") " pod="openshift-insights/insights-runtime-extractor-nxh6k"
Sep 08 14:35:05.193208 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:35:05.193132    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 14:35:05.193208 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:05.193177    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/767124fd-f9fe-4100-afd8-1a60106e384c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxh6k\" (UID: \"767124fd-f9fe-4100-afd8-1a60106e384c\") " pod="openshift-insights/insights-runtime-extractor-nxh6k"
Sep 08 14:35:05.193208 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:35:05.193203    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767124fd-f9fe-4100-afd8-1a60106e384c-insights-runtime-extractor-tls podName:767124fd-f9fe-4100-afd8-1a60106e384c nodeName:}" failed. No retries permitted until 2026-09-08 14:35:09.193183967 +0000 UTC m=+70.231584871 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/767124fd-f9fe-4100-afd8-1a60106e384c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nxh6k" (UID: "767124fd-f9fe-4100-afd8-1a60106e384c") : secret "insights-runtime-extractor-tls" not found
Sep 08 14:35:05.193350 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:35:05.193233    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 14:35:05.193350 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:35:05.193269    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/767124fd-f9fe-4100-afd8-1a60106e384c-kube-rbac-proxy-cm podName:767124fd-f9fe-4100-afd8-1a60106e384c nodeName:}" failed. No retries permitted until 2026-09-08 14:35:09.193257821 +0000 UTC m=+70.231658723 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/767124fd-f9fe-4100-afd8-1a60106e384c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nxh6k" (UID: "767124fd-f9fe-4100-afd8-1a60106e384c") : configmap "kube-rbac-proxy" not found
Sep 08 14:35:05.197513 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:05.197496    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 14:35:05.203374 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:35:05.203360    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 08 14:35:05.203428 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:35:05.203413    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58b796b8-809f-4e12-8fba-b018a9af00c8-metrics-certs podName:58b796b8-809f-4e12-8fba-b018a9af00c8 nodeName:}" failed. No retries permitted until 2026-09-08 14:36:09.203396337 +0000 UTC m=+130.241797252 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/58b796b8-809f-4e12-8fba-b018a9af00c8-metrics-certs") pod "network-metrics-daemon-v6nc9" (UID: "58b796b8-809f-4e12-8fba-b018a9af00c8") : secret "metrics-daemon-secret" not found
Sep 08 14:35:05.246632 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:05.246604    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vvtk9_1b275d6c-b08b-43d0-9988-e35e6657baeb/serve-healthcheck-canary/0.log"
Sep 08 14:35:05.294037 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:05.294010    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85fae7c9-a2d7-44ee-b3b6-499f4d98cf35-original-pull-secret\") pod \"global-pull-secret-syncer-nzr7f\" (UID: \"85fae7c9-a2d7-44ee-b3b6-499f4d98cf35\") " pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:35:05.296670 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:05.296653    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 14:35:05.307371 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:05.307346    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85fae7c9-a2d7-44ee-b3b6-499f4d98cf35-original-pull-secret\") pod \"global-pull-secret-syncer-nzr7f\" (UID: \"85fae7c9-a2d7-44ee-b3b6-499f4d98cf35\") " pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:35:05.394428 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:05.394399    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn2gl\" (UniqueName: \"kubernetes.io/projected/e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0-kube-api-access-fn2gl\") pod \"network-check-target-5jsdf\" (UID: \"e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0\") " pod="openshift-network-diagnostics/network-check-target-5jsdf"
Sep 08 14:35:05.398536 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:05.398512    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 14:35:05.405091 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:05.405072    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nzr7f"
Sep 08 14:35:05.408146 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:05.408130    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 14:35:05.417871 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:05.417850    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn2gl\" (UniqueName: \"kubernetes.io/projected/e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0-kube-api-access-fn2gl\") pod \"network-check-target-5jsdf\" (UID: \"e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0\") " pod="openshift-network-diagnostics/network-check-target-5jsdf"
Sep 08 14:35:05.682244 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:05.682195    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-ggxgg" podStartSLOduration=2.225851256 podStartE2EDuration="3.682178115s" totalImagesPullingTime="1.456326859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:04.80276674 +0000 UTC m=+65.841167664" watchObservedRunningTime="2026-09-08 14:35:05.682178115 +0000 UTC m=+66.720579030"
Sep 08 14:35:05.682648 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:05.682547    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nzr7f"]
Sep 08 14:35:05.685098 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:35:05.685073    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85fae7c9_a2d7_44ee_b3b6_499f4d98cf35.slice/crio-470e3038a2b43a3b7c91b378bd1fae9095aff4061b47b192ab5ac5c2af9aa764 WatchSource:0}: Error finding container 470e3038a2b43a3b7c91b378bd1fae9095aff4061b47b192ab5ac5c2af9aa764: Status 404 returned error can't find the container with id 470e3038a2b43a3b7c91b378bd1fae9095aff4061b47b192ab5ac5c2af9aa764
Sep 08 14:35:05.713032 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:05.712981    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nvk2x\""
Sep 08 14:35:05.720779 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:05.720757    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jsdf"
Sep 08 14:35:05.769605 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:05.769572    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nzr7f" event={"ID":"85fae7c9-a2d7-44ee-b3b6-499f4d98cf35","Type":"ContainerStarted","Data":"470e3038a2b43a3b7c91b378bd1fae9095aff4061b47b192ab5ac5c2af9aa764"}
Sep 08 14:35:05.993327 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:05.993261    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5jsdf"]
Sep 08 14:35:05.996356 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:35:05.996334    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6ca569a_4c5d_4780_a7c0_5c3622a3c1c0.slice/crio-e7f95d28c95ada66b59872498f1c9dbfaa74b81d6a488e78e972b9dfc4cb7188 WatchSource:0}: Error finding container e7f95d28c95ada66b59872498f1c9dbfaa74b81d6a488e78e972b9dfc4cb7188: Status 404 returned error can't find the container with id e7f95d28c95ada66b59872498f1c9dbfaa74b81d6a488e78e972b9dfc4cb7188
Sep 08 14:35:06.201452 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:06.201417    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-tls\") pod \"image-registry-54458ddb6b-qxnrt\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") " pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:35:06.201624 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:35:06.201575    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 14:35:06.201624 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:35:06.201592    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54458ddb6b-qxnrt: secret "image-registry-tls" not found
Sep 08 14:35:06.201694 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:35:06.201647    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-tls podName:67dab4b4-b501-487d-8df6-89b7c715fa80 nodeName:}" failed. No retries permitted until 2026-09-08 14:35:38.201629858 +0000 UTC m=+99.240030965 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-tls") pod "image-registry-54458ddb6b-qxnrt" (UID: "67dab4b4-b501-487d-8df6-89b7c715fa80") : secret "image-registry-tls" not found
Sep 08 14:35:06.302827 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:06.302748    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee765ac4-29fe-4529-8f78-23d2f886aa15-metrics-tls\") pod \"dns-default-bl4qh\" (UID: \"ee765ac4-29fe-4529-8f78-23d2f886aa15\") " pod="openshift-dns/dns-default-bl4qh"
Sep 08 14:35:06.302997 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:35:06.302909    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 14:35:06.302997 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:35:06.302971    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee765ac4-29fe-4529-8f78-23d2f886aa15-metrics-tls podName:ee765ac4-29fe-4529-8f78-23d2f886aa15 nodeName:}" failed. No retries permitted until 2026-09-08 14:35:38.302953444 +0000 UTC m=+99.341354346 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ee765ac4-29fe-4529-8f78-23d2f886aa15-metrics-tls") pod "dns-default-bl4qh" (UID: "ee765ac4-29fe-4529-8f78-23d2f886aa15") : secret "dns-default-metrics-tls" not found
Sep 08 14:35:06.774179 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:06.774135    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5jsdf" event={"ID":"e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0","Type":"ContainerStarted","Data":"e7f95d28c95ada66b59872498f1c9dbfaa74b81d6a488e78e972b9dfc4cb7188"}
Sep 08 14:35:09.225917 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:09.225877    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/767124fd-f9fe-4100-afd8-1a60106e384c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxh6k\" (UID: \"767124fd-f9fe-4100-afd8-1a60106e384c\") " pod="openshift-insights/insights-runtime-extractor-nxh6k"
Sep 08 14:35:09.226373 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:09.225928    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/767124fd-f9fe-4100-afd8-1a60106e384c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxh6k\" (UID: \"767124fd-f9fe-4100-afd8-1a60106e384c\") " pod="openshift-insights/insights-runtime-extractor-nxh6k"
Sep 08 14:35:09.226373 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:35:09.226044    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 14:35:09.226373 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:35:09.226052    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 14:35:09.226373 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:35:09.226122    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/767124fd-f9fe-4100-afd8-1a60106e384c-kube-rbac-proxy-cm podName:767124fd-f9fe-4100-afd8-1a60106e384c nodeName:}" failed. No retries permitted until 2026-09-08 14:35:17.226102087 +0000 UTC m=+78.264503009 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/767124fd-f9fe-4100-afd8-1a60106e384c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nxh6k" (UID: "767124fd-f9fe-4100-afd8-1a60106e384c") : configmap "kube-rbac-proxy" not found
Sep 08 14:35:09.226373 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:35:09.226141    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767124fd-f9fe-4100-afd8-1a60106e384c-insights-runtime-extractor-tls podName:767124fd-f9fe-4100-afd8-1a60106e384c nodeName:}" failed. No retries permitted until 2026-09-08 14:35:17.226131193 +0000 UTC m=+78.264532101 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/767124fd-f9fe-4100-afd8-1a60106e384c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nxh6k" (UID: "767124fd-f9fe-4100-afd8-1a60106e384c") : secret "insights-runtime-extractor-tls" not found
Sep 08 14:35:11.789907 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:11.789871    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nzr7f" event={"ID":"85fae7c9-a2d7-44ee-b3b6-499f4d98cf35","Type":"ContainerStarted","Data":"434bd99aa1b6fbb5a7166bffe590eeb0745aa0a623aa38a672a8f97e3c101a83"}
Sep 08 14:35:11.791482 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:11.791441    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5jsdf" event={"ID":"e6ca569a-4c5d-4780-a7c0-5c3622a3c1c0","Type":"ContainerStarted","Data":"88a70004e6eedcceb44a2c49d577eba3be9b7e844f1a664a940514501d3d7806"}
Sep 08 14:35:11.791606 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:11.791522    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5jsdf"
Sep 08 14:35:11.840773 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:11.840729    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nzr7f" podStartSLOduration=66.542043774 podStartE2EDuration="1m11.840714467s" totalImagesPullingTime="5.298670693s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:34:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:11.815121373 +0000 UTC m=+72.853522296" watchObservedRunningTime="2026-09-08 14:35:11.840714467 +0000 UTC m=+72.879115390"
Sep 08 14:35:17.292511 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:17.292458    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/767124fd-f9fe-4100-afd8-1a60106e384c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxh6k\" (UID: \"767124fd-f9fe-4100-afd8-1a60106e384c\") " pod="openshift-insights/insights-runtime-extractor-nxh6k"
Sep 08 14:35:17.292944 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:17.292520    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/767124fd-f9fe-4100-afd8-1a60106e384c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxh6k\" (UID: \"767124fd-f9fe-4100-afd8-1a60106e384c\") " pod="openshift-insights/insights-runtime-extractor-nxh6k"
Sep 08 14:35:17.292944 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:35:17.292605    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 14:35:17.292944 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:35:17.292668    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767124fd-f9fe-4100-afd8-1a60106e384c-insights-runtime-extractor-tls podName:767124fd-f9fe-4100-afd8-1a60106e384c nodeName:}" failed. No retries permitted until 2026-09-08 14:35:33.292652141 +0000 UTC m=+94.331053055 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/767124fd-f9fe-4100-afd8-1a60106e384c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nxh6k" (UID: "767124fd-f9fe-4100-afd8-1a60106e384c") : secret "insights-runtime-extractor-tls" not found
Sep 08 14:35:17.293053 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:17.292995    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/767124fd-f9fe-4100-afd8-1a60106e384c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxh6k\" (UID: \"767124fd-f9fe-4100-afd8-1a60106e384c\") " pod="openshift-insights/insights-runtime-extractor-nxh6k"
Sep 08 14:35:25.333994 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:25.333861    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5jsdf" podStartSLOduration=80.356164299 podStartE2EDuration="1m25.333846391s" totalImagesPullingTime="4.977682092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:34:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:11.840656622 +0000 UTC m=+72.879057544" watchObservedRunningTime="2026-09-08 14:35:25.333846391 +0000 UTC m=+86.372247313"
Sep 08 14:35:25.334843 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:25.334819    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76c6847bb9-7xnsg"]
Sep 08 14:35:25.339188 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:25.339168    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76c6847bb9-7xnsg"
Sep 08 14:35:25.353156 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:25.353133    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 08 14:35:25.353156 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:25.353145    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 08 14:35:25.353312 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:25.353136    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 08 14:35:25.353937 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:25.353921    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 08 14:35:25.353978 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:25.353948    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 08 14:35:25.354212 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:25.354198    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 08 14:35:25.356087 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:25.356070    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 08 14:35:25.365302 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:25.365281    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76c6847bb9-7xnsg"]
Sep 08 14:35:25.453859 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:25.453822    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5209576c-7e2d-42e8-a609-1d726b8817cd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-76c6847bb9-7xnsg\" (UID: \"5209576c-7e2d-42e8-a609-1d726b8817cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76c6847bb9-7xnsg"
Sep 08 14:35:25.454031 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:25.453896    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5209576c-7e2d-42e8-a609-1d726b8817cd-ca\") pod \"cluster-proxy-proxy-agent-76c6847bb9-7xnsg\" (UID: \"5209576c-7e2d-42e8-a609-1d726b8817cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76c6847bb9-7xnsg"
Sep 08 14:35:25.454031 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:25.453943    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5209576c-7e2d-42e8-a609-1d726b8817cd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-76c6847bb9-7xnsg\" (UID: \"5209576c-7e2d-42e8-a609-1d726b8817cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76c6847bb9-7xnsg"
Sep 08 14:35:25.454031 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:25.453977    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5209576c-7e2d-42e8-a609-1d726b8817cd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-76c6847bb9-7xnsg\" (UID: \"5209576c-7e2d-42e8-a609-1d726b8817cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76c6847bb9-7xnsg"
Sep 08 14:35:25.454167 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:25.454071    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5209576c-7e2d-42e8-a609-1d726b8817cd-hub\") pod \"cluster-proxy-proxy-agent-76c6847bb9-7xnsg\" (UID: \"5209576c-7e2d-42e8-a609-1d726b8817cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76c6847bb9-7xnsg"
Sep 08 14:35:25.454167 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:25.454109    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xbcz\" (UniqueName: \"kubernetes.io/projected/5209576c-7e2d-42e8-a609-1d726b8817cd-kube-api-access-7xbcz\") pod \"cluster-proxy-proxy-agent-76c6847bb9-7xnsg\" (UID: \"5209576c-7e2d-42e8-a609-1d726b8817cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76c6847bb9-7xnsg"
Sep 08 14:35:25.555190 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:25.555156    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5209576c-7e2d-42e8-a609-1d726b8817cd-hub\") pod \"cluster-proxy-proxy-agent-76c6847bb9-7xnsg\" (UID: \"5209576c-7e2d-42e8-a609-1d726b8817cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76c6847bb9-7xnsg"
Sep 08 14:35:25.555356 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:25.555208    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xbcz\" (UniqueName: \"kubernetes.io/projected/5209576c-7e2d-42e8-a609-1d726b8817cd-kube-api-access-7xbcz\") pod \"cluster-proxy-proxy-agent-76c6847bb9-7xnsg\" (UID: \"5209576c-7e2d-42e8-a609-1d726b8817cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76c6847bb9-7xnsg"
Sep 08 14:35:25.555356 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:25.555265    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5209576c-7e2d-42e8-a609-1d726b8817cd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-76c6847bb9-7xnsg\" (UID: \"5209576c-7e2d-42e8-a609-1d726b8817cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76c6847bb9-7xnsg"
Sep 08 14:35:25.555356 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:25.555305    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5209576c-7e2d-42e8-a609-1d726b8817cd-ca\") pod \"cluster-proxy-proxy-agent-76c6847bb9-7xnsg\" (UID: \"5209576c-7e2d-42e8-a609-1d726b8817cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76c6847bb9-7xnsg"
Sep 08 14:35:25.555561 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:25.555356    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5209576c-7e2d-42e8-a609-1d726b8817cd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-76c6847bb9-7xnsg\" (UID: \"5209576c-7e2d-42e8-a609-1d726b8817cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76c6847bb9-7xnsg"
Sep 08 14:35:25.555561 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:25.555389    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5209576c-7e2d-42e8-a609-1d726b8817cd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-76c6847bb9-7xnsg\" (UID: \"5209576c-7e2d-42e8-a609-1d726b8817cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76c6847bb9-7xnsg"
Sep 08 14:35:25.556371 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:25.556335    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5209576c-7e2d-42e8-a609-1d726b8817cd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-76c6847bb9-7xnsg\" (UID: \"5209576c-7e2d-42e8-a609-1d726b8817cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76c6847bb9-7xnsg"
Sep 08 14:35:25.557853 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:25.557825    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5209576c-7e2d-42e8-a609-1d726b8817cd-ca\") pod \"cluster-proxy-proxy-agent-76c6847bb9-7xnsg\" (UID: \"5209576c-7e2d-42e8-a609-1d726b8817cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76c6847bb9-7xnsg"
Sep 08 14:35:25.557995 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:25.557838    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5209576c-7e2d-42e8-a609-1d726b8817cd-hub\") pod \"cluster-proxy-proxy-agent-76c6847bb9-7xnsg\" (UID: \"5209576c-7e2d-42e8-a609-1d726b8817cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76c6847bb9-7xnsg"
Sep 08 14:35:25.557995 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:25.557934    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5209576c-7e2d-42e8-a609-1d726b8817cd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-76c6847bb9-7xnsg\" (UID: \"5209576c-7e2d-42e8-a609-1d726b8817cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76c6847bb9-7xnsg"
Sep 08 14:35:25.557995 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:25.557969    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5209576c-7e2d-42e8-a609-1d726b8817cd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-76c6847bb9-7xnsg\" (UID: \"5209576c-7e2d-42e8-a609-1d726b8817cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76c6847bb9-7xnsg"
Sep 08 14:35:25.563781 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:25.563757    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xbcz\" (UniqueName: \"kubernetes.io/projected/5209576c-7e2d-42e8-a609-1d726b8817cd-kube-api-access-7xbcz\") pod \"cluster-proxy-proxy-agent-76c6847bb9-7xnsg\" (UID: \"5209576c-7e2d-42e8-a609-1d726b8817cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76c6847bb9-7xnsg"
Sep 08 14:35:25.664050 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:25.664015    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76c6847bb9-7xnsg"
Sep 08 14:35:25.944732 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:25.944659    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76c6847bb9-7xnsg"]
Sep 08 14:35:25.949521 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:35:25.949456    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5209576c_7e2d_42e8_a609_1d726b8817cd.slice/crio-7e5612ed2e224455b3671e1969e7df7a6c3cbe207e61b510f925ef52e949b51d WatchSource:0}: Error finding container 7e5612ed2e224455b3671e1969e7df7a6c3cbe207e61b510f925ef52e949b51d: Status 404 returned error can't find the container with id 7e5612ed2e224455b3671e1969e7df7a6c3cbe207e61b510f925ef52e949b51d
Sep 08 14:35:26.839982 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:26.839947    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76c6847bb9-7xnsg" event={"ID":"5209576c-7e2d-42e8-a609-1d726b8817cd","Type":"ContainerStarted","Data":"7e5612ed2e224455b3671e1969e7df7a6c3cbe207e61b510f925ef52e949b51d"}
Sep 08 14:35:30.857955 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:30.857872    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76c6847bb9-7xnsg" event={"ID":"5209576c-7e2d-42e8-a609-1d726b8817cd","Type":"ContainerStarted","Data":"f531a036aa2557cbb34b5885997fee7b819ca8e203c8077446b4596c2ffcca56"}
Sep 08 14:35:30.857955 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:30.857917    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76c6847bb9-7xnsg" event={"ID":"5209576c-7e2d-42e8-a609-1d726b8817cd","Type":"ContainerStarted","Data":"adef69b56dc5285ace6057b7cc0f7e7b2cfee11f496b73d46d0665194387d785"}
Sep 08 14:35:30.857955 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:30.857933    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76c6847bb9-7xnsg" event={"ID":"5209576c-7e2d-42e8-a609-1d726b8817cd","Type":"ContainerStarted","Data":"f45d7888cc7025dbf3511c22277d42b30d7d123a6f30fc7a74076bfe69167168"}
Sep 08 14:35:30.878860 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:30.878810    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76c6847bb9-7xnsg" podStartSLOduration=1.298092169 podStartE2EDuration="5.878796791s" totalImagesPullingTime="4.580704622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:35:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:30.878670283 +0000 UTC m=+91.917071206" watchObservedRunningTime="2026-09-08 14:35:30.878796791 +0000 UTC m=+91.917197713"
Sep 08 14:35:33.314547 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:33.314505    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/767124fd-f9fe-4100-afd8-1a60106e384c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxh6k\" (UID: \"767124fd-f9fe-4100-afd8-1a60106e384c\") " pod="openshift-insights/insights-runtime-extractor-nxh6k"
Sep 08 14:35:33.316908 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:33.316890    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/767124fd-f9fe-4100-afd8-1a60106e384c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxh6k\" (UID: \"767124fd-f9fe-4100-afd8-1a60106e384c\") " pod="openshift-insights/insights-runtime-extractor-nxh6k"
Sep 08 14:35:33.613619 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:33.613536    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nxh6k"
Sep 08 14:35:33.884956 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:33.884883    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nxh6k"]
Sep 08 14:35:33.888590 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:35:33.888564    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod767124fd_f9fe_4100_afd8_1a60106e384c.slice/crio-7ed6b68e7a5d5eb0a1711d2040b3ce6b56ebdae1ed5f81582d7e7224e921f279 WatchSource:0}: Error finding container 7ed6b68e7a5d5eb0a1711d2040b3ce6b56ebdae1ed5f81582d7e7224e921f279: Status 404 returned error can't find the container with id 7ed6b68e7a5d5eb0a1711d2040b3ce6b56ebdae1ed5f81582d7e7224e921f279
Sep 08 14:35:34.871855 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:34.871825    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nxh6k" event={"ID":"767124fd-f9fe-4100-afd8-1a60106e384c","Type":"ContainerStarted","Data":"e3d0665181f089f20ec8f51421574020045d84c503855926350a4335bf340877"}
Sep 08 14:35:34.872161 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:34.871905    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nxh6k" event={"ID":"767124fd-f9fe-4100-afd8-1a60106e384c","Type":"ContainerStarted","Data":"074e8be1fb84c73f3ae22b2963bdd2c4e0851488d6a7feccf0701a433b3edbd8"}
Sep 08 14:35:34.872161 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:34.871925    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nxh6k" event={"ID":"767124fd-f9fe-4100-afd8-1a60106e384c","Type":"ContainerStarted","Data":"7ed6b68e7a5d5eb0a1711d2040b3ce6b56ebdae1ed5f81582d7e7224e921f279"}
Sep 08 14:35:37.883718 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:37.883678    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nxh6k" event={"ID":"767124fd-f9fe-4100-afd8-1a60106e384c","Type":"ContainerStarted","Data":"b0296f5eea92fa3f9fc72bf8b71d42281a1c78adcba3a78e785e18534b28f708"}
Sep 08 14:35:37.903678 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:37.903636    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nxh6k" podStartSLOduration=33.819160901000004 podStartE2EDuration="36.903622617s" totalImagesPullingTime="3.084461716s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:35:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:37.902547813 +0000 UTC m=+98.940948735" watchObservedRunningTime="2026-09-08 14:35:37.903622617 +0000 UTC m=+98.942023539"
Sep 08 14:35:38.251301 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:38.251260    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-tls\") pod \"image-registry-54458ddb6b-qxnrt\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") " pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:35:38.253749 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:38.253724    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-tls\") pod \"image-registry-54458ddb6b-qxnrt\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") " pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:35:38.270604 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:38.270580    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7gv8x\""
Sep 08 14:35:38.278305 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:38.278290    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:35:38.351957 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:38.351932    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee765ac4-29fe-4529-8f78-23d2f886aa15-metrics-tls\") pod \"dns-default-bl4qh\" (UID: \"ee765ac4-29fe-4529-8f78-23d2f886aa15\") " pod="openshift-dns/dns-default-bl4qh"
Sep 08 14:35:38.354232 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:38.354212    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ee765ac4-29fe-4529-8f78-23d2f886aa15-metrics-tls\") pod \"dns-default-bl4qh\" (UID: \"ee765ac4-29fe-4529-8f78-23d2f886aa15\") " pod="openshift-dns/dns-default-bl4qh"
Sep 08 14:35:38.550491 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:38.550406    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54458ddb6b-qxnrt"]
Sep 08 14:35:38.553902 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:35:38.553876    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67dab4b4_b501_487d_8df6_89b7c715fa80.slice/crio-1f149410c05d18e0fd38910cff031deb9476c71a2d4ce91d2e99d1ad83046550 WatchSource:0}: Error finding container 1f149410c05d18e0fd38910cff031deb9476c71a2d4ce91d2e99d1ad83046550: Status 404 returned error can't find the container with id 1f149410c05d18e0fd38910cff031deb9476c71a2d4ce91d2e99d1ad83046550
Sep 08 14:35:38.606287 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:38.606265    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rsnws\""
Sep 08 14:35:38.613675 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:38.613657    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bl4qh"
Sep 08 14:35:38.892880 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:38.892799    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bl4qh"]
Sep 08 14:35:38.893233 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:38.893186    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt" event={"ID":"67dab4b4-b501-487d-8df6-89b7c715fa80","Type":"ContainerStarted","Data":"76f4c627b4787b04ea81e1b13d4b422c93651ac9e74b1dc1aae59b74f186ec66"}
Sep 08 14:35:38.893278 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:38.893231    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt" event={"ID":"67dab4b4-b501-487d-8df6-89b7c715fa80","Type":"ContainerStarted","Data":"1f149410c05d18e0fd38910cff031deb9476c71a2d4ce91d2e99d1ad83046550"}
Sep 08 14:35:38.893429 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:38.893410    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:35:38.896630 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:35:38.896607    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee765ac4_29fe_4529_8f78_23d2f886aa15.slice/crio-2290ff021f53a676b59e6b86600c457eafe8850eb16c2f9f5f2b80264774ff3b WatchSource:0}: Error finding container 2290ff021f53a676b59e6b86600c457eafe8850eb16c2f9f5f2b80264774ff3b: Status 404 returned error can't find the container with id 2290ff021f53a676b59e6b86600c457eafe8850eb16c2f9f5f2b80264774ff3b
Sep 08 14:35:38.920212 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:38.920178    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt" podStartSLOduration=98.920163853 podStartE2EDuration="1m38.920163853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:34:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:38.920139091 +0000 UTC m=+99.958540015" watchObservedRunningTime="2026-09-08 14:35:38.920163853 +0000 UTC m=+99.958564792"
Sep 08 14:35:39.897018 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:39.896981    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bl4qh" event={"ID":"ee765ac4-29fe-4529-8f78-23d2f886aa15","Type":"ContainerStarted","Data":"2290ff021f53a676b59e6b86600c457eafe8850eb16c2f9f5f2b80264774ff3b"}
Sep 08 14:35:40.810957 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:40.810923    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kgn7g"]
Sep 08 14:35:40.830589 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:40.830563    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kgn7g"
Sep 08 14:35:40.833216 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:40.833190    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 08 14:35:40.833709 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:40.833546    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 08 14:35:40.833824 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:40.833814    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 08 14:35:40.833879 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:40.833826    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 08 14:35:40.834775 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:40.834753    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-v7mcr\""
Sep 08 14:35:40.834891 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:40.834839    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 08 14:35:40.834973 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:40.834959    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 08 14:35:40.971142 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:40.971110    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/59765590-520d-48ec-b544-75945952a4f4-node-exporter-accelerators-collector-config\") pod \"node-exporter-kgn7g\" (UID: \"59765590-520d-48ec-b544-75945952a4f4\") " pod="openshift-monitoring/node-exporter-kgn7g"
Sep 08 14:35:40.971142 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:40.971141    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59765590-520d-48ec-b544-75945952a4f4-sys\") pod \"node-exporter-kgn7g\" (UID: \"59765590-520d-48ec-b544-75945952a4f4\") " pod="openshift-monitoring/node-exporter-kgn7g"
Sep 08 14:35:40.971545 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:40.971161    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/59765590-520d-48ec-b544-75945952a4f4-node-exporter-textfile\") pod \"node-exporter-kgn7g\" (UID: \"59765590-520d-48ec-b544-75945952a4f4\") " pod="openshift-monitoring/node-exporter-kgn7g"
Sep 08 14:35:40.971545 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:40.971243    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/59765590-520d-48ec-b544-75945952a4f4-root\") pod \"node-exporter-kgn7g\" (UID: \"59765590-520d-48ec-b544-75945952a4f4\") " pod="openshift-monitoring/node-exporter-kgn7g"
Sep 08 14:35:40.971545 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:40.971280    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/59765590-520d-48ec-b544-75945952a4f4-node-exporter-wtmp\") pod \"node-exporter-kgn7g\" (UID: \"59765590-520d-48ec-b544-75945952a4f4\") " pod="openshift-monitoring/node-exporter-kgn7g"
Sep 08 14:35:40.971545 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:40.971302    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59765590-520d-48ec-b544-75945952a4f4-node-exporter-tls\") pod \"node-exporter-kgn7g\" (UID: \"59765590-520d-48ec-b544-75945952a4f4\") " pod="openshift-monitoring/node-exporter-kgn7g"
Sep 08 14:35:40.971545 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:40.971343    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g872f\" (UniqueName: \"kubernetes.io/projected/59765590-520d-48ec-b544-75945952a4f4-kube-api-access-g872f\") pod \"node-exporter-kgn7g\" (UID: \"59765590-520d-48ec-b544-75945952a4f4\") " pod="openshift-monitoring/node-exporter-kgn7g"
Sep 08 14:35:40.971545 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:40.971384    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59765590-520d-48ec-b544-75945952a4f4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kgn7g\" (UID: \"59765590-520d-48ec-b544-75945952a4f4\") " pod="openshift-monitoring/node-exporter-kgn7g"
Sep 08 14:35:40.971545 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:40.971411    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59765590-520d-48ec-b544-75945952a4f4-metrics-client-ca\") pod \"node-exporter-kgn7g\" (UID: \"59765590-520d-48ec-b544-75945952a4f4\") " pod="openshift-monitoring/node-exporter-kgn7g"
Sep 08 14:35:41.071973 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:41.071902    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/59765590-520d-48ec-b544-75945952a4f4-node-exporter-wtmp\") pod \"node-exporter-kgn7g\" (UID: \"59765590-520d-48ec-b544-75945952a4f4\") " pod="openshift-monitoring/node-exporter-kgn7g"
Sep 08 14:35:41.071973 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:41.071937    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59765590-520d-48ec-b544-75945952a4f4-node-exporter-tls\") pod \"node-exporter-kgn7g\" (UID: \"59765590-520d-48ec-b544-75945952a4f4\") " pod="openshift-monitoring/node-exporter-kgn7g"
Sep 08 14:35:41.071973 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:41.071961    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g872f\" (UniqueName: \"kubernetes.io/projected/59765590-520d-48ec-b544-75945952a4f4-kube-api-access-g872f\") pod \"node-exporter-kgn7g\" (UID: \"59765590-520d-48ec-b544-75945952a4f4\") " pod="openshift-monitoring/node-exporter-kgn7g"
Sep 08 14:35:41.072235 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:41.071996    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59765590-520d-48ec-b544-75945952a4f4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kgn7g\" (UID: \"59765590-520d-48ec-b544-75945952a4f4\") " pod="openshift-monitoring/node-exporter-kgn7g"
Sep 08 14:35:41.072235 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:41.072021    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59765590-520d-48ec-b544-75945952a4f4-metrics-client-ca\") pod \"node-exporter-kgn7g\" (UID: \"59765590-520d-48ec-b544-75945952a4f4\") " pod="openshift-monitoring/node-exporter-kgn7g"
Sep 08 14:35:41.072235 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:41.072055    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/59765590-520d-48ec-b544-75945952a4f4-node-exporter-accelerators-collector-config\") pod \"node-exporter-kgn7g\" (UID: \"59765590-520d-48ec-b544-75945952a4f4\") " pod="openshift-monitoring/node-exporter-kgn7g"
Sep 08 14:35:41.072235 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:41.072073    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/59765590-520d-48ec-b544-75945952a4f4-node-exporter-wtmp\") pod \"node-exporter-kgn7g\" (UID: \"59765590-520d-48ec-b544-75945952a4f4\") " pod="openshift-monitoring/node-exporter-kgn7g"
Sep 08 14:35:41.072235 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:41.072096    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59765590-520d-48ec-b544-75945952a4f4-sys\") pod \"node-exporter-kgn7g\" (UID: \"59765590-520d-48ec-b544-75945952a4f4\") " pod="openshift-monitoring/node-exporter-kgn7g"
Sep 08 14:35:41.072235 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:41.072215    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/59765590-520d-48ec-b544-75945952a4f4-node-exporter-textfile\") pod \"node-exporter-kgn7g\" (UID: \"59765590-520d-48ec-b544-75945952a4f4\") " pod="openshift-monitoring/node-exporter-kgn7g"
Sep 08 14:35:41.072235 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:41.072223    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59765590-520d-48ec-b544-75945952a4f4-sys\") pod \"node-exporter-kgn7g\" (UID: \"59765590-520d-48ec-b544-75945952a4f4\") " pod="openshift-monitoring/node-exporter-kgn7g"
Sep 08 14:35:41.072596 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:41.072289    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/59765590-520d-48ec-b544-75945952a4f4-root\") pod \"node-exporter-kgn7g\" (UID: \"59765590-520d-48ec-b544-75945952a4f4\") " pod="openshift-monitoring/node-exporter-kgn7g"
Sep 08 14:35:41.072596 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:41.072368    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/59765590-520d-48ec-b544-75945952a4f4-root\") pod \"node-exporter-kgn7g\" (UID: \"59765590-520d-48ec-b544-75945952a4f4\") " pod="openshift-monitoring/node-exporter-kgn7g"
Sep 08 14:35:41.072596 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:41.072533    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/59765590-520d-48ec-b544-75945952a4f4-node-exporter-textfile\") pod \"node-exporter-kgn7g\" (UID: \"59765590-520d-48ec-b544-75945952a4f4\") " pod="openshift-monitoring/node-exporter-kgn7g"
Sep 08 14:35:41.072748 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:41.072702    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/59765590-520d-48ec-b544-75945952a4f4-node-exporter-accelerators-collector-config\") pod \"node-exporter-kgn7g\" (UID: \"59765590-520d-48ec-b544-75945952a4f4\") " pod="openshift-monitoring/node-exporter-kgn7g"
Sep 08 14:35:41.072748 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:41.072731    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59765590-520d-48ec-b544-75945952a4f4-metrics-client-ca\") pod \"node-exporter-kgn7g\" (UID: \"59765590-520d-48ec-b544-75945952a4f4\") " pod="openshift-monitoring/node-exporter-kgn7g"
Sep 08 14:35:41.074333 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:41.074312    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59765590-520d-48ec-b544-75945952a4f4-node-exporter-tls\") pod \"node-exporter-kgn7g\" (UID: \"59765590-520d-48ec-b544-75945952a4f4\") " pod="openshift-monitoring/node-exporter-kgn7g"
Sep 08 14:35:41.074432 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:41.074389    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59765590-520d-48ec-b544-75945952a4f4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kgn7g\" (UID: \"59765590-520d-48ec-b544-75945952a4f4\") " pod="openshift-monitoring/node-exporter-kgn7g"
Sep 08 14:35:41.081259 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:41.081240    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g872f\" (UniqueName: \"kubernetes.io/projected/59765590-520d-48ec-b544-75945952a4f4-kube-api-access-g872f\") pod \"node-exporter-kgn7g\" (UID: \"59765590-520d-48ec-b544-75945952a4f4\") " pod="openshift-monitoring/node-exporter-kgn7g"
Sep 08 14:35:41.142585 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:41.142553    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kgn7g"
Sep 08 14:35:41.641763 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:35:41.641724    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59765590_520d_48ec_b544_75945952a4f4.slice/crio-f02e8cf22d55b105813dfaedcca2ddafbb78d7e98776a2a6f7dfb193b7d04844 WatchSource:0}: Error finding container f02e8cf22d55b105813dfaedcca2ddafbb78d7e98776a2a6f7dfb193b7d04844: Status 404 returned error can't find the container with id f02e8cf22d55b105813dfaedcca2ddafbb78d7e98776a2a6f7dfb193b7d04844
Sep 08 14:35:41.904880 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:41.904795    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kgn7g" event={"ID":"59765590-520d-48ec-b544-75945952a4f4","Type":"ContainerStarted","Data":"f02e8cf22d55b105813dfaedcca2ddafbb78d7e98776a2a6f7dfb193b7d04844"}
Sep 08 14:35:42.797836 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:42.797809    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5jsdf"
Sep 08 14:35:42.909321 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:42.909288    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bl4qh" event={"ID":"ee765ac4-29fe-4529-8f78-23d2f886aa15","Type":"ContainerStarted","Data":"7f43a380a906cadf711806de43071f9a61867622a51860e614c14e34c3401d82"}
Sep 08 14:35:42.909489 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:42.909336    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bl4qh" event={"ID":"ee765ac4-29fe-4529-8f78-23d2f886aa15","Type":"ContainerStarted","Data":"2542a1659122f180c25fb75dfa20b78fd32238a9e202bc1f1deb6bba188db565"}
Sep 08 14:35:42.909489 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:42.909412    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bl4qh"
Sep 08 14:35:42.965330 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:42.965286    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bl4qh" podStartSLOduration=65.842105105 podStartE2EDuration="1m8.965270656s" totalImagesPullingTime="3.123165551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:34:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:42.964087102 +0000 UTC m=+104.002488022" watchObservedRunningTime="2026-09-08 14:35:42.965270656 +0000 UTC m=+104.003671570"
Sep 08 14:35:43.914616 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:43.914577    2577 generic.go:356] "Generic (PLEG): container finished" podID="59765590-520d-48ec-b544-75945952a4f4" containerID="6bc2e6a737ec0f5f6342eb11bc441f329f9929f09095566ce9a1dbb66309af1e" exitCode=0
Sep 08 14:35:43.915064 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:43.914666    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kgn7g" event={"ID":"59765590-520d-48ec-b544-75945952a4f4","Type":"ContainerDied","Data":"6bc2e6a737ec0f5f6342eb11bc441f329f9929f09095566ce9a1dbb66309af1e"}
Sep 08 14:35:43.956229 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:43.956208    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5"]
Sep 08 14:35:43.960753 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:43.960736    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5"
Sep 08 14:35:43.965895 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:43.965876    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 08 14:35:43.965982 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:43.965944    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 08 14:35:43.966044 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:43.966011    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 08 14:35:43.966099 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:43.966051    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-fbtzv\""
Sep 08 14:35:43.966153 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:43.966144    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ag38hv11qgi97\""
Sep 08 14:35:43.966219 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:43.966204    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 08 14:35:43.966272 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:43.966204    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 08 14:35:43.982646 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:43.982624    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5"]
Sep 08 14:35:44.094420 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:44.094391    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2640414-5d50-49f8-a667-27f23590453c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57bbf4f5c7-pj7t5\" (UID: \"b2640414-5d50-49f8-a667-27f23590453c\") " pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5"
Sep 08 14:35:44.094608 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:44.094454    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm5n9\" (UniqueName: \"kubernetes.io/projected/b2640414-5d50-49f8-a667-27f23590453c-kube-api-access-zm5n9\") pod \"thanos-querier-57bbf4f5c7-pj7t5\" (UID: \"b2640414-5d50-49f8-a667-27f23590453c\") " pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5"
Sep 08 14:35:44.094608 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:44.094553    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b2640414-5d50-49f8-a667-27f23590453c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57bbf4f5c7-pj7t5\" (UID: \"b2640414-5d50-49f8-a667-27f23590453c\") " pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5"
Sep 08 14:35:44.094608 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:44.094600    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b2640414-5d50-49f8-a667-27f23590453c-secret-thanos-querier-tls\") pod \"thanos-querier-57bbf4f5c7-pj7t5\" (UID: \"b2640414-5d50-49f8-a667-27f23590453c\") " pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5"
Sep 08 14:35:44.094743 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:44.094642    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2640414-5d50-49f8-a667-27f23590453c-secret-grpc-tls\") pod \"thanos-querier-57bbf4f5c7-pj7t5\" (UID: \"b2640414-5d50-49f8-a667-27f23590453c\") " pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5"
Sep 08 14:35:44.094743 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:44.094671    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2640414-5d50-49f8-a667-27f23590453c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57bbf4f5c7-pj7t5\" (UID: \"b2640414-5d50-49f8-a667-27f23590453c\") " pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5"
Sep 08 14:35:44.094743 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:44.094690    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b2640414-5d50-49f8-a667-27f23590453c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57bbf4f5c7-pj7t5\" (UID: \"b2640414-5d50-49f8-a667-27f23590453c\") " pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5"
Sep 08 14:35:44.094861 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:44.094844    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2640414-5d50-49f8-a667-27f23590453c-metrics-client-ca\") pod \"thanos-querier-57bbf4f5c7-pj7t5\" (UID: \"b2640414-5d50-49f8-a667-27f23590453c\") " pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5"
Sep 08 14:35:44.195813 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:44.195744    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2640414-5d50-49f8-a667-27f23590453c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57bbf4f5c7-pj7t5\" (UID: \"b2640414-5d50-49f8-a667-27f23590453c\") " pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5"
Sep 08 14:35:44.195813 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:44.195772    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b2640414-5d50-49f8-a667-27f23590453c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57bbf4f5c7-pj7t5\" (UID: \"b2640414-5d50-49f8-a667-27f23590453c\") " pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5"
Sep 08 14:35:44.195813 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:44.195806    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2640414-5d50-49f8-a667-27f23590453c-metrics-client-ca\") pod \"thanos-querier-57bbf4f5c7-pj7t5\" (UID: \"b2640414-5d50-49f8-a667-27f23590453c\") " pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5"
Sep 08 14:35:44.196054 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:44.195832    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2640414-5d50-49f8-a667-27f23590453c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57bbf4f5c7-pj7t5\" (UID: \"b2640414-5d50-49f8-a667-27f23590453c\") " pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5"
Sep 08 14:35:44.196054 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:44.195987    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm5n9\" (UniqueName: \"kubernetes.io/projected/b2640414-5d50-49f8-a667-27f23590453c-kube-api-access-zm5n9\") pod \"thanos-querier-57bbf4f5c7-pj7t5\" (UID: \"b2640414-5d50-49f8-a667-27f23590453c\") " pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5"
Sep 08 14:35:44.196054 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:44.196038    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b2640414-5d50-49f8-a667-27f23590453c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57bbf4f5c7-pj7t5\" (UID: \"b2640414-5d50-49f8-a667-27f23590453c\") " pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5"
Sep 08 14:35:44.196222 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:44.196086    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b2640414-5d50-49f8-a667-27f23590453c-secret-thanos-querier-tls\") pod \"thanos-querier-57bbf4f5c7-pj7t5\" (UID: \"b2640414-5d50-49f8-a667-27f23590453c\") " pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5"
Sep 08 14:35:44.196222 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:44.196113    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2640414-5d50-49f8-a667-27f23590453c-secret-grpc-tls\") pod \"thanos-querier-57bbf4f5c7-pj7t5\" (UID: \"b2640414-5d50-49f8-a667-27f23590453c\") " pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5"
Sep 08 14:35:44.196768 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:44.196662    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2640414-5d50-49f8-a667-27f23590453c-metrics-client-ca\") pod \"thanos-querier-57bbf4f5c7-pj7t5\" (UID: \"b2640414-5d50-49f8-a667-27f23590453c\") " pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5"
Sep 08 14:35:44.198592 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:44.198562    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b2640414-5d50-49f8-a667-27f23590453c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57bbf4f5c7-pj7t5\" (UID: \"b2640414-5d50-49f8-a667-27f23590453c\") " pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5"
Sep 08 14:35:44.198957 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:44.198937    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b2640414-5d50-49f8-a667-27f23590453c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57bbf4f5c7-pj7t5\" (UID: \"b2640414-5d50-49f8-a667-27f23590453c\") " pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5"
Sep 08 14:35:44.199097 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:44.199077    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b2640414-5d50-49f8-a667-27f23590453c-secret-grpc-tls\") pod \"thanos-querier-57bbf4f5c7-pj7t5\" (UID: \"b2640414-5d50-49f8-a667-27f23590453c\") " pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5"
Sep 08 14:35:44.199154 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:44.199139    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b2640414-5d50-49f8-a667-27f23590453c-secret-thanos-querier-tls\") pod \"thanos-querier-57bbf4f5c7-pj7t5\" (UID: \"b2640414-5d50-49f8-a667-27f23590453c\") " pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5"
Sep 08 14:35:44.199229 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:44.199212    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b2640414-5d50-49f8-a667-27f23590453c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57bbf4f5c7-pj7t5\" (UID: \"b2640414-5d50-49f8-a667-27f23590453c\") " pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5"
Sep 08 14:35:44.199292 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:44.199276    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b2640414-5d50-49f8-a667-27f23590453c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57bbf4f5c7-pj7t5\" (UID: \"b2640414-5d50-49f8-a667-27f23590453c\") " pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5"
Sep 08 14:35:44.205964 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:44.205930    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm5n9\" (UniqueName: \"kubernetes.io/projected/b2640414-5d50-49f8-a667-27f23590453c-kube-api-access-zm5n9\") pod \"thanos-querier-57bbf4f5c7-pj7t5\" (UID: \"b2640414-5d50-49f8-a667-27f23590453c\") " pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5"
Sep 08 14:35:44.283416 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:44.283390    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5"
Sep 08 14:35:44.563635 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:44.563605    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5"]
Sep 08 14:35:44.565868 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:35:44.565840    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2640414_5d50_49f8_a667_27f23590453c.slice/crio-4d25fbf20ac1aebdc31e3cdb98ec6d732a8fe82498d79cc67136cf7a35690f43 WatchSource:0}: Error finding container 4d25fbf20ac1aebdc31e3cdb98ec6d732a8fe82498d79cc67136cf7a35690f43: Status 404 returned error can't find the container with id 4d25fbf20ac1aebdc31e3cdb98ec6d732a8fe82498d79cc67136cf7a35690f43
Sep 08 14:35:44.919286 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:44.919251    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5" event={"ID":"b2640414-5d50-49f8-a667-27f23590453c","Type":"ContainerStarted","Data":"4d25fbf20ac1aebdc31e3cdb98ec6d732a8fe82498d79cc67136cf7a35690f43"}
Sep 08 14:35:44.921283 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:44.921252    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kgn7g" event={"ID":"59765590-520d-48ec-b544-75945952a4f4","Type":"ContainerStarted","Data":"7d72dfa5f97ac7011eb981955865028db726fee62e8c8578d450549ebf4715f9"}
Sep 08 14:35:44.921386 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:44.921299    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kgn7g" event={"ID":"59765590-520d-48ec-b544-75945952a4f4","Type":"ContainerStarted","Data":"03f81a002878c009acc15df729b7e806cfb037206823889fd4073baa2c1fb871"}
Sep 08 14:35:44.955582 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:44.955537    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kgn7g" podStartSLOduration=3.491530079 podStartE2EDuration="4.955518104s" totalImagesPullingTime="1.380199446s" totalInitContainerRuntime="83.788579ms" isStatefulPod=true podCreationTimestamp="2026-09-08 14:35:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:44.954598117 +0000 UTC m=+105.992999064" watchObservedRunningTime="2026-09-08 14:35:44.955518104 +0000 UTC m=+105.993919028"
Sep 08 14:35:45.938587 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:45.938557    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt"]
Sep 08 14:35:45.941739 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:45.941724    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt"
Sep 08 14:35:45.945021 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:45.944990    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 08 14:35:45.945021 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:45.945010    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 08 14:35:45.945184 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:45.945118    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 08 14:35:45.945184 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:45.945133    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-gzr6q\""
Sep 08 14:35:45.945361 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:45.945347    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 08 14:35:45.945361 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:45.945355    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 08 14:35:45.949916 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:45.949899    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 08 14:35:45.959521 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:45.959500    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt"]
Sep 08 14:35:46.112006 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:46.111973    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59548e72-9439-41a6-b47e-b7e22ee731a0-serving-certs-ca-bundle\") pod \"telemeter-client-7d8cff5c6f-2dmzt\" (UID: \"59548e72-9439-41a6-b47e-b7e22ee731a0\") " pod="openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt"
Sep 08 14:35:46.112190 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:46.112014    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/59548e72-9439-41a6-b47e-b7e22ee731a0-telemeter-client-tls\") pod \"telemeter-client-7d8cff5c6f-2dmzt\" (UID: \"59548e72-9439-41a6-b47e-b7e22ee731a0\") " pod="openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt"
Sep 08 14:35:46.112190 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:46.112063    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59548e72-9439-41a6-b47e-b7e22ee731a0-metrics-client-ca\") pod \"telemeter-client-7d8cff5c6f-2dmzt\" (UID: \"59548e72-9439-41a6-b47e-b7e22ee731a0\") " pod="openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt"
Sep 08 14:35:46.112316 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:46.112233    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59548e72-9439-41a6-b47e-b7e22ee731a0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d8cff5c6f-2dmzt\" (UID: \"59548e72-9439-41a6-b47e-b7e22ee731a0\") " pod="openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt"
Sep 08 14:35:46.116251 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:46.112700    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/59548e72-9439-41a6-b47e-b7e22ee731a0-secret-telemeter-client\") pod \"telemeter-client-7d8cff5c6f-2dmzt\" (UID: \"59548e72-9439-41a6-b47e-b7e22ee731a0\") " pod="openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt"
Sep 08 14:35:46.116251 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:46.112754    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59548e72-9439-41a6-b47e-b7e22ee731a0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d8cff5c6f-2dmzt\" (UID: \"59548e72-9439-41a6-b47e-b7e22ee731a0\") " pod="openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt"
Sep 08 14:35:46.116251 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:46.112793    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/59548e72-9439-41a6-b47e-b7e22ee731a0-federate-client-tls\") pod \"telemeter-client-7d8cff5c6f-2dmzt\" (UID: \"59548e72-9439-41a6-b47e-b7e22ee731a0\") " pod="openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt"
Sep 08 14:35:46.116251 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:46.112961    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l95hj\" (UniqueName: \"kubernetes.io/projected/59548e72-9439-41a6-b47e-b7e22ee731a0-kube-api-access-l95hj\") pod \"telemeter-client-7d8cff5c6f-2dmzt\" (UID: \"59548e72-9439-41a6-b47e-b7e22ee731a0\") " pod="openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt"
Sep 08 14:35:46.214450 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:46.214364    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59548e72-9439-41a6-b47e-b7e22ee731a0-serving-certs-ca-bundle\") pod \"telemeter-client-7d8cff5c6f-2dmzt\" (UID: \"59548e72-9439-41a6-b47e-b7e22ee731a0\") " pod="openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt"
Sep 08 14:35:46.214450 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:46.214403    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/59548e72-9439-41a6-b47e-b7e22ee731a0-telemeter-client-tls\") pod \"telemeter-client-7d8cff5c6f-2dmzt\" (UID: \"59548e72-9439-41a6-b47e-b7e22ee731a0\") " pod="openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt"
Sep 08 14:35:46.214450 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:46.214429    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59548e72-9439-41a6-b47e-b7e22ee731a0-metrics-client-ca\") pod \"telemeter-client-7d8cff5c6f-2dmzt\" (UID: \"59548e72-9439-41a6-b47e-b7e22ee731a0\") " pod="openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt"
Sep 08 14:35:46.214723 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:46.214511    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59548e72-9439-41a6-b47e-b7e22ee731a0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d8cff5c6f-2dmzt\" (UID: \"59548e72-9439-41a6-b47e-b7e22ee731a0\") " pod="openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt"
Sep 08 14:35:46.214723 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:46.214544    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/59548e72-9439-41a6-b47e-b7e22ee731a0-secret-telemeter-client\") pod \"telemeter-client-7d8cff5c6f-2dmzt\" (UID: \"59548e72-9439-41a6-b47e-b7e22ee731a0\") " pod="openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt"
Sep 08 14:35:46.214723 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:46.214573    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59548e72-9439-41a6-b47e-b7e22ee731a0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d8cff5c6f-2dmzt\" (UID: \"59548e72-9439-41a6-b47e-b7e22ee731a0\") " pod="openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt"
Sep 08 14:35:46.214723 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:46.214600    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/59548e72-9439-41a6-b47e-b7e22ee731a0-federate-client-tls\") pod \"telemeter-client-7d8cff5c6f-2dmzt\" (UID: \"59548e72-9439-41a6-b47e-b7e22ee731a0\") " pod="openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt"
Sep 08 14:35:46.214723 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:46.214633    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l95hj\" (UniqueName: \"kubernetes.io/projected/59548e72-9439-41a6-b47e-b7e22ee731a0-kube-api-access-l95hj\") pod \"telemeter-client-7d8cff5c6f-2dmzt\" (UID: \"59548e72-9439-41a6-b47e-b7e22ee731a0\") " pod="openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt"
Sep 08 14:35:46.215290 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:46.215258    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59548e72-9439-41a6-b47e-b7e22ee731a0-serving-certs-ca-bundle\") pod \"telemeter-client-7d8cff5c6f-2dmzt\" (UID: \"59548e72-9439-41a6-b47e-b7e22ee731a0\") " pod="openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt"
Sep 08 14:35:46.215402 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:46.215358    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59548e72-9439-41a6-b47e-b7e22ee731a0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d8cff5c6f-2dmzt\" (UID: \"59548e72-9439-41a6-b47e-b7e22ee731a0\") " pod="openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt"
Sep 08 14:35:46.215613 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:46.215590    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59548e72-9439-41a6-b47e-b7e22ee731a0-metrics-client-ca\") pod \"telemeter-client-7d8cff5c6f-2dmzt\" (UID: \"59548e72-9439-41a6-b47e-b7e22ee731a0\") " pod="openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt"
Sep 08 14:35:46.218276 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:46.218248    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/59548e72-9439-41a6-b47e-b7e22ee731a0-telemeter-client-tls\") pod \"telemeter-client-7d8cff5c6f-2dmzt\" (UID: \"59548e72-9439-41a6-b47e-b7e22ee731a0\") " pod="openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt"
Sep 08 14:35:46.218373 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:46.218280    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/59548e72-9439-41a6-b47e-b7e22ee731a0-federate-client-tls\") pod \"telemeter-client-7d8cff5c6f-2dmzt\" (UID: \"59548e72-9439-41a6-b47e-b7e22ee731a0\") " pod="openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt"
Sep 08 14:35:46.218373 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:46.218343    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59548e72-9439-41a6-b47e-b7e22ee731a0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d8cff5c6f-2dmzt\" (UID: \"59548e72-9439-41a6-b47e-b7e22ee731a0\") " pod="openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt"
Sep 08 14:35:46.218515 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:46.218496    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/59548e72-9439-41a6-b47e-b7e22ee731a0-secret-telemeter-client\") pod \"telemeter-client-7d8cff5c6f-2dmzt\" (UID: \"59548e72-9439-41a6-b47e-b7e22ee731a0\") " pod="openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt"
Sep 08 14:35:46.223837 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:46.223816    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l95hj\" (UniqueName: \"kubernetes.io/projected/59548e72-9439-41a6-b47e-b7e22ee731a0-kube-api-access-l95hj\") pod \"telemeter-client-7d8cff5c6f-2dmzt\" (UID: \"59548e72-9439-41a6-b47e-b7e22ee731a0\") " pod="openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt"
Sep 08 14:35:46.251334 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:46.251306    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt"
Sep 08 14:35:46.805422 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:35:46.805392    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59548e72_9439_41a6_b47e_b7e22ee731a0.slice/crio-a4d673c5c44abdc45949fdedf205cf318daa21a805f124209e81367011db42a4 WatchSource:0}: Error finding container a4d673c5c44abdc45949fdedf205cf318daa21a805f124209e81367011db42a4: Status 404 returned error can't find the container with id a4d673c5c44abdc45949fdedf205cf318daa21a805f124209e81367011db42a4
Sep 08 14:35:46.805685 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:46.805663    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt"]
Sep 08 14:35:46.930519 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:46.930463    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5" event={"ID":"b2640414-5d50-49f8-a667-27f23590453c","Type":"ContainerStarted","Data":"70fadd9d230a45fcebf4a698ef82f7d419a9e15e05fe1b178a8da6e722c87405"}
Sep 08 14:35:46.930661 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:46.930557    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5" event={"ID":"b2640414-5d50-49f8-a667-27f23590453c","Type":"ContainerStarted","Data":"3a00e4e1694f8b276bd1e9c652e9e4c64a66c42755fa373f17ea23a32b077087"}
Sep 08 14:35:46.930661 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:46.930590    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5" event={"ID":"b2640414-5d50-49f8-a667-27f23590453c","Type":"ContainerStarted","Data":"91d1f9cdc2dff97622189a726a007bfafbcf586f7a94792b7352f065270dcb6b"}
Sep 08 14:35:46.931513 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:46.931489    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt" event={"ID":"59548e72-9439-41a6-b47e-b7e22ee731a0","Type":"ContainerStarted","Data":"a4d673c5c44abdc45949fdedf205cf318daa21a805f124209e81367011db42a4"}
Sep 08 14:35:47.938344 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:47.938311    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5" event={"ID":"b2640414-5d50-49f8-a667-27f23590453c","Type":"ContainerStarted","Data":"7b788e59cd047d537d266e9cd7c38d2201372747fbb2d7f6d679744a56828838"}
Sep 08 14:35:47.938702 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:47.938375    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5" event={"ID":"b2640414-5d50-49f8-a667-27f23590453c","Type":"ContainerStarted","Data":"7721f9bfb29994d741081011f00d1ed6484732c52b0c98e54618ae4ffdae55e4"}
Sep 08 14:35:47.938702 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:47.938402    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5" event={"ID":"b2640414-5d50-49f8-a667-27f23590453c","Type":"ContainerStarted","Data":"e528a010e35e1f8b1605ccbda8f76f50ba6870688d8901292769744fc320ac6d"}
Sep 08 14:35:47.938702 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:47.938450    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5"
Sep 08 14:35:47.969698 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:47.969650    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5" podStartSLOduration=2.050963264 podStartE2EDuration="4.969635849s" totalImagesPullingTime="2.918672585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:35:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:47.967313078 +0000 UTC m=+109.005714001" watchObservedRunningTime="2026-09-08 14:35:47.969635849 +0000 UTC m=+109.008036771"
Sep 08 14:35:48.943607 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:48.943578    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt" event={"ID":"59548e72-9439-41a6-b47e-b7e22ee731a0","Type":"ContainerStarted","Data":"05ea06a02675caf182d8a6cb52ffca505f7ca3588fbcea406fa81fdc3daa640d"}
Sep 08 14:35:49.897804 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:49.897770    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54458ddb6b-qxnrt"]
Sep 08 14:35:50.957688 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:50.957656    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt" event={"ID":"59548e72-9439-41a6-b47e-b7e22ee731a0","Type":"ContainerStarted","Data":"2b56b2270a4a0f52736a9045e0588e47af664dc123a2d9d472582bf93e8c1cbd"}
Sep 08 14:35:50.958056 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:50.957729    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt" event={"ID":"59548e72-9439-41a6-b47e-b7e22ee731a0","Type":"ContainerStarted","Data":"62629d00959703b904bf7d3c7180230b7738d5ed47d63069a0dad3e6882e4a12"}
Sep 08 14:35:50.991274 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:50.991225    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7d8cff5c6f-2dmzt" podStartSLOduration=2.226962859 podStartE2EDuration="5.991210003s" totalImagesPullingTime="3.764247144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:35:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:50.990122706 +0000 UTC m=+112.028523629" watchObservedRunningTime="2026-09-08 14:35:50.991210003 +0000 UTC m=+112.029610964"
Sep 08 14:35:52.916963 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:52.916937    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bl4qh"
Sep 08 14:35:53.950277 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:53.950247    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-57bbf4f5c7-pj7t5"
Sep 08 14:35:59.902906 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:35:59.902881    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:36:06.012658 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:06.012627    2577 generic.go:356] "Generic (PLEG): container finished" podID="2abb23b6-32c5-4ac9-bdb1-94950de2206c" containerID="c0ae697979b488740c8534df06a2ce9211cb9c7cc6dcd6d3a586e813ad931f48" exitCode=0
Sep 08 14:36:06.013064 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:06.012698    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fhk8t" event={"ID":"2abb23b6-32c5-4ac9-bdb1-94950de2206c","Type":"ContainerDied","Data":"c0ae697979b488740c8534df06a2ce9211cb9c7cc6dcd6d3a586e813ad931f48"}
Sep 08 14:36:06.013064 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:06.013038    2577 scope.go:117] "RemoveContainer" containerID="c0ae697979b488740c8534df06a2ce9211cb9c7cc6dcd6d3a586e813ad931f48"
Sep 08 14:36:07.017815 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:07.017783    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fhk8t" event={"ID":"2abb23b6-32c5-4ac9-bdb1-94950de2206c","Type":"ContainerStarted","Data":"d2ac3be16603f33c9f96df40bbe2f86af624e7be106214467c8f3c62ca93b897"}
Sep 08 14:36:09.289766 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:09.289730    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58b796b8-809f-4e12-8fba-b018a9af00c8-metrics-certs\") pod \"network-metrics-daemon-v6nc9\" (UID: \"58b796b8-809f-4e12-8fba-b018a9af00c8\") " pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:36:09.292164 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:09.292145    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58b796b8-809f-4e12-8fba-b018a9af00c8-metrics-certs\") pod \"network-metrics-daemon-v6nc9\" (UID: \"58b796b8-809f-4e12-8fba-b018a9af00c8\") " pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:36:09.300077 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:09.300058    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-42kmv\""
Sep 08 14:36:09.307511 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:09.307497    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6nc9"
Sep 08 14:36:09.576253 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:09.576171    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v6nc9"]
Sep 08 14:36:09.578912 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:36:09.578882    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58b796b8_809f_4e12_8fba_b018a9af00c8.slice/crio-4f5f6a2f41f30d7e2446e6262a4355d427b9a270ab6c8503299fe4b174b9bf87 WatchSource:0}: Error finding container 4f5f6a2f41f30d7e2446e6262a4355d427b9a270ab6c8503299fe4b174b9bf87: Status 404 returned error can't find the container with id 4f5f6a2f41f30d7e2446e6262a4355d427b9a270ab6c8503299fe4b174b9bf87
Sep 08 14:36:10.027860 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:10.027828    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v6nc9" event={"ID":"58b796b8-809f-4e12-8fba-b018a9af00c8","Type":"ContainerStarted","Data":"4f5f6a2f41f30d7e2446e6262a4355d427b9a270ab6c8503299fe4b174b9bf87"}
Sep 08 14:36:11.033600 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:11.033523    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v6nc9" event={"ID":"58b796b8-809f-4e12-8fba-b018a9af00c8","Type":"ContainerStarted","Data":"76ab195ee3f36b84b98463910ebd98436074ccca617f16805d6af9911dfd9cfe"}
Sep 08 14:36:11.033600 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:11.033580    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v6nc9" event={"ID":"58b796b8-809f-4e12-8fba-b018a9af00c8","Type":"ContainerStarted","Data":"fa98b8c1be5c01b0511bee634f7dc1edd02d3c181e106a14d4d054c8ea4c01c0"}
Sep 08 14:36:11.052806 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:11.052763    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-v6nc9" podStartSLOduration=130.88839629 podStartE2EDuration="2m12.052748346s" totalImagesPullingTime="1.164352056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:33:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:36:11.05131023 +0000 UTC m=+132.089711151" watchObservedRunningTime="2026-09-08 14:36:11.052748346 +0000 UTC m=+132.091149268"
Sep 08 14:36:14.917535 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:14.917458    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt" podUID="67dab4b4-b501-487d-8df6-89b7c715fa80" containerName="registry" containerID="cri-o://76f4c627b4787b04ea81e1b13d4b422c93651ac9e74b1dc1aae59b74f186ec66" gracePeriod=30
Sep 08 14:36:15.048438 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:15.048406    2577 generic.go:356] "Generic (PLEG): container finished" podID="67dab4b4-b501-487d-8df6-89b7c715fa80" containerID="76f4c627b4787b04ea81e1b13d4b422c93651ac9e74b1dc1aae59b74f186ec66" exitCode=0
Sep 08 14:36:15.048658 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:15.048605    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt" event={"ID":"67dab4b4-b501-487d-8df6-89b7c715fa80","Type":"ContainerDied","Data":"76f4c627b4787b04ea81e1b13d4b422c93651ac9e74b1dc1aae59b74f186ec66"}
Sep 08 14:36:15.162564 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:15.162531    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:36:15.236111 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:15.236013    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67dab4b4-b501-487d-8df6-89b7c715fa80-trusted-ca\") pod \"67dab4b4-b501-487d-8df6-89b7c715fa80\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") "
Sep 08 14:36:15.236111 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:15.236056    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/67dab4b4-b501-487d-8df6-89b7c715fa80-image-registry-private-configuration\") pod \"67dab4b4-b501-487d-8df6-89b7c715fa80\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") "
Sep 08 14:36:15.236111 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:15.236081    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/67dab4b4-b501-487d-8df6-89b7c715fa80-installation-pull-secrets\") pod \"67dab4b4-b501-487d-8df6-89b7c715fa80\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") "
Sep 08 14:36:15.236350 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:15.236115    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-certificates\") pod \"67dab4b4-b501-487d-8df6-89b7c715fa80\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") "
Sep 08 14:36:15.236350 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:15.236137    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-tls\") pod \"67dab4b4-b501-487d-8df6-89b7c715fa80\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") "
Sep 08 14:36:15.236350 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:15.236167    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-bound-sa-token\") pod \"67dab4b4-b501-487d-8df6-89b7c715fa80\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") "
Sep 08 14:36:15.236350 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:15.236200    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtb84\" (UniqueName: \"kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-kube-api-access-qtb84\") pod \"67dab4b4-b501-487d-8df6-89b7c715fa80\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") "
Sep 08 14:36:15.236350 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:15.236233    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/67dab4b4-b501-487d-8df6-89b7c715fa80-ca-trust-extracted\") pod \"67dab4b4-b501-487d-8df6-89b7c715fa80\" (UID: \"67dab4b4-b501-487d-8df6-89b7c715fa80\") "
Sep 08 14:36:15.236616 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:15.236530    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67dab4b4-b501-487d-8df6-89b7c715fa80-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "67dab4b4-b501-487d-8df6-89b7c715fa80" (UID: "67dab4b4-b501-487d-8df6-89b7c715fa80"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:36:15.236616 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:15.236570    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "67dab4b4-b501-487d-8df6-89b7c715fa80" (UID: "67dab4b4-b501-487d-8df6-89b7c715fa80"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:36:15.238700 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:15.238672    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "67dab4b4-b501-487d-8df6-89b7c715fa80" (UID: "67dab4b4-b501-487d-8df6-89b7c715fa80"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:36:15.238951 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:15.238918    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-kube-api-access-qtb84" (OuterVolumeSpecName: "kube-api-access-qtb84") pod "67dab4b4-b501-487d-8df6-89b7c715fa80" (UID: "67dab4b4-b501-487d-8df6-89b7c715fa80"). InnerVolumeSpecName "kube-api-access-qtb84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:36:15.239067 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:15.238941    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67dab4b4-b501-487d-8df6-89b7c715fa80-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "67dab4b4-b501-487d-8df6-89b7c715fa80" (UID: "67dab4b4-b501-487d-8df6-89b7c715fa80"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:36:15.239067 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:15.238990    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "67dab4b4-b501-487d-8df6-89b7c715fa80" (UID: "67dab4b4-b501-487d-8df6-89b7c715fa80"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:36:15.239067 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:15.239009    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67dab4b4-b501-487d-8df6-89b7c715fa80-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "67dab4b4-b501-487d-8df6-89b7c715fa80" (UID: "67dab4b4-b501-487d-8df6-89b7c715fa80"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:36:15.244444 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:15.244419    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67dab4b4-b501-487d-8df6-89b7c715fa80-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "67dab4b4-b501-487d-8df6-89b7c715fa80" (UID: "67dab4b4-b501-487d-8df6-89b7c715fa80"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:36:15.337003 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:15.336957    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtb84\" (UniqueName: \"kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-kube-api-access-qtb84\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:36:15.337003 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:15.336996    2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/67dab4b4-b501-487d-8df6-89b7c715fa80-ca-trust-extracted\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:36:15.337003 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:15.337005    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67dab4b4-b501-487d-8df6-89b7c715fa80-trusted-ca\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:36:15.337003 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:15.337018    2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/67dab4b4-b501-487d-8df6-89b7c715fa80-image-registry-private-configuration\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:36:15.337253 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:15.337027    2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/67dab4b4-b501-487d-8df6-89b7c715fa80-installation-pull-secrets\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:36:15.337253 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:15.337034    2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-certificates\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:36:15.337253 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:15.337042    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-registry-tls\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:36:15.337253 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:15.337049    2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/67dab4b4-b501-487d-8df6-89b7c715fa80-bound-sa-token\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:36:16.053983 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:16.053952    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt"
Sep 08 14:36:16.053983 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:16.053967    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54458ddb6b-qxnrt" event={"ID":"67dab4b4-b501-487d-8df6-89b7c715fa80","Type":"ContainerDied","Data":"1f149410c05d18e0fd38910cff031deb9476c71a2d4ce91d2e99d1ad83046550"}
Sep 08 14:36:16.054565 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:16.054024    2577 scope.go:117] "RemoveContainer" containerID="76f4c627b4787b04ea81e1b13d4b422c93651ac9e74b1dc1aae59b74f186ec66"
Sep 08 14:36:16.073216 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:16.073193    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54458ddb6b-qxnrt"]
Sep 08 14:36:16.077099 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:16.077062    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-54458ddb6b-qxnrt"]
Sep 08 14:36:17.489190 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:17.489152    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67dab4b4-b501-487d-8df6-89b7c715fa80" path="/var/lib/kubelet/pods/67dab4b4-b501-487d-8df6-89b7c715fa80/volumes"
Sep 08 14:36:32.114622 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:32.114581    2577 generic.go:356] "Generic (PLEG): container finished" podID="8cafbda6-6a6f-4ef1-999c-da76dfd7dc6d" containerID="a288953267ad0ee220bfb9d5506903c034b33df767656f325fe78e942020a1a9" exitCode=0
Sep 08 14:36:32.115042 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:32.114654    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9f956" event={"ID":"8cafbda6-6a6f-4ef1-999c-da76dfd7dc6d","Type":"ContainerDied","Data":"a288953267ad0ee220bfb9d5506903c034b33df767656f325fe78e942020a1a9"}
Sep 08 14:36:32.115042 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:32.115005    2577 scope.go:117] "RemoveContainer" containerID="a288953267ad0ee220bfb9d5506903c034b33df767656f325fe78e942020a1a9"
Sep 08 14:36:33.120102 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:36:33.120067    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-9f956" event={"ID":"8cafbda6-6a6f-4ef1-999c-da76dfd7dc6d","Type":"ContainerStarted","Data":"dbcb57432fbfeb2d4b076664ba3d1d072e6c7dd9f079c9bea199f8048ee06bc0"}
Sep 08 14:38:06.538852 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:06.538817    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hfb2"]
Sep 08 14:38:06.539286 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:06.539061    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67dab4b4-b501-487d-8df6-89b7c715fa80" containerName="registry"
Sep 08 14:38:06.539286 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:06.539071    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="67dab4b4-b501-487d-8df6-89b7c715fa80" containerName="registry"
Sep 08 14:38:06.539286 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:06.539123    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="67dab4b4-b501-487d-8df6-89b7c715fa80" containerName="registry"
Sep 08 14:38:06.542120 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:06.542105    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hfb2"
Sep 08 14:38:06.544599 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:06.544576    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 14:38:06.544714 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:06.544578    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8jjpz\""
Sep 08 14:38:06.545675 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:06.545649    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 14:38:06.555315 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:06.555291    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hfb2"]
Sep 08 14:38:06.661502 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:06.661455    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plf5t\" (UniqueName: \"kubernetes.io/projected/1c903540-1eec-4346-9307-33dee50bd3f8-kube-api-access-plf5t\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hfb2\" (UID: \"1c903540-1eec-4346-9307-33dee50bd3f8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hfb2"
Sep 08 14:38:06.661502 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:06.661514    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c903540-1eec-4346-9307-33dee50bd3f8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hfb2\" (UID: \"1c903540-1eec-4346-9307-33dee50bd3f8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hfb2"
Sep 08 14:38:06.661749 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:06.661539    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c903540-1eec-4346-9307-33dee50bd3f8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hfb2\" (UID: \"1c903540-1eec-4346-9307-33dee50bd3f8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hfb2"
Sep 08 14:38:06.762841 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:06.762798    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plf5t\" (UniqueName: \"kubernetes.io/projected/1c903540-1eec-4346-9307-33dee50bd3f8-kube-api-access-plf5t\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hfb2\" (UID: \"1c903540-1eec-4346-9307-33dee50bd3f8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hfb2"
Sep 08 14:38:06.763027 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:06.762852    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c903540-1eec-4346-9307-33dee50bd3f8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hfb2\" (UID: \"1c903540-1eec-4346-9307-33dee50bd3f8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hfb2"
Sep 08 14:38:06.763027 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:06.762883    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c903540-1eec-4346-9307-33dee50bd3f8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hfb2\" (UID: \"1c903540-1eec-4346-9307-33dee50bd3f8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hfb2"
Sep 08 14:38:06.763305 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:06.763284    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c903540-1eec-4346-9307-33dee50bd3f8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hfb2\" (UID: \"1c903540-1eec-4346-9307-33dee50bd3f8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hfb2"
Sep 08 14:38:06.763370 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:06.763310    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c903540-1eec-4346-9307-33dee50bd3f8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hfb2\" (UID: \"1c903540-1eec-4346-9307-33dee50bd3f8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hfb2"
Sep 08 14:38:06.771611 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:06.771583    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plf5t\" (UniqueName: \"kubernetes.io/projected/1c903540-1eec-4346-9307-33dee50bd3f8-kube-api-access-plf5t\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hfb2\" (UID: \"1c903540-1eec-4346-9307-33dee50bd3f8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hfb2"
Sep 08 14:38:06.851652 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:06.851574    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hfb2"
Sep 08 14:38:07.123409 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:07.123323    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hfb2"]
Sep 08 14:38:07.126163 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:38:07.126141    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c903540_1eec_4346_9307_33dee50bd3f8.slice/crio-7c6905df71afa16223ccb85e507741cf9082c07999dde303a0ccff277a5e1b89 WatchSource:0}: Error finding container 7c6905df71afa16223ccb85e507741cf9082c07999dde303a0ccff277a5e1b89: Status 404 returned error can't find the container with id 7c6905df71afa16223ccb85e507741cf9082c07999dde303a0ccff277a5e1b89
Sep 08 14:38:07.464414 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:07.464381    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hfb2" event={"ID":"1c903540-1eec-4346-9307-33dee50bd3f8","Type":"ContainerStarted","Data":"7c6905df71afa16223ccb85e507741cf9082c07999dde303a0ccff277a5e1b89"}
Sep 08 14:38:14.494094 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:14.494063    2577 generic.go:356] "Generic (PLEG): container finished" podID="1c903540-1eec-4346-9307-33dee50bd3f8" containerID="8070243bd8cd6c26aa1d7c0b975d56cc6f4359c0f359f85690eac3c0b52d170c" exitCode=0
Sep 08 14:38:14.494515 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:14.494139    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hfb2" event={"ID":"1c903540-1eec-4346-9307-33dee50bd3f8","Type":"ContainerDied","Data":"8070243bd8cd6c26aa1d7c0b975d56cc6f4359c0f359f85690eac3c0b52d170c"}
Sep 08 14:38:17.507509 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:17.507457    2577 generic.go:356] "Generic (PLEG): container finished" podID="1c903540-1eec-4346-9307-33dee50bd3f8" containerID="ec971a2afcb9256cead6ccab1565cee732789494f526db1493cd42ce8ebcf3b5" exitCode=0
Sep 08 14:38:17.507878 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:17.507515    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hfb2" event={"ID":"1c903540-1eec-4346-9307-33dee50bd3f8","Type":"ContainerDied","Data":"ec971a2afcb9256cead6ccab1565cee732789494f526db1493cd42ce8ebcf3b5"}
Sep 08 14:38:24.542553 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:24.542514    2577 generic.go:356] "Generic (PLEG): container finished" podID="1c903540-1eec-4346-9307-33dee50bd3f8" containerID="967019a51c526544a856b4d8d87f19bc804dc3acb3913fb0c29507656d6f39f8" exitCode=0
Sep 08 14:38:24.542925 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:24.542595    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hfb2" event={"ID":"1c903540-1eec-4346-9307-33dee50bd3f8","Type":"ContainerDied","Data":"967019a51c526544a856b4d8d87f19bc804dc3acb3913fb0c29507656d6f39f8"}
Sep 08 14:38:25.665603 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:25.665576    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hfb2"
Sep 08 14:38:25.717275 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:25.717241    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c903540-1eec-4346-9307-33dee50bd3f8-util\") pod \"1c903540-1eec-4346-9307-33dee50bd3f8\" (UID: \"1c903540-1eec-4346-9307-33dee50bd3f8\") "
Sep 08 14:38:25.717460 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:25.717294    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c903540-1eec-4346-9307-33dee50bd3f8-bundle\") pod \"1c903540-1eec-4346-9307-33dee50bd3f8\" (UID: \"1c903540-1eec-4346-9307-33dee50bd3f8\") "
Sep 08 14:38:25.717460 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:25.717326    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plf5t\" (UniqueName: \"kubernetes.io/projected/1c903540-1eec-4346-9307-33dee50bd3f8-kube-api-access-plf5t\") pod \"1c903540-1eec-4346-9307-33dee50bd3f8\" (UID: \"1c903540-1eec-4346-9307-33dee50bd3f8\") "
Sep 08 14:38:25.717958 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:25.717931    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c903540-1eec-4346-9307-33dee50bd3f8-bundle" (OuterVolumeSpecName: "bundle") pod "1c903540-1eec-4346-9307-33dee50bd3f8" (UID: "1c903540-1eec-4346-9307-33dee50bd3f8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:38:25.719683 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:25.719656    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c903540-1eec-4346-9307-33dee50bd3f8-kube-api-access-plf5t" (OuterVolumeSpecName: "kube-api-access-plf5t") pod "1c903540-1eec-4346-9307-33dee50bd3f8" (UID: "1c903540-1eec-4346-9307-33dee50bd3f8"). InnerVolumeSpecName "kube-api-access-plf5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:38:25.721552 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:25.721532    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c903540-1eec-4346-9307-33dee50bd3f8-util" (OuterVolumeSpecName: "util") pod "1c903540-1eec-4346-9307-33dee50bd3f8" (UID: "1c903540-1eec-4346-9307-33dee50bd3f8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:38:25.818793 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:25.818710    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plf5t\" (UniqueName: \"kubernetes.io/projected/1c903540-1eec-4346-9307-33dee50bd3f8-kube-api-access-plf5t\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:38:25.818793 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:25.818739    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c903540-1eec-4346-9307-33dee50bd3f8-util\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:38:25.818793 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:25.818751    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c903540-1eec-4346-9307-33dee50bd3f8-bundle\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:38:26.551522 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:26.551461    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hfb2" event={"ID":"1c903540-1eec-4346-9307-33dee50bd3f8","Type":"ContainerDied","Data":"7c6905df71afa16223ccb85e507741cf9082c07999dde303a0ccff277a5e1b89"}
Sep 08 14:38:26.551692 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:26.551540    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7c6905df71afa16223ccb85e507741cf9082c07999dde303a0ccff277a5e1b89"
Sep 08 14:38:26.551692 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:26.551501    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hfb2"
Sep 08 14:38:29.685171 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:29.685144    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bjb5d"]
Sep 08 14:38:29.685520 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:29.685428    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c903540-1eec-4346-9307-33dee50bd3f8" containerName="extract"
Sep 08 14:38:29.685520 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:29.685439    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c903540-1eec-4346-9307-33dee50bd3f8" containerName="extract"
Sep 08 14:38:29.685520 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:29.685447    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c903540-1eec-4346-9307-33dee50bd3f8" containerName="pull"
Sep 08 14:38:29.685520 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:29.685456    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c903540-1eec-4346-9307-33dee50bd3f8" containerName="pull"
Sep 08 14:38:29.685520 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:29.685481    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c903540-1eec-4346-9307-33dee50bd3f8" containerName="util"
Sep 08 14:38:29.685520 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:29.685487    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c903540-1eec-4346-9307-33dee50bd3f8" containerName="util"
Sep 08 14:38:29.685707 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:29.685530    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c903540-1eec-4346-9307-33dee50bd3f8" containerName="extract"
Sep 08 14:38:29.728658 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:29.728633    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bjb5d"]
Sep 08 14:38:29.728784 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:29.728739    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bjb5d"
Sep 08 14:38:29.731364 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:29.731335    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 08 14:38:29.731514 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:29.731496    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 08 14:38:29.731696 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:29.731680    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-lvmj4\""
Sep 08 14:38:29.847309 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:29.847277    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac61fab2-c0c2-432c-bfca-fa3bcb6a5cd0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bjb5d\" (UID: \"ac61fab2-c0c2-432c-bfca-fa3bcb6a5cd0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bjb5d"
Sep 08 14:38:29.847456 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:29.847345    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjdtg\" (UniqueName: \"kubernetes.io/projected/ac61fab2-c0c2-432c-bfca-fa3bcb6a5cd0-kube-api-access-hjdtg\") pod \"cert-manager-operator-controller-manager-55c444bf86-bjb5d\" (UID: \"ac61fab2-c0c2-432c-bfca-fa3bcb6a5cd0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bjb5d"
Sep 08 14:38:29.948417 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:29.948350    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjdtg\" (UniqueName: \"kubernetes.io/projected/ac61fab2-c0c2-432c-bfca-fa3bcb6a5cd0-kube-api-access-hjdtg\") pod \"cert-manager-operator-controller-manager-55c444bf86-bjb5d\" (UID: \"ac61fab2-c0c2-432c-bfca-fa3bcb6a5cd0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bjb5d"
Sep 08 14:38:29.948417 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:29.948395    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac61fab2-c0c2-432c-bfca-fa3bcb6a5cd0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bjb5d\" (UID: \"ac61fab2-c0c2-432c-bfca-fa3bcb6a5cd0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bjb5d"
Sep 08 14:38:29.948728 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:29.948713    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac61fab2-c0c2-432c-bfca-fa3bcb6a5cd0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bjb5d\" (UID: \"ac61fab2-c0c2-432c-bfca-fa3bcb6a5cd0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bjb5d"
Sep 08 14:38:29.957104 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:29.957077    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjdtg\" (UniqueName: \"kubernetes.io/projected/ac61fab2-c0c2-432c-bfca-fa3bcb6a5cd0-kube-api-access-hjdtg\") pod \"cert-manager-operator-controller-manager-55c444bf86-bjb5d\" (UID: \"ac61fab2-c0c2-432c-bfca-fa3bcb6a5cd0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bjb5d"
Sep 08 14:38:30.038128 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:30.038097    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bjb5d"
Sep 08 14:38:30.349286 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:30.349264    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bjb5d"]
Sep 08 14:38:30.350987 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:38:30.350955    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac61fab2_c0c2_432c_bfca_fa3bcb6a5cd0.slice/crio-e5c1a5b405b3f41ecc583791ff621d4b63678c0493432b0a447b1a47f85f0090 WatchSource:0}: Error finding container e5c1a5b405b3f41ecc583791ff621d4b63678c0493432b0a447b1a47f85f0090: Status 404 returned error can't find the container with id e5c1a5b405b3f41ecc583791ff621d4b63678c0493432b0a447b1a47f85f0090
Sep 08 14:38:30.567162 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:30.567128    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bjb5d" event={"ID":"ac61fab2-c0c2-432c-bfca-fa3bcb6a5cd0","Type":"ContainerStarted","Data":"e5c1a5b405b3f41ecc583791ff621d4b63678c0493432b0a447b1a47f85f0090"}
Sep 08 14:38:33.579080 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:33.579047    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bjb5d" event={"ID":"ac61fab2-c0c2-432c-bfca-fa3bcb6a5cd0","Type":"ContainerStarted","Data":"62dd3f12df08effb23aa66041455b31fc374643fb0db0870bfa61bca5a798bca"}
Sep 08 14:38:33.620796 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:33.620735    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bjb5d" podStartSLOduration=2.461522355 podStartE2EDuration="4.620718243s" totalImagesPullingTime="2.159195888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:38:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:38:33.618977161 +0000 UTC m=+274.657378076" watchObservedRunningTime="2026-09-08 14:38:33.620718243 +0000 UTC m=+274.659119166"
Sep 08 14:38:34.611031 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:34.610995    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flc2gj"]
Sep 08 14:38:34.613993 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:34.613975    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flc2gj"
Sep 08 14:38:34.617156 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:34.617123    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 14:38:34.618031 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:34.618011    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 14:38:34.618143 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:34.618017    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8jjpz\""
Sep 08 14:38:34.623866 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:34.623841    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flc2gj"]
Sep 08 14:38:34.687458 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:34.687423    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96fc1ffd-2fb2-4304-b7b9-45da15f07816-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flc2gj\" (UID: \"96fc1ffd-2fb2-4304-b7b9-45da15f07816\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flc2gj"
Sep 08 14:38:34.687647 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:34.687537    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rjmk\" (UniqueName: \"kubernetes.io/projected/96fc1ffd-2fb2-4304-b7b9-45da15f07816-kube-api-access-5rjmk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flc2gj\" (UID: \"96fc1ffd-2fb2-4304-b7b9-45da15f07816\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flc2gj"
Sep 08 14:38:34.687647 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:34.687581    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96fc1ffd-2fb2-4304-b7b9-45da15f07816-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flc2gj\" (UID: \"96fc1ffd-2fb2-4304-b7b9-45da15f07816\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flc2gj"
Sep 08 14:38:34.787899 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:34.787857    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rjmk\" (UniqueName: \"kubernetes.io/projected/96fc1ffd-2fb2-4304-b7b9-45da15f07816-kube-api-access-5rjmk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flc2gj\" (UID: \"96fc1ffd-2fb2-4304-b7b9-45da15f07816\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flc2gj"
Sep 08 14:38:34.787899 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:34.787897    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96fc1ffd-2fb2-4304-b7b9-45da15f07816-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flc2gj\" (UID: \"96fc1ffd-2fb2-4304-b7b9-45da15f07816\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flc2gj"
Sep 08 14:38:34.788110 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:34.787926    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96fc1ffd-2fb2-4304-b7b9-45da15f07816-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flc2gj\" (UID: \"96fc1ffd-2fb2-4304-b7b9-45da15f07816\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flc2gj"
Sep 08 14:38:34.788335 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:34.788315    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96fc1ffd-2fb2-4304-b7b9-45da15f07816-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flc2gj\" (UID: \"96fc1ffd-2fb2-4304-b7b9-45da15f07816\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flc2gj"
Sep 08 14:38:34.788370 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:34.788332    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96fc1ffd-2fb2-4304-b7b9-45da15f07816-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flc2gj\" (UID: \"96fc1ffd-2fb2-4304-b7b9-45da15f07816\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flc2gj"
Sep 08 14:38:34.797810 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:34.797788    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rjmk\" (UniqueName: \"kubernetes.io/projected/96fc1ffd-2fb2-4304-b7b9-45da15f07816-kube-api-access-5rjmk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flc2gj\" (UID: \"96fc1ffd-2fb2-4304-b7b9-45da15f07816\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flc2gj"
Sep 08 14:38:34.922389 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:34.922357    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flc2gj"
Sep 08 14:38:35.192742 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:35.192665    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flc2gj"]
Sep 08 14:38:35.195616 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:38:35.195590    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96fc1ffd_2fb2_4304_b7b9_45da15f07816.slice/crio-94d7db7935f555d205e037ae7d8207f541a45473e252a630bfd346ecebc90736 WatchSource:0}: Error finding container 94d7db7935f555d205e037ae7d8207f541a45473e252a630bfd346ecebc90736: Status 404 returned error can't find the container with id 94d7db7935f555d205e037ae7d8207f541a45473e252a630bfd346ecebc90736
Sep 08 14:38:35.589254 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:35.589168    2577 generic.go:356] "Generic (PLEG): container finished" podID="96fc1ffd-2fb2-4304-b7b9-45da15f07816" containerID="eef236d72b6b173dd1a0f6b9f3f0b000f548d1468762ab057c3b7e05b13ce6cd" exitCode=0
Sep 08 14:38:35.589408 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:35.589261    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flc2gj" event={"ID":"96fc1ffd-2fb2-4304-b7b9-45da15f07816","Type":"ContainerDied","Data":"eef236d72b6b173dd1a0f6b9f3f0b000f548d1468762ab057c3b7e05b13ce6cd"}
Sep 08 14:38:35.589408 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:35.589311    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flc2gj" event={"ID":"96fc1ffd-2fb2-4304-b7b9-45da15f07816","Type":"ContainerStarted","Data":"94d7db7935f555d205e037ae7d8207f541a45473e252a630bfd346ecebc90736"}
Sep 08 14:38:38.602811 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:38.602774    2577 generic.go:356] "Generic (PLEG): container finished" podID="96fc1ffd-2fb2-4304-b7b9-45da15f07816" containerID="3261871000c480d05ea1d24ef3bc595ec9ed80eb8a04a457f26529bdf1e3a0f3" exitCode=0
Sep 08 14:38:38.603173 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:38.602860    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flc2gj" event={"ID":"96fc1ffd-2fb2-4304-b7b9-45da15f07816","Type":"ContainerDied","Data":"3261871000c480d05ea1d24ef3bc595ec9ed80eb8a04a457f26529bdf1e3a0f3"}
Sep 08 14:38:39.608450 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:39.608413    2577 generic.go:356] "Generic (PLEG): container finished" podID="96fc1ffd-2fb2-4304-b7b9-45da15f07816" containerID="0aff4d449828973907cd09c33fc5a2c70081d8b7b3eb2096b44a46f5fd111bb0" exitCode=0
Sep 08 14:38:39.608829 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:39.608512    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flc2gj" event={"ID":"96fc1ffd-2fb2-4304-b7b9-45da15f07816","Type":"ContainerDied","Data":"0aff4d449828973907cd09c33fc5a2c70081d8b7b3eb2096b44a46f5fd111bb0"}
Sep 08 14:38:40.740806 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:40.740775    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flc2gj"
Sep 08 14:38:40.831916 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:40.831882    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96fc1ffd-2fb2-4304-b7b9-45da15f07816-util\") pod \"96fc1ffd-2fb2-4304-b7b9-45da15f07816\" (UID: \"96fc1ffd-2fb2-4304-b7b9-45da15f07816\") "
Sep 08 14:38:40.832117 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:40.831947    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rjmk\" (UniqueName: \"kubernetes.io/projected/96fc1ffd-2fb2-4304-b7b9-45da15f07816-kube-api-access-5rjmk\") pod \"96fc1ffd-2fb2-4304-b7b9-45da15f07816\" (UID: \"96fc1ffd-2fb2-4304-b7b9-45da15f07816\") "
Sep 08 14:38:40.832117 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:40.831975    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96fc1ffd-2fb2-4304-b7b9-45da15f07816-bundle\") pod \"96fc1ffd-2fb2-4304-b7b9-45da15f07816\" (UID: \"96fc1ffd-2fb2-4304-b7b9-45da15f07816\") "
Sep 08 14:38:40.832402 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:40.832381    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96fc1ffd-2fb2-4304-b7b9-45da15f07816-bundle" (OuterVolumeSpecName: "bundle") pod "96fc1ffd-2fb2-4304-b7b9-45da15f07816" (UID: "96fc1ffd-2fb2-4304-b7b9-45da15f07816"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:38:40.834302 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:40.834277    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96fc1ffd-2fb2-4304-b7b9-45da15f07816-kube-api-access-5rjmk" (OuterVolumeSpecName: "kube-api-access-5rjmk") pod "96fc1ffd-2fb2-4304-b7b9-45da15f07816" (UID: "96fc1ffd-2fb2-4304-b7b9-45da15f07816"). InnerVolumeSpecName "kube-api-access-5rjmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:38:40.836224 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:40.836182    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96fc1ffd-2fb2-4304-b7b9-45da15f07816-util" (OuterVolumeSpecName: "util") pod "96fc1ffd-2fb2-4304-b7b9-45da15f07816" (UID: "96fc1ffd-2fb2-4304-b7b9-45da15f07816"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:38:40.932982 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:40.932952    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rjmk\" (UniqueName: \"kubernetes.io/projected/96fc1ffd-2fb2-4304-b7b9-45da15f07816-kube-api-access-5rjmk\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:38:40.932982 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:40.932979    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96fc1ffd-2fb2-4304-b7b9-45da15f07816-bundle\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:38:40.932982 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:40.932988    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96fc1ffd-2fb2-4304-b7b9-45da15f07816-util\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:38:41.620335 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:41.620311    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flc2gj"
Sep 08 14:38:41.620525 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:41.620302    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flc2gj" event={"ID":"96fc1ffd-2fb2-4304-b7b9-45da15f07816","Type":"ContainerDied","Data":"94d7db7935f555d205e037ae7d8207f541a45473e252a630bfd346ecebc90736"}
Sep 08 14:38:41.620525 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:41.620434    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94d7db7935f555d205e037ae7d8207f541a45473e252a630bfd346ecebc90736"
Sep 08 14:38:48.018815 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:48.018776    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mns95"]
Sep 08 14:38:48.019188 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:48.019067    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96fc1ffd-2fb2-4304-b7b9-45da15f07816" containerName="pull"
Sep 08 14:38:48.019188 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:48.019078    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="96fc1ffd-2fb2-4304-b7b9-45da15f07816" containerName="pull"
Sep 08 14:38:48.019188 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:48.019090    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96fc1ffd-2fb2-4304-b7b9-45da15f07816" containerName="util"
Sep 08 14:38:48.019188 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:48.019095    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="96fc1ffd-2fb2-4304-b7b9-45da15f07816" containerName="util"
Sep 08 14:38:48.019188 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:48.019102    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96fc1ffd-2fb2-4304-b7b9-45da15f07816" containerName="extract"
Sep 08 14:38:48.019188 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:48.019108    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="96fc1ffd-2fb2-4304-b7b9-45da15f07816" containerName="extract"
Sep 08 14:38:48.019188 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:48.019150    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="96fc1ffd-2fb2-4304-b7b9-45da15f07816" containerName="extract"
Sep 08 14:38:48.022737 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:48.022721    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mns95"
Sep 08 14:38:48.025612 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:48.025577    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 08 14:38:48.025741 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:48.025596    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 08 14:38:48.026724 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:48.026705    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-s8fvm\""
Sep 08 14:38:48.033077 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:48.033055    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mns95"]
Sep 08 14:38:48.086702 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:48.086666    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51d1db6b-4e42-4d00-9d7c-f245090fb18a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mns95\" (UID: \"51d1db6b-4e42-4d00-9d7c-f245090fb18a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mns95"
Sep 08 14:38:48.086858 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:48.086720    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58l5s\" (UniqueName: \"kubernetes.io/projected/51d1db6b-4e42-4d00-9d7c-f245090fb18a-kube-api-access-58l5s\") pod \"openshift-lws-operator-fd8ccff4c-mns95\" (UID: \"51d1db6b-4e42-4d00-9d7c-f245090fb18a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mns95"
Sep 08 14:38:48.187492 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:48.187426    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51d1db6b-4e42-4d00-9d7c-f245090fb18a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mns95\" (UID: \"51d1db6b-4e42-4d00-9d7c-f245090fb18a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mns95"
Sep 08 14:38:48.187669 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:48.187525    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58l5s\" (UniqueName: \"kubernetes.io/projected/51d1db6b-4e42-4d00-9d7c-f245090fb18a-kube-api-access-58l5s\") pod \"openshift-lws-operator-fd8ccff4c-mns95\" (UID: \"51d1db6b-4e42-4d00-9d7c-f245090fb18a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mns95"
Sep 08 14:38:48.187840 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:48.187820    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51d1db6b-4e42-4d00-9d7c-f245090fb18a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mns95\" (UID: \"51d1db6b-4e42-4d00-9d7c-f245090fb18a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mns95"
Sep 08 14:38:48.196959 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:48.196926    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58l5s\" (UniqueName: \"kubernetes.io/projected/51d1db6b-4e42-4d00-9d7c-f245090fb18a-kube-api-access-58l5s\") pod \"openshift-lws-operator-fd8ccff4c-mns95\" (UID: \"51d1db6b-4e42-4d00-9d7c-f245090fb18a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mns95"
Sep 08 14:38:48.332451 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:48.332365    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mns95"
Sep 08 14:38:48.601699 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:48.601676    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mns95"]
Sep 08 14:38:48.604186 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:38:48.604163    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51d1db6b_4e42_4d00_9d7c_f245090fb18a.slice/crio-4fe52aade8829bbcbd71ff659c277ffa1b37254b4a6703cada7e26e3f858f0e2 WatchSource:0}: Error finding container 4fe52aade8829bbcbd71ff659c277ffa1b37254b4a6703cada7e26e3f858f0e2: Status 404 returned error can't find the container with id 4fe52aade8829bbcbd71ff659c277ffa1b37254b4a6703cada7e26e3f858f0e2
Sep 08 14:38:48.648520 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:48.648487    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mns95" event={"ID":"51d1db6b-4e42-4d00-9d7c-f245090fb18a","Type":"ContainerStarted","Data":"4fe52aade8829bbcbd71ff659c277ffa1b37254b4a6703cada7e26e3f858f0e2"}
Sep 08 14:38:50.658762 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:50.658732    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mns95" event={"ID":"51d1db6b-4e42-4d00-9d7c-f245090fb18a","Type":"ContainerStarted","Data":"2af2737379c19936f00b6804966985facbf7c8e5ac8fc77a3517f09e50142a99"}
Sep 08 14:38:50.677381 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:50.677329    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mns95" podStartSLOduration=1.131764577 podStartE2EDuration="2.677314433s" totalImagesPullingTime="1.545549856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:38:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:38:50.675874406 +0000 UTC m=+291.714275330" watchObservedRunningTime="2026-09-08 14:38:50.677314433 +0000 UTC m=+291.715715357"
Sep 08 14:38:53.002349 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:53.002315    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8w9dd"]
Sep 08 14:38:53.005694 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:53.005679    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8w9dd"
Sep 08 14:38:53.009241 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:53.009219    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 14:38:53.009375 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:53.009219    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8jjpz\""
Sep 08 14:38:53.010112 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:53.010096    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 14:38:53.014377 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:53.014354    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8w9dd"]
Sep 08 14:38:53.126561 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:53.126525    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8w9dd\" (UID: \"7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8w9dd"
Sep 08 14:38:53.126739 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:53.126570    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kwtj\" (UniqueName: \"kubernetes.io/projected/7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27-kube-api-access-9kwtj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8w9dd\" (UID: \"7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8w9dd"
Sep 08 14:38:53.126739 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:53.126599    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8w9dd\" (UID: \"7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8w9dd"
Sep 08 14:38:53.227932 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:53.227898    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8w9dd\" (UID: \"7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8w9dd"
Sep 08 14:38:53.228086 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:53.227954    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kwtj\" (UniqueName: \"kubernetes.io/projected/7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27-kube-api-access-9kwtj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8w9dd\" (UID: \"7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8w9dd"
Sep 08 14:38:53.228086 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:53.227996    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8w9dd\" (UID: \"7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8w9dd"
Sep 08 14:38:53.228286 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:53.228267    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8w9dd\" (UID: \"7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8w9dd"
Sep 08 14:38:53.228362 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:53.228342    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8w9dd\" (UID: \"7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8w9dd"
Sep 08 14:38:53.236766 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:53.236740    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kwtj\" (UniqueName: \"kubernetes.io/projected/7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27-kube-api-access-9kwtj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8w9dd\" (UID: \"7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8w9dd"
Sep 08 14:38:53.315017 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:53.314937    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8w9dd"
Sep 08 14:38:53.591099 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:53.591076    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8w9dd"]
Sep 08 14:38:53.593337 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:38:53.593307    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7101c2ae_bb3d_41a4_9cb0_41c87e2b2f27.slice/crio-1db36a7107194626e3a8bb1d6393df22ea8825e74dd2e0d9f58f9768f31a7ca5 WatchSource:0}: Error finding container 1db36a7107194626e3a8bb1d6393df22ea8825e74dd2e0d9f58f9768f31a7ca5: Status 404 returned error can't find the container with id 1db36a7107194626e3a8bb1d6393df22ea8825e74dd2e0d9f58f9768f31a7ca5
Sep 08 14:38:53.674384 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:53.674350    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8w9dd" event={"ID":"7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27","Type":"ContainerStarted","Data":"78e5f2a82a4621244dbe205c80b2b568083f92844df7b5c092aad3333dff4227"}
Sep 08 14:38:53.674555 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:53.674400    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8w9dd" event={"ID":"7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27","Type":"ContainerStarted","Data":"1db36a7107194626e3a8bb1d6393df22ea8825e74dd2e0d9f58f9768f31a7ca5"}
Sep 08 14:38:54.680002 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:54.679966    2577 generic.go:356] "Generic (PLEG): container finished" podID="7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27" containerID="78e5f2a82a4621244dbe205c80b2b568083f92844df7b5c092aad3333dff4227" exitCode=0
Sep 08 14:38:54.680391 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:54.680061    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8w9dd" event={"ID":"7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27","Type":"ContainerDied","Data":"78e5f2a82a4621244dbe205c80b2b568083f92844df7b5c092aad3333dff4227"}
Sep 08 14:38:56.689959 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:56.689913    2577 generic.go:356] "Generic (PLEG): container finished" podID="7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27" containerID="1d397e2f49a6e57d9f2e29dc15a98792c80e80e2093770de15aa75db17c27b39" exitCode=0
Sep 08 14:38:56.690408 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:56.689997    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8w9dd" event={"ID":"7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27","Type":"ContainerDied","Data":"1d397e2f49a6e57d9f2e29dc15a98792c80e80e2093770de15aa75db17c27b39"}
Sep 08 14:38:57.696153 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:57.696117    2577 generic.go:356] "Generic (PLEG): container finished" podID="7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27" containerID="4783c77fc4408cb6dbef7fe3259944d7bfd5b19373bdb7df40fdb6b686c19dd3" exitCode=0
Sep 08 14:38:57.696519 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:57.696204    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8w9dd" event={"ID":"7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27","Type":"ContainerDied","Data":"4783c77fc4408cb6dbef7fe3259944d7bfd5b19373bdb7df40fdb6b686c19dd3"}
Sep 08 14:38:58.820594 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:58.820567    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8w9dd"
Sep 08 14:38:58.977400 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:58.977320    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27-util\") pod \"7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27\" (UID: \"7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27\") "
Sep 08 14:38:58.977400 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:58.977380    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kwtj\" (UniqueName: \"kubernetes.io/projected/7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27-kube-api-access-9kwtj\") pod \"7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27\" (UID: \"7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27\") "
Sep 08 14:38:58.977400 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:58.977403    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27-bundle\") pod \"7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27\" (UID: \"7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27\") "
Sep 08 14:38:58.978155 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:58.978126    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27-bundle" (OuterVolumeSpecName: "bundle") pod "7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27" (UID: "7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:38:58.979577 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:58.979547    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27-kube-api-access-9kwtj" (OuterVolumeSpecName: "kube-api-access-9kwtj") pod "7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27" (UID: "7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27"). InnerVolumeSpecName "kube-api-access-9kwtj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:38:59.042330 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:59.042293    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27-util" (OuterVolumeSpecName: "util") pod "7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27" (UID: "7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:38:59.078119 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:59.078091    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27-util\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:38:59.078119 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:59.078118    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kwtj\" (UniqueName: \"kubernetes.io/projected/7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27-kube-api-access-9kwtj\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:38:59.078254 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:59.078129    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27-bundle\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:38:59.404367 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:59.404304    2577 kubelet.go:1648] "Image garbage collection succeeded"
Sep 08 14:38:59.706415 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:59.706379    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8w9dd" event={"ID":"7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27","Type":"ContainerDied","Data":"1db36a7107194626e3a8bb1d6393df22ea8825e74dd2e0d9f58f9768f31a7ca5"}
Sep 08 14:38:59.706415 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:59.706408    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8w9dd"
Sep 08 14:38:59.706715 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:38:59.706431    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1db36a7107194626e3a8bb1d6393df22ea8825e74dd2e0d9f58f9768f31a7ca5"
Sep 08 14:39:07.608915 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:07.608879    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dgbz8"]
Sep 08 14:39:07.609353 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:07.609133    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27" containerName="pull"
Sep 08 14:39:07.609353 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:07.609143    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27" containerName="pull"
Sep 08 14:39:07.609353 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:07.609155    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27" containerName="util"
Sep 08 14:39:07.609353 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:07.609160    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27" containerName="util"
Sep 08 14:39:07.609353 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:07.609173    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27" containerName="extract"
Sep 08 14:39:07.609353 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:07.609178    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27" containerName="extract"
Sep 08 14:39:07.609353 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:07.609223    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7101c2ae-bb3d-41a4-9cb0-41c87e2b2f27" containerName="extract"
Sep 08 14:39:07.613150 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:07.613134    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dgbz8"
Sep 08 14:39:07.615717 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:07.615695    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 14:39:07.616632 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:07.616616    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 14:39:07.616701 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:07.616616    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8jjpz\""
Sep 08 14:39:07.619848 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:07.619825    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dgbz8"]
Sep 08 14:39:07.745484 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:07.743554    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9zdm\" (UniqueName: \"kubernetes.io/projected/f1007ea2-63a4-45d9-bf52-206382693dc7-kube-api-access-s9zdm\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dgbz8\" (UID: \"f1007ea2-63a4-45d9-bf52-206382693dc7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dgbz8"
Sep 08 14:39:07.745484 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:07.743625    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1007ea2-63a4-45d9-bf52-206382693dc7-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dgbz8\" (UID: \"f1007ea2-63a4-45d9-bf52-206382693dc7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dgbz8"
Sep 08 14:39:07.745484 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:07.743658    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1007ea2-63a4-45d9-bf52-206382693dc7-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dgbz8\" (UID: \"f1007ea2-63a4-45d9-bf52-206382693dc7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dgbz8"
Sep 08 14:39:07.844543 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:07.844511    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9zdm\" (UniqueName: \"kubernetes.io/projected/f1007ea2-63a4-45d9-bf52-206382693dc7-kube-api-access-s9zdm\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dgbz8\" (UID: \"f1007ea2-63a4-45d9-bf52-206382693dc7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dgbz8"
Sep 08 14:39:07.844701 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:07.844575    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1007ea2-63a4-45d9-bf52-206382693dc7-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dgbz8\" (UID: \"f1007ea2-63a4-45d9-bf52-206382693dc7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dgbz8"
Sep 08 14:39:07.844701 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:07.844603    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1007ea2-63a4-45d9-bf52-206382693dc7-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dgbz8\" (UID: \"f1007ea2-63a4-45d9-bf52-206382693dc7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dgbz8"
Sep 08 14:39:07.844974 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:07.844952    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1007ea2-63a4-45d9-bf52-206382693dc7-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dgbz8\" (UID: \"f1007ea2-63a4-45d9-bf52-206382693dc7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dgbz8"
Sep 08 14:39:07.845016 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:07.844977    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1007ea2-63a4-45d9-bf52-206382693dc7-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dgbz8\" (UID: \"f1007ea2-63a4-45d9-bf52-206382693dc7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dgbz8"
Sep 08 14:39:07.857560 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:07.857526    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9zdm\" (UniqueName: \"kubernetes.io/projected/f1007ea2-63a4-45d9-bf52-206382693dc7-kube-api-access-s9zdm\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dgbz8\" (UID: \"f1007ea2-63a4-45d9-bf52-206382693dc7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dgbz8"
Sep 08 14:39:07.923268 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:07.923237    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dgbz8"
Sep 08 14:39:08.197457 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:08.197435    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dgbz8"]
Sep 08 14:39:08.199682 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:39:08.199658    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1007ea2_63a4_45d9_bf52_206382693dc7.slice/crio-2b5111f3a7373aa9ddb1c298937ccb833e72c8c372b739d2b9e7911121b77eb1 WatchSource:0}: Error finding container 2b5111f3a7373aa9ddb1c298937ccb833e72c8c372b739d2b9e7911121b77eb1: Status 404 returned error can't find the container with id 2b5111f3a7373aa9ddb1c298937ccb833e72c8c372b739d2b9e7911121b77eb1
Sep 08 14:39:08.748643 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:08.748601    2577 generic.go:356] "Generic (PLEG): container finished" podID="f1007ea2-63a4-45d9-bf52-206382693dc7" containerID="bebf0f91ddac258f6685d18b2efcd8159e10782e472ac8079a1a069a48392459" exitCode=0
Sep 08 14:39:08.749009 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:08.748690    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dgbz8" event={"ID":"f1007ea2-63a4-45d9-bf52-206382693dc7","Type":"ContainerDied","Data":"bebf0f91ddac258f6685d18b2efcd8159e10782e472ac8079a1a069a48392459"}
Sep 08 14:39:08.749009 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:08.748743    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dgbz8" event={"ID":"f1007ea2-63a4-45d9-bf52-206382693dc7","Type":"ContainerStarted","Data":"2b5111f3a7373aa9ddb1c298937ccb833e72c8c372b739d2b9e7911121b77eb1"}
Sep 08 14:39:08.749098 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:08.749083    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 14:39:09.353662 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:09.353626    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-766f77f8db-99m64"]
Sep 08 14:39:09.357522 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:09.357499    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-99m64"
Sep 08 14:39:09.361406 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:09.361378    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 08 14:39:09.361406 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:09.361399    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 08 14:39:09.361597 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:09.361400    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 08 14:39:09.361597 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:09.361378    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 08 14:39:09.361597 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:09.361495    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-q8mbk\""
Sep 08 14:39:09.375791 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:09.375766    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-766f77f8db-99m64"]
Sep 08 14:39:09.457265 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:09.457234    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fddac6a4-6507-4d7b-aa5d-3f9058f199ca-webhook-cert\") pod \"opendatahub-operator-controller-manager-766f77f8db-99m64\" (UID: \"fddac6a4-6507-4d7b-aa5d-3f9058f199ca\") " pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-99m64"
Sep 08 14:39:09.457421 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:09.457291    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fddac6a4-6507-4d7b-aa5d-3f9058f199ca-apiservice-cert\") pod \"opendatahub-operator-controller-manager-766f77f8db-99m64\" (UID: \"fddac6a4-6507-4d7b-aa5d-3f9058f199ca\") " pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-99m64"
Sep 08 14:39:09.457421 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:09.457353    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fddac6a4-6507-4d7b-aa5d-3f9058f199ca-tmp\") pod \"opendatahub-operator-controller-manager-766f77f8db-99m64\" (UID: \"fddac6a4-6507-4d7b-aa5d-3f9058f199ca\") " pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-99m64"
Sep 08 14:39:09.457421 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:09.457394    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fddac6a4-6507-4d7b-aa5d-3f9058f199ca-manifests\") pod \"opendatahub-operator-controller-manager-766f77f8db-99m64\" (UID: \"fddac6a4-6507-4d7b-aa5d-3f9058f199ca\") " pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-99m64"
Sep 08 14:39:09.457554 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:09.457443    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6wb9\" (UniqueName: \"kubernetes.io/projected/fddac6a4-6507-4d7b-aa5d-3f9058f199ca-kube-api-access-d6wb9\") pod \"opendatahub-operator-controller-manager-766f77f8db-99m64\" (UID: \"fddac6a4-6507-4d7b-aa5d-3f9058f199ca\") " pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-99m64"
Sep 08 14:39:09.558121 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:09.558090    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fddac6a4-6507-4d7b-aa5d-3f9058f199ca-apiservice-cert\") pod \"opendatahub-operator-controller-manager-766f77f8db-99m64\" (UID: \"fddac6a4-6507-4d7b-aa5d-3f9058f199ca\") " pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-99m64"
Sep 08 14:39:09.558300 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:09.558134    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fddac6a4-6507-4d7b-aa5d-3f9058f199ca-tmp\") pod \"opendatahub-operator-controller-manager-766f77f8db-99m64\" (UID: \"fddac6a4-6507-4d7b-aa5d-3f9058f199ca\") " pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-99m64"
Sep 08 14:39:09.558300 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:09.558168    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fddac6a4-6507-4d7b-aa5d-3f9058f199ca-manifests\") pod \"opendatahub-operator-controller-manager-766f77f8db-99m64\" (UID: \"fddac6a4-6507-4d7b-aa5d-3f9058f199ca\") " pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-99m64"
Sep 08 14:39:09.558300 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:09.558225    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6wb9\" (UniqueName: \"kubernetes.io/projected/fddac6a4-6507-4d7b-aa5d-3f9058f199ca-kube-api-access-d6wb9\") pod \"opendatahub-operator-controller-manager-766f77f8db-99m64\" (UID: \"fddac6a4-6507-4d7b-aa5d-3f9058f199ca\") " pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-99m64"
Sep 08 14:39:09.558300 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:09.558263    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fddac6a4-6507-4d7b-aa5d-3f9058f199ca-webhook-cert\") pod \"opendatahub-operator-controller-manager-766f77f8db-99m64\" (UID: \"fddac6a4-6507-4d7b-aa5d-3f9058f199ca\") " pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-99m64"
Sep 08 14:39:09.558753 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:09.558725    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fddac6a4-6507-4d7b-aa5d-3f9058f199ca-manifests\") pod \"opendatahub-operator-controller-manager-766f77f8db-99m64\" (UID: \"fddac6a4-6507-4d7b-aa5d-3f9058f199ca\") " pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-99m64"
Sep 08 14:39:09.561040 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:09.561015    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fddac6a4-6507-4d7b-aa5d-3f9058f199ca-apiservice-cert\") pod \"opendatahub-operator-controller-manager-766f77f8db-99m64\" (UID: \"fddac6a4-6507-4d7b-aa5d-3f9058f199ca\") " pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-99m64"
Sep 08 14:39:09.561040 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:09.561034    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fddac6a4-6507-4d7b-aa5d-3f9058f199ca-tmp\") pod \"opendatahub-operator-controller-manager-766f77f8db-99m64\" (UID: \"fddac6a4-6507-4d7b-aa5d-3f9058f199ca\") " pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-99m64"
Sep 08 14:39:09.561191 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:09.561070    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fddac6a4-6507-4d7b-aa5d-3f9058f199ca-webhook-cert\") pod \"opendatahub-operator-controller-manager-766f77f8db-99m64\" (UID: \"fddac6a4-6507-4d7b-aa5d-3f9058f199ca\") " pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-99m64"
Sep 08 14:39:09.572937 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:09.572914    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6wb9\" (UniqueName: \"kubernetes.io/projected/fddac6a4-6507-4d7b-aa5d-3f9058f199ca-kube-api-access-d6wb9\") pod \"opendatahub-operator-controller-manager-766f77f8db-99m64\" (UID: \"fddac6a4-6507-4d7b-aa5d-3f9058f199ca\") " pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-99m64"
Sep 08 14:39:09.667484 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:09.667447    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-99m64"
Sep 08 14:39:09.755341 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:09.755312    2577 generic.go:356] "Generic (PLEG): container finished" podID="f1007ea2-63a4-45d9-bf52-206382693dc7" containerID="fce855bc8105d25f1b5ae720bc96e2f532de61272b3c31e6559abfc511e560e0" exitCode=0
Sep 08 14:39:09.755695 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:09.755393    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dgbz8" event={"ID":"f1007ea2-63a4-45d9-bf52-206382693dc7","Type":"ContainerDied","Data":"fce855bc8105d25f1b5ae720bc96e2f532de61272b3c31e6559abfc511e560e0"}
Sep 08 14:39:09.950992 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:09.950957    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-766f77f8db-99m64"]
Sep 08 14:39:09.965288 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:39:09.965263    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfddac6a4_6507_4d7b_aa5d_3f9058f199ca.slice/crio-f541393bf9c66f10428b001795dfbc1449142b24d4842c9c71f28f2da887837e WatchSource:0}: Error finding container f541393bf9c66f10428b001795dfbc1449142b24d4842c9c71f28f2da887837e: Status 404 returned error can't find the container with id f541393bf9c66f10428b001795dfbc1449142b24d4842c9c71f28f2da887837e
Sep 08 14:39:10.767638 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:10.767601    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-99m64" event={"ID":"fddac6a4-6507-4d7b-aa5d-3f9058f199ca","Type":"ContainerStarted","Data":"f541393bf9c66f10428b001795dfbc1449142b24d4842c9c71f28f2da887837e"}
Sep 08 14:39:10.770763 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:10.770733    2577 generic.go:356] "Generic (PLEG): container finished" podID="f1007ea2-63a4-45d9-bf52-206382693dc7" containerID="8caf8e932c733426b35c811983daa828e5875459b6c0a0a18c9a5d675d458d97" exitCode=0
Sep 08 14:39:10.770959 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:10.770769    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dgbz8" event={"ID":"f1007ea2-63a4-45d9-bf52-206382693dc7","Type":"ContainerDied","Data":"8caf8e932c733426b35c811983daa828e5875459b6c0a0a18c9a5d675d458d97"}
Sep 08 14:39:13.009618 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:13.009594    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dgbz8"
Sep 08 14:39:13.189753 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:13.189727    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1007ea2-63a4-45d9-bf52-206382693dc7-util\") pod \"f1007ea2-63a4-45d9-bf52-206382693dc7\" (UID: \"f1007ea2-63a4-45d9-bf52-206382693dc7\") "
Sep 08 14:39:13.189892 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:13.189763    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9zdm\" (UniqueName: \"kubernetes.io/projected/f1007ea2-63a4-45d9-bf52-206382693dc7-kube-api-access-s9zdm\") pod \"f1007ea2-63a4-45d9-bf52-206382693dc7\" (UID: \"f1007ea2-63a4-45d9-bf52-206382693dc7\") "
Sep 08 14:39:13.189892 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:13.189875    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1007ea2-63a4-45d9-bf52-206382693dc7-bundle\") pod \"f1007ea2-63a4-45d9-bf52-206382693dc7\" (UID: \"f1007ea2-63a4-45d9-bf52-206382693dc7\") "
Sep 08 14:39:13.190531 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:13.190498    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1007ea2-63a4-45d9-bf52-206382693dc7-bundle" (OuterVolumeSpecName: "bundle") pod "f1007ea2-63a4-45d9-bf52-206382693dc7" (UID: "f1007ea2-63a4-45d9-bf52-206382693dc7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:39:13.191955 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:13.191928    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1007ea2-63a4-45d9-bf52-206382693dc7-kube-api-access-s9zdm" (OuterVolumeSpecName: "kube-api-access-s9zdm") pod "f1007ea2-63a4-45d9-bf52-206382693dc7" (UID: "f1007ea2-63a4-45d9-bf52-206382693dc7"). InnerVolumeSpecName "kube-api-access-s9zdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:39:13.194516 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:13.194497    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1007ea2-63a4-45d9-bf52-206382693dc7-util" (OuterVolumeSpecName: "util") pod "f1007ea2-63a4-45d9-bf52-206382693dc7" (UID: "f1007ea2-63a4-45d9-bf52-206382693dc7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:39:13.290996 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:13.290923    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1007ea2-63a4-45d9-bf52-206382693dc7-bundle\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:39:13.290996 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:13.290950    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1007ea2-63a4-45d9-bf52-206382693dc7-util\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:39:13.290996 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:13.290959    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9zdm\" (UniqueName: \"kubernetes.io/projected/f1007ea2-63a4-45d9-bf52-206382693dc7-kube-api-access-s9zdm\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:39:13.787754 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:13.787718    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-99m64" event={"ID":"fddac6a4-6507-4d7b-aa5d-3f9058f199ca","Type":"ContainerStarted","Data":"1568cfbdf2444dc61fdf24f1750ca99896e09d38c118392cfc4a4845f56bb6a3"}
Sep 08 14:39:13.789703 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:13.789681    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dgbz8"
Sep 08 14:39:13.789823 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:13.789700    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0dgbz8" event={"ID":"f1007ea2-63a4-45d9-bf52-206382693dc7","Type":"ContainerDied","Data":"2b5111f3a7373aa9ddb1c298937ccb833e72c8c372b739d2b9e7911121b77eb1"}
Sep 08 14:39:13.789823 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:13.789734    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b5111f3a7373aa9ddb1c298937ccb833e72c8c372b739d2b9e7911121b77eb1"
Sep 08 14:39:14.795131 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:14.795092    2577 generic.go:356] "Generic (PLEG): container finished" podID="fddac6a4-6507-4d7b-aa5d-3f9058f199ca" containerID="1568cfbdf2444dc61fdf24f1750ca99896e09d38c118392cfc4a4845f56bb6a3" exitCode=0
Sep 08 14:39:14.795634 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:14.795150    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-99m64" event={"ID":"fddac6a4-6507-4d7b-aa5d-3f9058f199ca","Type":"ContainerDied","Data":"1568cfbdf2444dc61fdf24f1750ca99896e09d38c118392cfc4a4845f56bb6a3"}
Sep 08 14:39:15.801122 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:15.801089    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-99m64" event={"ID":"fddac6a4-6507-4d7b-aa5d-3f9058f199ca","Type":"ContainerStarted","Data":"9b9ae7922b4839e70774d5ccf616963605416b28ae449431f926e43a42f91ef3"}
Sep 08 14:39:15.801557 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:15.801233    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-99m64"
Sep 08 14:39:15.826241 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:15.826197    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-99m64" podStartSLOduration=2.341449471 podStartE2EDuration="6.826182939s" totalImagesPullingTime="3.484087352s" totalInitContainerRuntime="1.000646116s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:39:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:39:15.824927761 +0000 UTC m=+316.863328684" watchObservedRunningTime="2026-09-08 14:39:15.826182939 +0000 UTC m=+316.864583862"
Sep 08 14:39:26.807675 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:26.807644    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-766f77f8db-99m64"
Sep 08 14:39:29.186172 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:29.186137    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6dd8bb6964-vtpjp"]
Sep 08 14:39:29.186545 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:29.186429    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1007ea2-63a4-45d9-bf52-206382693dc7" containerName="util"
Sep 08 14:39:29.186545 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:29.186443    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1007ea2-63a4-45d9-bf52-206382693dc7" containerName="util"
Sep 08 14:39:29.186545 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:29.186480    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1007ea2-63a4-45d9-bf52-206382693dc7" containerName="pull"
Sep 08 14:39:29.186545 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:29.186486    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1007ea2-63a4-45d9-bf52-206382693dc7" containerName="pull"
Sep 08 14:39:29.186545 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:29.186493    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1007ea2-63a4-45d9-bf52-206382693dc7" containerName="extract"
Sep 08 14:39:29.186545 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:29.186499    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1007ea2-63a4-45d9-bf52-206382693dc7" containerName="extract"
Sep 08 14:39:29.186759 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:29.186554    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1007ea2-63a4-45d9-bf52-206382693dc7" containerName="extract"
Sep 08 14:39:29.189844 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:29.189828    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6dd8bb6964-vtpjp"
Sep 08 14:39:29.193213 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:29.193188    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 08 14:39:29.193348 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:29.193229    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 08 14:39:29.193348 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:29.193231    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 08 14:39:29.194191 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:29.194173    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 08 14:39:29.202138 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:29.202085    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b72wr\" (UniqueName: \"kubernetes.io/projected/6e7e0405-a415-4f24-a373-7b8e84a9ece6-kube-api-access-b72wr\") pod \"kube-auth-proxy-6dd8bb6964-vtpjp\" (UID: \"6e7e0405-a415-4f24-a373-7b8e84a9ece6\") " pod="openshift-ingress/kube-auth-proxy-6dd8bb6964-vtpjp"
Sep 08 14:39:29.202138 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:29.202131    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e7e0405-a415-4f24-a373-7b8e84a9ece6-tmp\") pod \"kube-auth-proxy-6dd8bb6964-vtpjp\" (UID: \"6e7e0405-a415-4f24-a373-7b8e84a9ece6\") " pod="openshift-ingress/kube-auth-proxy-6dd8bb6964-vtpjp"
Sep 08 14:39:29.202295 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:29.202180    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e7e0405-a415-4f24-a373-7b8e84a9ece6-tls-certs\") pod \"kube-auth-proxy-6dd8bb6964-vtpjp\" (UID: \"6e7e0405-a415-4f24-a373-7b8e84a9ece6\") " pod="openshift-ingress/kube-auth-proxy-6dd8bb6964-vtpjp"
Sep 08 14:39:29.208074 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:29.208053    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6dd8bb6964-vtpjp"]
Sep 08 14:39:29.302636 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:29.302603    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e7e0405-a415-4f24-a373-7b8e84a9ece6-tmp\") pod \"kube-auth-proxy-6dd8bb6964-vtpjp\" (UID: \"6e7e0405-a415-4f24-a373-7b8e84a9ece6\") " pod="openshift-ingress/kube-auth-proxy-6dd8bb6964-vtpjp"
Sep 08 14:39:29.302803 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:29.302648    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e7e0405-a415-4f24-a373-7b8e84a9ece6-tls-certs\") pod \"kube-auth-proxy-6dd8bb6964-vtpjp\" (UID: \"6e7e0405-a415-4f24-a373-7b8e84a9ece6\") " pod="openshift-ingress/kube-auth-proxy-6dd8bb6964-vtpjp"
Sep 08 14:39:29.302803 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:29.302673    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b72wr\" (UniqueName: \"kubernetes.io/projected/6e7e0405-a415-4f24-a373-7b8e84a9ece6-kube-api-access-b72wr\") pod \"kube-auth-proxy-6dd8bb6964-vtpjp\" (UID: \"6e7e0405-a415-4f24-a373-7b8e84a9ece6\") " pod="openshift-ingress/kube-auth-proxy-6dd8bb6964-vtpjp"
Sep 08 14:39:29.305179 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:29.305153    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e7e0405-a415-4f24-a373-7b8e84a9ece6-tmp\") pod \"kube-auth-proxy-6dd8bb6964-vtpjp\" (UID: \"6e7e0405-a415-4f24-a373-7b8e84a9ece6\") " pod="openshift-ingress/kube-auth-proxy-6dd8bb6964-vtpjp"
Sep 08 14:39:29.305363 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:29.305347    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e7e0405-a415-4f24-a373-7b8e84a9ece6-tls-certs\") pod \"kube-auth-proxy-6dd8bb6964-vtpjp\" (UID: \"6e7e0405-a415-4f24-a373-7b8e84a9ece6\") " pod="openshift-ingress/kube-auth-proxy-6dd8bb6964-vtpjp"
Sep 08 14:39:29.314232 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:29.314207    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b72wr\" (UniqueName: \"kubernetes.io/projected/6e7e0405-a415-4f24-a373-7b8e84a9ece6-kube-api-access-b72wr\") pod \"kube-auth-proxy-6dd8bb6964-vtpjp\" (UID: \"6e7e0405-a415-4f24-a373-7b8e84a9ece6\") " pod="openshift-ingress/kube-auth-proxy-6dd8bb6964-vtpjp"
Sep 08 14:39:29.498985 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:29.498911    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6dd8bb6964-vtpjp"
Sep 08 14:39:29.777887 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:29.777862    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6dd8bb6964-vtpjp"]
Sep 08 14:39:29.780212 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:39:29.780182    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e7e0405_a415_4f24_a373_7b8e84a9ece6.slice/crio-a13cdec51f88c2fcbd7cce04d550650ace1577fe9ccb83e5a284853c611ba916 WatchSource:0}: Error finding container a13cdec51f88c2fcbd7cce04d550650ace1577fe9ccb83e5a284853c611ba916: Status 404 returned error can't find the container with id a13cdec51f88c2fcbd7cce04d550650ace1577fe9ccb83e5a284853c611ba916
Sep 08 14:39:29.865617 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:29.865581    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6dd8bb6964-vtpjp" event={"ID":"6e7e0405-a415-4f24-a373-7b8e84a9ece6","Type":"ContainerStarted","Data":"a13cdec51f88c2fcbd7cce04d550650ace1577fe9ccb83e5a284853c611ba916"}
Sep 08 14:39:30.730357 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:30.730318    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"]
Sep 08 14:39:30.733839 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:30.733818    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"
Sep 08 14:39:30.736455 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:30.736434    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 08 14:39:30.736587 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:30.736487    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 08 14:39:30.736796 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:30.736778    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 08 14:39:30.736887 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:30.736834    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-9dqd8\""
Sep 08 14:39:30.737287 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:30.737271    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 14:39:30.750790 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:30.750764    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"]
Sep 08 14:39:30.813300 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:30.813262    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d933de9-3897-4a03-89e1-7e53e561a987-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-cf4k2\" (UID: \"5d933de9-3897-4a03-89e1-7e53e561a987\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"
Sep 08 14:39:30.813300 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:30.813307    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5d933de9-3897-4a03-89e1-7e53e561a987-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-cf4k2\" (UID: \"5d933de9-3897-4a03-89e1-7e53e561a987\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"
Sep 08 14:39:30.813704 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:30.813391    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5d933de9-3897-4a03-89e1-7e53e561a987-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-cf4k2\" (UID: \"5d933de9-3897-4a03-89e1-7e53e561a987\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"
Sep 08 14:39:30.813704 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:30.813456    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5d933de9-3897-4a03-89e1-7e53e561a987-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-cf4k2\" (UID: \"5d933de9-3897-4a03-89e1-7e53e561a987\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"
Sep 08 14:39:30.813704 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:30.813537    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d933de9-3897-4a03-89e1-7e53e561a987-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-cf4k2\" (UID: \"5d933de9-3897-4a03-89e1-7e53e561a987\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"
Sep 08 14:39:30.813704 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:30.813562    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5nbm\" (UniqueName: \"kubernetes.io/projected/5d933de9-3897-4a03-89e1-7e53e561a987-kube-api-access-j5nbm\") pod \"istiod-openshift-gateway-7b7995d5cd-cf4k2\" (UID: \"5d933de9-3897-4a03-89e1-7e53e561a987\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"
Sep 08 14:39:30.813704 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:30.813597    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d933de9-3897-4a03-89e1-7e53e561a987-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-cf4k2\" (UID: \"5d933de9-3897-4a03-89e1-7e53e561a987\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"
Sep 08 14:39:30.914537 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:30.914506    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d933de9-3897-4a03-89e1-7e53e561a987-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-cf4k2\" (UID: \"5d933de9-3897-4a03-89e1-7e53e561a987\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"
Sep 08 14:39:30.914757 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:30.914546    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d933de9-3897-4a03-89e1-7e53e561a987-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-cf4k2\" (UID: \"5d933de9-3897-4a03-89e1-7e53e561a987\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"
Sep 08 14:39:30.914757 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:30.914565    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5d933de9-3897-4a03-89e1-7e53e561a987-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-cf4k2\" (UID: \"5d933de9-3897-4a03-89e1-7e53e561a987\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"
Sep 08 14:39:30.914757 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:30.914599    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5d933de9-3897-4a03-89e1-7e53e561a987-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-cf4k2\" (UID: \"5d933de9-3897-4a03-89e1-7e53e561a987\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"
Sep 08 14:39:30.914757 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:30.914629    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5d933de9-3897-4a03-89e1-7e53e561a987-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-cf4k2\" (UID: \"5d933de9-3897-4a03-89e1-7e53e561a987\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"
Sep 08 14:39:30.914757 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:30.914684    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d933de9-3897-4a03-89e1-7e53e561a987-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-cf4k2\" (UID: \"5d933de9-3897-4a03-89e1-7e53e561a987\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"
Sep 08 14:39:30.914757 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:30.914710    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5nbm\" (UniqueName: \"kubernetes.io/projected/5d933de9-3897-4a03-89e1-7e53e561a987-kube-api-access-j5nbm\") pod \"istiod-openshift-gateway-7b7995d5cd-cf4k2\" (UID: \"5d933de9-3897-4a03-89e1-7e53e561a987\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"
Sep 08 14:39:30.915587 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:30.915557    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5d933de9-3897-4a03-89e1-7e53e561a987-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-cf4k2\" (UID: \"5d933de9-3897-4a03-89e1-7e53e561a987\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"
Sep 08 14:39:30.917569 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:30.917546    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5d933de9-3897-4a03-89e1-7e53e561a987-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-cf4k2\" (UID: \"5d933de9-3897-4a03-89e1-7e53e561a987\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"
Sep 08 14:39:30.917648 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:30.917608    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5d933de9-3897-4a03-89e1-7e53e561a987-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-cf4k2\" (UID: \"5d933de9-3897-4a03-89e1-7e53e561a987\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"
Sep 08 14:39:30.917826 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:30.917809    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d933de9-3897-4a03-89e1-7e53e561a987-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-cf4k2\" (UID: \"5d933de9-3897-4a03-89e1-7e53e561a987\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"
Sep 08 14:39:30.918024 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:30.917983    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d933de9-3897-4a03-89e1-7e53e561a987-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-cf4k2\" (UID: \"5d933de9-3897-4a03-89e1-7e53e561a987\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"
Sep 08 14:39:30.925113 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:30.925071    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d933de9-3897-4a03-89e1-7e53e561a987-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-cf4k2\" (UID: \"5d933de9-3897-4a03-89e1-7e53e561a987\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"
Sep 08 14:39:30.925618 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:30.925570    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5nbm\" (UniqueName: \"kubernetes.io/projected/5d933de9-3897-4a03-89e1-7e53e561a987-kube-api-access-j5nbm\") pod \"istiod-openshift-gateway-7b7995d5cd-cf4k2\" (UID: \"5d933de9-3897-4a03-89e1-7e53e561a987\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"
Sep 08 14:39:31.044594 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:31.044506    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"
Sep 08 14:39:31.341116 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:31.341047    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"]
Sep 08 14:39:32.521732 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:39:32.521701    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d933de9_3897_4a03_89e1_7e53e561a987.slice/crio-9ea1cfc653fe78eb2eaa2c5fe96f64115e68068e3fbf295f291f57eee0bd9a4a WatchSource:0}: Error finding container 9ea1cfc653fe78eb2eaa2c5fe96f64115e68068e3fbf295f291f57eee0bd9a4a: Status 404 returned error can't find the container with id 9ea1cfc653fe78eb2eaa2c5fe96f64115e68068e3fbf295f291f57eee0bd9a4a
Sep 08 14:39:32.881685 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:32.881588    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6dd8bb6964-vtpjp" event={"ID":"6e7e0405-a415-4f24-a373-7b8e84a9ece6","Type":"ContainerStarted","Data":"e85abe6c1337a433ec2e1b10b4e9b1fe1d2e389b425d78c481d2cde17b02dfdb"}
Sep 08 14:39:32.882829 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:32.882800    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2" event={"ID":"5d933de9-3897-4a03-89e1-7e53e561a987","Type":"ContainerStarted","Data":"9ea1cfc653fe78eb2eaa2c5fe96f64115e68068e3fbf295f291f57eee0bd9a4a"}
Sep 08 14:39:32.904828 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:32.904782    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6dd8bb6964-vtpjp" podStartSLOduration=1.110793046 podStartE2EDuration="3.904768056s" totalImagesPullingTime="2.79397501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:39:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:39:32.902689555 +0000 UTC m=+333.941090488" watchObservedRunningTime="2026-09-08 14:39:32.904768056 +0000 UTC m=+333.943168979"
Sep 08 14:39:35.585318 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:35.585278    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:39:35.585698 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:35.585408    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:39:35.900322 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:35.900212    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2" event={"ID":"5d933de9-3897-4a03-89e1-7e53e561a987","Type":"ContainerStarted","Data":"30a3b15d30dc9d7f4fd0cb74cdfa3b08c8e5c8d25631415e7fcd4813c63e0ea8"}
Sep 08 14:39:35.900503 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:35.900342    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"
Sep 08 14:39:35.923421 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:35.923373    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2" podStartSLOduration=2.861943154 podStartE2EDuration="5.923358993s" totalImagesPullingTime="3.061415839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:39:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:39:35.921964235 +0000 UTC m=+336.960365160" watchObservedRunningTime="2026-09-08 14:39:35.923358993 +0000 UTC m=+336.961759915"
Sep 08 14:39:36.908841 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:36.908785    2577 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-cf4k2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 14:39:36.909406 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:36.908878    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2" podUID="5d933de9-3897-4a03-89e1-7e53e561a987" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 14:39:39.908284 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:39.908253    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"
Sep 08 14:39:50.861581 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:50.861348    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-c4bll"]
Sep 08 14:39:50.866226 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:50.866201    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c4bll"
Sep 08 14:39:50.868763 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:50.868744    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 08 14:39:50.868902 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:50.868884    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-vsqpl\""
Sep 08 14:39:50.874402 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:50.874380    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-knv7q"]
Sep 08 14:39:50.877557 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:50.877539    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-knv7q"
Sep 08 14:39:50.880153 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:50.880136    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-mkfmd\""
Sep 08 14:39:50.880702 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:50.880683    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 08 14:39:50.881017 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:50.880998    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-c4bll"]
Sep 08 14:39:50.894547 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:50.894526    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-knv7q"]
Sep 08 14:39:50.975338 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:50.975300    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-768hg\" (UniqueName: \"kubernetes.io/projected/1232051a-c7cd-47ee-8a03-e3bd498b80b5-kube-api-access-768hg\") pod \"kserve-controller-manager-d6f4b65b8-c4bll\" (UID: \"1232051a-c7cd-47ee-8a03-e3bd498b80b5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c4bll"
Sep 08 14:39:50.975338 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:50.975337    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34d6fcec-2abe-4655-a088-48b5910ddca8-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-knv7q\" (UID: \"34d6fcec-2abe-4655-a088-48b5910ddca8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-knv7q"
Sep 08 14:39:50.975605 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:50.975361    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1232051a-c7cd-47ee-8a03-e3bd498b80b5-cert\") pod \"kserve-controller-manager-d6f4b65b8-c4bll\" (UID: \"1232051a-c7cd-47ee-8a03-e3bd498b80b5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c4bll"
Sep 08 14:39:50.975605 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:50.975461    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8r6x\" (UniqueName: \"kubernetes.io/projected/34d6fcec-2abe-4655-a088-48b5910ddca8-kube-api-access-k8r6x\") pod \"llmisvc-controller-manager-777c6bd7d5-knv7q\" (UID: \"34d6fcec-2abe-4655-a088-48b5910ddca8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-knv7q"
Sep 08 14:39:51.076205 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:51.076169    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8r6x\" (UniqueName: \"kubernetes.io/projected/34d6fcec-2abe-4655-a088-48b5910ddca8-kube-api-access-k8r6x\") pod \"llmisvc-controller-manager-777c6bd7d5-knv7q\" (UID: \"34d6fcec-2abe-4655-a088-48b5910ddca8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-knv7q"
Sep 08 14:39:51.076205 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:51.076210    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-768hg\" (UniqueName: \"kubernetes.io/projected/1232051a-c7cd-47ee-8a03-e3bd498b80b5-kube-api-access-768hg\") pod \"kserve-controller-manager-d6f4b65b8-c4bll\" (UID: \"1232051a-c7cd-47ee-8a03-e3bd498b80b5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c4bll"
Sep 08 14:39:51.076417 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:51.076234    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34d6fcec-2abe-4655-a088-48b5910ddca8-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-knv7q\" (UID: \"34d6fcec-2abe-4655-a088-48b5910ddca8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-knv7q"
Sep 08 14:39:51.076417 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:51.076267    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1232051a-c7cd-47ee-8a03-e3bd498b80b5-cert\") pod \"kserve-controller-manager-d6f4b65b8-c4bll\" (UID: \"1232051a-c7cd-47ee-8a03-e3bd498b80b5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c4bll"
Sep 08 14:39:51.078922 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:51.078896    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1232051a-c7cd-47ee-8a03-e3bd498b80b5-cert\") pod \"kserve-controller-manager-d6f4b65b8-c4bll\" (UID: \"1232051a-c7cd-47ee-8a03-e3bd498b80b5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c4bll"
Sep 08 14:39:51.079060 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:51.079042    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34d6fcec-2abe-4655-a088-48b5910ddca8-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-knv7q\" (UID: \"34d6fcec-2abe-4655-a088-48b5910ddca8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-knv7q"
Sep 08 14:39:51.087439 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:51.087407    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-768hg\" (UniqueName: \"kubernetes.io/projected/1232051a-c7cd-47ee-8a03-e3bd498b80b5-kube-api-access-768hg\") pod \"kserve-controller-manager-d6f4b65b8-c4bll\" (UID: \"1232051a-c7cd-47ee-8a03-e3bd498b80b5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c4bll"
Sep 08 14:39:51.088867 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:51.088841    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8r6x\" (UniqueName: \"kubernetes.io/projected/34d6fcec-2abe-4655-a088-48b5910ddca8-kube-api-access-k8r6x\") pod \"llmisvc-controller-manager-777c6bd7d5-knv7q\" (UID: \"34d6fcec-2abe-4655-a088-48b5910ddca8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-knv7q"
Sep 08 14:39:51.176401 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:51.176363    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c4bll"
Sep 08 14:39:51.187604 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:51.187576    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-knv7q"
Sep 08 14:39:51.457679 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:51.457656    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-c4bll"]
Sep 08 14:39:51.459685 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:39:51.459657    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1232051a_c7cd_47ee_8a03_e3bd498b80b5.slice/crio-95551bd6ef08733003eac14588b19c66dc3e5d0538be227af166143d60dedbb9 WatchSource:0}: Error finding container 95551bd6ef08733003eac14588b19c66dc3e5d0538be227af166143d60dedbb9: Status 404 returned error can't find the container with id 95551bd6ef08733003eac14588b19c66dc3e5d0538be227af166143d60dedbb9
Sep 08 14:39:51.468654 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:51.468633    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-knv7q"]
Sep 08 14:39:51.470410 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:39:51.470386    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod34d6fcec_2abe_4655_a088_48b5910ddca8.slice/crio-4a08d9971ba22ff9bf47e235ad42c6e285688c8be20488d5b17a52d7d6125af6 WatchSource:0}: Error finding container 4a08d9971ba22ff9bf47e235ad42c6e285688c8be20488d5b17a52d7d6125af6: Status 404 returned error can't find the container with id 4a08d9971ba22ff9bf47e235ad42c6e285688c8be20488d5b17a52d7d6125af6
Sep 08 14:39:51.974112 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:51.974072    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c4bll" event={"ID":"1232051a-c7cd-47ee-8a03-e3bd498b80b5","Type":"ContainerStarted","Data":"95551bd6ef08733003eac14588b19c66dc3e5d0538be227af166143d60dedbb9"}
Sep 08 14:39:51.975399 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:51.975370    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-knv7q" event={"ID":"34d6fcec-2abe-4655-a088-48b5910ddca8","Type":"ContainerStarted","Data":"4a08d9971ba22ff9bf47e235ad42c6e285688c8be20488d5b17a52d7d6125af6"}
Sep 08 14:39:53.014672 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:53.014600    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"]
Sep 08 14:39:53.015136 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:53.014825    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2" podUID="5d933de9-3897-4a03-89e1-7e53e561a987" containerName="discovery" containerID="cri-o://30a3b15d30dc9d7f4fd0cb74cdfa3b08c8e5c8d25631415e7fcd4813c63e0ea8" gracePeriod=30
Sep 08 14:39:53.817679 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:53.817654    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"
Sep 08 14:39:53.898217 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:53.898188    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d933de9-3897-4a03-89e1-7e53e561a987-istio-token\") pod \"5d933de9-3897-4a03-89e1-7e53e561a987\" (UID: \"5d933de9-3897-4a03-89e1-7e53e561a987\") "
Sep 08 14:39:53.898402 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:53.898290    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5d933de9-3897-4a03-89e1-7e53e561a987-istio-csr-dns-cert\") pod \"5d933de9-3897-4a03-89e1-7e53e561a987\" (UID: \"5d933de9-3897-4a03-89e1-7e53e561a987\") "
Sep 08 14:39:53.898402 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:53.898321    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d933de9-3897-4a03-89e1-7e53e561a987-local-certs\") pod \"5d933de9-3897-4a03-89e1-7e53e561a987\" (UID: \"5d933de9-3897-4a03-89e1-7e53e561a987\") "
Sep 08 14:39:53.898402 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:53.898353    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d933de9-3897-4a03-89e1-7e53e561a987-istio-kubeconfig\") pod \"5d933de9-3897-4a03-89e1-7e53e561a987\" (UID: \"5d933de9-3897-4a03-89e1-7e53e561a987\") "
Sep 08 14:39:53.898402 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:53.898390    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5nbm\" (UniqueName: \"kubernetes.io/projected/5d933de9-3897-4a03-89e1-7e53e561a987-kube-api-access-j5nbm\") pod \"5d933de9-3897-4a03-89e1-7e53e561a987\" (UID: \"5d933de9-3897-4a03-89e1-7e53e561a987\") "
Sep 08 14:39:53.898659 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:53.898426    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5d933de9-3897-4a03-89e1-7e53e561a987-cacerts\") pod \"5d933de9-3897-4a03-89e1-7e53e561a987\" (UID: \"5d933de9-3897-4a03-89e1-7e53e561a987\") "
Sep 08 14:39:53.898659 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:53.898463    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5d933de9-3897-4a03-89e1-7e53e561a987-istio-csr-ca-configmap\") pod \"5d933de9-3897-4a03-89e1-7e53e561a987\" (UID: \"5d933de9-3897-4a03-89e1-7e53e561a987\") "
Sep 08 14:39:53.899025 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:53.898978    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d933de9-3897-4a03-89e1-7e53e561a987-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "5d933de9-3897-4a03-89e1-7e53e561a987" (UID: "5d933de9-3897-4a03-89e1-7e53e561a987"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:39:53.901729 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:53.901690    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d933de9-3897-4a03-89e1-7e53e561a987-local-certs" (OuterVolumeSpecName: "local-certs") pod "5d933de9-3897-4a03-89e1-7e53e561a987" (UID: "5d933de9-3897-4a03-89e1-7e53e561a987"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:39:53.901729 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:53.901697    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d933de9-3897-4a03-89e1-7e53e561a987-kube-api-access-j5nbm" (OuterVolumeSpecName: "kube-api-access-j5nbm") pod "5d933de9-3897-4a03-89e1-7e53e561a987" (UID: "5d933de9-3897-4a03-89e1-7e53e561a987"). InnerVolumeSpecName "kube-api-access-j5nbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:39:53.901729 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:53.901713    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d933de9-3897-4a03-89e1-7e53e561a987-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "5d933de9-3897-4a03-89e1-7e53e561a987" (UID: "5d933de9-3897-4a03-89e1-7e53e561a987"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:39:53.901992 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:53.901966    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d933de9-3897-4a03-89e1-7e53e561a987-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "5d933de9-3897-4a03-89e1-7e53e561a987" (UID: "5d933de9-3897-4a03-89e1-7e53e561a987"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:39:53.901992 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:53.901970    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d933de9-3897-4a03-89e1-7e53e561a987-istio-token" (OuterVolumeSpecName: "istio-token") pod "5d933de9-3897-4a03-89e1-7e53e561a987" (UID: "5d933de9-3897-4a03-89e1-7e53e561a987"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:39:53.902156 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:53.902042    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d933de9-3897-4a03-89e1-7e53e561a987-cacerts" (OuterVolumeSpecName: "cacerts") pod "5d933de9-3897-4a03-89e1-7e53e561a987" (UID: "5d933de9-3897-4a03-89e1-7e53e561a987"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:39:53.986428 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:53.986341    2577 generic.go:356] "Generic (PLEG): container finished" podID="5d933de9-3897-4a03-89e1-7e53e561a987" containerID="30a3b15d30dc9d7f4fd0cb74cdfa3b08c8e5c8d25631415e7fcd4813c63e0ea8" exitCode=0
Sep 08 14:39:53.986428 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:53.986400    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"
Sep 08 14:39:53.986684 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:53.986431    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2" event={"ID":"5d933de9-3897-4a03-89e1-7e53e561a987","Type":"ContainerDied","Data":"30a3b15d30dc9d7f4fd0cb74cdfa3b08c8e5c8d25631415e7fcd4813c63e0ea8"}
Sep 08 14:39:53.986684 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:53.986501    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2" event={"ID":"5d933de9-3897-4a03-89e1-7e53e561a987","Type":"ContainerDied","Data":"9ea1cfc653fe78eb2eaa2c5fe96f64115e68068e3fbf295f291f57eee0bd9a4a"}
Sep 08 14:39:53.986684 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:53.986526    2577 scope.go:117] "RemoveContainer" containerID="30a3b15d30dc9d7f4fd0cb74cdfa3b08c8e5c8d25631415e7fcd4813c63e0ea8"
Sep 08 14:39:53.988336 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:53.988301    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c4bll" event={"ID":"1232051a-c7cd-47ee-8a03-e3bd498b80b5","Type":"ContainerStarted","Data":"cf02b6da0cf406bfbc4d0b7b4247edbb9f96f1638104e6656c15babaaa4aa489"}
Sep 08 14:39:53.988454 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:53.988357    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c4bll"
Sep 08 14:39:53.999995 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:53.999977    2577 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5d933de9-3897-4a03-89e1-7e53e561a987-istio-csr-ca-configmap\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:39:54.000083 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:53.999996    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d933de9-3897-4a03-89e1-7e53e561a987-istio-token\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:39:54.000083 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:54.000007    2577 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5d933de9-3897-4a03-89e1-7e53e561a987-istio-csr-dns-cert\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:39:54.000083 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:54.000020    2577 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d933de9-3897-4a03-89e1-7e53e561a987-local-certs\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:39:54.000083 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:54.000032    2577 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d933de9-3897-4a03-89e1-7e53e561a987-istio-kubeconfig\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:39:54.000083 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:54.000044    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5nbm\" (UniqueName: \"kubernetes.io/projected/5d933de9-3897-4a03-89e1-7e53e561a987-kube-api-access-j5nbm\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:39:54.000083 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:54.000053    2577 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5d933de9-3897-4a03-89e1-7e53e561a987-cacerts\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:39:54.010457 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:54.010411    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c4bll" podStartSLOduration=1.739488685 podStartE2EDuration="4.010396449s" totalImagesPullingTime="2.270907764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:39:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:39:54.009258461 +0000 UTC m=+355.047659384" watchObservedRunningTime="2026-09-08 14:39:54.010396449 +0000 UTC m=+355.048797373"
Sep 08 14:39:54.031546 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:54.031515    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"]
Sep 08 14:39:54.035636 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:54.035612    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cf4k2"]
Sep 08 14:39:54.411168 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:54.411057    2577 scope.go:117] "RemoveContainer" containerID="30a3b15d30dc9d7f4fd0cb74cdfa3b08c8e5c8d25631415e7fcd4813c63e0ea8"
Sep 08 14:39:54.411481 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:39:54.411448    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30a3b15d30dc9d7f4fd0cb74cdfa3b08c8e5c8d25631415e7fcd4813c63e0ea8\": container with ID starting with 30a3b15d30dc9d7f4fd0cb74cdfa3b08c8e5c8d25631415e7fcd4813c63e0ea8 not found: ID does not exist" containerID="30a3b15d30dc9d7f4fd0cb74cdfa3b08c8e5c8d25631415e7fcd4813c63e0ea8"
Sep 08 14:39:54.411605 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:54.411570    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30a3b15d30dc9d7f4fd0cb74cdfa3b08c8e5c8d25631415e7fcd4813c63e0ea8"} err="failed to get container status \"30a3b15d30dc9d7f4fd0cb74cdfa3b08c8e5c8d25631415e7fcd4813c63e0ea8\": rpc error: code = NotFound desc = could not find container \"30a3b15d30dc9d7f4fd0cb74cdfa3b08c8e5c8d25631415e7fcd4813c63e0ea8\": container with ID starting with 30a3b15d30dc9d7f4fd0cb74cdfa3b08c8e5c8d25631415e7fcd4813c63e0ea8 not found: ID does not exist"
Sep 08 14:39:54.995017 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:54.994983    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-knv7q" event={"ID":"34d6fcec-2abe-4655-a088-48b5910ddca8","Type":"ContainerStarted","Data":"2b8339b991cf04bb4421a38cdb0dcaa549989eafb4d8b8dccf55b382d4bb32cf"}
Sep 08 14:39:54.995178 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:54.995074    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-knv7q"
Sep 08 14:39:55.016977 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:55.016928    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-knv7q" podStartSLOduration=2.029588093 podStartE2EDuration="5.016913722s" totalImagesPullingTime="2.987325629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:39:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:39:55.015981655 +0000 UTC m=+356.054382577" watchObservedRunningTime="2026-09-08 14:39:55.016913722 +0000 UTC m=+356.055314644"
Sep 08 14:39:55.489805 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:39:55.489775    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d933de9-3897-4a03-89e1-7e53e561a987" path="/var/lib/kubelet/pods/5d933de9-3897-4a03-89e1-7e53e561a987/volumes"
Sep 08 14:40:25.000747 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:25.000717    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c4bll"
Sep 08 14:40:26.002261 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:26.002230    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-knv7q"
Sep 08 14:40:44.441210 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.441172    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4tdfn"]
Sep 08 14:40:44.441646 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.441505    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d933de9-3897-4a03-89e1-7e53e561a987" containerName="discovery"
Sep 08 14:40:44.441646 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.441519    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d933de9-3897-4a03-89e1-7e53e561a987" containerName="discovery"
Sep 08 14:40:44.441646 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.441589    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d933de9-3897-4a03-89e1-7e53e561a987" containerName="discovery"
Sep 08 14:40:44.448443 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.448428    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4tdfn"
Sep 08 14:40:44.451229 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.451208    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 14:40:44.452544 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.452521    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 14:40:44.452673 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.452559    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8jjpz\""
Sep 08 14:40:44.454668 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.454645    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4tdfn"]
Sep 08 14:40:44.539968 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.539933    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkgm8r"]
Sep 08 14:40:44.543376 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.543356    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkgm8r"
Sep 08 14:40:44.552546 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.552522    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkgm8r"]
Sep 08 14:40:44.580090 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.580062    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5081b3a9-1d8c-479d-8df0-ecc781e0893a-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4tdfn\" (UID: \"5081b3a9-1d8c-479d-8df0-ecc781e0893a\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4tdfn"
Sep 08 14:40:44.580090 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.580091    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5081b3a9-1d8c-479d-8df0-ecc781e0893a-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4tdfn\" (UID: \"5081b3a9-1d8c-479d-8df0-ecc781e0893a\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4tdfn"
Sep 08 14:40:44.580240 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.580112    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b56s\" (UniqueName: \"kubernetes.io/projected/5081b3a9-1d8c-479d-8df0-ecc781e0893a-kube-api-access-4b56s\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4tdfn\" (UID: \"5081b3a9-1d8c-479d-8df0-ecc781e0893a\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4tdfn"
Sep 08 14:40:44.645410 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.645383    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sn4cf"]
Sep 08 14:40:44.648812 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.648796    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sn4cf"
Sep 08 14:40:44.657277 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.657248    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sn4cf"]
Sep 08 14:40:44.680831 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.680805    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0b7c9e4-bf1d-4745-bd99-e690997503ed-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkgm8r\" (UID: \"b0b7c9e4-bf1d-4745-bd99-e690997503ed\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkgm8r"
Sep 08 14:40:44.680961 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.680836    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b56s\" (UniqueName: \"kubernetes.io/projected/5081b3a9-1d8c-479d-8df0-ecc781e0893a-kube-api-access-4b56s\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4tdfn\" (UID: \"5081b3a9-1d8c-479d-8df0-ecc781e0893a\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4tdfn"
Sep 08 14:40:44.680961 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.680866    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn75r\" (UniqueName: \"kubernetes.io/projected/b0b7c9e4-bf1d-4745-bd99-e690997503ed-kube-api-access-tn75r\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkgm8r\" (UID: \"b0b7c9e4-bf1d-4745-bd99-e690997503ed\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkgm8r"
Sep 08 14:40:44.681037 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.680962    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0b7c9e4-bf1d-4745-bd99-e690997503ed-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkgm8r\" (UID: \"b0b7c9e4-bf1d-4745-bd99-e690997503ed\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkgm8r"
Sep 08 14:40:44.681037 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.681001    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5081b3a9-1d8c-479d-8df0-ecc781e0893a-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4tdfn\" (UID: \"5081b3a9-1d8c-479d-8df0-ecc781e0893a\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4tdfn"
Sep 08 14:40:44.681037 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.681019    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5081b3a9-1d8c-479d-8df0-ecc781e0893a-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4tdfn\" (UID: \"5081b3a9-1d8c-479d-8df0-ecc781e0893a\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4tdfn"
Sep 08 14:40:44.681408 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.681389    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5081b3a9-1d8c-479d-8df0-ecc781e0893a-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4tdfn\" (UID: \"5081b3a9-1d8c-479d-8df0-ecc781e0893a\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4tdfn"
Sep 08 14:40:44.681443 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.681401    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5081b3a9-1d8c-479d-8df0-ecc781e0893a-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4tdfn\" (UID: \"5081b3a9-1d8c-479d-8df0-ecc781e0893a\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4tdfn"
Sep 08 14:40:44.690349 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.690324    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b56s\" (UniqueName: \"kubernetes.io/projected/5081b3a9-1d8c-479d-8df0-ecc781e0893a-kube-api-access-4b56s\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4tdfn\" (UID: \"5081b3a9-1d8c-479d-8df0-ecc781e0893a\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4tdfn"
Sep 08 14:40:44.741206 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.741123    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053vxndb"]
Sep 08 14:40:44.744810 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.744790    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053vxndb"
Sep 08 14:40:44.752960 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.752935    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053vxndb"]
Sep 08 14:40:44.758027 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.758010    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4tdfn"
Sep 08 14:40:44.781520 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.781445    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcvjn\" (UniqueName: \"kubernetes.io/projected/bbc045f1-6388-49f3-93a6-c9de63391452-kube-api-access-wcvjn\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sn4cf\" (UID: \"bbc045f1-6388-49f3-93a6-c9de63391452\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sn4cf"
Sep 08 14:40:44.781623 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.781554    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0b7c9e4-bf1d-4745-bd99-e690997503ed-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkgm8r\" (UID: \"b0b7c9e4-bf1d-4745-bd99-e690997503ed\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkgm8r"
Sep 08 14:40:44.781623 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.781610    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn75r\" (UniqueName: \"kubernetes.io/projected/b0b7c9e4-bf1d-4745-bd99-e690997503ed-kube-api-access-tn75r\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkgm8r\" (UID: \"b0b7c9e4-bf1d-4745-bd99-e690997503ed\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkgm8r"
Sep 08 14:40:44.781718 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.781637    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbc045f1-6388-49f3-93a6-c9de63391452-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sn4cf\" (UID: \"bbc045f1-6388-49f3-93a6-c9de63391452\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sn4cf"
Sep 08 14:40:44.781718 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.781692    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbc045f1-6388-49f3-93a6-c9de63391452-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sn4cf\" (UID: \"bbc045f1-6388-49f3-93a6-c9de63391452\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sn4cf"
Sep 08 14:40:44.781813 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.781744    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0b7c9e4-bf1d-4745-bd99-e690997503ed-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkgm8r\" (UID: \"b0b7c9e4-bf1d-4745-bd99-e690997503ed\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkgm8r"
Sep 08 14:40:44.781879 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.781857    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0b7c9e4-bf1d-4745-bd99-e690997503ed-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkgm8r\" (UID: \"b0b7c9e4-bf1d-4745-bd99-e690997503ed\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkgm8r"
Sep 08 14:40:44.782092 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.782072    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0b7c9e4-bf1d-4745-bd99-e690997503ed-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkgm8r\" (UID: \"b0b7c9e4-bf1d-4745-bd99-e690997503ed\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkgm8r"
Sep 08 14:40:44.792264 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.792242    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn75r\" (UniqueName: \"kubernetes.io/projected/b0b7c9e4-bf1d-4745-bd99-e690997503ed-kube-api-access-tn75r\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkgm8r\" (UID: \"b0b7c9e4-bf1d-4745-bd99-e690997503ed\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkgm8r"
Sep 08 14:40:44.852804 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.852773    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkgm8r"
Sep 08 14:40:44.882442 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.882414    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcvjn\" (UniqueName: \"kubernetes.io/projected/bbc045f1-6388-49f3-93a6-c9de63391452-kube-api-access-wcvjn\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sn4cf\" (UID: \"bbc045f1-6388-49f3-93a6-c9de63391452\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sn4cf"
Sep 08 14:40:44.882582 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.882458    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da1693fd-40df-408f-80ca-0270b070821e-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053vxndb\" (UID: \"da1693fd-40df-408f-80ca-0270b070821e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053vxndb"
Sep 08 14:40:44.882582 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.882518    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbc045f1-6388-49f3-93a6-c9de63391452-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sn4cf\" (UID: \"bbc045f1-6388-49f3-93a6-c9de63391452\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sn4cf"
Sep 08 14:40:44.882582 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.882554    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbc045f1-6388-49f3-93a6-c9de63391452-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sn4cf\" (UID: \"bbc045f1-6388-49f3-93a6-c9de63391452\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sn4cf"
Sep 08 14:40:44.882736 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.882683    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shq8h\" (UniqueName: \"kubernetes.io/projected/da1693fd-40df-408f-80ca-0270b070821e-kube-api-access-shq8h\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053vxndb\" (UID: \"da1693fd-40df-408f-80ca-0270b070821e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053vxndb"
Sep 08 14:40:44.882736 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.882718    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da1693fd-40df-408f-80ca-0270b070821e-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053vxndb\" (UID: \"da1693fd-40df-408f-80ca-0270b070821e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053vxndb"
Sep 08 14:40:44.882932 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.882916    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbc045f1-6388-49f3-93a6-c9de63391452-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sn4cf\" (UID: \"bbc045f1-6388-49f3-93a6-c9de63391452\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sn4cf"
Sep 08 14:40:44.882974 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.882911    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbc045f1-6388-49f3-93a6-c9de63391452-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sn4cf\" (UID: \"bbc045f1-6388-49f3-93a6-c9de63391452\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sn4cf"
Sep 08 14:40:44.893626 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.893601    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcvjn\" (UniqueName: \"kubernetes.io/projected/bbc045f1-6388-49f3-93a6-c9de63391452-kube-api-access-wcvjn\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sn4cf\" (UID: \"bbc045f1-6388-49f3-93a6-c9de63391452\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sn4cf"
Sep 08 14:40:44.957717 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.957686    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sn4cf"
Sep 08 14:40:44.983267 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.983234    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shq8h\" (UniqueName: \"kubernetes.io/projected/da1693fd-40df-408f-80ca-0270b070821e-kube-api-access-shq8h\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053vxndb\" (UID: \"da1693fd-40df-408f-80ca-0270b070821e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053vxndb"
Sep 08 14:40:44.983419 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.983276    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da1693fd-40df-408f-80ca-0270b070821e-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053vxndb\" (UID: \"da1693fd-40df-408f-80ca-0270b070821e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053vxndb"
Sep 08 14:40:44.983419 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.983315    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da1693fd-40df-408f-80ca-0270b070821e-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053vxndb\" (UID: \"da1693fd-40df-408f-80ca-0270b070821e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053vxndb"
Sep 08 14:40:44.983712 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.983694    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da1693fd-40df-408f-80ca-0270b070821e-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053vxndb\" (UID: \"da1693fd-40df-408f-80ca-0270b070821e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053vxndb"
Sep 08 14:40:44.983780 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.983714    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da1693fd-40df-408f-80ca-0270b070821e-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053vxndb\" (UID: \"da1693fd-40df-408f-80ca-0270b070821e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053vxndb"
Sep 08 14:40:44.992386 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:44.992323    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shq8h\" (UniqueName: \"kubernetes.io/projected/da1693fd-40df-408f-80ca-0270b070821e-kube-api-access-shq8h\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053vxndb\" (UID: \"da1693fd-40df-408f-80ca-0270b070821e\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053vxndb"
Sep 08 14:40:45.034312 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:45.034285    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4tdfn"]
Sep 08 14:40:45.036196 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:40:45.036165    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5081b3a9_1d8c_479d_8df0_ecc781e0893a.slice/crio-c46b318181fe437a183ffb346691a4671014c3be376d71086c1c81d6ac8e8e70 WatchSource:0}: Error finding container c46b318181fe437a183ffb346691a4671014c3be376d71086c1c81d6ac8e8e70: Status 404 returned error can't find the container with id c46b318181fe437a183ffb346691a4671014c3be376d71086c1c81d6ac8e8e70
Sep 08 14:40:45.054571 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:45.054547    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053vxndb"
Sep 08 14:40:45.132161 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:45.132135    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkgm8r"]
Sep 08 14:40:45.133691 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:40:45.133649    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0b7c9e4_bf1d_4745_bd99_e690997503ed.slice/crio-a61cfc205802f5f7f334381d9a2cf0b5a3b845e379a29825052768ee507bbaea WatchSource:0}: Error finding container a61cfc205802f5f7f334381d9a2cf0b5a3b845e379a29825052768ee507bbaea: Status 404 returned error can't find the container with id a61cfc205802f5f7f334381d9a2cf0b5a3b845e379a29825052768ee507bbaea
Sep 08 14:40:45.212540 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:45.212505    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkgm8r" event={"ID":"b0b7c9e4-bf1d-4745-bd99-e690997503ed","Type":"ContainerStarted","Data":"a61cfc205802f5f7f334381d9a2cf0b5a3b845e379a29825052768ee507bbaea"}
Sep 08 14:40:45.214297 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:45.214262    2577 generic.go:356] "Generic (PLEG): container finished" podID="5081b3a9-1d8c-479d-8df0-ecc781e0893a" containerID="c93afa69ae0c3f8cf792bf866c566d063133fbee657010ed2c48f4a32a61eb87" exitCode=0
Sep 08 14:40:45.214416 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:45.214346    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4tdfn" event={"ID":"5081b3a9-1d8c-479d-8df0-ecc781e0893a","Type":"ContainerDied","Data":"c93afa69ae0c3f8cf792bf866c566d063133fbee657010ed2c48f4a32a61eb87"}
Sep 08 14:40:45.214416 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:45.214391    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4tdfn" event={"ID":"5081b3a9-1d8c-479d-8df0-ecc781e0893a","Type":"ContainerStarted","Data":"c46b318181fe437a183ffb346691a4671014c3be376d71086c1c81d6ac8e8e70"}
Sep 08 14:40:45.234833 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:45.234807    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sn4cf"]
Sep 08 14:40:45.238876 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:40:45.238846    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbc045f1_6388_49f3_93a6_c9de63391452.slice/crio-cc9f37423712083b1aec6a60c8420208345c9fc5ca2792a6986b8c58fee8b1e4 WatchSource:0}: Error finding container cc9f37423712083b1aec6a60c8420208345c9fc5ca2792a6986b8c58fee8b1e4: Status 404 returned error can't find the container with id cc9f37423712083b1aec6a60c8420208345c9fc5ca2792a6986b8c58fee8b1e4
Sep 08 14:40:45.332268 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:45.332243    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053vxndb"]
Sep 08 14:40:45.378235 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:40:45.378201    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda1693fd_40df_408f_80ca_0270b070821e.slice/crio-c432e9196f67937b97291ab2934170416fabd778d414adc3b93bebe726c72fa9 WatchSource:0}: Error finding container c432e9196f67937b97291ab2934170416fabd778d414adc3b93bebe726c72fa9: Status 404 returned error can't find the container with id c432e9196f67937b97291ab2934170416fabd778d414adc3b93bebe726c72fa9
Sep 08 14:40:46.221439 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:46.221402    2577 generic.go:356] "Generic (PLEG): container finished" podID="5081b3a9-1d8c-479d-8df0-ecc781e0893a" containerID="d87d2793de3f385ba5368a761b0e8dfd6d71056fd5e1398f8fdfe24cc68ab4c3" exitCode=0
Sep 08 14:40:46.221924 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:46.221490    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4tdfn" event={"ID":"5081b3a9-1d8c-479d-8df0-ecc781e0893a","Type":"ContainerDied","Data":"d87d2793de3f385ba5368a761b0e8dfd6d71056fd5e1398f8fdfe24cc68ab4c3"}
Sep 08 14:40:46.223138 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:46.223112    2577 generic.go:356] "Generic (PLEG): container finished" podID="da1693fd-40df-408f-80ca-0270b070821e" containerID="09ee8dee53e86fb91492963edacc3caaf5e82e161c8b1c4b0337814c8c821427" exitCode=0
Sep 08 14:40:46.223202 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:46.223187    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053vxndb" event={"ID":"da1693fd-40df-408f-80ca-0270b070821e","Type":"ContainerDied","Data":"09ee8dee53e86fb91492963edacc3caaf5e82e161c8b1c4b0337814c8c821427"}
Sep 08 14:40:46.223257 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:46.223228    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053vxndb" event={"ID":"da1693fd-40df-408f-80ca-0270b070821e","Type":"ContainerStarted","Data":"c432e9196f67937b97291ab2934170416fabd778d414adc3b93bebe726c72fa9"}
Sep 08 14:40:46.224877 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:46.224858    2577 generic.go:356] "Generic (PLEG): container finished" podID="bbc045f1-6388-49f3-93a6-c9de63391452" containerID="11a2f5c278749c63fb20d7e0dd440f4db7b7366d3b729965f6a337d954a28ae1" exitCode=0
Sep 08 14:40:46.224976 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:46.224879    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sn4cf" event={"ID":"bbc045f1-6388-49f3-93a6-c9de63391452","Type":"ContainerDied","Data":"11a2f5c278749c63fb20d7e0dd440f4db7b7366d3b729965f6a337d954a28ae1"}
Sep 08 14:40:46.224976 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:46.224920    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sn4cf" event={"ID":"bbc045f1-6388-49f3-93a6-c9de63391452","Type":"ContainerStarted","Data":"cc9f37423712083b1aec6a60c8420208345c9fc5ca2792a6986b8c58fee8b1e4"}
Sep 08 14:40:46.227096 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:46.227076    2577 generic.go:356] "Generic (PLEG): container finished" podID="b0b7c9e4-bf1d-4745-bd99-e690997503ed" containerID="834ee3ff6e80c13c8b97d90fa781a6b1ffa9ba919ed613ad964e304f2f8db8ac" exitCode=0
Sep 08 14:40:46.227167 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:46.227121    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkgm8r" event={"ID":"b0b7c9e4-bf1d-4745-bd99-e690997503ed","Type":"ContainerDied","Data":"834ee3ff6e80c13c8b97d90fa781a6b1ffa9ba919ed613ad964e304f2f8db8ac"}
Sep 08 14:40:47.235923 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:47.235738    2577 generic.go:356] "Generic (PLEG): container finished" podID="5081b3a9-1d8c-479d-8df0-ecc781e0893a" containerID="42ed1529fac42960bf6dd6a26cf7a114ec9eafd44c678084e6d80815631d3510" exitCode=0
Sep 08 14:40:47.235923 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:47.235813    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4tdfn" event={"ID":"5081b3a9-1d8c-479d-8df0-ecc781e0893a","Type":"ContainerDied","Data":"42ed1529fac42960bf6dd6a26cf7a114ec9eafd44c678084e6d80815631d3510"}
Sep 08 14:40:48.248232 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:48.248198    2577 generic.go:356] "Generic (PLEG): container finished" podID="da1693fd-40df-408f-80ca-0270b070821e" containerID="0dce2864679cb85ee0835797660957d765977891c983ad12ab93d532001fa491" exitCode=0
Sep 08 14:40:48.248703 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:48.248285    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053vxndb" event={"ID":"da1693fd-40df-408f-80ca-0270b070821e","Type":"ContainerDied","Data":"0dce2864679cb85ee0835797660957d765977891c983ad12ab93d532001fa491"}
Sep 08 14:40:48.252999 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:48.252972    2577 generic.go:356] "Generic (PLEG): container finished" podID="bbc045f1-6388-49f3-93a6-c9de63391452" containerID="ce148242285c7d00cbec41a30fa0f8cd54e08c7421062bdeee97710a660282f7" exitCode=0
Sep 08 14:40:48.253131 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:48.253076    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sn4cf" event={"ID":"bbc045f1-6388-49f3-93a6-c9de63391452","Type":"ContainerDied","Data":"ce148242285c7d00cbec41a30fa0f8cd54e08c7421062bdeee97710a660282f7"}
Sep 08 14:40:48.392903 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:48.392878    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4tdfn"
Sep 08 14:40:48.410006 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:48.409976    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5081b3a9-1d8c-479d-8df0-ecc781e0893a-util\") pod \"5081b3a9-1d8c-479d-8df0-ecc781e0893a\" (UID: \"5081b3a9-1d8c-479d-8df0-ecc781e0893a\") "
Sep 08 14:40:48.410153 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:48.410026    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4b56s\" (UniqueName: \"kubernetes.io/projected/5081b3a9-1d8c-479d-8df0-ecc781e0893a-kube-api-access-4b56s\") pod \"5081b3a9-1d8c-479d-8df0-ecc781e0893a\" (UID: \"5081b3a9-1d8c-479d-8df0-ecc781e0893a\") "
Sep 08 14:40:48.412230 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:48.412198    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5081b3a9-1d8c-479d-8df0-ecc781e0893a-kube-api-access-4b56s" (OuterVolumeSpecName: "kube-api-access-4b56s") pod "5081b3a9-1d8c-479d-8df0-ecc781e0893a" (UID: "5081b3a9-1d8c-479d-8df0-ecc781e0893a"). InnerVolumeSpecName "kube-api-access-4b56s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:40:48.416158 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:48.416047    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5081b3a9-1d8c-479d-8df0-ecc781e0893a-util" (OuterVolumeSpecName: "util") pod "5081b3a9-1d8c-479d-8df0-ecc781e0893a" (UID: "5081b3a9-1d8c-479d-8df0-ecc781e0893a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:40:48.510736 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:48.510668    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5081b3a9-1d8c-479d-8df0-ecc781e0893a-bundle\") pod \"5081b3a9-1d8c-479d-8df0-ecc781e0893a\" (UID: \"5081b3a9-1d8c-479d-8df0-ecc781e0893a\") "
Sep 08 14:40:48.510852 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:48.510841    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4b56s\" (UniqueName: \"kubernetes.io/projected/5081b3a9-1d8c-479d-8df0-ecc781e0893a-kube-api-access-4b56s\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:40:48.510888 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:48.510855    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5081b3a9-1d8c-479d-8df0-ecc781e0893a-util\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:40:48.511148 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:48.511125    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5081b3a9-1d8c-479d-8df0-ecc781e0893a-bundle" (OuterVolumeSpecName: "bundle") pod "5081b3a9-1d8c-479d-8df0-ecc781e0893a" (UID: "5081b3a9-1d8c-479d-8df0-ecc781e0893a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:40:48.611460 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:48.611424    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5081b3a9-1d8c-479d-8df0-ecc781e0893a-bundle\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:40:49.260387 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:49.260352    2577 generic.go:356] "Generic (PLEG): container finished" podID="bbc045f1-6388-49f3-93a6-c9de63391452" containerID="e89ff6d4a22b69e47763e33b91f2e3c1a6cc520c488d3a9d890a0162200d29a0" exitCode=0
Sep 08 14:40:49.260806 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:49.260444    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sn4cf" event={"ID":"bbc045f1-6388-49f3-93a6-c9de63391452","Type":"ContainerDied","Data":"e89ff6d4a22b69e47763e33b91f2e3c1a6cc520c488d3a9d890a0162200d29a0"}
Sep 08 14:40:49.262324 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:49.262303    2577 generic.go:356] "Generic (PLEG): container finished" podID="b0b7c9e4-bf1d-4745-bd99-e690997503ed" containerID="6878f0003f71d340c63650437dc711972884242eb1b986a89102b73457dcc8dc" exitCode=0
Sep 08 14:40:49.262406 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:49.262395    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkgm8r" event={"ID":"b0b7c9e4-bf1d-4745-bd99-e690997503ed","Type":"ContainerDied","Data":"6878f0003f71d340c63650437dc711972884242eb1b986a89102b73457dcc8dc"}
Sep 08 14:40:49.264363 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:49.264344    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4tdfn"
Sep 08 14:40:49.264528 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:49.264366    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4tdfn" event={"ID":"5081b3a9-1d8c-479d-8df0-ecc781e0893a","Type":"ContainerDied","Data":"c46b318181fe437a183ffb346691a4671014c3be376d71086c1c81d6ac8e8e70"}
Sep 08 14:40:49.264528 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:49.264404    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c46b318181fe437a183ffb346691a4671014c3be376d71086c1c81d6ac8e8e70"
Sep 08 14:40:49.266643 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:49.266621    2577 generic.go:356] "Generic (PLEG): container finished" podID="da1693fd-40df-408f-80ca-0270b070821e" containerID="96399e9da68607f1e9bc204479e462ef410709625fa7e1c4e5392e50850d5b33" exitCode=0
Sep 08 14:40:49.266733 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:49.266683    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053vxndb" event={"ID":"da1693fd-40df-408f-80ca-0270b070821e","Type":"ContainerDied","Data":"96399e9da68607f1e9bc204479e462ef410709625fa7e1c4e5392e50850d5b33"}
Sep 08 14:40:50.273329 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:50.273295    2577 generic.go:356] "Generic (PLEG): container finished" podID="b0b7c9e4-bf1d-4745-bd99-e690997503ed" containerID="f90b763ab7ab81fcbd9bccb325945e13b3bf549c28b4665e1fd38a82350f607b" exitCode=0
Sep 08 14:40:50.273811 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:50.273368    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkgm8r" event={"ID":"b0b7c9e4-bf1d-4745-bd99-e690997503ed","Type":"ContainerDied","Data":"f90b763ab7ab81fcbd9bccb325945e13b3bf549c28b4665e1fd38a82350f607b"}
Sep 08 14:40:50.426427 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:50.426403    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sn4cf"
Sep 08 14:40:50.437491 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:50.437451    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053vxndb"
Sep 08 14:40:50.526129 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:50.526057    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shq8h\" (UniqueName: \"kubernetes.io/projected/da1693fd-40df-408f-80ca-0270b070821e-kube-api-access-shq8h\") pod \"da1693fd-40df-408f-80ca-0270b070821e\" (UID: \"da1693fd-40df-408f-80ca-0270b070821e\") "
Sep 08 14:40:50.526129 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:50.526090    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbc045f1-6388-49f3-93a6-c9de63391452-util\") pod \"bbc045f1-6388-49f3-93a6-c9de63391452\" (UID: \"bbc045f1-6388-49f3-93a6-c9de63391452\") "
Sep 08 14:40:50.526297 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:50.526134    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da1693fd-40df-408f-80ca-0270b070821e-util\") pod \"da1693fd-40df-408f-80ca-0270b070821e\" (UID: \"da1693fd-40df-408f-80ca-0270b070821e\") "
Sep 08 14:40:50.526297 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:50.526165    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbc045f1-6388-49f3-93a6-c9de63391452-bundle\") pod \"bbc045f1-6388-49f3-93a6-c9de63391452\" (UID: \"bbc045f1-6388-49f3-93a6-c9de63391452\") "
Sep 08 14:40:50.526297 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:50.526202    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcvjn\" (UniqueName: \"kubernetes.io/projected/bbc045f1-6388-49f3-93a6-c9de63391452-kube-api-access-wcvjn\") pod \"bbc045f1-6388-49f3-93a6-c9de63391452\" (UID: \"bbc045f1-6388-49f3-93a6-c9de63391452\") "
Sep 08 14:40:50.526297 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:50.526264    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da1693fd-40df-408f-80ca-0270b070821e-bundle\") pod \"da1693fd-40df-408f-80ca-0270b070821e\" (UID: \"da1693fd-40df-408f-80ca-0270b070821e\") "
Sep 08 14:40:50.526789 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:50.526704    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbc045f1-6388-49f3-93a6-c9de63391452-bundle" (OuterVolumeSpecName: "bundle") pod "bbc045f1-6388-49f3-93a6-c9de63391452" (UID: "bbc045f1-6388-49f3-93a6-c9de63391452"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:40:50.527022 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:50.527000    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbc045f1-6388-49f3-93a6-c9de63391452-bundle\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:40:50.527175 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:50.527068    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da1693fd-40df-408f-80ca-0270b070821e-bundle" (OuterVolumeSpecName: "bundle") pod "da1693fd-40df-408f-80ca-0270b070821e" (UID: "da1693fd-40df-408f-80ca-0270b070821e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:40:50.528373 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:50.528351    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da1693fd-40df-408f-80ca-0270b070821e-kube-api-access-shq8h" (OuterVolumeSpecName: "kube-api-access-shq8h") pod "da1693fd-40df-408f-80ca-0270b070821e" (UID: "da1693fd-40df-408f-80ca-0270b070821e"). InnerVolumeSpecName "kube-api-access-shq8h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:40:50.528825 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:50.528808    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbc045f1-6388-49f3-93a6-c9de63391452-kube-api-access-wcvjn" (OuterVolumeSpecName: "kube-api-access-wcvjn") pod "bbc045f1-6388-49f3-93a6-c9de63391452" (UID: "bbc045f1-6388-49f3-93a6-c9de63391452"). InnerVolumeSpecName "kube-api-access-wcvjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:40:50.532382 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:50.532359    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbc045f1-6388-49f3-93a6-c9de63391452-util" (OuterVolumeSpecName: "util") pod "bbc045f1-6388-49f3-93a6-c9de63391452" (UID: "bbc045f1-6388-49f3-93a6-c9de63391452"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:40:50.534873 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:50.534848    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da1693fd-40df-408f-80ca-0270b070821e-util" (OuterVolumeSpecName: "util") pod "da1693fd-40df-408f-80ca-0270b070821e" (UID: "da1693fd-40df-408f-80ca-0270b070821e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:40:50.628366 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:50.628336    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shq8h\" (UniqueName: \"kubernetes.io/projected/da1693fd-40df-408f-80ca-0270b070821e-kube-api-access-shq8h\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:40:50.628366 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:50.628363    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbc045f1-6388-49f3-93a6-c9de63391452-util\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:40:50.628366 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:50.628372    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da1693fd-40df-408f-80ca-0270b070821e-util\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:40:50.628602 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:50.628379    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcvjn\" (UniqueName: \"kubernetes.io/projected/bbc045f1-6388-49f3-93a6-c9de63391452-kube-api-access-wcvjn\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:40:50.628602 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:50.628388    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da1693fd-40df-408f-80ca-0270b070821e-bundle\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:40:51.281090 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:51.281058    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053vxndb"
Sep 08 14:40:51.281090 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:51.281059    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053vxndb" event={"ID":"da1693fd-40df-408f-80ca-0270b070821e","Type":"ContainerDied","Data":"c432e9196f67937b97291ab2934170416fabd778d414adc3b93bebe726c72fa9"}
Sep 08 14:40:51.281602 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:51.281109    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c432e9196f67937b97291ab2934170416fabd778d414adc3b93bebe726c72fa9"
Sep 08 14:40:51.283050 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:51.283031    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sn4cf"
Sep 08 14:40:51.283148 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:51.283047    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sn4cf" event={"ID":"bbc045f1-6388-49f3-93a6-c9de63391452","Type":"ContainerDied","Data":"cc9f37423712083b1aec6a60c8420208345c9fc5ca2792a6986b8c58fee8b1e4"}
Sep 08 14:40:51.283148 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:51.283079    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc9f37423712083b1aec6a60c8420208345c9fc5ca2792a6986b8c58fee8b1e4"
Sep 08 14:40:51.407887 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:51.407866    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkgm8r"
Sep 08 14:40:51.434135 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:51.434110    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0b7c9e4-bf1d-4745-bd99-e690997503ed-util\") pod \"b0b7c9e4-bf1d-4745-bd99-e690997503ed\" (UID: \"b0b7c9e4-bf1d-4745-bd99-e690997503ed\") "
Sep 08 14:40:51.434286 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:51.434160    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tn75r\" (UniqueName: \"kubernetes.io/projected/b0b7c9e4-bf1d-4745-bd99-e690997503ed-kube-api-access-tn75r\") pod \"b0b7c9e4-bf1d-4745-bd99-e690997503ed\" (UID: \"b0b7c9e4-bf1d-4745-bd99-e690997503ed\") "
Sep 08 14:40:51.434286 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:51.434205    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0b7c9e4-bf1d-4745-bd99-e690997503ed-bundle\") pod \"b0b7c9e4-bf1d-4745-bd99-e690997503ed\" (UID: \"b0b7c9e4-bf1d-4745-bd99-e690997503ed\") "
Sep 08 14:40:51.434883 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:51.434804    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0b7c9e4-bf1d-4745-bd99-e690997503ed-bundle" (OuterVolumeSpecName: "bundle") pod "b0b7c9e4-bf1d-4745-bd99-e690997503ed" (UID: "b0b7c9e4-bf1d-4745-bd99-e690997503ed"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:40:51.436351 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:51.436325    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0b7c9e4-bf1d-4745-bd99-e690997503ed-kube-api-access-tn75r" (OuterVolumeSpecName: "kube-api-access-tn75r") pod "b0b7c9e4-bf1d-4745-bd99-e690997503ed" (UID: "b0b7c9e4-bf1d-4745-bd99-e690997503ed"). InnerVolumeSpecName "kube-api-access-tn75r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:40:51.438213 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:51.438175    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0b7c9e4-bf1d-4745-bd99-e690997503ed-util" (OuterVolumeSpecName: "util") pod "b0b7c9e4-bf1d-4745-bd99-e690997503ed" (UID: "b0b7c9e4-bf1d-4745-bd99-e690997503ed"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:40:51.535277 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:51.535205    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0b7c9e4-bf1d-4745-bd99-e690997503ed-util\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:40:51.535277 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:51.535232    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tn75r\" (UniqueName: \"kubernetes.io/projected/b0b7c9e4-bf1d-4745-bd99-e690997503ed-kube-api-access-tn75r\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:40:51.535277 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:51.535242    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0b7c9e4-bf1d-4745-bd99-e690997503ed-bundle\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:40:52.289545 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:52.289509    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkgm8r" event={"ID":"b0b7c9e4-bf1d-4745-bd99-e690997503ed","Type":"ContainerDied","Data":"a61cfc205802f5f7f334381d9a2cf0b5a3b845e379a29825052768ee507bbaea"}
Sep 08 14:40:52.289545 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:52.289532    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbkgm8r"
Sep 08 14:40:52.289950 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:52.289560    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a61cfc205802f5f7f334381d9a2cf0b5a3b845e379a29825052768ee507bbaea"
Sep 08 14:40:57.379209 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.379175    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-5t7wl"]
Sep 08 14:40:57.379588 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.379504    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5081b3a9-1d8c-479d-8df0-ecc781e0893a" containerName="pull"
Sep 08 14:40:57.379588 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.379516    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5081b3a9-1d8c-479d-8df0-ecc781e0893a" containerName="pull"
Sep 08 14:40:57.379588 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.379525    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5081b3a9-1d8c-479d-8df0-ecc781e0893a" containerName="extract"
Sep 08 14:40:57.379588 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.379531    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5081b3a9-1d8c-479d-8df0-ecc781e0893a" containerName="extract"
Sep 08 14:40:57.379588 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.379539    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da1693fd-40df-408f-80ca-0270b070821e" containerName="extract"
Sep 08 14:40:57.379588 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.379544    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="da1693fd-40df-408f-80ca-0270b070821e" containerName="extract"
Sep 08 14:40:57.379588 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.379548    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbc045f1-6388-49f3-93a6-c9de63391452" containerName="extract"
Sep 08 14:40:57.379588 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.379553    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbc045f1-6388-49f3-93a6-c9de63391452" containerName="extract"
Sep 08 14:40:57.379588 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.379559    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbc045f1-6388-49f3-93a6-c9de63391452" containerName="pull"
Sep 08 14:40:57.379588 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.379565    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbc045f1-6388-49f3-93a6-c9de63391452" containerName="pull"
Sep 08 14:40:57.379588 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.379573    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0b7c9e4-bf1d-4745-bd99-e690997503ed" containerName="extract"
Sep 08 14:40:57.379588 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.379578    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0b7c9e4-bf1d-4745-bd99-e690997503ed" containerName="extract"
Sep 08 14:40:57.379588 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.379594    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0b7c9e4-bf1d-4745-bd99-e690997503ed" containerName="util"
Sep 08 14:40:57.379953 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.379598    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0b7c9e4-bf1d-4745-bd99-e690997503ed" containerName="util"
Sep 08 14:40:57.379953 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.379604    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da1693fd-40df-408f-80ca-0270b070821e" containerName="pull"
Sep 08 14:40:57.379953 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.379608    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="da1693fd-40df-408f-80ca-0270b070821e" containerName="pull"
Sep 08 14:40:57.379953 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.379614    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0b7c9e4-bf1d-4745-bd99-e690997503ed" containerName="pull"
Sep 08 14:40:57.379953 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.379618    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0b7c9e4-bf1d-4745-bd99-e690997503ed" containerName="pull"
Sep 08 14:40:57.379953 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.379625    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5081b3a9-1d8c-479d-8df0-ecc781e0893a" containerName="util"
Sep 08 14:40:57.379953 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.379630    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5081b3a9-1d8c-479d-8df0-ecc781e0893a" containerName="util"
Sep 08 14:40:57.379953 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.379635    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbc045f1-6388-49f3-93a6-c9de63391452" containerName="util"
Sep 08 14:40:57.379953 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.379639    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbc045f1-6388-49f3-93a6-c9de63391452" containerName="util"
Sep 08 14:40:57.379953 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.379644    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da1693fd-40df-408f-80ca-0270b070821e" containerName="util"
Sep 08 14:40:57.379953 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.379649    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="da1693fd-40df-408f-80ca-0270b070821e" containerName="util"
Sep 08 14:40:57.379953 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.379711    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5081b3a9-1d8c-479d-8df0-ecc781e0893a" containerName="extract"
Sep 08 14:40:57.379953 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.379718    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0b7c9e4-bf1d-4745-bd99-e690997503ed" containerName="extract"
Sep 08 14:40:57.379953 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.379725    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbc045f1-6388-49f3-93a6-c9de63391452" containerName="extract"
Sep 08 14:40:57.379953 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.379731    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="da1693fd-40df-408f-80ca-0270b070821e" containerName="extract"
Sep 08 14:40:57.382861 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.382844    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-5t7wl"
Sep 08 14:40:57.385554 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.385526    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 08 14:40:57.385813 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.385795    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-cxbcx\""
Sep 08 14:40:57.385909 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.385853    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 08 14:40:57.385909 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.385879    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 08 14:40:57.396332 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.396308    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-5t7wl"]
Sep 08 14:40:57.479272 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.479228    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8qrv\" (UniqueName: \"kubernetes.io/projected/ac3a9021-6fce-454d-b70a-1379acad35f8-kube-api-access-v8qrv\") pod \"dns-operator-controller-manager-5985564776-5t7wl\" (UID: \"ac3a9021-6fce-454d-b70a-1379acad35f8\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-5t7wl"
Sep 08 14:40:57.580045 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.580003    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8qrv\" (UniqueName: \"kubernetes.io/projected/ac3a9021-6fce-454d-b70a-1379acad35f8-kube-api-access-v8qrv\") pod \"dns-operator-controller-manager-5985564776-5t7wl\" (UID: \"ac3a9021-6fce-454d-b70a-1379acad35f8\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-5t7wl"
Sep 08 14:40:57.589776 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.589746    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8qrv\" (UniqueName: \"kubernetes.io/projected/ac3a9021-6fce-454d-b70a-1379acad35f8-kube-api-access-v8qrv\") pod \"dns-operator-controller-manager-5985564776-5t7wl\" (UID: \"ac3a9021-6fce-454d-b70a-1379acad35f8\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-5t7wl"
Sep 08 14:40:57.692459 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.692428    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-5t7wl"
Sep 08 14:40:57.963946 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:57.963925    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-5t7wl"]
Sep 08 14:40:57.966232 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:40:57.966208    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac3a9021_6fce_454d_b70a_1379acad35f8.slice/crio-ad4a15fbb790dbdeb93b3d0847e33a3c420bac6fd3b35d792194f2e426f417c5 WatchSource:0}: Error finding container ad4a15fbb790dbdeb93b3d0847e33a3c420bac6fd3b35d792194f2e426f417c5: Status 404 returned error can't find the container with id ad4a15fbb790dbdeb93b3d0847e33a3c420bac6fd3b35d792194f2e426f417c5
Sep 08 14:40:58.319928 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.319846    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-5t7wl" event={"ID":"ac3a9021-6fce-454d-b70a-1379acad35f8","Type":"ContainerStarted","Data":"ad4a15fbb790dbdeb93b3d0847e33a3c420bac6fd3b35d792194f2e426f417c5"}
Sep 08 14:40:58.654288 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.654210    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-697d967997-2ps7z"]
Sep 08 14:40:58.658661 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.658646    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-697d967997-2ps7z"
Sep 08 14:40:58.683439 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.683420    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 08 14:40:58.683808 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.683788    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pcvkg\""
Sep 08 14:40:58.684616 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.684603    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 08 14:40:58.684687 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.684629    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 08 14:40:58.688154 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.688124    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083-console-oauth-config\") pod \"console-697d967997-2ps7z\" (UID: \"7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083\") " pod="openshift-console/console-697d967997-2ps7z"
Sep 08 14:40:58.688243 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.688179    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cmhr\" (UniqueName: \"kubernetes.io/projected/7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083-kube-api-access-2cmhr\") pod \"console-697d967997-2ps7z\" (UID: \"7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083\") " pod="openshift-console/console-697d967997-2ps7z"
Sep 08 14:40:58.688243 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.688222    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083-oauth-serving-cert\") pod \"console-697d967997-2ps7z\" (UID: \"7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083\") " pod="openshift-console/console-697d967997-2ps7z"
Sep 08 14:40:58.688328 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.688300    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083-console-config\") pod \"console-697d967997-2ps7z\" (UID: \"7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083\") " pod="openshift-console/console-697d967997-2ps7z"
Sep 08 14:40:58.688362 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.688328    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083-service-ca\") pod \"console-697d967997-2ps7z\" (UID: \"7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083\") " pod="openshift-console/console-697d967997-2ps7z"
Sep 08 14:40:58.688362 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.688350    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083-trusted-ca-bundle\") pod \"console-697d967997-2ps7z\" (UID: \"7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083\") " pod="openshift-console/console-697d967997-2ps7z"
Sep 08 14:40:58.688439 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.688399    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083-console-serving-cert\") pod \"console-697d967997-2ps7z\" (UID: \"7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083\") " pod="openshift-console/console-697d967997-2ps7z"
Sep 08 14:40:58.688911 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.688897    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 08 14:40:58.689529 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.689513    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 08 14:40:58.690874 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.690862    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 08 14:40:58.692501 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.692488    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 08 14:40:58.704947 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.704925    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 08 14:40:58.705050 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.705032    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-697d967997-2ps7z"]
Sep 08 14:40:58.789595 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.789562    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083-console-oauth-config\") pod \"console-697d967997-2ps7z\" (UID: \"7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083\") " pod="openshift-console/console-697d967997-2ps7z"
Sep 08 14:40:58.789765 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.789610    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cmhr\" (UniqueName: \"kubernetes.io/projected/7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083-kube-api-access-2cmhr\") pod \"console-697d967997-2ps7z\" (UID: \"7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083\") " pod="openshift-console/console-697d967997-2ps7z"
Sep 08 14:40:58.789765 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.789634    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083-oauth-serving-cert\") pod \"console-697d967997-2ps7z\" (UID: \"7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083\") " pod="openshift-console/console-697d967997-2ps7z"
Sep 08 14:40:58.789765 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.789661    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083-console-config\") pod \"console-697d967997-2ps7z\" (UID: \"7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083\") " pod="openshift-console/console-697d967997-2ps7z"
Sep 08 14:40:58.789765 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.789682    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083-service-ca\") pod \"console-697d967997-2ps7z\" (UID: \"7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083\") " pod="openshift-console/console-697d967997-2ps7z"
Sep 08 14:40:58.789765 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.789696    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083-trusted-ca-bundle\") pod \"console-697d967997-2ps7z\" (UID: \"7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083\") " pod="openshift-console/console-697d967997-2ps7z"
Sep 08 14:40:58.789765 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.789727    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083-console-serving-cert\") pod \"console-697d967997-2ps7z\" (UID: \"7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083\") " pod="openshift-console/console-697d967997-2ps7z"
Sep 08 14:40:58.790560 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.790453    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083-oauth-serving-cert\") pod \"console-697d967997-2ps7z\" (UID: \"7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083\") " pod="openshift-console/console-697d967997-2ps7z"
Sep 08 14:40:58.790688 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.790615    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083-console-config\") pod \"console-697d967997-2ps7z\" (UID: \"7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083\") " pod="openshift-console/console-697d967997-2ps7z"
Sep 08 14:40:58.790756 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.790704    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083-trusted-ca-bundle\") pod \"console-697d967997-2ps7z\" (UID: \"7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083\") " pod="openshift-console/console-697d967997-2ps7z"
Sep 08 14:40:58.790840 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.790816    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083-service-ca\") pod \"console-697d967997-2ps7z\" (UID: \"7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083\") " pod="openshift-console/console-697d967997-2ps7z"
Sep 08 14:40:58.792338 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.792309    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083-console-oauth-config\") pod \"console-697d967997-2ps7z\" (UID: \"7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083\") " pod="openshift-console/console-697d967997-2ps7z"
Sep 08 14:40:58.792432 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.792420    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083-console-serving-cert\") pod \"console-697d967997-2ps7z\" (UID: \"7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083\") " pod="openshift-console/console-697d967997-2ps7z"
Sep 08 14:40:58.806262 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.806240    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cmhr\" (UniqueName: \"kubernetes.io/projected/7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083-kube-api-access-2cmhr\") pod \"console-697d967997-2ps7z\" (UID: \"7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083\") " pod="openshift-console/console-697d967997-2ps7z"
Sep 08 14:40:58.968145 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:58.968116    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-697d967997-2ps7z"
Sep 08 14:40:59.244178 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:59.244151    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-697d967997-2ps7z"]
Sep 08 14:40:59.245931 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:40:59.245907    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f16fb2c_fc2f_4ede_bb8b_7ed0b62d6083.slice/crio-d95292813618d121884f75cd7983f02f85af906903fb64e78a2dfaf0e2075dfd WatchSource:0}: Error finding container d95292813618d121884f75cd7983f02f85af906903fb64e78a2dfaf0e2075dfd: Status 404 returned error can't find the container with id d95292813618d121884f75cd7983f02f85af906903fb64e78a2dfaf0e2075dfd
Sep 08 14:40:59.330145 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:59.330095    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-697d967997-2ps7z" event={"ID":"7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083","Type":"ContainerStarted","Data":"d95292813618d121884f75cd7983f02f85af906903fb64e78a2dfaf0e2075dfd"}
Sep 08 14:40:59.909828 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:59.909793    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-8b7jr"]
Sep 08 14:40:59.913093 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:59.913073    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-8b7jr"
Sep 08 14:40:59.915871 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:59.915847    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-89p4v\""
Sep 08 14:40:59.923932 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:59.923913    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-8b7jr"]
Sep 08 14:40:59.998726 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:40:59.998688    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j5bg\" (UniqueName: \"kubernetes.io/projected/eb857e8d-ff78-4496-a152-70f78a7b96ee-kube-api-access-4j5bg\") pod \"authorino-operator-68d88948d8-8b7jr\" (UID: \"eb857e8d-ff78-4496-a152-70f78a7b96ee\") " pod="kuadrant-system/authorino-operator-68d88948d8-8b7jr"
Sep 08 14:41:00.099338 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:00.099303    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j5bg\" (UniqueName: \"kubernetes.io/projected/eb857e8d-ff78-4496-a152-70f78a7b96ee-kube-api-access-4j5bg\") pod \"authorino-operator-68d88948d8-8b7jr\" (UID: \"eb857e8d-ff78-4496-a152-70f78a7b96ee\") " pod="kuadrant-system/authorino-operator-68d88948d8-8b7jr"
Sep 08 14:41:00.108544 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:00.108515    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j5bg\" (UniqueName: \"kubernetes.io/projected/eb857e8d-ff78-4496-a152-70f78a7b96ee-kube-api-access-4j5bg\") pod \"authorino-operator-68d88948d8-8b7jr\" (UID: \"eb857e8d-ff78-4496-a152-70f78a7b96ee\") " pod="kuadrant-system/authorino-operator-68d88948d8-8b7jr"
Sep 08 14:41:00.224355 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:00.224281    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-8b7jr"
Sep 08 14:41:01.022648 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:01.022622    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 08 14:41:01.218921 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:01.218896    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-8b7jr"]
Sep 08 14:41:01.221464 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:41:01.221437    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb857e8d_ff78_4496_a152_70f78a7b96ee.slice/crio-92dd422813929606f2d0571b58385857f3617379e1f87a20a46afd2759229c73 WatchSource:0}: Error finding container 92dd422813929606f2d0571b58385857f3617379e1f87a20a46afd2759229c73: Status 404 returned error can't find the container with id 92dd422813929606f2d0571b58385857f3617379e1f87a20a46afd2759229c73
Sep 08 14:41:01.341925 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:01.341886    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-8b7jr" event={"ID":"eb857e8d-ff78-4496-a152-70f78a7b96ee","Type":"ContainerStarted","Data":"92dd422813929606f2d0571b58385857f3617379e1f87a20a46afd2759229c73"}
Sep 08 14:41:01.343594 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:01.343569    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-5t7wl" event={"ID":"ac3a9021-6fce-454d-b70a-1379acad35f8","Type":"ContainerStarted","Data":"41071be8c9c953af6471b6ef4fde609dc5964120ad74d9c246459735d7884727"}
Sep 08 14:41:01.343738 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:01.343648    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-5t7wl"
Sep 08 14:41:01.368455 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:01.368411    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-5t7wl" podStartSLOduration=1.3164652829999999 podStartE2EDuration="4.368397076s" totalImagesPullingTime="3.051931793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:40:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:41:01.365368368 +0000 UTC m=+422.403769290" watchObservedRunningTime="2026-09-08 14:41:01.368397076 +0000 UTC m=+422.406797999"
Sep 08 14:41:02.359342 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:02.359298    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4fjbt"]
Sep 08 14:41:02.363305 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:02.363285    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4fjbt"
Sep 08 14:41:02.367071 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:02.367054    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-46xz6\""
Sep 08 14:41:02.384162 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:02.384137    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4fjbt"]
Sep 08 14:41:02.418944 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:02.418918    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfr7m\" (UniqueName: \"kubernetes.io/projected/73a09e66-a53b-435f-9439-e1e1dc9da1ef-kube-api-access-zfr7m\") pod \"limitador-operator-controller-manager-6c549b6d85-4fjbt\" (UID: \"73a09e66-a53b-435f-9439-e1e1dc9da1ef\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4fjbt"
Sep 08 14:41:02.519582 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:02.519551    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfr7m\" (UniqueName: \"kubernetes.io/projected/73a09e66-a53b-435f-9439-e1e1dc9da1ef-kube-api-access-zfr7m\") pod \"limitador-operator-controller-manager-6c549b6d85-4fjbt\" (UID: \"73a09e66-a53b-435f-9439-e1e1dc9da1ef\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4fjbt"
Sep 08 14:41:02.537571 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:02.537546    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfr7m\" (UniqueName: \"kubernetes.io/projected/73a09e66-a53b-435f-9439-e1e1dc9da1ef-kube-api-access-zfr7m\") pod \"limitador-operator-controller-manager-6c549b6d85-4fjbt\" (UID: \"73a09e66-a53b-435f-9439-e1e1dc9da1ef\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4fjbt"
Sep 08 14:41:02.676220 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:02.676185    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4fjbt"
Sep 08 14:41:02.973659 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:02.973637    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4fjbt"]
Sep 08 14:41:02.975879 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:41:02.975855    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73a09e66_a53b_435f_9439_e1e1dc9da1ef.slice/crio-b0d847c427194257c12f380d87d9f6b3cd2a67ee735beebff582658d176a450b WatchSource:0}: Error finding container b0d847c427194257c12f380d87d9f6b3cd2a67ee735beebff582658d176a450b: Status 404 returned error can't find the container with id b0d847c427194257c12f380d87d9f6b3cd2a67ee735beebff582658d176a450b
Sep 08 14:41:03.357995 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:03.357900    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-8b7jr" event={"ID":"eb857e8d-ff78-4496-a152-70f78a7b96ee","Type":"ContainerStarted","Data":"e2dc82fe00b079f8b713409b5c6af37321146f961cc321a9fedf6d438d719a2b"}
Sep 08 14:41:03.357995 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:03.357963    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-8b7jr"
Sep 08 14:41:03.359174 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:03.359153    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4fjbt" event={"ID":"73a09e66-a53b-435f-9439-e1e1dc9da1ef","Type":"ContainerStarted","Data":"b0d847c427194257c12f380d87d9f6b3cd2a67ee735beebff582658d176a450b"}
Sep 08 14:41:03.392599 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:03.388036    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-8b7jr" podStartSLOduration=3.050996693 podStartE2EDuration="4.388009206s" totalImagesPullingTime="1.337012513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:40:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:41:03.385111908 +0000 UTC m=+424.423512832" watchObservedRunningTime="2026-09-08 14:41:03.388009206 +0000 UTC m=+424.426410130"
Sep 08 14:41:05.375129 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:05.375084    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4fjbt" event={"ID":"73a09e66-a53b-435f-9439-e1e1dc9da1ef","Type":"ContainerStarted","Data":"f00f1ae1199dd6a03956308c8564c16d60091cc94911b7bc1add503d3f532fc2"}
Sep 08 14:41:05.375580 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:05.375251    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4fjbt"
Sep 08 14:41:05.403721 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:05.403664    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4fjbt" podStartSLOduration=1.595045147 podStartE2EDuration="3.403646276s" totalImagesPullingTime="1.808601129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:41:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:41:05.402546944 +0000 UTC m=+426.440947879" watchObservedRunningTime="2026-09-08 14:41:05.403646276 +0000 UTC m=+426.442047198"
Sep 08 14:41:06.382338 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:06.382243    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-697d967997-2ps7z" event={"ID":"7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083","Type":"ContainerStarted","Data":"21cc8e53d19c2bc3ea2bdabb1e229f598a0f38411da6b878f0596138f711c8ad"}
Sep 08 14:41:06.404630 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:06.404584    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-697d967997-2ps7z" podStartSLOduration=1.660726896 podStartE2EDuration="8.40456882s" totalImagesPullingTime="6.743841924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:40:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:41:06.401885299 +0000 UTC m=+427.440286217" watchObservedRunningTime="2026-09-08 14:41:06.40456882 +0000 UTC m=+427.442969743"
Sep 08 14:41:07.838172 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:07.838138    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mc22h"]
Sep 08 14:41:07.841816 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:07.841794    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mc22h"
Sep 08 14:41:07.847473 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:07.847453    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qzljs\""
Sep 08 14:41:07.862078 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:07.862057    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mc22h"]
Sep 08 14:41:07.865988 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:07.865965    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b223979-5c2a-459a-8cc1-23d8c652522c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-mc22h\" (UID: \"6b223979-5c2a-459a-8cc1-23d8c652522c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mc22h"
Sep 08 14:41:07.866092 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:07.866010    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qzf7\" (UniqueName: \"kubernetes.io/projected/6b223979-5c2a-459a-8cc1-23d8c652522c-kube-api-access-5qzf7\") pod \"kuadrant-operator-controller-manager-58fc56757c-mc22h\" (UID: \"6b223979-5c2a-459a-8cc1-23d8c652522c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mc22h"
Sep 08 14:41:07.966857 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:07.966830    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b223979-5c2a-459a-8cc1-23d8c652522c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-mc22h\" (UID: \"6b223979-5c2a-459a-8cc1-23d8c652522c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mc22h"
Sep 08 14:41:07.966996 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:07.966864    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qzf7\" (UniqueName: \"kubernetes.io/projected/6b223979-5c2a-459a-8cc1-23d8c652522c-kube-api-access-5qzf7\") pod \"kuadrant-operator-controller-manager-58fc56757c-mc22h\" (UID: \"6b223979-5c2a-459a-8cc1-23d8c652522c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mc22h"
Sep 08 14:41:07.967253 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:07.967233    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b223979-5c2a-459a-8cc1-23d8c652522c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-mc22h\" (UID: \"6b223979-5c2a-459a-8cc1-23d8c652522c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mc22h"
Sep 08 14:41:07.984077 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:07.984056    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qzf7\" (UniqueName: \"kubernetes.io/projected/6b223979-5c2a-459a-8cc1-23d8c652522c-kube-api-access-5qzf7\") pod \"kuadrant-operator-controller-manager-58fc56757c-mc22h\" (UID: \"6b223979-5c2a-459a-8cc1-23d8c652522c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mc22h"
Sep 08 14:41:08.152650 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:08.152567    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mc22h"
Sep 08 14:41:08.433257 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:08.433227    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mc22h"]
Sep 08 14:41:08.434432 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:41:08.434405    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b223979_5c2a_459a_8cc1_23d8c652522c.slice/crio-3d79c37f1f49801d4151eede34487aea5988840fa80b4544e5f97d88feef88d6 WatchSource:0}: Error finding container 3d79c37f1f49801d4151eede34487aea5988840fa80b4544e5f97d88feef88d6: Status 404 returned error can't find the container with id 3d79c37f1f49801d4151eede34487aea5988840fa80b4544e5f97d88feef88d6
Sep 08 14:41:08.968523 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:08.968457    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-697d967997-2ps7z"
Sep 08 14:41:08.968955 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:08.968547    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-697d967997-2ps7z"
Sep 08 14:41:08.973404 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:08.973379    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-697d967997-2ps7z"
Sep 08 14:41:09.398878 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:09.398776    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mc22h" event={"ID":"6b223979-5c2a-459a-8cc1-23d8c652522c","Type":"ContainerStarted","Data":"3d79c37f1f49801d4151eede34487aea5988840fa80b4544e5f97d88feef88d6"}
Sep 08 14:41:09.403316 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:09.403288    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-697d967997-2ps7z"
Sep 08 14:41:12.352086 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:12.352054    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-5t7wl"
Sep 08 14:41:12.418031 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:12.417997    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mc22h" event={"ID":"6b223979-5c2a-459a-8cc1-23d8c652522c","Type":"ContainerStarted","Data":"ea2caaa20fd31e35355c1379fea1aa939c6f1b69a8638460643cc5bdac98b7dd"}
Sep 08 14:41:12.418181 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:12.418097    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mc22h"
Sep 08 14:41:12.440393 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:12.440350    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mc22h" podStartSLOduration=1.685345376 podStartE2EDuration="5.440334461s" totalImagesPullingTime="3.754989085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:41:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:41:12.438459118 +0000 UTC m=+433.476860040" watchObservedRunningTime="2026-09-08 14:41:12.440334461 +0000 UTC m=+433.478735384"
Sep 08 14:41:14.369882 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:14.369852    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-8b7jr"
Sep 08 14:41:14.663094 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:14.663060    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-5gtql"]
Sep 08 14:41:14.666861 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:14.666842    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-5gtql"
Sep 08 14:41:14.669551 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:14.669533    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 08 14:41:14.669640 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:14.669575    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vhn69\""
Sep 08 14:41:14.670051 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:14.670038    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 08 14:41:14.677414 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:14.677391    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-5gtql"]
Sep 08 14:41:14.725295 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:14.725267    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd1541de-0eee-4d92-9aeb-48bde9e40636-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-5gtql\" (UID: \"bd1541de-0eee-4d92-9aeb-48bde9e40636\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-5gtql"
Sep 08 14:41:14.725416 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:14.725316    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bd1541de-0eee-4d92-9aeb-48bde9e40636-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-5gtql\" (UID: \"bd1541de-0eee-4d92-9aeb-48bde9e40636\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-5gtql"
Sep 08 14:41:14.725460 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:14.725408    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp26w\" (UniqueName: \"kubernetes.io/projected/bd1541de-0eee-4d92-9aeb-48bde9e40636-kube-api-access-qp26w\") pod \"kuadrant-console-plugin-598f86468b-5gtql\" (UID: \"bd1541de-0eee-4d92-9aeb-48bde9e40636\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-5gtql"
Sep 08 14:41:14.826517 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:14.826485    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bd1541de-0eee-4d92-9aeb-48bde9e40636-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-5gtql\" (UID: \"bd1541de-0eee-4d92-9aeb-48bde9e40636\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-5gtql"
Sep 08 14:41:14.826692 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:14.826574    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp26w\" (UniqueName: \"kubernetes.io/projected/bd1541de-0eee-4d92-9aeb-48bde9e40636-kube-api-access-qp26w\") pod \"kuadrant-console-plugin-598f86468b-5gtql\" (UID: \"bd1541de-0eee-4d92-9aeb-48bde9e40636\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-5gtql"
Sep 08 14:41:14.826692 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:14.826628    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd1541de-0eee-4d92-9aeb-48bde9e40636-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-5gtql\" (UID: \"bd1541de-0eee-4d92-9aeb-48bde9e40636\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-5gtql"
Sep 08 14:41:14.826814 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:41:14.826751    2577 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Sep 08 14:41:14.826814 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:41:14.826809    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd1541de-0eee-4d92-9aeb-48bde9e40636-plugin-serving-cert podName:bd1541de-0eee-4d92-9aeb-48bde9e40636 nodeName:}" failed. No retries permitted until 2026-09-08 14:41:15.326791262 +0000 UTC m=+436.365192163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/bd1541de-0eee-4d92-9aeb-48bde9e40636-plugin-serving-cert") pod "kuadrant-console-plugin-598f86468b-5gtql" (UID: "bd1541de-0eee-4d92-9aeb-48bde9e40636") : secret "plugin-serving-cert" not found
Sep 08 14:41:14.827160 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:14.827141    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bd1541de-0eee-4d92-9aeb-48bde9e40636-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-5gtql\" (UID: \"bd1541de-0eee-4d92-9aeb-48bde9e40636\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-5gtql"
Sep 08 14:41:14.837544 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:14.837523    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp26w\" (UniqueName: \"kubernetes.io/projected/bd1541de-0eee-4d92-9aeb-48bde9e40636-kube-api-access-qp26w\") pod \"kuadrant-console-plugin-598f86468b-5gtql\" (UID: \"bd1541de-0eee-4d92-9aeb-48bde9e40636\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-5gtql"
Sep 08 14:41:15.330527 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:15.330494    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd1541de-0eee-4d92-9aeb-48bde9e40636-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-5gtql\" (UID: \"bd1541de-0eee-4d92-9aeb-48bde9e40636\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-5gtql"
Sep 08 14:41:15.332971 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:15.332942    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd1541de-0eee-4d92-9aeb-48bde9e40636-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-5gtql\" (UID: \"bd1541de-0eee-4d92-9aeb-48bde9e40636\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-5gtql"
Sep 08 14:41:15.576077 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:15.576036    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-5gtql"
Sep 08 14:41:15.849980 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:15.849953    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-5gtql"]
Sep 08 14:41:15.851153 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:41:15.851132    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd1541de_0eee_4d92_9aeb_48bde9e40636.slice/crio-4afb3193e7ff871b850526af4069cb0239a32aec3bbe3764942673349c54e79e WatchSource:0}: Error finding container 4afb3193e7ff871b850526af4069cb0239a32aec3bbe3764942673349c54e79e: Status 404 returned error can't find the container with id 4afb3193e7ff871b850526af4069cb0239a32aec3bbe3764942673349c54e79e
Sep 08 14:41:16.384710 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:16.384681    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4fjbt"
Sep 08 14:41:16.441718 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:16.441679    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-5gtql" event={"ID":"bd1541de-0eee-4d92-9aeb-48bde9e40636","Type":"ContainerStarted","Data":"4afb3193e7ff871b850526af4069cb0239a32aec3bbe3764942673349c54e79e"}
Sep 08 14:41:23.426604 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:23.426408    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mc22h"
Sep 08 14:41:24.556902 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:24.556859    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ks9m4"]
Sep 08 14:41:24.571093 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:24.571066    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ks9m4"
Sep 08 14:41:24.606691 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:24.606665    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ks9m4"]
Sep 08 14:41:24.711724 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:24.711687    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a1bcd2b-db5b-4030-969c-02057359c1d1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-ks9m4\" (UID: \"2a1bcd2b-db5b-4030-969c-02057359c1d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ks9m4"
Sep 08 14:41:24.711905 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:24.711740    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8bjn\" (UniqueName: \"kubernetes.io/projected/2a1bcd2b-db5b-4030-969c-02057359c1d1-kube-api-access-q8bjn\") pod \"kuadrant-operator-controller-manager-96db98c47-ks9m4\" (UID: \"2a1bcd2b-db5b-4030-969c-02057359c1d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ks9m4"
Sep 08 14:41:24.741192 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:24.741157    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ks9m4"]
Sep 08 14:41:24.741482 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:41:24.741444    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-q8bjn], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ks9m4" podUID="2a1bcd2b-db5b-4030-969c-02057359c1d1"
Sep 08 14:41:24.784166 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:24.784132    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8pttl"]
Sep 08 14:41:24.793079 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:24.793057    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8pttl"
Sep 08 14:41:24.805517 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:24.805495    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8pttl"]
Sep 08 14:41:24.812439 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:24.812390    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a1bcd2b-db5b-4030-969c-02057359c1d1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-ks9m4\" (UID: \"2a1bcd2b-db5b-4030-969c-02057359c1d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ks9m4"
Sep 08 14:41:24.812439 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:24.812432    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8bjn\" (UniqueName: \"kubernetes.io/projected/2a1bcd2b-db5b-4030-969c-02057359c1d1-kube-api-access-q8bjn\") pod \"kuadrant-operator-controller-manager-96db98c47-ks9m4\" (UID: \"2a1bcd2b-db5b-4030-969c-02057359c1d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ks9m4"
Sep 08 14:41:24.812743 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:24.812727    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a1bcd2b-db5b-4030-969c-02057359c1d1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-ks9m4\" (UID: \"2a1bcd2b-db5b-4030-969c-02057359c1d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ks9m4"
Sep 08 14:41:24.827634 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:24.827608    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8bjn\" (UniqueName: \"kubernetes.io/projected/2a1bcd2b-db5b-4030-969c-02057359c1d1-kube-api-access-q8bjn\") pod \"kuadrant-operator-controller-manager-96db98c47-ks9m4\" (UID: \"2a1bcd2b-db5b-4030-969c-02057359c1d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ks9m4"
Sep 08 14:41:24.913153 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:24.913115    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cqmk\" (UniqueName: \"kubernetes.io/projected/9f00e875-6cfc-4c72-84af-29ad184558e2-kube-api-access-4cqmk\") pod \"kuadrant-operator-controller-manager-6bd956ccf-8pttl\" (UID: \"9f00e875-6cfc-4c72-84af-29ad184558e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8pttl"
Sep 08 14:41:24.913306 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:24.913234    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f00e875-6cfc-4c72-84af-29ad184558e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-8pttl\" (UID: \"9f00e875-6cfc-4c72-84af-29ad184558e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8pttl"
Sep 08 14:41:25.014769 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.014724    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f00e875-6cfc-4c72-84af-29ad184558e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-8pttl\" (UID: \"9f00e875-6cfc-4c72-84af-29ad184558e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8pttl"
Sep 08 14:41:25.014950 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.014845    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cqmk\" (UniqueName: \"kubernetes.io/projected/9f00e875-6cfc-4c72-84af-29ad184558e2-kube-api-access-4cqmk\") pod \"kuadrant-operator-controller-manager-6bd956ccf-8pttl\" (UID: \"9f00e875-6cfc-4c72-84af-29ad184558e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8pttl"
Sep 08 14:41:25.015188 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.015162    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f00e875-6cfc-4c72-84af-29ad184558e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-8pttl\" (UID: \"9f00e875-6cfc-4c72-84af-29ad184558e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8pttl"
Sep 08 14:41:25.027503 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.027480    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cqmk\" (UniqueName: \"kubernetes.io/projected/9f00e875-6cfc-4c72-84af-29ad184558e2-kube-api-access-4cqmk\") pod \"kuadrant-operator-controller-manager-6bd956ccf-8pttl\" (UID: \"9f00e875-6cfc-4c72-84af-29ad184558e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8pttl"
Sep 08 14:41:25.103224 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.103128    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8pttl"
Sep 08 14:41:25.493680 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.493647    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ks9m4"
Sep 08 14:41:25.508101 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.508074    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ks9m4"
Sep 08 14:41:25.550565 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.550529    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mc22h"]
Sep 08 14:41:25.550755 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.550732    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mc22h" podUID="6b223979-5c2a-459a-8cc1-23d8c652522c" containerName="manager" containerID="cri-o://ea2caaa20fd31e35355c1379fea1aa939c6f1b69a8638460643cc5bdac98b7dd" gracePeriod=2
Sep 08 14:41:25.558938 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.558724    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mc22h"]
Sep 08 14:41:25.560849 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:41:25.560806    2577 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6b223979-5c2a-459a-8cc1-23d8c652522c\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-58fc56757c-mc22h\": pods \"kuadrant-operator-controller-manager-58fc56757c-mc22h\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mc22h"
Sep 08 14:41:25.582222 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.582198    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8pttl"]
Sep 08 14:41:25.591359 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.591331    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8pttl"]
Sep 08 14:41:25.608500 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.608446    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ks9m4"]
Sep 08 14:41:25.618228 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.618203    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-zhs4s"]
Sep 08 14:41:25.618673 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.618656    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b223979-5c2a-459a-8cc1-23d8c652522c" containerName="manager"
Sep 08 14:41:25.618759 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.618675    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b223979-5c2a-459a-8cc1-23d8c652522c" containerName="manager"
Sep 08 14:41:25.618759 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.618745    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b223979-5c2a-459a-8cc1-23d8c652522c" containerName="manager"
Sep 08 14:41:25.621443 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.621379    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a1bcd2b-db5b-4030-969c-02057359c1d1-extensions-socket-volume\") pod \"2a1bcd2b-db5b-4030-969c-02057359c1d1\" (UID: \"2a1bcd2b-db5b-4030-969c-02057359c1d1\") "
Sep 08 14:41:25.621443 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.621429    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8bjn\" (UniqueName: \"kubernetes.io/projected/2a1bcd2b-db5b-4030-969c-02057359c1d1-kube-api-access-q8bjn\") pod \"2a1bcd2b-db5b-4030-969c-02057359c1d1\" (UID: \"2a1bcd2b-db5b-4030-969c-02057359c1d1\") "
Sep 08 14:41:25.621826 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.621675    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-zhs4s"
Sep 08 14:41:25.621826 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.621756    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a1bcd2b-db5b-4030-969c-02057359c1d1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2a1bcd2b-db5b-4030-969c-02057359c1d1" (UID: "2a1bcd2b-db5b-4030-969c-02057359c1d1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:41:25.624423 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.624396    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a1bcd2b-db5b-4030-969c-02057359c1d1-kube-api-access-q8bjn" (OuterVolumeSpecName: "kube-api-access-q8bjn") pod "2a1bcd2b-db5b-4030-969c-02057359c1d1" (UID: "2a1bcd2b-db5b-4030-969c-02057359c1d1"). InnerVolumeSpecName "kube-api-access-q8bjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:41:25.625098 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.625074    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ks9m4"]
Sep 08 14:41:25.638933 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.637147    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4fjbt"]
Sep 08 14:41:25.638933 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.637376    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4fjbt" podUID="73a09e66-a53b-435f-9439-e1e1dc9da1ef" containerName="manager" containerID="cri-o://f00f1ae1199dd6a03956308c8564c16d60091cc94911b7bc1add503d3f532fc2" gracePeriod=2
Sep 08 14:41:25.640137 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.640099    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-zhs4s"]
Sep 08 14:41:25.652870 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.652642    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4fjbt"]
Sep 08 14:41:25.665817 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:41:25.665688    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-mc22h\" is forbidden: User \"system:node:ip-10-0-142-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-20.ec2.internal' and this object" podUID="6b223979-5c2a-459a-8cc1-23d8c652522c" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mc22h"
Sep 08 14:41:25.667866 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:41:25.667838    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-mc22h\" is forbidden: User \"system:node:ip-10-0-142-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-20.ec2.internal' and this object" podUID="6b223979-5c2a-459a-8cc1-23d8c652522c" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mc22h"
Sep 08 14:41:25.668001 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.667984    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jqd5j"]
Sep 08 14:41:25.668314 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.668302    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73a09e66-a53b-435f-9439-e1e1dc9da1ef" containerName="manager"
Sep 08 14:41:25.668351 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.668319    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="73a09e66-a53b-435f-9439-e1e1dc9da1ef" containerName="manager"
Sep 08 14:41:25.668395 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.668385    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="73a09e66-a53b-435f-9439-e1e1dc9da1ef" containerName="manager"
Sep 08 14:41:25.669911 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:41:25.669892    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-4fjbt\" is forbidden: User \"system:node:ip-10-0-142-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-20.ec2.internal' and this object" podUID="73a09e66-a53b-435f-9439-e1e1dc9da1ef" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4fjbt"
Sep 08 14:41:25.671368 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.671350    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jqd5j"
Sep 08 14:41:25.673695 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:41:25.673670    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-4fjbt\" is forbidden: User \"system:node:ip-10-0-142-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-20.ec2.internal' and this object" podUID="73a09e66-a53b-435f-9439-e1e1dc9da1ef" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4fjbt"
Sep 08 14:41:25.675855 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:41:25.675825    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-mc22h\" is forbidden: User \"system:node:ip-10-0-142-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-20.ec2.internal' and this object" podUID="6b223979-5c2a-459a-8cc1-23d8c652522c" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mc22h"
Sep 08 14:41:25.685580 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.685556    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jqd5j"]
Sep 08 14:41:25.722182 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.722145    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bd296b4-e448-4905-9eff-13e7411546f6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-zhs4s\" (UID: \"3bd296b4-e448-4905-9eff-13e7411546f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-zhs4s"
Sep 08 14:41:25.722349 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.722263    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qzns\" (UniqueName: \"kubernetes.io/projected/3bd296b4-e448-4905-9eff-13e7411546f6-kube-api-access-8qzns\") pod \"kuadrant-operator-controller-manager-6bd956ccf-zhs4s\" (UID: \"3bd296b4-e448-4905-9eff-13e7411546f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-zhs4s"
Sep 08 14:41:25.722349 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.722305    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a1bcd2b-db5b-4030-969c-02057359c1d1-extensions-socket-volume\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:41:25.722349 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.722319    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8bjn\" (UniqueName: \"kubernetes.io/projected/2a1bcd2b-db5b-4030-969c-02057359c1d1-kube-api-access-q8bjn\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:41:25.823213 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.823139    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42vjv\" (UniqueName: \"kubernetes.io/projected/093e1b2b-bab0-46b9-8f74-9928cbbf0a8d-kube-api-access-42vjv\") pod \"limitador-operator-controller-manager-6c549b6d85-jqd5j\" (UID: \"093e1b2b-bab0-46b9-8f74-9928cbbf0a8d\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jqd5j"
Sep 08 14:41:25.823338 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.823222    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qzns\" (UniqueName: \"kubernetes.io/projected/3bd296b4-e448-4905-9eff-13e7411546f6-kube-api-access-8qzns\") pod \"kuadrant-operator-controller-manager-6bd956ccf-zhs4s\" (UID: \"3bd296b4-e448-4905-9eff-13e7411546f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-zhs4s"
Sep 08 14:41:25.823338 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.823273    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bd296b4-e448-4905-9eff-13e7411546f6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-zhs4s\" (UID: \"3bd296b4-e448-4905-9eff-13e7411546f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-zhs4s"
Sep 08 14:41:25.823671 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.823647    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bd296b4-e448-4905-9eff-13e7411546f6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-zhs4s\" (UID: \"3bd296b4-e448-4905-9eff-13e7411546f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-zhs4s"
Sep 08 14:41:25.833128 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.833100    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qzns\" (UniqueName: \"kubernetes.io/projected/3bd296b4-e448-4905-9eff-13e7411546f6-kube-api-access-8qzns\") pod \"kuadrant-operator-controller-manager-6bd956ccf-zhs4s\" (UID: \"3bd296b4-e448-4905-9eff-13e7411546f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-zhs4s"
Sep 08 14:41:25.924750 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.924719    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42vjv\" (UniqueName: \"kubernetes.io/projected/093e1b2b-bab0-46b9-8f74-9928cbbf0a8d-kube-api-access-42vjv\") pod \"limitador-operator-controller-manager-6c549b6d85-jqd5j\" (UID: \"093e1b2b-bab0-46b9-8f74-9928cbbf0a8d\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jqd5j"
Sep 08 14:41:25.935834 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.935811    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42vjv\" (UniqueName: \"kubernetes.io/projected/093e1b2b-bab0-46b9-8f74-9928cbbf0a8d-kube-api-access-42vjv\") pod \"limitador-operator-controller-manager-6c549b6d85-jqd5j\" (UID: \"093e1b2b-bab0-46b9-8f74-9928cbbf0a8d\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jqd5j"
Sep 08 14:41:25.957323 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.957254    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-zhs4s"
Sep 08 14:41:25.963222 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.963204    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mc22h"
Sep 08 14:41:25.965810 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:41:25.965783    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-4fjbt\" is forbidden: User \"system:node:ip-10-0-142-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-20.ec2.internal' and this object" podUID="73a09e66-a53b-435f-9439-e1e1dc9da1ef" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4fjbt"
Sep 08 14:41:25.967088 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:25.967069    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4fjbt"
Sep 08 14:41:25.967980 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:41:25.967954    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-mc22h\" is forbidden: User \"system:node:ip-10-0-142-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-20.ec2.internal' and this object" podUID="6b223979-5c2a-459a-8cc1-23d8c652522c" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mc22h"
Sep 08 14:41:25.970292 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:41:25.970269    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-4fjbt\" is forbidden: User \"system:node:ip-10-0-142-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-20.ec2.internal' and this object" podUID="73a09e66-a53b-435f-9439-e1e1dc9da1ef" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4fjbt"
Sep 08 14:41:25.972412 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:41:25.972389    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-mc22h\" is forbidden: User \"system:node:ip-10-0-142-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-20.ec2.internal' and this object" podUID="6b223979-5c2a-459a-8cc1-23d8c652522c" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mc22h"
Sep 08 14:41:26.026062 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.026002    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b223979-5c2a-459a-8cc1-23d8c652522c-extensions-socket-volume\") pod \"6b223979-5c2a-459a-8cc1-23d8c652522c\" (UID: \"6b223979-5c2a-459a-8cc1-23d8c652522c\") "
Sep 08 14:41:26.026191 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.026075    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qzf7\" (UniqueName: \"kubernetes.io/projected/6b223979-5c2a-459a-8cc1-23d8c652522c-kube-api-access-5qzf7\") pod \"6b223979-5c2a-459a-8cc1-23d8c652522c\" (UID: \"6b223979-5c2a-459a-8cc1-23d8c652522c\") "
Sep 08 14:41:26.026191 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.026144    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfr7m\" (UniqueName: \"kubernetes.io/projected/73a09e66-a53b-435f-9439-e1e1dc9da1ef-kube-api-access-zfr7m\") pod \"73a09e66-a53b-435f-9439-e1e1dc9da1ef\" (UID: \"73a09e66-a53b-435f-9439-e1e1dc9da1ef\") "
Sep 08 14:41:26.026462 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.026438    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b223979-5c2a-459a-8cc1-23d8c652522c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6b223979-5c2a-459a-8cc1-23d8c652522c" (UID: "6b223979-5c2a-459a-8cc1-23d8c652522c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:41:26.026877 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.026793    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jqd5j"
Sep 08 14:41:26.029732 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.029710    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73a09e66-a53b-435f-9439-e1e1dc9da1ef-kube-api-access-zfr7m" (OuterVolumeSpecName: "kube-api-access-zfr7m") pod "73a09e66-a53b-435f-9439-e1e1dc9da1ef" (UID: "73a09e66-a53b-435f-9439-e1e1dc9da1ef"). InnerVolumeSpecName "kube-api-access-zfr7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:41:26.029827 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.029802    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b223979-5c2a-459a-8cc1-23d8c652522c-kube-api-access-5qzf7" (OuterVolumeSpecName: "kube-api-access-5qzf7") pod "6b223979-5c2a-459a-8cc1-23d8c652522c" (UID: "6b223979-5c2a-459a-8cc1-23d8c652522c"). InnerVolumeSpecName "kube-api-access-5qzf7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:41:26.127259 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.127228    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfr7m\" (UniqueName: \"kubernetes.io/projected/73a09e66-a53b-435f-9439-e1e1dc9da1ef-kube-api-access-zfr7m\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:41:26.127259 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.127255    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b223979-5c2a-459a-8cc1-23d8c652522c-extensions-socket-volume\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:41:26.127436 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.127272    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qzf7\" (UniqueName: \"kubernetes.io/projected/6b223979-5c2a-459a-8cc1-23d8c652522c-kube-api-access-5qzf7\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:41:26.250104 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.250079    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-zhs4s"]
Sep 08 14:41:26.252202 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:41:26.252174    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bd296b4_e448_4905_9eff_13e7411546f6.slice/crio-27d932b3e7cad6d1136ea900c773e77945fea44ff8eb328d89f4b80115b64caf WatchSource:0}: Error finding container 27d932b3e7cad6d1136ea900c773e77945fea44ff8eb328d89f4b80115b64caf: Status 404 returned error can't find the container with id 27d932b3e7cad6d1136ea900c773e77945fea44ff8eb328d89f4b80115b64caf
Sep 08 14:41:26.303226 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.303205    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jqd5j"]
Sep 08 14:41:26.309439 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:41:26.309414    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod093e1b2b_bab0_46b9_8f74_9928cbbf0a8d.slice/crio-83a9a33243fcd856402c13c7c171915b1a4b790c5839102cf708758ef5fdd00c WatchSource:0}: Error finding container 83a9a33243fcd856402c13c7c171915b1a4b790c5839102cf708758ef5fdd00c: Status 404 returned error can't find the container with id 83a9a33243fcd856402c13c7c171915b1a4b790c5839102cf708758ef5fdd00c
Sep 08 14:41:26.503106 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.503058    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-zhs4s" event={"ID":"3bd296b4-e448-4905-9eff-13e7411546f6","Type":"ContainerStarted","Data":"ce37c7eff2a35b0fddffd296d71ee6244dabac11e93b453414312d89b690e35f"}
Sep 08 14:41:26.503301 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.503118    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-zhs4s" event={"ID":"3bd296b4-e448-4905-9eff-13e7411546f6","Type":"ContainerStarted","Data":"27d932b3e7cad6d1136ea900c773e77945fea44ff8eb328d89f4b80115b64caf"}
Sep 08 14:41:26.503301 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.503145    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-zhs4s"
Sep 08 14:41:26.504397 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.504378    2577 generic.go:356] "Generic (PLEG): container finished" podID="6b223979-5c2a-459a-8cc1-23d8c652522c" containerID="ea2caaa20fd31e35355c1379fea1aa939c6f1b69a8638460643cc5bdac98b7dd" exitCode=0
Sep 08 14:41:26.504491 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.504412    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mc22h"
Sep 08 14:41:26.504553 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.504500    2577 scope.go:117] "RemoveContainer" containerID="ea2caaa20fd31e35355c1379fea1aa939c6f1b69a8638460643cc5bdac98b7dd"
Sep 08 14:41:26.505890 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:41:26.505869    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-mc22h\" is forbidden: User \"system:node:ip-10-0-142-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-20.ec2.internal' and this object" podUID="6b223979-5c2a-459a-8cc1-23d8c652522c" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mc22h"
Sep 08 14:41:26.506739 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.506694    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-5gtql" event={"ID":"bd1541de-0eee-4d92-9aeb-48bde9e40636","Type":"ContainerStarted","Data":"26cf1dc75bd2250d05da8e0f3400af90bb369809cb2b4557f7e806b69410f2f7"}
Sep 08 14:41:26.507914 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:41:26.507885    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-4fjbt\" is forbidden: User \"system:node:ip-10-0-142-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-20.ec2.internal' and this object" podUID="73a09e66-a53b-435f-9439-e1e1dc9da1ef" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4fjbt"
Sep 08 14:41:26.508332 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.508245    2577 generic.go:356] "Generic (PLEG): container finished" podID="73a09e66-a53b-435f-9439-e1e1dc9da1ef" containerID="f00f1ae1199dd6a03956308c8564c16d60091cc94911b7bc1add503d3f532fc2" exitCode=0
Sep 08 14:41:26.508332 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.508288    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4fjbt"
Sep 08 14:41:26.511501 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.510729    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ks9m4"
Sep 08 14:41:26.511501 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.510727    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jqd5j" event={"ID":"093e1b2b-bab0-46b9-8f74-9928cbbf0a8d","Type":"ContainerStarted","Data":"ab17c71a60308dd15e16ed502c8a5ca5cab213a35d4523facfb6b7506c1621fa"}
Sep 08 14:41:26.511501 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.510854    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jqd5j" event={"ID":"093e1b2b-bab0-46b9-8f74-9928cbbf0a8d","Type":"ContainerStarted","Data":"83a9a33243fcd856402c13c7c171915b1a4b790c5839102cf708758ef5fdd00c"}
Sep 08 14:41:26.515166 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.515138    2577 scope.go:117] "RemoveContainer" containerID="ea2caaa20fd31e35355c1379fea1aa939c6f1b69a8638460643cc5bdac98b7dd"
Sep 08 14:41:26.515516 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:41:26.515460    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea2caaa20fd31e35355c1379fea1aa939c6f1b69a8638460643cc5bdac98b7dd\": container with ID starting with ea2caaa20fd31e35355c1379fea1aa939c6f1b69a8638460643cc5bdac98b7dd not found: ID does not exist" containerID="ea2caaa20fd31e35355c1379fea1aa939c6f1b69a8638460643cc5bdac98b7dd"
Sep 08 14:41:26.515669 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.515640    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea2caaa20fd31e35355c1379fea1aa939c6f1b69a8638460643cc5bdac98b7dd"} err="failed to get container status \"ea2caaa20fd31e35355c1379fea1aa939c6f1b69a8638460643cc5bdac98b7dd\": rpc error: code = NotFound desc = could not find container \"ea2caaa20fd31e35355c1379fea1aa939c6f1b69a8638460643cc5bdac98b7dd\": container with ID starting with ea2caaa20fd31e35355c1379fea1aa939c6f1b69a8638460643cc5bdac98b7dd not found: ID does not exist"
Sep 08 14:41:26.515669 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.515670    2577 scope.go:117] "RemoveContainer" containerID="f00f1ae1199dd6a03956308c8564c16d60091cc94911b7bc1add503d3f532fc2"
Sep 08 14:41:26.525411 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.525388    2577 scope.go:117] "RemoveContainer" containerID="f00f1ae1199dd6a03956308c8564c16d60091cc94911b7bc1add503d3f532fc2"
Sep 08 14:41:26.525737 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:41:26.525720    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f00f1ae1199dd6a03956308c8564c16d60091cc94911b7bc1add503d3f532fc2\": container with ID starting with f00f1ae1199dd6a03956308c8564c16d60091cc94911b7bc1add503d3f532fc2 not found: ID does not exist" containerID="f00f1ae1199dd6a03956308c8564c16d60091cc94911b7bc1add503d3f532fc2"
Sep 08 14:41:26.525807 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.525746    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f00f1ae1199dd6a03956308c8564c16d60091cc94911b7bc1add503d3f532fc2"} err="failed to get container status \"f00f1ae1199dd6a03956308c8564c16d60091cc94911b7bc1add503d3f532fc2\": rpc error: code = NotFound desc = could not find container \"f00f1ae1199dd6a03956308c8564c16d60091cc94911b7bc1add503d3f532fc2\": container with ID starting with f00f1ae1199dd6a03956308c8564c16d60091cc94911b7bc1add503d3f532fc2 not found: ID does not exist"
Sep 08 14:41:26.539768 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.539697    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-zhs4s" podStartSLOduration=1.539683272 podStartE2EDuration="1.539683272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:41:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:41:26.537115763 +0000 UTC m=+447.575516687" watchObservedRunningTime="2026-09-08 14:41:26.539683272 +0000 UTC m=+447.578084195"
Sep 08 14:41:26.564598 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:41:26.564568    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-ks9m4\" is forbidden: User \"system:node:ip-10-0-142-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-20.ec2.internal' and this object" podUID="2a1bcd2b-db5b-4030-969c-02057359c1d1" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-ks9m4"
Sep 08 14:41:26.566627 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:41:26.566608    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-4fjbt\" is forbidden: User \"system:node:ip-10-0-142-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-20.ec2.internal' and this object" podUID="73a09e66-a53b-435f-9439-e1e1dc9da1ef" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4fjbt"
Sep 08 14:41:26.568664 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:41:26.568625    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-mc22h\" is forbidden: User \"system:node:ip-10-0-142-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-20.ec2.internal' and this object" podUID="6b223979-5c2a-459a-8cc1-23d8c652522c" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mc22h"
Sep 08 14:41:26.589487 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.589424    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jqd5j" podStartSLOduration=1.5894080910000001 podStartE2EDuration="1.589408091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:41:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:41:26.587043993 +0000 UTC m=+447.625444930" watchObservedRunningTime="2026-09-08 14:41:26.589408091 +0000 UTC m=+447.627809014"
Sep 08 14:41:26.589594 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:26.589527    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-5gtql" podStartSLOduration=2.586986525 podStartE2EDuration="12.589520192s" totalImagesPullingTime="10.002533667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:41:26.56264133 +0000 UTC m=+447.601042252" watchObservedRunningTime="2026-09-08 14:41:26.589520192 +0000 UTC m=+447.627921114"
Sep 08 14:41:27.490005 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:27.489960    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a1bcd2b-db5b-4030-969c-02057359c1d1" path="/var/lib/kubelet/pods/2a1bcd2b-db5b-4030-969c-02057359c1d1/volumes"
Sep 08 14:41:27.490285 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:27.490267    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b223979-5c2a-459a-8cc1-23d8c652522c" path="/var/lib/kubelet/pods/6b223979-5c2a-459a-8cc1-23d8c652522c/volumes"
Sep 08 14:41:27.490650 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:27.490630    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73a09e66-a53b-435f-9439-e1e1dc9da1ef" path="/var/lib/kubelet/pods/73a09e66-a53b-435f-9439-e1e1dc9da1ef/volumes"
Sep 08 14:41:27.517292 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:27.517270    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jqd5j"
Sep 08 14:41:28.300261 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:41:28.300227    2577 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6bd956ccf-8pttl_kuadrant-system_9f00e875-6cfc-4c72-84af-29ad184558e2_0(c0cd730a85d5917c195b4319e9ea2ed69c1ce66b8b3c8f3de869085a73f363ea): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6bd956ccf-8pttl to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Sep 08 14:41:28.300591 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:41:28.300290    2577 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6bd956ccf-8pttl_kuadrant-system_9f00e875-6cfc-4c72-84af-29ad184558e2_0(c0cd730a85d5917c195b4319e9ea2ed69c1ce66b8b3c8f3de869085a73f363ea): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6bd956ccf-8pttl to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8pttl"
Sep 08 14:41:28.522243 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:28.522204    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8pttl"
Sep 08 14:41:28.530293 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:28.530269    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8pttl"
Sep 08 14:41:28.532678 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:41:28.532655    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-8pttl\" is forbidden: User \"system:node:ip-10-0-142-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-20.ec2.internal' and this object" podUID="9f00e875-6cfc-4c72-84af-29ad184558e2" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8pttl"
Sep 08 14:41:28.646678 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:28.646604    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cqmk\" (UniqueName: \"kubernetes.io/projected/9f00e875-6cfc-4c72-84af-29ad184558e2-kube-api-access-4cqmk\") pod \"9f00e875-6cfc-4c72-84af-29ad184558e2\" (UID: \"9f00e875-6cfc-4c72-84af-29ad184558e2\") "
Sep 08 14:41:28.646678 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:28.646633    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f00e875-6cfc-4c72-84af-29ad184558e2-extensions-socket-volume\") pod \"9f00e875-6cfc-4c72-84af-29ad184558e2\" (UID: \"9f00e875-6cfc-4c72-84af-29ad184558e2\") "
Sep 08 14:41:28.646942 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:28.646912    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f00e875-6cfc-4c72-84af-29ad184558e2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9f00e875-6cfc-4c72-84af-29ad184558e2" (UID: "9f00e875-6cfc-4c72-84af-29ad184558e2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:41:28.648827 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:28.648805    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f00e875-6cfc-4c72-84af-29ad184558e2-kube-api-access-4cqmk" (OuterVolumeSpecName: "kube-api-access-4cqmk") pod "9f00e875-6cfc-4c72-84af-29ad184558e2" (UID: "9f00e875-6cfc-4c72-84af-29ad184558e2"). InnerVolumeSpecName "kube-api-access-4cqmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:41:28.747935 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:28.747908    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cqmk\" (UniqueName: \"kubernetes.io/projected/9f00e875-6cfc-4c72-84af-29ad184558e2-kube-api-access-4cqmk\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:41:28.747935 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:28.747930    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f00e875-6cfc-4c72-84af-29ad184558e2-extensions-socket-volume\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:41:29.489347 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:41:29.489312    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-8pttl\" is forbidden: User \"system:node:ip-10-0-142-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-20.ec2.internal' and this object" podUID="9f00e875-6cfc-4c72-84af-29ad184558e2" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8pttl"
Sep 08 14:41:29.490277 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:29.490255    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f00e875-6cfc-4c72-84af-29ad184558e2" path="/var/lib/kubelet/pods/9f00e875-6cfc-4c72-84af-29ad184558e2/volumes"
Sep 08 14:41:29.526952 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:29.526925    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8pttl"
Sep 08 14:41:29.531020 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:41:29.530997    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-8pttl\" is forbidden: User \"system:node:ip-10-0-142-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-20.ec2.internal' and this object" podUID="9f00e875-6cfc-4c72-84af-29ad184558e2" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8pttl"
Sep 08 14:41:37.519520 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:37.519490    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-zhs4s"
Sep 08 14:41:37.791627 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:37.791539    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xbflb"]
Sep 08 14:41:37.879107 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:37.879077    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xbflb"]
Sep 08 14:41:37.879253 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:37.879169    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xbflb"
Sep 08 14:41:38.028296 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:38.028265    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9xx8\" (UniqueName: \"kubernetes.io/projected/af1a4809-ced8-4c84-a301-0fd06e5965ce-kube-api-access-h9xx8\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-xbflb\" (UID: \"af1a4809-ced8-4c84-a301-0fd06e5965ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xbflb"
Sep 08 14:41:38.028458 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:38.028307    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/af1a4809-ced8-4c84-a301-0fd06e5965ce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-xbflb\" (UID: \"af1a4809-ced8-4c84-a301-0fd06e5965ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xbflb"
Sep 08 14:41:38.129617 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:38.129588    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9xx8\" (UniqueName: \"kubernetes.io/projected/af1a4809-ced8-4c84-a301-0fd06e5965ce-kube-api-access-h9xx8\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-xbflb\" (UID: \"af1a4809-ced8-4c84-a301-0fd06e5965ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xbflb"
Sep 08 14:41:38.129705 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:38.129640    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/af1a4809-ced8-4c84-a301-0fd06e5965ce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-xbflb\" (UID: \"af1a4809-ced8-4c84-a301-0fd06e5965ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xbflb"
Sep 08 14:41:38.130049 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:38.130031    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/af1a4809-ced8-4c84-a301-0fd06e5965ce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-xbflb\" (UID: \"af1a4809-ced8-4c84-a301-0fd06e5965ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xbflb"
Sep 08 14:41:38.141844 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:38.141818    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9xx8\" (UniqueName: \"kubernetes.io/projected/af1a4809-ced8-4c84-a301-0fd06e5965ce-kube-api-access-h9xx8\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-xbflb\" (UID: \"af1a4809-ced8-4c84-a301-0fd06e5965ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xbflb"
Sep 08 14:41:38.191759 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:38.191735    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xbflb"
Sep 08 14:41:38.482293 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:38.482270    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xbflb"]
Sep 08 14:41:38.483905 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:41:38.483874    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf1a4809_ced8_4c84_a301_0fd06e5965ce.slice/crio-45da89e75538b533a048ac7936a3748ac331b8ae4b7b6f0d225109d2672dfa11 WatchSource:0}: Error finding container 45da89e75538b533a048ac7936a3748ac331b8ae4b7b6f0d225109d2672dfa11: Status 404 returned error can't find the container with id 45da89e75538b533a048ac7936a3748ac331b8ae4b7b6f0d225109d2672dfa11
Sep 08 14:41:38.525254 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:38.525232    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jqd5j"
Sep 08 14:41:38.575174 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:38.575145    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xbflb" event={"ID":"af1a4809-ced8-4c84-a301-0fd06e5965ce","Type":"ContainerStarted","Data":"4b834e019a3a82b9b9359a1b50d3ff08ce1942756bc653e820c64b1ee544e276"}
Sep 08 14:41:38.575315 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:38.575194    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xbflb" event={"ID":"af1a4809-ced8-4c84-a301-0fd06e5965ce","Type":"ContainerStarted","Data":"45da89e75538b533a048ac7936a3748ac331b8ae4b7b6f0d225109d2672dfa11"}
Sep 08 14:41:38.575315 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:38.575215    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xbflb"
Sep 08 14:41:38.600277 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:38.600222    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xbflb" podStartSLOduration=1.600200011 podStartE2EDuration="1.600200011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:41:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:41:38.59698481 +0000 UTC m=+459.635385737" watchObservedRunningTime="2026-09-08 14:41:38.600200011 +0000 UTC m=+459.638600934"
Sep 08 14:41:49.581618 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:49.581592    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xbflb"
Sep 08 14:41:49.636653 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:49.636626    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-zhs4s"]
Sep 08 14:41:49.636872 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:49.636827    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-zhs4s" podUID="3bd296b4-e448-4905-9eff-13e7411546f6" containerName="manager" containerID="cri-o://ce37c7eff2a35b0fddffd296d71ee6244dabac11e93b453414312d89b690e35f" gracePeriod=10
Sep 08 14:41:49.878868 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:49.878847    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-zhs4s"
Sep 08 14:41:50.030768 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:50.030743    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bd296b4-e448-4905-9eff-13e7411546f6-extensions-socket-volume\") pod \"3bd296b4-e448-4905-9eff-13e7411546f6\" (UID: \"3bd296b4-e448-4905-9eff-13e7411546f6\") "
Sep 08 14:41:50.030768 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:50.030771    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qzns\" (UniqueName: \"kubernetes.io/projected/3bd296b4-e448-4905-9eff-13e7411546f6-kube-api-access-8qzns\") pod \"3bd296b4-e448-4905-9eff-13e7411546f6\" (UID: \"3bd296b4-e448-4905-9eff-13e7411546f6\") "
Sep 08 14:41:50.031140 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:50.031118    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bd296b4-e448-4905-9eff-13e7411546f6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3bd296b4-e448-4905-9eff-13e7411546f6" (UID: "3bd296b4-e448-4905-9eff-13e7411546f6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:41:50.032963 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:50.032938    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bd296b4-e448-4905-9eff-13e7411546f6-kube-api-access-8qzns" (OuterVolumeSpecName: "kube-api-access-8qzns") pod "3bd296b4-e448-4905-9eff-13e7411546f6" (UID: "3bd296b4-e448-4905-9eff-13e7411546f6"). InnerVolumeSpecName "kube-api-access-8qzns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:41:50.131974 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:50.131902    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bd296b4-e448-4905-9eff-13e7411546f6-extensions-socket-volume\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:41:50.131974 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:50.131937    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qzns\" (UniqueName: \"kubernetes.io/projected/3bd296b4-e448-4905-9eff-13e7411546f6-kube-api-access-8qzns\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:41:50.642796 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:50.642759    2577 generic.go:356] "Generic (PLEG): container finished" podID="3bd296b4-e448-4905-9eff-13e7411546f6" containerID="ce37c7eff2a35b0fddffd296d71ee6244dabac11e93b453414312d89b690e35f" exitCode=0
Sep 08 14:41:50.643173 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:50.642809    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-zhs4s"
Sep 08 14:41:50.643173 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:50.642814    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-zhs4s" event={"ID":"3bd296b4-e448-4905-9eff-13e7411546f6","Type":"ContainerDied","Data":"ce37c7eff2a35b0fddffd296d71ee6244dabac11e93b453414312d89b690e35f"}
Sep 08 14:41:50.643173 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:50.642946    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-zhs4s" event={"ID":"3bd296b4-e448-4905-9eff-13e7411546f6","Type":"ContainerDied","Data":"27d932b3e7cad6d1136ea900c773e77945fea44ff8eb328d89f4b80115b64caf"}
Sep 08 14:41:50.643173 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:50.642981    2577 scope.go:117] "RemoveContainer" containerID="ce37c7eff2a35b0fddffd296d71ee6244dabac11e93b453414312d89b690e35f"
Sep 08 14:41:50.654106 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:50.654090    2577 scope.go:117] "RemoveContainer" containerID="ce37c7eff2a35b0fddffd296d71ee6244dabac11e93b453414312d89b690e35f"
Sep 08 14:41:50.654545 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:41:50.654519    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce37c7eff2a35b0fddffd296d71ee6244dabac11e93b453414312d89b690e35f\": container with ID starting with ce37c7eff2a35b0fddffd296d71ee6244dabac11e93b453414312d89b690e35f not found: ID does not exist" containerID="ce37c7eff2a35b0fddffd296d71ee6244dabac11e93b453414312d89b690e35f"
Sep 08 14:41:50.654600 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:50.654557    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce37c7eff2a35b0fddffd296d71ee6244dabac11e93b453414312d89b690e35f"} err="failed to get container status \"ce37c7eff2a35b0fddffd296d71ee6244dabac11e93b453414312d89b690e35f\": rpc error: code = NotFound desc = could not find container \"ce37c7eff2a35b0fddffd296d71ee6244dabac11e93b453414312d89b690e35f\": container with ID starting with ce37c7eff2a35b0fddffd296d71ee6244dabac11e93b453414312d89b690e35f not found: ID does not exist"
Sep 08 14:41:50.668452 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:50.668429    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-zhs4s"]
Sep 08 14:41:50.674589 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:50.674571    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-zhs4s"]
Sep 08 14:41:51.495034 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:41:51.495000    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bd296b4-e448-4905-9eff-13e7411546f6" path="/var/lib/kubelet/pods/3bd296b4-e448-4905-9eff-13e7411546f6/volumes"
Sep 08 14:42:11.046850 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:11.046816    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-fkrx5"]
Sep 08 14:42:11.047287 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:11.047153    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bd296b4-e448-4905-9eff-13e7411546f6" containerName="manager"
Sep 08 14:42:11.047287 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:11.047163    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bd296b4-e448-4905-9eff-13e7411546f6" containerName="manager"
Sep 08 14:42:11.047287 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:11.047214    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bd296b4-e448-4905-9eff-13e7411546f6" containerName="manager"
Sep 08 14:42:11.074104 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:11.074072    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-fkrx5"]
Sep 08 14:42:11.074253 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:11.074183    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-fkrx5"
Sep 08 14:42:11.076982 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:11.076949    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 08 14:42:11.137880 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:11.137852    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-fkrx5"]
Sep 08 14:42:11.200659 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:11.200631    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8e45217f-4196-4be5-a03f-55d278face19-config-file\") pod \"limitador-limitador-859c4d96d6-fkrx5\" (UID: \"8e45217f-4196-4be5-a03f-55d278face19\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-fkrx5"
Sep 08 14:42:11.200659 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:11.200662    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prst8\" (UniqueName: \"kubernetes.io/projected/8e45217f-4196-4be5-a03f-55d278face19-kube-api-access-prst8\") pod \"limitador-limitador-859c4d96d6-fkrx5\" (UID: \"8e45217f-4196-4be5-a03f-55d278face19\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-fkrx5"
Sep 08 14:42:11.301575 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:11.301494    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8e45217f-4196-4be5-a03f-55d278face19-config-file\") pod \"limitador-limitador-859c4d96d6-fkrx5\" (UID: \"8e45217f-4196-4be5-a03f-55d278face19\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-fkrx5"
Sep 08 14:42:11.301575 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:11.301528    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prst8\" (UniqueName: \"kubernetes.io/projected/8e45217f-4196-4be5-a03f-55d278face19-kube-api-access-prst8\") pod \"limitador-limitador-859c4d96d6-fkrx5\" (UID: \"8e45217f-4196-4be5-a03f-55d278face19\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-fkrx5"
Sep 08 14:42:11.302059 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:11.302039    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8e45217f-4196-4be5-a03f-55d278face19-config-file\") pod \"limitador-limitador-859c4d96d6-fkrx5\" (UID: \"8e45217f-4196-4be5-a03f-55d278face19\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-fkrx5"
Sep 08 14:42:11.312032 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:11.311994    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prst8\" (UniqueName: \"kubernetes.io/projected/8e45217f-4196-4be5-a03f-55d278face19-kube-api-access-prst8\") pod \"limitador-limitador-859c4d96d6-fkrx5\" (UID: \"8e45217f-4196-4be5-a03f-55d278face19\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-fkrx5"
Sep 08 14:42:11.381666 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:11.381635    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:42:11.384316 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:11.384292    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-fkrx5"
Sep 08 14:42:11.385232 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:11.385211    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"
Sep 08 14:42:11.411789 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:11.411760    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:42:11.474511 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:11.474460    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:42:11.503006 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:11.502979    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gjxn\" (UniqueName: \"kubernetes.io/projected/ea2101e6-f241-4059-adf8-efcb76ee2a14-kube-api-access-5gjxn\") pod \"limitador-limitador-85d9db4d5d-qb8vf\" (UID: \"ea2101e6-f241-4059-adf8-efcb76ee2a14\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"
Sep 08 14:42:11.503151 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:11.503023    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ea2101e6-f241-4059-adf8-efcb76ee2a14-config-file\") pod \"limitador-limitador-85d9db4d5d-qb8vf\" (UID: \"ea2101e6-f241-4059-adf8-efcb76ee2a14\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"
Sep 08 14:42:11.604187 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:11.604111    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gjxn\" (UniqueName: \"kubernetes.io/projected/ea2101e6-f241-4059-adf8-efcb76ee2a14-kube-api-access-5gjxn\") pod \"limitador-limitador-85d9db4d5d-qb8vf\" (UID: \"ea2101e6-f241-4059-adf8-efcb76ee2a14\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"
Sep 08 14:42:11.604187 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:11.604156    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ea2101e6-f241-4059-adf8-efcb76ee2a14-config-file\") pod \"limitador-limitador-85d9db4d5d-qb8vf\" (UID: \"ea2101e6-f241-4059-adf8-efcb76ee2a14\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"
Sep 08 14:42:11.604774 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:11.604756    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ea2101e6-f241-4059-adf8-efcb76ee2a14-config-file\") pod \"limitador-limitador-85d9db4d5d-qb8vf\" (UID: \"ea2101e6-f241-4059-adf8-efcb76ee2a14\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"
Sep 08 14:42:11.613953 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:11.613930    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gjxn\" (UniqueName: \"kubernetes.io/projected/ea2101e6-f241-4059-adf8-efcb76ee2a14-kube-api-access-5gjxn\") pod \"limitador-limitador-85d9db4d5d-qb8vf\" (UID: \"ea2101e6-f241-4059-adf8-efcb76ee2a14\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"
Sep 08 14:42:11.664560 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:11.664534    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-fkrx5"]
Sep 08 14:42:11.666267 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:42:11.666234    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e45217f_4196_4be5_a03f_55d278face19.slice/crio-f60e547d0a12ec5860a51d6046efa0f5bce16defb36f7db8244e1c66eba70d73 WatchSource:0}: Error finding container f60e547d0a12ec5860a51d6046efa0f5bce16defb36f7db8244e1c66eba70d73: Status 404 returned error can't find the container with id f60e547d0a12ec5860a51d6046efa0f5bce16defb36f7db8244e1c66eba70d73
Sep 08 14:42:11.710604 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:11.710581    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"
Sep 08 14:42:11.754462 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:11.754421    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-fkrx5" event={"ID":"8e45217f-4196-4be5-a03f-55d278face19","Type":"ContainerStarted","Data":"f60e547d0a12ec5860a51d6046efa0f5bce16defb36f7db8244e1c66eba70d73"}
Sep 08 14:42:11.985502 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:11.985458    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:42:11.987227 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:42:11.987194    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea2101e6_f241_4059_adf8_efcb76ee2a14.slice/crio-abaa0c136cf6d503d4f3499c6604362ad8cf3d4490b5cc6782b2ca8bbf70a411 WatchSource:0}: Error finding container abaa0c136cf6d503d4f3499c6604362ad8cf3d4490b5cc6782b2ca8bbf70a411: Status 404 returned error can't find the container with id abaa0c136cf6d503d4f3499c6604362ad8cf3d4490b5cc6782b2ca8bbf70a411
Sep 08 14:42:12.760996 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:12.760958    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf" event={"ID":"ea2101e6-f241-4059-adf8-efcb76ee2a14","Type":"ContainerStarted","Data":"abaa0c136cf6d503d4f3499c6604362ad8cf3d4490b5cc6782b2ca8bbf70a411"}
Sep 08 14:42:13.767180 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:13.767144    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf" event={"ID":"ea2101e6-f241-4059-adf8-efcb76ee2a14","Type":"ContainerStarted","Data":"2a9ad524b208184661f5d038518ac9f2a1b5192b58512f6dda1008903f1d565a"}
Sep 08 14:42:13.767602 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:13.767220    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"
Sep 08 14:42:13.787028 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:13.786982    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf" podStartSLOduration=1.552964604 podStartE2EDuration="2.78696932s" totalImagesPullingTime="1.234004716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:42:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:42:13.784820615 +0000 UTC m=+494.823221540" watchObservedRunningTime="2026-09-08 14:42:13.78696932 +0000 UTC m=+494.825370265"
Sep 08 14:42:14.774415 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:14.774375    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-fkrx5" event={"ID":"8e45217f-4196-4be5-a03f-55d278face19","Type":"ContainerStarted","Data":"b57591e03636e5cabadea1e0a02542f9da5af1b94a0bb6fe6f3e5013a5f917b3"}
Sep 08 14:42:14.792132 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:14.792079    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-fkrx5" podStartSLOduration=1.475116941 podStartE2EDuration="3.792042646s" totalImagesPullingTime="2.316925705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:42:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:42:14.790383437 +0000 UTC m=+495.828784358" watchObservedRunningTime="2026-09-08 14:42:14.792042646 +0000 UTC m=+495.830443565"
Sep 08 14:42:15.779633 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:15.779605    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-fkrx5"
Sep 08 14:42:24.775404 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:24.775374    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"
Sep 08 14:42:24.829193 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:24.829152    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-fkrx5"]
Sep 08 14:42:24.829367 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:24.829347    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-fkrx5" podUID="8e45217f-4196-4be5-a03f-55d278face19" containerName="limitador" containerID="cri-o://b57591e03636e5cabadea1e0a02542f9da5af1b94a0bb6fe6f3e5013a5f917b3" gracePeriod=30
Sep 08 14:42:24.830001 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:24.829935    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-fkrx5"
Sep 08 14:42:25.373314 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:25.373292    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-fkrx5"
Sep 08 14:42:25.519437 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:25.519410    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8e45217f-4196-4be5-a03f-55d278face19-config-file\") pod \"8e45217f-4196-4be5-a03f-55d278face19\" (UID: \"8e45217f-4196-4be5-a03f-55d278face19\") "
Sep 08 14:42:25.519635 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:25.519448    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prst8\" (UniqueName: \"kubernetes.io/projected/8e45217f-4196-4be5-a03f-55d278face19-kube-api-access-prst8\") pod \"8e45217f-4196-4be5-a03f-55d278face19\" (UID: \"8e45217f-4196-4be5-a03f-55d278face19\") "
Sep 08 14:42:25.519811 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:25.519790    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e45217f-4196-4be5-a03f-55d278face19-config-file" (OuterVolumeSpecName: "config-file") pod "8e45217f-4196-4be5-a03f-55d278face19" (UID: "8e45217f-4196-4be5-a03f-55d278face19"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:42:25.521712 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:25.521694    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e45217f-4196-4be5-a03f-55d278face19-kube-api-access-prst8" (OuterVolumeSpecName: "kube-api-access-prst8") pod "8e45217f-4196-4be5-a03f-55d278face19" (UID: "8e45217f-4196-4be5-a03f-55d278face19"). InnerVolumeSpecName "kube-api-access-prst8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:42:25.620780 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:25.620752    2577 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8e45217f-4196-4be5-a03f-55d278face19-config-file\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:42:25.620780 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:25.620778    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prst8\" (UniqueName: \"kubernetes.io/projected/8e45217f-4196-4be5-a03f-55d278face19-kube-api-access-prst8\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:42:25.832600 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:25.832518    2577 generic.go:356] "Generic (PLEG): container finished" podID="8e45217f-4196-4be5-a03f-55d278face19" containerID="b57591e03636e5cabadea1e0a02542f9da5af1b94a0bb6fe6f3e5013a5f917b3" exitCode=0
Sep 08 14:42:25.832600 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:25.832564    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-fkrx5"
Sep 08 14:42:25.833052 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:25.832603    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-fkrx5" event={"ID":"8e45217f-4196-4be5-a03f-55d278face19","Type":"ContainerDied","Data":"b57591e03636e5cabadea1e0a02542f9da5af1b94a0bb6fe6f3e5013a5f917b3"}
Sep 08 14:42:25.833052 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:25.832657    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-fkrx5" event={"ID":"8e45217f-4196-4be5-a03f-55d278face19","Type":"ContainerDied","Data":"f60e547d0a12ec5860a51d6046efa0f5bce16defb36f7db8244e1c66eba70d73"}
Sep 08 14:42:25.833052 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:25.832679    2577 scope.go:117] "RemoveContainer" containerID="b57591e03636e5cabadea1e0a02542f9da5af1b94a0bb6fe6f3e5013a5f917b3"
Sep 08 14:42:25.841864 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:25.841847    2577 scope.go:117] "RemoveContainer" containerID="b57591e03636e5cabadea1e0a02542f9da5af1b94a0bb6fe6f3e5013a5f917b3"
Sep 08 14:42:25.842133 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:42:25.842116    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b57591e03636e5cabadea1e0a02542f9da5af1b94a0bb6fe6f3e5013a5f917b3\": container with ID starting with b57591e03636e5cabadea1e0a02542f9da5af1b94a0bb6fe6f3e5013a5f917b3 not found: ID does not exist" containerID="b57591e03636e5cabadea1e0a02542f9da5af1b94a0bb6fe6f3e5013a5f917b3"
Sep 08 14:42:25.842202 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:25.842140    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b57591e03636e5cabadea1e0a02542f9da5af1b94a0bb6fe6f3e5013a5f917b3"} err="failed to get container status \"b57591e03636e5cabadea1e0a02542f9da5af1b94a0bb6fe6f3e5013a5f917b3\": rpc error: code = NotFound desc = could not find container \"b57591e03636e5cabadea1e0a02542f9da5af1b94a0bb6fe6f3e5013a5f917b3\": container with ID starting with b57591e03636e5cabadea1e0a02542f9da5af1b94a0bb6fe6f3e5013a5f917b3 not found: ID does not exist"
Sep 08 14:42:25.854788 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:25.854769    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-fkrx5"]
Sep 08 14:42:25.858631 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:25.858613    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-fkrx5"]
Sep 08 14:42:27.490378 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:27.490342    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e45217f-4196-4be5-a03f-55d278face19" path="/var/lib/kubelet/pods/8e45217f-4196-4be5-a03f-55d278face19/volumes"
Sep 08 14:42:48.184723 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:48.184693    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b46c4bd46-65pss"]
Sep 08 14:42:48.185191 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:48.185059    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e45217f-4196-4be5-a03f-55d278face19" containerName="limitador"
Sep 08 14:42:48.185191 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:48.185071    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e45217f-4196-4be5-a03f-55d278face19" containerName="limitador"
Sep 08 14:42:48.185191 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:48.185125    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e45217f-4196-4be5-a03f-55d278face19" containerName="limitador"
Sep 08 14:42:48.190511 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:48.190493    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b46c4bd46-65pss"
Sep 08 14:42:48.193389 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:48.193367    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 08 14:42:48.193522 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:48.193378    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 08 14:42:48.194363 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:48.194346    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 08 14:42:48.194417 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:48.194372    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xvj5m\""
Sep 08 14:42:48.202749 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:48.202725    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b46c4bd46-65pss"]
Sep 08 14:42:48.209682 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:48.209654    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8062dfca-292a-4eb3-b57e-c334ba5559e4-webhook-cert\") pod \"maas-controller-b46c4bd46-65pss\" (UID: \"8062dfca-292a-4eb3-b57e-c334ba5559e4\") " pod="opendatahub/maas-controller-b46c4bd46-65pss"
Sep 08 14:42:48.209777 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:48.209711    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8062dfca-292a-4eb3-b57e-c334ba5559e4-metrics-certs\") pod \"maas-controller-b46c4bd46-65pss\" (UID: \"8062dfca-292a-4eb3-b57e-c334ba5559e4\") " pod="opendatahub/maas-controller-b46c4bd46-65pss"
Sep 08 14:42:48.209777 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:48.209772    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4fzm\" (UniqueName: \"kubernetes.io/projected/8062dfca-292a-4eb3-b57e-c334ba5559e4-kube-api-access-z4fzm\") pod \"maas-controller-b46c4bd46-65pss\" (UID: \"8062dfca-292a-4eb3-b57e-c334ba5559e4\") " pod="opendatahub/maas-controller-b46c4bd46-65pss"
Sep 08 14:42:48.311099 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:48.311069    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4fzm\" (UniqueName: \"kubernetes.io/projected/8062dfca-292a-4eb3-b57e-c334ba5559e4-kube-api-access-z4fzm\") pod \"maas-controller-b46c4bd46-65pss\" (UID: \"8062dfca-292a-4eb3-b57e-c334ba5559e4\") " pod="opendatahub/maas-controller-b46c4bd46-65pss"
Sep 08 14:42:48.311257 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:48.311123    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8062dfca-292a-4eb3-b57e-c334ba5559e4-webhook-cert\") pod \"maas-controller-b46c4bd46-65pss\" (UID: \"8062dfca-292a-4eb3-b57e-c334ba5559e4\") " pod="opendatahub/maas-controller-b46c4bd46-65pss"
Sep 08 14:42:48.311257 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:48.311163    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8062dfca-292a-4eb3-b57e-c334ba5559e4-metrics-certs\") pod \"maas-controller-b46c4bd46-65pss\" (UID: \"8062dfca-292a-4eb3-b57e-c334ba5559e4\") " pod="opendatahub/maas-controller-b46c4bd46-65pss"
Sep 08 14:42:48.313799 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:48.313778    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8062dfca-292a-4eb3-b57e-c334ba5559e4-webhook-cert\") pod \"maas-controller-b46c4bd46-65pss\" (UID: \"8062dfca-292a-4eb3-b57e-c334ba5559e4\") " pod="opendatahub/maas-controller-b46c4bd46-65pss"
Sep 08 14:42:48.313904 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:48.313806    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8062dfca-292a-4eb3-b57e-c334ba5559e4-metrics-certs\") pod \"maas-controller-b46c4bd46-65pss\" (UID: \"8062dfca-292a-4eb3-b57e-c334ba5559e4\") " pod="opendatahub/maas-controller-b46c4bd46-65pss"
Sep 08 14:42:48.323819 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:48.323797    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4fzm\" (UniqueName: \"kubernetes.io/projected/8062dfca-292a-4eb3-b57e-c334ba5559e4-kube-api-access-z4fzm\") pod \"maas-controller-b46c4bd46-65pss\" (UID: \"8062dfca-292a-4eb3-b57e-c334ba5559e4\") " pod="opendatahub/maas-controller-b46c4bd46-65pss"
Sep 08 14:42:48.500619 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:48.500534    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b46c4bd46-65pss"
Sep 08 14:42:48.774805 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:48.774666    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b46c4bd46-65pss"]
Sep 08 14:42:48.778081 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:42:48.778060    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8062dfca_292a_4eb3_b57e_c334ba5559e4.slice/crio-d2a2723098c5157cc910f1f811057ed876ceacdc3440953c82c3e314e6ace32c WatchSource:0}: Error finding container d2a2723098c5157cc910f1f811057ed876ceacdc3440953c82c3e314e6ace32c: Status 404 returned error can't find the container with id d2a2723098c5157cc910f1f811057ed876ceacdc3440953c82c3e314e6ace32c
Sep 08 14:42:48.950557 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:48.950522    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b46c4bd46-65pss" event={"ID":"8062dfca-292a-4eb3-b57e-c334ba5559e4","Type":"ContainerStarted","Data":"d2a2723098c5157cc910f1f811057ed876ceacdc3440953c82c3e314e6ace32c"}
Sep 08 14:42:51.969430 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:51.969394    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b46c4bd46-65pss" event={"ID":"8062dfca-292a-4eb3-b57e-c334ba5559e4","Type":"ContainerStarted","Data":"a948593bd709748df23b0e8e1db7d161d668ec6ef3ca75aadb99ab734587af46"}
Sep 08 14:42:51.969836 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:51.969531    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b46c4bd46-65pss"
Sep 08 14:42:51.992593 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:42:51.992549    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-b46c4bd46-65pss" podStartSLOduration=1.56433048 podStartE2EDuration="3.992534835s" totalImagesPullingTime="2.428204355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:42:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:42:51.990804631 +0000 UTC m=+533.029205553" watchObservedRunningTime="2026-09-08 14:42:51.992534835 +0000 UTC m=+533.030935758"
Sep 08 14:43:02.976750 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:02.976720    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b46c4bd46-65pss"
Sep 08 14:43:25.432700 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:25.432666    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-84d9df9944-cszm2"]
Sep 08 14:43:25.439721 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:25.439699    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84d9df9944-cszm2"
Sep 08 14:43:25.445206 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:25.445187    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 14:43:25.445360 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:25.445340    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-k5czt\""
Sep 08 14:43:25.445495 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:25.445455    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 08 14:43:25.445553 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:25.445518    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 08 14:43:25.445553 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:25.445541    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 14:43:25.454550 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:25.454530    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-84d9df9944-cszm2"]
Sep 08 14:43:25.505487 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:25.505440    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4fb51864-7202-4258-add8-e8cb4b735c3c-metrics-certs\") pod \"maas-api-84d9df9944-cszm2\" (UID: \"4fb51864-7202-4258-add8-e8cb4b735c3c\") " pod="odh-ai-gateway-infra/maas-api-84d9df9944-cszm2"
Sep 08 14:43:25.505641 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:25.505499    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krm8r\" (UniqueName: \"kubernetes.io/projected/4fb51864-7202-4258-add8-e8cb4b735c3c-kube-api-access-krm8r\") pod \"maas-api-84d9df9944-cszm2\" (UID: \"4fb51864-7202-4258-add8-e8cb4b735c3c\") " pod="odh-ai-gateway-infra/maas-api-84d9df9944-cszm2"
Sep 08 14:43:25.505641 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:25.505573    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fb51864-7202-4258-add8-e8cb4b735c3c-openshift-service-ca\") pod \"maas-api-84d9df9944-cszm2\" (UID: \"4fb51864-7202-4258-add8-e8cb4b735c3c\") " pod="odh-ai-gateway-infra/maas-api-84d9df9944-cszm2"
Sep 08 14:43:25.505641 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:25.505611    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fb51864-7202-4258-add8-e8cb4b735c3c-maas-api-tls\") pod \"maas-api-84d9df9944-cszm2\" (UID: \"4fb51864-7202-4258-add8-e8cb4b735c3c\") " pod="odh-ai-gateway-infra/maas-api-84d9df9944-cszm2"
Sep 08 14:43:25.606956 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:25.606929    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krm8r\" (UniqueName: \"kubernetes.io/projected/4fb51864-7202-4258-add8-e8cb4b735c3c-kube-api-access-krm8r\") pod \"maas-api-84d9df9944-cszm2\" (UID: \"4fb51864-7202-4258-add8-e8cb4b735c3c\") " pod="odh-ai-gateway-infra/maas-api-84d9df9944-cszm2"
Sep 08 14:43:25.607131 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:25.606965    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fb51864-7202-4258-add8-e8cb4b735c3c-openshift-service-ca\") pod \"maas-api-84d9df9944-cszm2\" (UID: \"4fb51864-7202-4258-add8-e8cb4b735c3c\") " pod="odh-ai-gateway-infra/maas-api-84d9df9944-cszm2"
Sep 08 14:43:25.607131 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:25.606986    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fb51864-7202-4258-add8-e8cb4b735c3c-maas-api-tls\") pod \"maas-api-84d9df9944-cszm2\" (UID: \"4fb51864-7202-4258-add8-e8cb4b735c3c\") " pod="odh-ai-gateway-infra/maas-api-84d9df9944-cszm2"
Sep 08 14:43:25.607131 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:25.607035    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4fb51864-7202-4258-add8-e8cb4b735c3c-metrics-certs\") pod \"maas-api-84d9df9944-cszm2\" (UID: \"4fb51864-7202-4258-add8-e8cb4b735c3c\") " pod="odh-ai-gateway-infra/maas-api-84d9df9944-cszm2"
Sep 08 14:43:25.607131 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:43:25.607122    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found
Sep 08 14:43:25.607277 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:43:25.607155    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Sep 08 14:43:25.607277 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:43:25.607182    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fb51864-7202-4258-add8-e8cb4b735c3c-metrics-certs podName:4fb51864-7202-4258-add8-e8cb4b735c3c nodeName:}" failed. No retries permitted until 2026-09-08 14:43:26.10716609 +0000 UTC m=+567.145566990 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4fb51864-7202-4258-add8-e8cb4b735c3c-metrics-certs") pod "maas-api-84d9df9944-cszm2" (UID: "4fb51864-7202-4258-add8-e8cb4b735c3c") : secret "maas-api-metrics-tls" not found
Sep 08 14:43:25.607277 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:43:25.607222    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fb51864-7202-4258-add8-e8cb4b735c3c-maas-api-tls podName:4fb51864-7202-4258-add8-e8cb4b735c3c nodeName:}" failed. No retries permitted until 2026-09-08 14:43:26.107203903 +0000 UTC m=+567.145604805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4fb51864-7202-4258-add8-e8cb4b735c3c-maas-api-tls") pod "maas-api-84d9df9944-cszm2" (UID: "4fb51864-7202-4258-add8-e8cb4b735c3c") : secret "maas-api-serving-cert" not found
Sep 08 14:43:25.607624 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:25.607606    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fb51864-7202-4258-add8-e8cb4b735c3c-openshift-service-ca\") pod \"maas-api-84d9df9944-cszm2\" (UID: \"4fb51864-7202-4258-add8-e8cb4b735c3c\") " pod="odh-ai-gateway-infra/maas-api-84d9df9944-cszm2"
Sep 08 14:43:25.623415 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:25.623389    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krm8r\" (UniqueName: \"kubernetes.io/projected/4fb51864-7202-4258-add8-e8cb4b735c3c-kube-api-access-krm8r\") pod \"maas-api-84d9df9944-cszm2\" (UID: \"4fb51864-7202-4258-add8-e8cb4b735c3c\") " pod="odh-ai-gateway-infra/maas-api-84d9df9944-cszm2"
Sep 08 14:43:26.103274 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:26.103241    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:43:26.112008 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:26.111981    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4fb51864-7202-4258-add8-e8cb4b735c3c-metrics-certs\") pod \"maas-api-84d9df9944-cszm2\" (UID: \"4fb51864-7202-4258-add8-e8cb4b735c3c\") " pod="odh-ai-gateway-infra/maas-api-84d9df9944-cszm2"
Sep 08 14:43:26.112186 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:26.112043    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fb51864-7202-4258-add8-e8cb4b735c3c-maas-api-tls\") pod \"maas-api-84d9df9944-cszm2\" (UID: \"4fb51864-7202-4258-add8-e8cb4b735c3c\") " pod="odh-ai-gateway-infra/maas-api-84d9df9944-cszm2"
Sep 08 14:43:26.114701 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:26.114670    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fb51864-7202-4258-add8-e8cb4b735c3c-maas-api-tls\") pod \"maas-api-84d9df9944-cszm2\" (UID: \"4fb51864-7202-4258-add8-e8cb4b735c3c\") " pod="odh-ai-gateway-infra/maas-api-84d9df9944-cszm2"
Sep 08 14:43:26.114812 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:26.114679    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4fb51864-7202-4258-add8-e8cb4b735c3c-metrics-certs\") pod \"maas-api-84d9df9944-cszm2\" (UID: \"4fb51864-7202-4258-add8-e8cb4b735c3c\") " pod="odh-ai-gateway-infra/maas-api-84d9df9944-cszm2"
Sep 08 14:43:26.187658 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:26.187626    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-frbc8"]
Sep 08 14:43:26.191620 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:26.191601    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-frbc8"
Sep 08 14:43:26.194268 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:26.194244    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 08 14:43:26.194486 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:26.194450    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-b7w9g\""
Sep 08 14:43:26.202377 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:26.202355    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-frbc8"]
Sep 08 14:43:26.313998 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:26.313962    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac63e955-806d-44b0-ba92-1e7c94474243-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-frbc8\" (UID: \"ac63e955-806d-44b0-ba92-1e7c94474243\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-frbc8"
Sep 08 14:43:26.314258 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:26.314011    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blbkv\" (UniqueName: \"kubernetes.io/projected/ac63e955-806d-44b0-ba92-1e7c94474243-kube-api-access-blbkv\") pod \"payload-processing-5b54b7fbb7-frbc8\" (UID: \"ac63e955-806d-44b0-ba92-1e7c94474243\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-frbc8"
Sep 08 14:43:26.349914 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:26.349871    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84d9df9944-cszm2"
Sep 08 14:43:26.415282 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:26.415214    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac63e955-806d-44b0-ba92-1e7c94474243-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-frbc8\" (UID: \"ac63e955-806d-44b0-ba92-1e7c94474243\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-frbc8"
Sep 08 14:43:26.415282 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:26.415262    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blbkv\" (UniqueName: \"kubernetes.io/projected/ac63e955-806d-44b0-ba92-1e7c94474243-kube-api-access-blbkv\") pod \"payload-processing-5b54b7fbb7-frbc8\" (UID: \"ac63e955-806d-44b0-ba92-1e7c94474243\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-frbc8"
Sep 08 14:43:26.416730 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:26.416707    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac63e955-806d-44b0-ba92-1e7c94474243-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-frbc8\" (UID: \"ac63e955-806d-44b0-ba92-1e7c94474243\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-frbc8"
Sep 08 14:43:26.427605 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:26.427583    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blbkv\" (UniqueName: \"kubernetes.io/projected/ac63e955-806d-44b0-ba92-1e7c94474243-kube-api-access-blbkv\") pod \"payload-processing-5b54b7fbb7-frbc8\" (UID: \"ac63e955-806d-44b0-ba92-1e7c94474243\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-frbc8"
Sep 08 14:43:26.502800 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:26.502768    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-frbc8"
Sep 08 14:43:26.623622 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:26.623597    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-84d9df9944-cszm2"]
Sep 08 14:43:26.625811 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:43:26.625786    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fb51864_7202_4258_add8_e8cb4b735c3c.slice/crio-401a43385b0e13e0b6f5c005cae9eac53befc4ed7f63be33fae9e2002eef4d3f WatchSource:0}: Error finding container 401a43385b0e13e0b6f5c005cae9eac53befc4ed7f63be33fae9e2002eef4d3f: Status 404 returned error can't find the container with id 401a43385b0e13e0b6f5c005cae9eac53befc4ed7f63be33fae9e2002eef4d3f
Sep 08 14:43:26.778253 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:26.778231    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-frbc8"]
Sep 08 14:43:26.780319 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:43:26.780293    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac63e955_806d_44b0_ba92_1e7c94474243.slice/crio-7dc19072aaf0a53dcf019976d0ea5a4b68724573ee2943fb9e72151e2aa9706f WatchSource:0}: Error finding container 7dc19072aaf0a53dcf019976d0ea5a4b68724573ee2943fb9e72151e2aa9706f: Status 404 returned error can't find the container with id 7dc19072aaf0a53dcf019976d0ea5a4b68724573ee2943fb9e72151e2aa9706f
Sep 08 14:43:27.156511 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:27.156457    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84d9df9944-cszm2" event={"ID":"4fb51864-7202-4258-add8-e8cb4b735c3c","Type":"ContainerStarted","Data":"401a43385b0e13e0b6f5c005cae9eac53befc4ed7f63be33fae9e2002eef4d3f"}
Sep 08 14:43:27.157695 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:27.157672    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-frbc8" event={"ID":"ac63e955-806d-44b0-ba92-1e7c94474243","Type":"ContainerStarted","Data":"7dc19072aaf0a53dcf019976d0ea5a4b68724573ee2943fb9e72151e2aa9706f"}
Sep 08 14:43:29.171535 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:29.171500    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84d9df9944-cszm2" event={"ID":"4fb51864-7202-4258-add8-e8cb4b735c3c","Type":"ContainerStarted","Data":"d0e4bae5ad7f7e1e108fd512800625adc1b31ae286d2658e3106b2bca6b30837"}
Sep 08 14:43:29.171987 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:29.171608    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-84d9df9944-cszm2"
Sep 08 14:43:29.173233 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:29.173208    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-frbc8" event={"ID":"ac63e955-806d-44b0-ba92-1e7c94474243","Type":"ContainerStarted","Data":"8de170ad65cc1cf6ec572a9453e6b3a71028915f7c4f10ccdbc2d1656e2455af"}
Sep 08 14:43:29.173347 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:29.173259    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-frbc8"
Sep 08 14:43:29.191009 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:29.190960    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-84d9df9944-cszm2" podStartSLOduration=1.9731333979999999 podStartE2EDuration="4.190940911s" totalImagesPullingTime="2.217807513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:43:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:43:29.188704771 +0000 UTC m=+570.227105694" watchObservedRunningTime="2026-09-08 14:43:29.190940911 +0000 UTC m=+570.229341833"
Sep 08 14:43:29.207621 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:29.207582    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-frbc8" podStartSLOduration=1.145190405 podStartE2EDuration="3.207570876s" totalImagesPullingTime="2.062380471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:43:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:43:29.206667172 +0000 UTC m=+570.245068093" watchObservedRunningTime="2026-09-08 14:43:29.207570876 +0000 UTC m=+570.245971797"
Sep 08 14:43:35.184114 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:35.184083    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-84d9df9944-cszm2"
Sep 08 14:43:40.180637 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:40.180609    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-frbc8"
Sep 08 14:43:57.875456 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:43:57.875421    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:44:05.177275 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:05.177237    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:44:12.069123 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:12.069086    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:44:16.585566 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:16.585529    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nd9h2"]
Sep 08 14:44:16.589616 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:16.589594    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nd9h2"
Sep 08 14:44:16.592773 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:16.592744    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 08 14:44:16.593840 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:16.593817    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 08 14:44:16.593954 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:16.593852    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 08 14:44:16.593954 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:16.593896    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-cmtn4\""
Sep 08 14:44:16.610905 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:16.610882    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nd9h2"]
Sep 08 14:44:16.741602 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:16.741575    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3ce564f-a64e-4915-ba91-9891ea8fddc6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nd9h2\" (UID: \"b3ce564f-a64e-4915-ba91-9891ea8fddc6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nd9h2"
Sep 08 14:44:16.741763 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:16.741609    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3ce564f-a64e-4915-ba91-9891ea8fddc6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nd9h2\" (UID: \"b3ce564f-a64e-4915-ba91-9891ea8fddc6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nd9h2"
Sep 08 14:44:16.741763 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:16.741632    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3ce564f-a64e-4915-ba91-9891ea8fddc6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nd9h2\" (UID: \"b3ce564f-a64e-4915-ba91-9891ea8fddc6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nd9h2"
Sep 08 14:44:16.741763 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:16.741681    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbhws\" (UniqueName: \"kubernetes.io/projected/b3ce564f-a64e-4915-ba91-9891ea8fddc6-kube-api-access-qbhws\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nd9h2\" (UID: \"b3ce564f-a64e-4915-ba91-9891ea8fddc6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nd9h2"
Sep 08 14:44:16.741763 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:16.741726    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3ce564f-a64e-4915-ba91-9891ea8fddc6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nd9h2\" (UID: \"b3ce564f-a64e-4915-ba91-9891ea8fddc6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nd9h2"
Sep 08 14:44:16.741763 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:16.741761    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3ce564f-a64e-4915-ba91-9891ea8fddc6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nd9h2\" (UID: \"b3ce564f-a64e-4915-ba91-9891ea8fddc6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nd9h2"
Sep 08 14:44:16.843069 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:16.842990    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3ce564f-a64e-4915-ba91-9891ea8fddc6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nd9h2\" (UID: \"b3ce564f-a64e-4915-ba91-9891ea8fddc6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nd9h2"
Sep 08 14:44:16.843069 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:16.843037    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbhws\" (UniqueName: \"kubernetes.io/projected/b3ce564f-a64e-4915-ba91-9891ea8fddc6-kube-api-access-qbhws\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nd9h2\" (UID: \"b3ce564f-a64e-4915-ba91-9891ea8fddc6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nd9h2"
Sep 08 14:44:16.843259 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:16.843075    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3ce564f-a64e-4915-ba91-9891ea8fddc6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nd9h2\" (UID: \"b3ce564f-a64e-4915-ba91-9891ea8fddc6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nd9h2"
Sep 08 14:44:16.843259 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:16.843112    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3ce564f-a64e-4915-ba91-9891ea8fddc6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nd9h2\" (UID: \"b3ce564f-a64e-4915-ba91-9891ea8fddc6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nd9h2"
Sep 08 14:44:16.843401 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:16.843266    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3ce564f-a64e-4915-ba91-9891ea8fddc6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nd9h2\" (UID: \"b3ce564f-a64e-4915-ba91-9891ea8fddc6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nd9h2"
Sep 08 14:44:16.843401 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:16.843319    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3ce564f-a64e-4915-ba91-9891ea8fddc6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nd9h2\" (UID: \"b3ce564f-a64e-4915-ba91-9891ea8fddc6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nd9h2"
Sep 08 14:44:16.843643 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:16.843499    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3ce564f-a64e-4915-ba91-9891ea8fddc6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nd9h2\" (UID: \"b3ce564f-a64e-4915-ba91-9891ea8fddc6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nd9h2"
Sep 08 14:44:16.843643 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:16.843540    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3ce564f-a64e-4915-ba91-9891ea8fddc6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nd9h2\" (UID: \"b3ce564f-a64e-4915-ba91-9891ea8fddc6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nd9h2"
Sep 08 14:44:16.843643 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:16.843578    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3ce564f-a64e-4915-ba91-9891ea8fddc6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nd9h2\" (UID: \"b3ce564f-a64e-4915-ba91-9891ea8fddc6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nd9h2"
Sep 08 14:44:16.845448 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:16.845428    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3ce564f-a64e-4915-ba91-9891ea8fddc6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nd9h2\" (UID: \"b3ce564f-a64e-4915-ba91-9891ea8fddc6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nd9h2"
Sep 08 14:44:16.845840 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:16.845824    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3ce564f-a64e-4915-ba91-9891ea8fddc6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nd9h2\" (UID: \"b3ce564f-a64e-4915-ba91-9891ea8fddc6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nd9h2"
Sep 08 14:44:16.851785 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:16.851763    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbhws\" (UniqueName: \"kubernetes.io/projected/b3ce564f-a64e-4915-ba91-9891ea8fddc6-kube-api-access-qbhws\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nd9h2\" (UID: \"b3ce564f-a64e-4915-ba91-9891ea8fddc6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nd9h2"
Sep 08 14:44:16.900388 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:16.900362    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nd9h2"
Sep 08 14:44:17.180654 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:17.180625    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nd9h2"]
Sep 08 14:44:17.181221 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:44:17.181198    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3ce564f_a64e_4915_ba91_9891ea8fddc6.slice/crio-65c2e01802c185f1d6b1e4a07b1bda30c11958dc2b2e81127f2f0e271a5c79a1 WatchSource:0}: Error finding container 65c2e01802c185f1d6b1e4a07b1bda30c11958dc2b2e81127f2f0e271a5c79a1: Status 404 returned error can't find the container with id 65c2e01802c185f1d6b1e4a07b1bda30c11958dc2b2e81127f2f0e271a5c79a1
Sep 08 14:44:17.182452 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:17.182436    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 14:44:17.438623 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:17.438538    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nd9h2" event={"ID":"b3ce564f-a64e-4915-ba91-9891ea8fddc6","Type":"ContainerStarted","Data":"65c2e01802c185f1d6b1e4a07b1bda30c11958dc2b2e81127f2f0e271a5c79a1"}
Sep 08 14:44:18.065486 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:18.065437    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:44:18.444989 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:18.444954    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nd9h2" event={"ID":"b3ce564f-a64e-4915-ba91-9891ea8fddc6","Type":"ContainerStarted","Data":"aadc114a9f6a62263bab9a0cbe8fc6755b08d392814836e6368abf83af306d7a"}
Sep 08 14:44:18.462921 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:18.462875    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nd9h2" podStartSLOduration=1.4288168589999999 podStartE2EDuration="2.462858196s" totalImagesPullingTime="1.034041337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:44:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:44:18.462526059 +0000 UTC m=+619.500926981" watchObservedRunningTime="2026-09-08 14:44:18.462858196 +0000 UTC m=+619.501259119"
Sep 08 14:44:26.900745 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:26.900661    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nd9h2"
Sep 08 14:44:26.901141 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:26.900789    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nd9h2"
Sep 08 14:44:26.913309 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:26.913289    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nd9h2"
Sep 08 14:44:27.505325 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:27.505300    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nd9h2"
Sep 08 14:44:37.471124 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:37.471091    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:44:47.173061 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:47.173024    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:44:56.870140 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:44:56.870103    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:46:04.029313 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:04.029237    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7880-139777572537520"]
Sep 08 14:46:04.032783 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:04.032765    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7880-139777572537520"
Sep 08 14:46:04.035961 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:04.035938    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-2sfkk\""
Sep 08 14:46:04.053192 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:04.053159    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7880-139777572537520"]
Sep 08 14:46:04.114917 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:04.114889    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lttk8\" (UniqueName: \"kubernetes.io/projected/38ab9139-b3f8-4ded-9e2b-c8342b6d6d78-kube-api-access-lttk8\") pod \"test-curl-7880-139777572537520\" (UID: \"38ab9139-b3f8-4ded-9e2b-c8342b6d6d78\") " pod="opendatahub/test-curl-7880-139777572537520"
Sep 08 14:46:04.215882 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:04.215855    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lttk8\" (UniqueName: \"kubernetes.io/projected/38ab9139-b3f8-4ded-9e2b-c8342b6d6d78-kube-api-access-lttk8\") pod \"test-curl-7880-139777572537520\" (UID: \"38ab9139-b3f8-4ded-9e2b-c8342b6d6d78\") " pod="opendatahub/test-curl-7880-139777572537520"
Sep 08 14:46:04.225274 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:04.225250    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lttk8\" (UniqueName: \"kubernetes.io/projected/38ab9139-b3f8-4ded-9e2b-c8342b6d6d78-kube-api-access-lttk8\") pod \"test-curl-7880-139777572537520\" (UID: \"38ab9139-b3f8-4ded-9e2b-c8342b6d6d78\") " pod="opendatahub/test-curl-7880-139777572537520"
Sep 08 14:46:04.341175 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:04.341099    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7880-139777572537520"
Sep 08 14:46:04.613115 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:04.613084    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7880-139777572537520"]
Sep 08 14:46:04.614623 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:46:04.614596    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38ab9139_b3f8_4ded_9e2b_c8342b6d6d78.slice/crio-e0c04813fbbcee0a47df0d47b4a8f0e7a99ba7e1f54988a0d04ec25428f9289b WatchSource:0}: Error finding container e0c04813fbbcee0a47df0d47b4a8f0e7a99ba7e1f54988a0d04ec25428f9289b: Status 404 returned error can't find the container with id e0c04813fbbcee0a47df0d47b4a8f0e7a99ba7e1f54988a0d04ec25428f9289b
Sep 08 14:46:05.003171 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:05.003141    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7880-139777572537520" event={"ID":"38ab9139-b3f8-4ded-9e2b-c8342b6d6d78","Type":"ContainerStarted","Data":"e0c04813fbbcee0a47df0d47b4a8f0e7a99ba7e1f54988a0d04ec25428f9289b"}
Sep 08 14:46:05.879851 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:05.879818    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:46:06.011778 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:06.011740    2577 generic.go:356] "Generic (PLEG): container finished" podID="38ab9139-b3f8-4ded-9e2b-c8342b6d6d78" containerID="2a83a23b3c3804a0be051e739201897e430ce18f4cb700c25f0b60338e6934dc" exitCode=0
Sep 08 14:46:06.011948 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:06.011820    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7880-139777572537520" event={"ID":"38ab9139-b3f8-4ded-9e2b-c8342b6d6d78","Type":"ContainerDied","Data":"2a83a23b3c3804a0be051e739201897e430ce18f4cb700c25f0b60338e6934dc"}
Sep 08 14:46:06.744255 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:06.744222    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw"]
Sep 08 14:46:06.747937 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:06.747916    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw"
Sep 08 14:46:06.750968 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:06.750951    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-798a5d-serving-cert\""
Sep 08 14:46:06.765802 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:06.765780    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw"]
Sep 08 14:46:06.840745 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:06.840711    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b08c26ea-8fe6-4cb4-ab5d-e02faae77f69-metrics-certs\") pod \"maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw\" (UID: \"b08c26ea-8fe6-4cb4-ab5d-e02faae77f69\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw"
Sep 08 14:46:06.840901 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:06.840749    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b08c26ea-8fe6-4cb4-ab5d-e02faae77f69-maas-api-tls\") pod \"maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw\" (UID: \"b08c26ea-8fe6-4cb4-ab5d-e02faae77f69\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw"
Sep 08 14:46:06.840901 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:06.840777    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fn52\" (UniqueName: \"kubernetes.io/projected/b08c26ea-8fe6-4cb4-ab5d-e02faae77f69-kube-api-access-9fn52\") pod \"maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw\" (UID: \"b08c26ea-8fe6-4cb4-ab5d-e02faae77f69\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw"
Sep 08 14:46:06.840901 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:06.840843    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b08c26ea-8fe6-4cb4-ab5d-e02faae77f69-openshift-service-ca\") pod \"maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw\" (UID: \"b08c26ea-8fe6-4cb4-ab5d-e02faae77f69\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw"
Sep 08 14:46:06.941891 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:06.941863    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b08c26ea-8fe6-4cb4-ab5d-e02faae77f69-metrics-certs\") pod \"maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw\" (UID: \"b08c26ea-8fe6-4cb4-ab5d-e02faae77f69\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw"
Sep 08 14:46:06.942359 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:06.941897    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b08c26ea-8fe6-4cb4-ab5d-e02faae77f69-maas-api-tls\") pod \"maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw\" (UID: \"b08c26ea-8fe6-4cb4-ab5d-e02faae77f69\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw"
Sep 08 14:46:06.942359 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:06.941915    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fn52\" (UniqueName: \"kubernetes.io/projected/b08c26ea-8fe6-4cb4-ab5d-e02faae77f69-kube-api-access-9fn52\") pod \"maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw\" (UID: \"b08c26ea-8fe6-4cb4-ab5d-e02faae77f69\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw"
Sep 08 14:46:06.942359 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:06.941938    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b08c26ea-8fe6-4cb4-ab5d-e02faae77f69-openshift-service-ca\") pod \"maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw\" (UID: \"b08c26ea-8fe6-4cb4-ab5d-e02faae77f69\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw"
Sep 08 14:46:06.942359 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:46:06.942023    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-serving-cert: secret "maas-api-e2e-inf-a-798a5d-serving-cert" not found
Sep 08 14:46:06.942359 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:46:06.942092    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b08c26ea-8fe6-4cb4-ab5d-e02faae77f69-maas-api-tls podName:b08c26ea-8fe6-4cb4-ab5d-e02faae77f69 nodeName:}" failed. No retries permitted until 2026-09-08 14:46:07.442075219 +0000 UTC m=+728.480476139 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b08c26ea-8fe6-4cb4-ab5d-e02faae77f69-maas-api-tls") pod "maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw" (UID: "b08c26ea-8fe6-4cb4-ab5d-e02faae77f69") : secret "maas-api-e2e-inf-a-798a5d-serving-cert" not found
Sep 08 14:46:06.942723 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:06.942707    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b08c26ea-8fe6-4cb4-ab5d-e02faae77f69-openshift-service-ca\") pod \"maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw\" (UID: \"b08c26ea-8fe6-4cb4-ab5d-e02faae77f69\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw"
Sep 08 14:46:06.944697 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:06.944677    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b08c26ea-8fe6-4cb4-ab5d-e02faae77f69-metrics-certs\") pod \"maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw\" (UID: \"b08c26ea-8fe6-4cb4-ab5d-e02faae77f69\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw"
Sep 08 14:46:06.955985 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:06.955962    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fn52\" (UniqueName: \"kubernetes.io/projected/b08c26ea-8fe6-4cb4-ab5d-e02faae77f69-kube-api-access-9fn52\") pod \"maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw\" (UID: \"b08c26ea-8fe6-4cb4-ab5d-e02faae77f69\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw"
Sep 08 14:46:07.154651 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:07.154627    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7880-139777572537520"
Sep 08 14:46:07.204489 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:07.204423    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7880-139777572537520_38ab9139-b3f8-4ded-9e2b-c8342b6d6d78/test-curl-7880-139777572537520/0.log"
Sep 08 14:46:07.231717 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:07.231694    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7880-139777572537520"]
Sep 08 14:46:07.243905 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:07.243885    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lttk8\" (UniqueName: \"kubernetes.io/projected/38ab9139-b3f8-4ded-9e2b-c8342b6d6d78-kube-api-access-lttk8\") pod \"38ab9139-b3f8-4ded-9e2b-c8342b6d6d78\" (UID: \"38ab9139-b3f8-4ded-9e2b-c8342b6d6d78\") "
Sep 08 14:46:07.245161 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:07.245144    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7880-139777572537520"]
Sep 08 14:46:07.246128 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:07.246107    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38ab9139-b3f8-4ded-9e2b-c8342b6d6d78-kube-api-access-lttk8" (OuterVolumeSpecName: "kube-api-access-lttk8") pod "38ab9139-b3f8-4ded-9e2b-c8342b6d6d78" (UID: "38ab9139-b3f8-4ded-9e2b-c8342b6d6d78"). InnerVolumeSpecName "kube-api-access-lttk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:46:07.344874 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:07.344803    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lttk8\" (UniqueName: \"kubernetes.io/projected/38ab9139-b3f8-4ded-9e2b-c8342b6d6d78-kube-api-access-lttk8\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:46:07.384515 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:07.381897    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7880-139777572537520"]
Sep 08 14:46:07.384515 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:07.382893    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38ab9139-b3f8-4ded-9e2b-c8342b6d6d78" containerName="test-curl-7880-139777572537520"
Sep 08 14:46:07.384515 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:07.382914    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="38ab9139-b3f8-4ded-9e2b-c8342b6d6d78" containerName="test-curl-7880-139777572537520"
Sep 08 14:46:07.384515 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:07.383095    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="38ab9139-b3f8-4ded-9e2b-c8342b6d6d78" containerName="test-curl-7880-139777572537520"
Sep 08 14:46:07.391802 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:07.391780    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7880-139777572537520"
Sep 08 14:46:07.393642 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:07.393598    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7880-139777572537520"]
Sep 08 14:46:07.446211 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:07.446183    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b08c26ea-8fe6-4cb4-ab5d-e02faae77f69-maas-api-tls\") pod \"maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw\" (UID: \"b08c26ea-8fe6-4cb4-ab5d-e02faae77f69\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw"
Sep 08 14:46:07.446349 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:07.446223    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jtzm\" (UniqueName: \"kubernetes.io/projected/f0c7dc86-a432-4c63-b0da-cf2964b12d4a-kube-api-access-5jtzm\") pod \"test-curl-7880-139777572537520\" (UID: \"f0c7dc86-a432-4c63-b0da-cf2964b12d4a\") " pod="opendatahub/test-curl-7880-139777572537520"
Sep 08 14:46:07.448629 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:07.448606    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b08c26ea-8fe6-4cb4-ab5d-e02faae77f69-maas-api-tls\") pod \"maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw\" (UID: \"b08c26ea-8fe6-4cb4-ab5d-e02faae77f69\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw"
Sep 08 14:46:07.490671 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:07.490642    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38ab9139-b3f8-4ded-9e2b-c8342b6d6d78" path="/var/lib/kubelet/pods/38ab9139-b3f8-4ded-9e2b-c8342b6d6d78/volumes"
Sep 08 14:46:07.546730 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:07.546698    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jtzm\" (UniqueName: \"kubernetes.io/projected/f0c7dc86-a432-4c63-b0da-cf2964b12d4a-kube-api-access-5jtzm\") pod \"test-curl-7880-139777572537520\" (UID: \"f0c7dc86-a432-4c63-b0da-cf2964b12d4a\") " pod="opendatahub/test-curl-7880-139777572537520"
Sep 08 14:46:07.559939 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:07.559916    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jtzm\" (UniqueName: \"kubernetes.io/projected/f0c7dc86-a432-4c63-b0da-cf2964b12d4a-kube-api-access-5jtzm\") pod \"test-curl-7880-139777572537520\" (UID: \"f0c7dc86-a432-4c63-b0da-cf2964b12d4a\") " pod="opendatahub/test-curl-7880-139777572537520"
Sep 08 14:46:07.657879 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:07.657807    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw"
Sep 08 14:46:07.704243 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:07.704210    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7880-139777572537520"
Sep 08 14:46:07.944403 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:07.944377    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw"]
Sep 08 14:46:07.946716 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:46:07.946687    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb08c26ea_8fe6_4cb4_ab5d_e02faae77f69.slice/crio-93b4f75b62950ff875e63c1a724bd788af559de020d46eed7675b8d932421c54 WatchSource:0}: Error finding container 93b4f75b62950ff875e63c1a724bd788af559de020d46eed7675b8d932421c54: Status 404 returned error can't find the container with id 93b4f75b62950ff875e63c1a724bd788af559de020d46eed7675b8d932421c54
Sep 08 14:46:07.990313 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:07.990290    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7880-139777572537520"]
Sep 08 14:46:07.992326 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:46:07.992302    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0c7dc86_a432_4c63_b0da_cf2964b12d4a.slice/crio-03f897e70d65e69fa8bb4090c4670ef598bdcccf022ba0305e26199c21424b88 WatchSource:0}: Error finding container 03f897e70d65e69fa8bb4090c4670ef598bdcccf022ba0305e26199c21424b88: Status 404 returned error can't find the container with id 03f897e70d65e69fa8bb4090c4670ef598bdcccf022ba0305e26199c21424b88
Sep 08 14:46:08.024942 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:08.024906    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7880-139777572537520" event={"ID":"f0c7dc86-a432-4c63-b0da-cf2964b12d4a","Type":"ContainerStarted","Data":"03f897e70d65e69fa8bb4090c4670ef598bdcccf022ba0305e26199c21424b88"}
Sep 08 14:46:08.026291 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:08.026268    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw" event={"ID":"b08c26ea-8fe6-4cb4-ab5d-e02faae77f69","Type":"ContainerStarted","Data":"93b4f75b62950ff875e63c1a724bd788af559de020d46eed7675b8d932421c54"}
Sep 08 14:46:08.027572 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:08.027553    2577 scope.go:117] "RemoveContainer" containerID="2a83a23b3c3804a0be051e739201897e430ce18f4cb700c25f0b60338e6934dc"
Sep 08 14:46:08.027666 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:08.027572    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7880-139777572537520"
Sep 08 14:46:09.034042 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:09.033954    2577 generic.go:356] "Generic (PLEG): container finished" podID="f0c7dc86-a432-4c63-b0da-cf2964b12d4a" containerID="33435c1357cdefbc010432b8165c595f64a1a275738240b30b31d5860dd33303" exitCode=0
Sep 08 14:46:09.034042 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:09.034034    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7880-139777572537520" event={"ID":"f0c7dc86-a432-4c63-b0da-cf2964b12d4a","Type":"ContainerDied","Data":"33435c1357cdefbc010432b8165c595f64a1a275738240b30b31d5860dd33303"}
Sep 08 14:46:09.035700 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:09.035669    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw" event={"ID":"b08c26ea-8fe6-4cb4-ab5d-e02faae77f69","Type":"ContainerStarted","Data":"d1ebc890c05e1b69f436ef00cf3369a74c6912c1e658fc038d2f6f9f54cad0e3"}
Sep 08 14:46:09.035800 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:09.035719    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw"
Sep 08 14:46:09.074018 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:09.073969    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw" podStartSLOduration=2.581725222 podStartE2EDuration="3.073955158s" totalImagesPullingTime="492.229936ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:46:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:46:09.072058088 +0000 UTC m=+730.110459006" watchObservedRunningTime="2026-09-08 14:46:09.073955158 +0000 UTC m=+730.112356080"
Sep 08 14:46:10.172535 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:10.172510    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7880-139777572537520"
Sep 08 14:46:10.194451 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:10.194421    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7880-139777572537520_f0c7dc86-a432-4c63-b0da-cf2964b12d4a/test-curl-7880-139777572537520/0.log"
Sep 08 14:46:10.219896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:10.219863    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7880-139777572537520"]
Sep 08 14:46:10.227080 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:10.227056    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7880-139777572537520"]
Sep 08 14:46:10.271841 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:10.271816    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jtzm\" (UniqueName: \"kubernetes.io/projected/f0c7dc86-a432-4c63-b0da-cf2964b12d4a-kube-api-access-5jtzm\") pod \"f0c7dc86-a432-4c63-b0da-cf2964b12d4a\" (UID: \"f0c7dc86-a432-4c63-b0da-cf2964b12d4a\") "
Sep 08 14:46:10.273927 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:10.273904    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0c7dc86-a432-4c63-b0da-cf2964b12d4a-kube-api-access-5jtzm" (OuterVolumeSpecName: "kube-api-access-5jtzm") pod "f0c7dc86-a432-4c63-b0da-cf2964b12d4a" (UID: "f0c7dc86-a432-4c63-b0da-cf2964b12d4a"). InnerVolumeSpecName "kube-api-access-5jtzm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:46:10.372822 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:10.372751    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jtzm\" (UniqueName: \"kubernetes.io/projected/f0c7dc86-a432-4c63-b0da-cf2964b12d4a-kube-api-access-5jtzm\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:46:11.049621 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:11.049582    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7880-139777572537520"
Sep 08 14:46:11.049621 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:11.049607    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="03f897e70d65e69fa8bb4090c4670ef598bdcccf022ba0305e26199c21424b88"
Sep 08 14:46:11.059294 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:46:11.059268    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7880-139777572537520\" is forbidden: User \"system:node:ip-10-0-142-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-20.ec2.internal' and this object" podUID="f0c7dc86-a432-4c63-b0da-cf2964b12d4a" pod="opendatahub/test-curl-7880-139777572537520"
Sep 08 14:46:11.490381 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:11.490350    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0c7dc86-a432-4c63-b0da-cf2964b12d4a" path="/var/lib/kubelet/pods/f0c7dc86-a432-4c63-b0da-cf2964b12d4a/volumes"
Sep 08 14:46:14.265672 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:14.265645    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc"]
Sep 08 14:46:14.266103 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:14.266085    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0c7dc86-a432-4c63-b0da-cf2964b12d4a" containerName="test-curl-7880-139777572537520"
Sep 08 14:46:14.266190 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:14.266106    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0c7dc86-a432-4c63-b0da-cf2964b12d4a" containerName="test-curl-7880-139777572537520"
Sep 08 14:46:14.266190 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:14.266168    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0c7dc86-a432-4c63-b0da-cf2964b12d4a" containerName="test-curl-7880-139777572537520"
Sep 08 14:46:14.269508 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:14.269487    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc"
Sep 08 14:46:14.272526 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:14.272508    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-3af37e0c-serving-cert\""
Sep 08 14:46:14.287490 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:14.287422    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc"]
Sep 08 14:46:14.405185 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:14.405137    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f88969b2-a1d2-432c-94da-5d658c843638-metrics-certs\") pod \"maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc\" (UID: \"f88969b2-a1d2-432c-94da-5d658c843638\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc"
Sep 08 14:46:14.405373 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:14.405198    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-766jp\" (UniqueName: \"kubernetes.io/projected/f88969b2-a1d2-432c-94da-5d658c843638-kube-api-access-766jp\") pod \"maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc\" (UID: \"f88969b2-a1d2-432c-94da-5d658c843638\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc"
Sep 08 14:46:14.405373 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:14.405251    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f88969b2-a1d2-432c-94da-5d658c843638-openshift-service-ca\") pod \"maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc\" (UID: \"f88969b2-a1d2-432c-94da-5d658c843638\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc"
Sep 08 14:46:14.405373 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:14.405288    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f88969b2-a1d2-432c-94da-5d658c843638-maas-api-tls\") pod \"maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc\" (UID: \"f88969b2-a1d2-432c-94da-5d658c843638\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc"
Sep 08 14:46:14.505737 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:14.505709    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f88969b2-a1d2-432c-94da-5d658c843638-metrics-certs\") pod \"maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc\" (UID: \"f88969b2-a1d2-432c-94da-5d658c843638\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc"
Sep 08 14:46:14.505927 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:14.505753    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-766jp\" (UniqueName: \"kubernetes.io/projected/f88969b2-a1d2-432c-94da-5d658c843638-kube-api-access-766jp\") pod \"maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc\" (UID: \"f88969b2-a1d2-432c-94da-5d658c843638\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc"
Sep 08 14:46:14.505927 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:14.505790    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f88969b2-a1d2-432c-94da-5d658c843638-openshift-service-ca\") pod \"maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc\" (UID: \"f88969b2-a1d2-432c-94da-5d658c843638\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc"
Sep 08 14:46:14.505927 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:14.505814    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f88969b2-a1d2-432c-94da-5d658c843638-maas-api-tls\") pod \"maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc\" (UID: \"f88969b2-a1d2-432c-94da-5d658c843638\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc"
Sep 08 14:46:14.505927 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:46:14.505912    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-serving-cert: secret "maas-api-e2e-ait-3af37e0c-serving-cert" not found
Sep 08 14:46:14.506133 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:46:14.505961    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f88969b2-a1d2-432c-94da-5d658c843638-maas-api-tls podName:f88969b2-a1d2-432c-94da-5d658c843638 nodeName:}" failed. No retries permitted until 2026-09-08 14:46:15.005946502 +0000 UTC m=+736.044347403 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f88969b2-a1d2-432c-94da-5d658c843638-maas-api-tls") pod "maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc" (UID: "f88969b2-a1d2-432c-94da-5d658c843638") : secret "maas-api-e2e-ait-3af37e0c-serving-cert" not found
Sep 08 14:46:14.506885 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:14.506853    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f88969b2-a1d2-432c-94da-5d658c843638-openshift-service-ca\") pod \"maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc\" (UID: \"f88969b2-a1d2-432c-94da-5d658c843638\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc"
Sep 08 14:46:14.508526 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:14.508501    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f88969b2-a1d2-432c-94da-5d658c843638-metrics-certs\") pod \"maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc\" (UID: \"f88969b2-a1d2-432c-94da-5d658c843638\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc"
Sep 08 14:46:14.524451 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:14.524388    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-766jp\" (UniqueName: \"kubernetes.io/projected/f88969b2-a1d2-432c-94da-5d658c843638-kube-api-access-766jp\") pod \"maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc\" (UID: \"f88969b2-a1d2-432c-94da-5d658c843638\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc"
Sep 08 14:46:15.010963 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:15.010928    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f88969b2-a1d2-432c-94da-5d658c843638-maas-api-tls\") pod \"maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc\" (UID: \"f88969b2-a1d2-432c-94da-5d658c843638\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc"
Sep 08 14:46:15.013691 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:15.013663    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f88969b2-a1d2-432c-94da-5d658c843638-maas-api-tls\") pod \"maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc\" (UID: \"f88969b2-a1d2-432c-94da-5d658c843638\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc"
Sep 08 14:46:15.048671 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:15.048646    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw"
Sep 08 14:46:15.178854 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:15.178822    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc"
Sep 08 14:46:15.465546 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:15.465518    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc"]
Sep 08 14:46:15.466910 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:46:15.466882    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf88969b2_a1d2_432c_94da_5d658c843638.slice/crio-8b4e0d7bb935ab8b939d720cb48f97c149184c43b054a7d8ff60fa1c0ff74a0b WatchSource:0}: Error finding container 8b4e0d7bb935ab8b939d720cb48f97c149184c43b054a7d8ff60fa1c0ff74a0b: Status 404 returned error can't find the container with id 8b4e0d7bb935ab8b939d720cb48f97c149184c43b054a7d8ff60fa1c0ff74a0b
Sep 08 14:46:16.082770 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:16.082729    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc" event={"ID":"f88969b2-a1d2-432c-94da-5d658c843638","Type":"ContainerStarted","Data":"26e3b8f151070b23100f05981cf4e720fcb1eba95e239c59b88c1cb1508e784e"}
Sep 08 14:46:16.082943 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:16.082787    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc" event={"ID":"f88969b2-a1d2-432c-94da-5d658c843638","Type":"ContainerStarted","Data":"8b4e0d7bb935ab8b939d720cb48f97c149184c43b054a7d8ff60fa1c0ff74a0b"}
Sep 08 14:46:16.082943 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:16.082879    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc"
Sep 08 14:46:16.102834 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:16.102779    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc" podStartSLOduration=1.603686781 podStartE2EDuration="2.10276189s" totalImagesPullingTime="499.075109ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:46:16.101086153 +0000 UTC m=+737.139487076" watchObservedRunningTime="2026-09-08 14:46:16.10276189 +0000 UTC m=+737.141162811"
Sep 08 14:46:16.182529 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:16.182488    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-71518b-5776ffbf88-hpsgb"]
Sep 08 14:46:16.194524 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:16.194459    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-71518b-5776ffbf88-hpsgb"
Sep 08 14:46:16.198263 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:16.198236    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-71518b-serving-cert\""
Sep 08 14:46:16.200291 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:16.200263    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-71518b-5776ffbf88-hpsgb"]
Sep 08 14:46:16.322644 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:16.322560    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dec73e6c-462c-4c13-adf0-e6574f38ca2f-maas-api-tls\") pod \"maas-api-e2e-autores-71518b-5776ffbf88-hpsgb\" (UID: \"dec73e6c-462c-4c13-adf0-e6574f38ca2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-71518b-5776ffbf88-hpsgb"
Sep 08 14:46:16.322644 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:16.322625    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dec73e6c-462c-4c13-adf0-e6574f38ca2f-openshift-service-ca\") pod \"maas-api-e2e-autores-71518b-5776ffbf88-hpsgb\" (UID: \"dec73e6c-462c-4c13-adf0-e6574f38ca2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-71518b-5776ffbf88-hpsgb"
Sep 08 14:46:16.322855 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:16.322695    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hxfz\" (UniqueName: \"kubernetes.io/projected/dec73e6c-462c-4c13-adf0-e6574f38ca2f-kube-api-access-9hxfz\") pod \"maas-api-e2e-autores-71518b-5776ffbf88-hpsgb\" (UID: \"dec73e6c-462c-4c13-adf0-e6574f38ca2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-71518b-5776ffbf88-hpsgb"
Sep 08 14:46:16.322855 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:16.322723    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dec73e6c-462c-4c13-adf0-e6574f38ca2f-metrics-certs\") pod \"maas-api-e2e-autores-71518b-5776ffbf88-hpsgb\" (UID: \"dec73e6c-462c-4c13-adf0-e6574f38ca2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-71518b-5776ffbf88-hpsgb"
Sep 08 14:46:16.423625 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:16.423586    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dec73e6c-462c-4c13-adf0-e6574f38ca2f-maas-api-tls\") pod \"maas-api-e2e-autores-71518b-5776ffbf88-hpsgb\" (UID: \"dec73e6c-462c-4c13-adf0-e6574f38ca2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-71518b-5776ffbf88-hpsgb"
Sep 08 14:46:16.423808 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:16.423663    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dec73e6c-462c-4c13-adf0-e6574f38ca2f-openshift-service-ca\") pod \"maas-api-e2e-autores-71518b-5776ffbf88-hpsgb\" (UID: \"dec73e6c-462c-4c13-adf0-e6574f38ca2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-71518b-5776ffbf88-hpsgb"
Sep 08 14:46:16.423808 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:16.423737    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hxfz\" (UniqueName: \"kubernetes.io/projected/dec73e6c-462c-4c13-adf0-e6574f38ca2f-kube-api-access-9hxfz\") pod \"maas-api-e2e-autores-71518b-5776ffbf88-hpsgb\" (UID: \"dec73e6c-462c-4c13-adf0-e6574f38ca2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-71518b-5776ffbf88-hpsgb"
Sep 08 14:46:16.423808 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:46:16.423748    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-71518b-serving-cert: secret "maas-api-e2e-autores-71518b-serving-cert" not found
Sep 08 14:46:16.423808 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:16.423762    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dec73e6c-462c-4c13-adf0-e6574f38ca2f-metrics-certs\") pod \"maas-api-e2e-autores-71518b-5776ffbf88-hpsgb\" (UID: \"dec73e6c-462c-4c13-adf0-e6574f38ca2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-71518b-5776ffbf88-hpsgb"
Sep 08 14:46:16.424040 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:46:16.423811    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dec73e6c-462c-4c13-adf0-e6574f38ca2f-maas-api-tls podName:dec73e6c-462c-4c13-adf0-e6574f38ca2f nodeName:}" failed. No retries permitted until 2026-09-08 14:46:16.923793789 +0000 UTC m=+737.962194689 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dec73e6c-462c-4c13-adf0-e6574f38ca2f-maas-api-tls") pod "maas-api-e2e-autores-71518b-5776ffbf88-hpsgb" (UID: "dec73e6c-462c-4c13-adf0-e6574f38ca2f") : secret "maas-api-e2e-autores-71518b-serving-cert" not found
Sep 08 14:46:16.424496 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:16.424454    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dec73e6c-462c-4c13-adf0-e6574f38ca2f-openshift-service-ca\") pod \"maas-api-e2e-autores-71518b-5776ffbf88-hpsgb\" (UID: \"dec73e6c-462c-4c13-adf0-e6574f38ca2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-71518b-5776ffbf88-hpsgb"
Sep 08 14:46:16.426353 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:16.426331    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dec73e6c-462c-4c13-adf0-e6574f38ca2f-metrics-certs\") pod \"maas-api-e2e-autores-71518b-5776ffbf88-hpsgb\" (UID: \"dec73e6c-462c-4c13-adf0-e6574f38ca2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-71518b-5776ffbf88-hpsgb"
Sep 08 14:46:16.435274 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:16.435251    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hxfz\" (UniqueName: \"kubernetes.io/projected/dec73e6c-462c-4c13-adf0-e6574f38ca2f-kube-api-access-9hxfz\") pod \"maas-api-e2e-autores-71518b-5776ffbf88-hpsgb\" (UID: \"dec73e6c-462c-4c13-adf0-e6574f38ca2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-71518b-5776ffbf88-hpsgb"
Sep 08 14:46:16.928321 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:16.928289    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dec73e6c-462c-4c13-adf0-e6574f38ca2f-maas-api-tls\") pod \"maas-api-e2e-autores-71518b-5776ffbf88-hpsgb\" (UID: \"dec73e6c-462c-4c13-adf0-e6574f38ca2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-71518b-5776ffbf88-hpsgb"
Sep 08 14:46:16.930825 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:16.930800    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dec73e6c-462c-4c13-adf0-e6574f38ca2f-maas-api-tls\") pod \"maas-api-e2e-autores-71518b-5776ffbf88-hpsgb\" (UID: \"dec73e6c-462c-4c13-adf0-e6574f38ca2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-71518b-5776ffbf88-hpsgb"
Sep 08 14:46:16.978662 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:16.978639    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww"]
Sep 08 14:46:16.982321 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:16.982307    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww"
Sep 08 14:46:16.985132 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:16.985113    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-71518b\""
Sep 08 14:46:16.985223 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:16.985157    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-71518b-dockercfg-zcsl6\""
Sep 08 14:46:16.997074 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:16.997040    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww"]
Sep 08 14:46:17.029353 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:17.029324    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww\" (UID: \"f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww"
Sep 08 14:46:17.029446 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:17.029360    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnp7c\" (UniqueName: \"kubernetes.io/projected/f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463-kube-api-access-pnp7c\") pod \"payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww\" (UID: \"f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww"
Sep 08 14:46:17.106545 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:17.106520    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-71518b-5776ffbf88-hpsgb"
Sep 08 14:46:17.131070 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:17.131035    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww\" (UID: \"f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww"
Sep 08 14:46:17.131193 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:17.131087    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnp7c\" (UniqueName: \"kubernetes.io/projected/f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463-kube-api-access-pnp7c\") pod \"payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww\" (UID: \"f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww"
Sep 08 14:46:17.131919 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:17.131893    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww\" (UID: \"f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww"
Sep 08 14:46:17.143092 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:17.143053    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnp7c\" (UniqueName: \"kubernetes.io/projected/f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463-kube-api-access-pnp7c\") pod \"payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww\" (UID: \"f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww"
Sep 08 14:46:17.292556 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:17.292451    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww"
Sep 08 14:46:17.388658 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:17.388635    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-71518b-5776ffbf88-hpsgb"]
Sep 08 14:46:17.390371 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:46:17.390347    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddec73e6c_462c_4c13_adf0_e6574f38ca2f.slice/crio-127f1057f42a4a60e1f4b605798985b97939fdd44314743141a60f178f97e489 WatchSource:0}: Error finding container 127f1057f42a4a60e1f4b605798985b97939fdd44314743141a60f178f97e489: Status 404 returned error can't find the container with id 127f1057f42a4a60e1f4b605798985b97939fdd44314743141a60f178f97e489
Sep 08 14:46:17.474266 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:17.474237    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:46:17.573512 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:17.573491    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww"]
Sep 08 14:46:17.575409 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:46:17.575386    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2f5fc0c_0c2f_4cd6_a5a5_ee730649d463.slice/crio-41f8a5204f432e5000f0e5a653f3a3756e699902e39aa712fb606dba52b274a6 WatchSource:0}: Error finding container 41f8a5204f432e5000f0e5a653f3a3756e699902e39aa712fb606dba52b274a6: Status 404 returned error can't find the container with id 41f8a5204f432e5000f0e5a653f3a3756e699902e39aa712fb606dba52b274a6
Sep 08 14:46:18.096479 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:18.096445    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-71518b-5776ffbf88-hpsgb" event={"ID":"dec73e6c-462c-4c13-adf0-e6574f38ca2f","Type":"ContainerStarted","Data":"1f2140070cf9bccb9cd24a96c87060cf88d3ea0657bf1cfa9e6a4734f994a272"}
Sep 08 14:46:18.096855 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:18.096513    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-71518b-5776ffbf88-hpsgb" event={"ID":"dec73e6c-462c-4c13-adf0-e6574f38ca2f","Type":"ContainerStarted","Data":"127f1057f42a4a60e1f4b605798985b97939fdd44314743141a60f178f97e489"}
Sep 08 14:46:18.096855 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:18.096539    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-71518b-5776ffbf88-hpsgb"
Sep 08 14:46:18.098272 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:18.098247    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww" event={"ID":"f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463","Type":"ContainerStarted","Data":"23cb85e87d38b081a922e02eb99ec27d3f7080841bdbff499e12618fdd70829d"}
Sep 08 14:46:18.098427 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:18.098294    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww" event={"ID":"f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463","Type":"ContainerStarted","Data":"41f8a5204f432e5000f0e5a653f3a3756e699902e39aa712fb606dba52b274a6"}
Sep 08 14:46:18.098427 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:18.098323    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww"
Sep 08 14:46:18.122769 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:18.122722    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-71518b-5776ffbf88-hpsgb" podStartSLOduration=1.56910222 podStartE2EDuration="2.122706881s" totalImagesPullingTime="553.604661ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:46:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:46:18.120186799 +0000 UTC m=+739.158587720" watchObservedRunningTime="2026-09-08 14:46:18.122706881 +0000 UTC m=+739.161107848"
Sep 08 14:46:18.144034 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:18.143988    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww" podStartSLOduration=2.143973643 podStartE2EDuration="2.143973643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:46:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:46:18.142826889 +0000 UTC m=+739.181227815" watchObservedRunningTime="2026-09-08 14:46:18.143973643 +0000 UTC m=+739.182374565"
Sep 08 14:46:22.093923 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:22.093893    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc"
Sep 08 14:46:24.110017 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:24.109899    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-71518b-5776ffbf88-hpsgb"
Sep 08 14:46:29.107213 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:29.107179    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww"
Sep 08 14:46:33.570458 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:33.570424    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:46:36.481168 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:36.481136    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv"]
Sep 08 14:46:36.484930 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:36.484911    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv"
Sep 08 14:46:36.487689 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:36.487667    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-02a199-serving-cert\""
Sep 08 14:46:36.502261 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:36.502234    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv"]
Sep 08 14:46:36.603376 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:36.603343    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f3ecf81-fddc-46a0-a5ea-cea5b05854a1-openshift-service-ca\") pod \"maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv\" (UID: \"1f3ecf81-fddc-46a0-a5ea-cea5b05854a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv"
Sep 08 14:46:36.603569 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:36.603413    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f3ecf81-fddc-46a0-a5ea-cea5b05854a1-maas-api-tls\") pod \"maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv\" (UID: \"1f3ecf81-fddc-46a0-a5ea-cea5b05854a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv"
Sep 08 14:46:36.603569 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:36.603458    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq2t9\" (UniqueName: \"kubernetes.io/projected/1f3ecf81-fddc-46a0-a5ea-cea5b05854a1-kube-api-access-fq2t9\") pod \"maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv\" (UID: \"1f3ecf81-fddc-46a0-a5ea-cea5b05854a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv"
Sep 08 14:46:36.603569 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:36.603540    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f3ecf81-fddc-46a0-a5ea-cea5b05854a1-metrics-certs\") pod \"maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv\" (UID: \"1f3ecf81-fddc-46a0-a5ea-cea5b05854a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv"
Sep 08 14:46:36.704789 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:36.704752    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f3ecf81-fddc-46a0-a5ea-cea5b05854a1-maas-api-tls\") pod \"maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv\" (UID: \"1f3ecf81-fddc-46a0-a5ea-cea5b05854a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv"
Sep 08 14:46:36.704929 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:36.704797    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq2t9\" (UniqueName: \"kubernetes.io/projected/1f3ecf81-fddc-46a0-a5ea-cea5b05854a1-kube-api-access-fq2t9\") pod \"maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv\" (UID: \"1f3ecf81-fddc-46a0-a5ea-cea5b05854a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv"
Sep 08 14:46:36.704929 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:36.704833    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f3ecf81-fddc-46a0-a5ea-cea5b05854a1-metrics-certs\") pod \"maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv\" (UID: \"1f3ecf81-fddc-46a0-a5ea-cea5b05854a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv"
Sep 08 14:46:36.704929 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:46:36.704897    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-serving-cert: secret "maas-api-e2e-inf-b-02a199-serving-cert" not found
Sep 08 14:46:36.704929 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:36.704909    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f3ecf81-fddc-46a0-a5ea-cea5b05854a1-openshift-service-ca\") pod \"maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv\" (UID: \"1f3ecf81-fddc-46a0-a5ea-cea5b05854a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv"
Sep 08 14:46:36.705156 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:46:36.704967    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f3ecf81-fddc-46a0-a5ea-cea5b05854a1-maas-api-tls podName:1f3ecf81-fddc-46a0-a5ea-cea5b05854a1 nodeName:}" failed. No retries permitted until 2026-09-08 14:46:37.204947966 +0000 UTC m=+758.243348871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1f3ecf81-fddc-46a0-a5ea-cea5b05854a1-maas-api-tls") pod "maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv" (UID: "1f3ecf81-fddc-46a0-a5ea-cea5b05854a1") : secret "maas-api-e2e-inf-b-02a199-serving-cert" not found
Sep 08 14:46:36.705663 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:36.705640    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f3ecf81-fddc-46a0-a5ea-cea5b05854a1-openshift-service-ca\") pod \"maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv\" (UID: \"1f3ecf81-fddc-46a0-a5ea-cea5b05854a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv"
Sep 08 14:46:36.707711 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:36.707677    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f3ecf81-fddc-46a0-a5ea-cea5b05854a1-metrics-certs\") pod \"maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv\" (UID: \"1f3ecf81-fddc-46a0-a5ea-cea5b05854a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv"
Sep 08 14:46:36.717138 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:36.717107    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq2t9\" (UniqueName: \"kubernetes.io/projected/1f3ecf81-fddc-46a0-a5ea-cea5b05854a1-kube-api-access-fq2t9\") pod \"maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv\" (UID: \"1f3ecf81-fddc-46a0-a5ea-cea5b05854a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv"
Sep 08 14:46:37.209648 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:37.209613    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f3ecf81-fddc-46a0-a5ea-cea5b05854a1-maas-api-tls\") pod \"maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv\" (UID: \"1f3ecf81-fddc-46a0-a5ea-cea5b05854a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv"
Sep 08 14:46:37.212166 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:37.212139    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f3ecf81-fddc-46a0-a5ea-cea5b05854a1-maas-api-tls\") pod \"maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv\" (UID: \"1f3ecf81-fddc-46a0-a5ea-cea5b05854a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv"
Sep 08 14:46:37.395195 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:37.395164    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv"
Sep 08 14:46:37.678825 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:37.678803    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv"]
Sep 08 14:46:37.680913 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:46:37.680889    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f3ecf81_fddc_46a0_a5ea_cea5b05854a1.slice/crio-efda3536048be01a6b69d94fe5842fcc48c0d4bb3abce0a1647239f8fb658205 WatchSource:0}: Error finding container efda3536048be01a6b69d94fe5842fcc48c0d4bb3abce0a1647239f8fb658205: Status 404 returned error can't find the container with id efda3536048be01a6b69d94fe5842fcc48c0d4bb3abce0a1647239f8fb658205
Sep 08 14:46:38.222843 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:38.222812    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv" event={"ID":"1f3ecf81-fddc-46a0-a5ea-cea5b05854a1","Type":"ContainerStarted","Data":"efda3536048be01a6b69d94fe5842fcc48c0d4bb3abce0a1647239f8fb658205"}
Sep 08 14:46:39.231108 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:39.231065    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv" event={"ID":"1f3ecf81-fddc-46a0-a5ea-cea5b05854a1","Type":"ContainerStarted","Data":"df8928753d46318f18381bb0730cd05f97395e6c3230589b30e2ae18a0d14cce"}
Sep 08 14:46:39.231595 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:39.231231    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv"
Sep 08 14:46:39.254002 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:39.253956    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv" podStartSLOduration=2.7721162809999997 podStartE2EDuration="3.253942357s" totalImagesPullingTime="481.826076ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:46:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:46:39.251726965 +0000 UTC m=+760.290127887" watchObservedRunningTime="2026-09-08 14:46:39.253942357 +0000 UTC m=+760.292343305"
Sep 08 14:46:45.242317 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:45.242284    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv"
Sep 08 14:46:45.343732 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:45.343702    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc"]
Sep 08 14:46:45.343914 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:45.343890    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc" podUID="f88969b2-a1d2-432c-94da-5d658c843638" containerName="maas-api" containerID="cri-o://26e3b8f151070b23100f05981cf4e720fcb1eba95e239c59b88c1cb1508e784e" gracePeriod=30
Sep 08 14:46:45.598168 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:45.598145    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc"
Sep 08 14:46:45.680046 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:45.680014    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f88969b2-a1d2-432c-94da-5d658c843638-openshift-service-ca\") pod \"f88969b2-a1d2-432c-94da-5d658c843638\" (UID: \"f88969b2-a1d2-432c-94da-5d658c843638\") "
Sep 08 14:46:45.680216 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:45.680073    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-766jp\" (UniqueName: \"kubernetes.io/projected/f88969b2-a1d2-432c-94da-5d658c843638-kube-api-access-766jp\") pod \"f88969b2-a1d2-432c-94da-5d658c843638\" (UID: \"f88969b2-a1d2-432c-94da-5d658c843638\") "
Sep 08 14:46:45.680216 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:45.680090    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f88969b2-a1d2-432c-94da-5d658c843638-maas-api-tls\") pod \"f88969b2-a1d2-432c-94da-5d658c843638\" (UID: \"f88969b2-a1d2-432c-94da-5d658c843638\") "
Sep 08 14:46:45.680216 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:45.680140    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f88969b2-a1d2-432c-94da-5d658c843638-metrics-certs\") pod \"f88969b2-a1d2-432c-94da-5d658c843638\" (UID: \"f88969b2-a1d2-432c-94da-5d658c843638\") "
Sep 08 14:46:45.680386 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:45.680360    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f88969b2-a1d2-432c-94da-5d658c843638-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f88969b2-a1d2-432c-94da-5d658c843638" (UID: "f88969b2-a1d2-432c-94da-5d658c843638"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:46:45.682423 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:45.682400    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f88969b2-a1d2-432c-94da-5d658c843638-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f88969b2-a1d2-432c-94da-5d658c843638" (UID: "f88969b2-a1d2-432c-94da-5d658c843638"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:46:45.682547 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:45.682420    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f88969b2-a1d2-432c-94da-5d658c843638-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f88969b2-a1d2-432c-94da-5d658c843638" (UID: "f88969b2-a1d2-432c-94da-5d658c843638"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:46:45.682547 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:45.682486    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f88969b2-a1d2-432c-94da-5d658c843638-kube-api-access-766jp" (OuterVolumeSpecName: "kube-api-access-766jp") pod "f88969b2-a1d2-432c-94da-5d658c843638" (UID: "f88969b2-a1d2-432c-94da-5d658c843638"). InnerVolumeSpecName "kube-api-access-766jp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:46:45.780815 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:45.780730    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f88969b2-a1d2-432c-94da-5d658c843638-openshift-service-ca\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:46:45.780815 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:45.780762    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-766jp\" (UniqueName: \"kubernetes.io/projected/f88969b2-a1d2-432c-94da-5d658c843638-kube-api-access-766jp\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:46:45.780815 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:45.780774    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f88969b2-a1d2-432c-94da-5d658c843638-maas-api-tls\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:46:45.780815 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:45.780785    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f88969b2-a1d2-432c-94da-5d658c843638-metrics-certs\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:46:46.282838 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.282808    2577 generic.go:356] "Generic (PLEG): container finished" podID="f88969b2-a1d2-432c-94da-5d658c843638" containerID="26e3b8f151070b23100f05981cf4e720fcb1eba95e239c59b88c1cb1508e784e" exitCode=0
Sep 08 14:46:46.283247 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.282859    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc"
Sep 08 14:46:46.283247 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.282865    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc" event={"ID":"f88969b2-a1d2-432c-94da-5d658c843638","Type":"ContainerDied","Data":"26e3b8f151070b23100f05981cf4e720fcb1eba95e239c59b88c1cb1508e784e"}
Sep 08 14:46:46.283247 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.282906    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc" event={"ID":"f88969b2-a1d2-432c-94da-5d658c843638","Type":"ContainerDied","Data":"8b4e0d7bb935ab8b939d720cb48f97c149184c43b054a7d8ff60fa1c0ff74a0b"}
Sep 08 14:46:46.283247 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.282932    2577 scope.go:117] "RemoveContainer" containerID="26e3b8f151070b23100f05981cf4e720fcb1eba95e239c59b88c1cb1508e784e"
Sep 08 14:46:46.292333 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.292315    2577 scope.go:117] "RemoveContainer" containerID="26e3b8f151070b23100f05981cf4e720fcb1eba95e239c59b88c1cb1508e784e"
Sep 08 14:46:46.292636 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:46:46.292618    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26e3b8f151070b23100f05981cf4e720fcb1eba95e239c59b88c1cb1508e784e\": container with ID starting with 26e3b8f151070b23100f05981cf4e720fcb1eba95e239c59b88c1cb1508e784e not found: ID does not exist" containerID="26e3b8f151070b23100f05981cf4e720fcb1eba95e239c59b88c1cb1508e784e"
Sep 08 14:46:46.292702 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.292642    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26e3b8f151070b23100f05981cf4e720fcb1eba95e239c59b88c1cb1508e784e"} err="failed to get container status \"26e3b8f151070b23100f05981cf4e720fcb1eba95e239c59b88c1cb1508e784e\": rpc error: code = NotFound desc = could not find container \"26e3b8f151070b23100f05981cf4e720fcb1eba95e239c59b88c1cb1508e784e\": container with ID starting with 26e3b8f151070b23100f05981cf4e720fcb1eba95e239c59b88c1cb1508e784e not found: ID does not exist"
Sep 08 14:46:46.337675 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.337645    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc"]
Sep 08 14:46:46.344210 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.344188    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3af37e0c-5f9c95884c-wntxc"]
Sep 08 14:46:46.808438 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.808407    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"]
Sep 08 14:46:46.808828 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.808814    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f88969b2-a1d2-432c-94da-5d658c843638" containerName="maas-api"
Sep 08 14:46:46.808828 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.808828    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f88969b2-a1d2-432c-94da-5d658c843638" containerName="maas-api"
Sep 08 14:46:46.808922 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.808896    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f88969b2-a1d2-432c-94da-5d658c843638" containerName="maas-api"
Sep 08 14:46:46.813544 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.813527    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:46.816117 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.816098    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 14:46:46.816262 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.816246    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-8ac49eaa-gw-openshift-default-dockercfg-8fh8z\""
Sep 08 14:46:46.827402 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.827375    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"]
Sep 08 14:46:46.887373 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.887332    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cb38dfc-5031-4485-96a6-e884c9e8d266-istio-podinfo\") pod \"e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") " pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:46.887373 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.887374    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cb38dfc-5031-4485-96a6-e884c9e8d266-istio-data\") pod \"e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") " pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:46.887642 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.887397    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cb38dfc-5031-4485-96a6-e884c9e8d266-istiod-ca-cert\") pod \"e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") " pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:46.887642 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.887492    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cb38dfc-5031-4485-96a6-e884c9e8d266-istio-envoy\") pod \"e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") " pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:46.887642 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.887516    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cb38dfc-5031-4485-96a6-e884c9e8d266-istio-token\") pod \"e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") " pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:46.887642 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.887554    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cb38dfc-5031-4485-96a6-e884c9e8d266-workload-certs\") pod \"e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") " pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:46.887642 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.887579    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4m6g\" (UniqueName: \"kubernetes.io/projected/3cb38dfc-5031-4485-96a6-e884c9e8d266-kube-api-access-f4m6g\") pod \"e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") " pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:46.887642 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.887603    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cb38dfc-5031-4485-96a6-e884c9e8d266-credential-socket\") pod \"e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") " pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:46.887835 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.887657    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cb38dfc-5031-4485-96a6-e884c9e8d266-workload-socket\") pod \"e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") " pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:46.988242 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.988205    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cb38dfc-5031-4485-96a6-e884c9e8d266-istio-podinfo\") pod \"e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") " pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:46.988242 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.988243    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cb38dfc-5031-4485-96a6-e884c9e8d266-istio-data\") pod \"e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") " pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:46.988512 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.988261    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cb38dfc-5031-4485-96a6-e884c9e8d266-istiod-ca-cert\") pod \"e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") " pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:46.988512 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.988314    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cb38dfc-5031-4485-96a6-e884c9e8d266-istio-envoy\") pod \"e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") " pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:46.988512 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.988329    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cb38dfc-5031-4485-96a6-e884c9e8d266-istio-token\") pod \"e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") " pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:46.988512 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.988371    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cb38dfc-5031-4485-96a6-e884c9e8d266-workload-certs\") pod \"e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") " pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:46.988512 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.988392    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4m6g\" (UniqueName: \"kubernetes.io/projected/3cb38dfc-5031-4485-96a6-e884c9e8d266-kube-api-access-f4m6g\") pod \"e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") " pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:46.988512 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.988416    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cb38dfc-5031-4485-96a6-e884c9e8d266-credential-socket\") pod \"e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") " pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:46.988512 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.988452    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cb38dfc-5031-4485-96a6-e884c9e8d266-workload-socket\") pod \"e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") " pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:46.989111 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.988698    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cb38dfc-5031-4485-96a6-e884c9e8d266-istio-data\") pod \"e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") " pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:46.989111 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.988807    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cb38dfc-5031-4485-96a6-e884c9e8d266-workload-certs\") pod \"e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") " pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:46.989111 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.988899    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cb38dfc-5031-4485-96a6-e884c9e8d266-workload-socket\") pod \"e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") " pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:46.989111 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.988976    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cb38dfc-5031-4485-96a6-e884c9e8d266-credential-socket\") pod \"e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") " pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:46.989276 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.989161    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cb38dfc-5031-4485-96a6-e884c9e8d266-istiod-ca-cert\") pod \"e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") " pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:46.990815 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.990790    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cb38dfc-5031-4485-96a6-e884c9e8d266-istio-envoy\") pod \"e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") " pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:46.990950 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.990929    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cb38dfc-5031-4485-96a6-e884c9e8d266-istio-podinfo\") pod \"e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") " pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:46.997711 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.997689    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cb38dfc-5031-4485-96a6-e884c9e8d266-istio-token\") pod \"e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") " pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:46.997809 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:46.997787    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4m6g\" (UniqueName: \"kubernetes.io/projected/3cb38dfc-5031-4485-96a6-e884c9e8d266-kube-api-access-f4m6g\") pod \"e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") " pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:47.124405 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:47.124329    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:47.404228 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:47.404204    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"]
Sep 08 14:46:47.406544 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:46:47.406511    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cb38dfc_5031_4485_96a6_e884c9e8d266.slice/crio-68bb167681850eae0b4b57ae942927af5307f910e4e2ee8d0ef6ac70e0056025 WatchSource:0}: Error finding container 68bb167681850eae0b4b57ae942927af5307f910e4e2ee8d0ef6ac70e0056025: Status 404 returned error can't find the container with id 68bb167681850eae0b4b57ae942927af5307f910e4e2ee8d0ef6ac70e0056025
Sep 08 14:46:47.490676 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:47.490649    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f88969b2-a1d2-432c-94da-5d658c843638" path="/var/lib/kubelet/pods/f88969b2-a1d2-432c-94da-5d658c843638/volumes"
Sep 08 14:46:48.297609 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:48.297568    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn" event={"ID":"3cb38dfc-5031-4485-96a6-e884c9e8d266","Type":"ContainerStarted","Data":"68bb167681850eae0b4b57ae942927af5307f910e4e2ee8d0ef6ac70e0056025"}
Sep 08 14:46:50.140291 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:50.140254    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:46:50.140581 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:50.140330    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:46:50.140581 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:50.140364    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:46:50.311830 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:50.311791    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn" event={"ID":"3cb38dfc-5031-4485-96a6-e884c9e8d266","Type":"ContainerStarted","Data":"8efd87d780efd0cbdec8c3dd1f5256d45d0105f639420c5902e59d9e8fbd892d"}
Sep 08 14:46:50.337393 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:50.337330    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn" podStartSLOduration=1.606122675 podStartE2EDuration="4.337309488s" totalImagesPullingTime="2.731186813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:46:50.334849834 +0000 UTC m=+771.373250756" watchObservedRunningTime="2026-09-08 14:46:50.337309488 +0000 UTC m=+771.375710410"
Sep 08 14:46:51.125026 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:51.124994    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:51.129847 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:51.129824    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:51.318810 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:51.318773    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:51.319795 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:51.319771    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:46:51.382849 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:51.382770    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:46:52.274055 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:52.274022    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl"]
Sep 08 14:46:52.279028 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:52.279008    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl"
Sep 08 14:46:52.281638 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:52.281620    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-8ac49eaa-serving-cert\""
Sep 08 14:46:52.291288 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:52.291269    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl"]
Sep 08 14:46:52.334073 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:52.334045    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d795ce5-4974-4b7b-94cf-fdb33011d0b8-openshift-service-ca\") pod \"maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl\" (UID: \"6d795ce5-4974-4b7b-94cf-fdb33011d0b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl"
Sep 08 14:46:52.334411 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:52.334245    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d795ce5-4974-4b7b-94cf-fdb33011d0b8-metrics-certs\") pod \"maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl\" (UID: \"6d795ce5-4974-4b7b-94cf-fdb33011d0b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl"
Sep 08 14:46:52.334411 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:52.334301    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp5sb\" (UniqueName: \"kubernetes.io/projected/6d795ce5-4974-4b7b-94cf-fdb33011d0b8-kube-api-access-fp5sb\") pod \"maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl\" (UID: \"6d795ce5-4974-4b7b-94cf-fdb33011d0b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl"
Sep 08 14:46:52.334411 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:52.334356    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d795ce5-4974-4b7b-94cf-fdb33011d0b8-maas-api-tls\") pod \"maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl\" (UID: \"6d795ce5-4974-4b7b-94cf-fdb33011d0b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl"
Sep 08 14:46:52.435431 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:52.435397    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d795ce5-4974-4b7b-94cf-fdb33011d0b8-openshift-service-ca\") pod \"maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl\" (UID: \"6d795ce5-4974-4b7b-94cf-fdb33011d0b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl"
Sep 08 14:46:52.435623 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:52.435457    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d795ce5-4974-4b7b-94cf-fdb33011d0b8-metrics-certs\") pod \"maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl\" (UID: \"6d795ce5-4974-4b7b-94cf-fdb33011d0b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl"
Sep 08 14:46:52.435623 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:52.435498    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp5sb\" (UniqueName: \"kubernetes.io/projected/6d795ce5-4974-4b7b-94cf-fdb33011d0b8-kube-api-access-fp5sb\") pod \"maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl\" (UID: \"6d795ce5-4974-4b7b-94cf-fdb33011d0b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl"
Sep 08 14:46:52.435623 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:52.435543    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d795ce5-4974-4b7b-94cf-fdb33011d0b8-maas-api-tls\") pod \"maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl\" (UID: \"6d795ce5-4974-4b7b-94cf-fdb33011d0b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl"
Sep 08 14:46:52.435753 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:46:52.435629    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-serving-cert: secret "maas-api-e2e-migrate-8ac49eaa-serving-cert" not found
Sep 08 14:46:52.435753 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:46:52.435688    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d795ce5-4974-4b7b-94cf-fdb33011d0b8-maas-api-tls podName:6d795ce5-4974-4b7b-94cf-fdb33011d0b8 nodeName:}" failed. No retries permitted until 2026-09-08 14:46:52.935670721 +0000 UTC m=+773.974071621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6d795ce5-4974-4b7b-94cf-fdb33011d0b8-maas-api-tls") pod "maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl" (UID: "6d795ce5-4974-4b7b-94cf-fdb33011d0b8") : secret "maas-api-e2e-migrate-8ac49eaa-serving-cert" not found
Sep 08 14:46:52.436154 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:52.436135    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d795ce5-4974-4b7b-94cf-fdb33011d0b8-openshift-service-ca\") pod \"maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl\" (UID: \"6d795ce5-4974-4b7b-94cf-fdb33011d0b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl"
Sep 08 14:46:52.438040 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:52.438017    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d795ce5-4974-4b7b-94cf-fdb33011d0b8-metrics-certs\") pod \"maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl\" (UID: \"6d795ce5-4974-4b7b-94cf-fdb33011d0b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl"
Sep 08 14:46:52.445436 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:52.445411    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp5sb\" (UniqueName: \"kubernetes.io/projected/6d795ce5-4974-4b7b-94cf-fdb33011d0b8-kube-api-access-fp5sb\") pod \"maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl\" (UID: \"6d795ce5-4974-4b7b-94cf-fdb33011d0b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl"
Sep 08 14:46:52.941442 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:52.941407    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d795ce5-4974-4b7b-94cf-fdb33011d0b8-maas-api-tls\") pod \"maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl\" (UID: \"6d795ce5-4974-4b7b-94cf-fdb33011d0b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl"
Sep 08 14:46:52.943898 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:52.943867    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d795ce5-4974-4b7b-94cf-fdb33011d0b8-maas-api-tls\") pod \"maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl\" (UID: \"6d795ce5-4974-4b7b-94cf-fdb33011d0b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl"
Sep 08 14:46:53.191371 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:53.191343    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl"
Sep 08 14:46:53.474578 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:53.474554    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl"]
Sep 08 14:46:53.476170 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:46:53.476150    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d795ce5_4974_4b7b_94cf_fdb33011d0b8.slice/crio-f7433f9f99d891f93eebc9f1ad17561b74428f593b1ece9134eefad942bded6c WatchSource:0}: Error finding container f7433f9f99d891f93eebc9f1ad17561b74428f593b1ece9134eefad942bded6c: Status 404 returned error can't find the container with id f7433f9f99d891f93eebc9f1ad17561b74428f593b1ece9134eefad942bded6c
Sep 08 14:46:54.337178 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:54.337142    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl" event={"ID":"6d795ce5-4974-4b7b-94cf-fdb33011d0b8","Type":"ContainerStarted","Data":"c8fd4fcb4dc0f86a574ee13cf879863f51588bef66459a3eb1c80301a4a46dea"}
Sep 08 14:46:54.337309 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:54.337206    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl" event={"ID":"6d795ce5-4974-4b7b-94cf-fdb33011d0b8","Type":"ContainerStarted","Data":"f7433f9f99d891f93eebc9f1ad17561b74428f593b1ece9134eefad942bded6c"}
Sep 08 14:46:54.337348 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:54.337313    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl"
Sep 08 14:46:54.356226 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:46:54.356184    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl" podStartSLOduration=1.586232967 podStartE2EDuration="2.356169281s" totalImagesPullingTime="769.936314ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:46:54.354897809 +0000 UTC m=+775.393298732" watchObservedRunningTime="2026-09-08 14:46:54.356169281 +0000 UTC m=+775.394570203"
Sep 08 14:47:00.348155 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:00.348128    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl"
Sep 08 14:47:11.082800 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:11.082764    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:47:11.462528 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:11.462457    2577 generic.go:356] "Generic (PLEG): container finished" podID="3cb38dfc-5031-4485-96a6-e884c9e8d266" containerID="8efd87d780efd0cbdec8c3dd1f5256d45d0105f639420c5902e59d9e8fbd892d" exitCode=0
Sep 08 14:47:11.462528 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:11.462531    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn" event={"ID":"3cb38dfc-5031-4485-96a6-e884c9e8d266","Type":"ContainerDied","Data":"8efd87d780efd0cbdec8c3dd1f5256d45d0105f639420c5902e59d9e8fbd892d"}
Sep 08 14:47:11.462922 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:11.462908    2577 scope.go:117] "RemoveContainer" containerID="8efd87d780efd0cbdec8c3dd1f5256d45d0105f639420c5902e59d9e8fbd892d"
Sep 08 14:47:11.463977 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:11.463952    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:47:11.464031 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:11.464017    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:47:11.464084 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:11.464071    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:47:12.470096 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:12.470061    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn" event={"ID":"3cb38dfc-5031-4485-96a6-e884c9e8d266","Type":"ContainerStarted","Data":"49ce05f441a482525fab39ff6aebf5d3d635caa3b9540e45dab5b5b3c437cebd"}
Sep 08 14:47:13.125291 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:13.125259    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:47:13.125708 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:13.125624    2577 patch_prober.go:28] interesting pod/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 08 14:47:13.125889 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:13.125867    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn" podUID="3cb38dfc-5031-4485-96a6-e884c9e8d266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 08 14:47:14.125211 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:14.125166    2577 patch_prober.go:28] interesting pod/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 08 14:47:14.125769 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:14.125235    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn" podUID="3cb38dfc-5031-4485-96a6-e884c9e8d266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 08 14:47:15.125717 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:15.125679    2577 patch_prober.go:28] interesting pod/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 08 14:47:15.126276 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:15.126244    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn" podUID="3cb38dfc-5031-4485-96a6-e884c9e8d266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 08 14:47:16.124999 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:16.124947    2577 patch_prober.go:28] interesting pod/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 08 14:47:16.125325 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:16.125025    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn" podUID="3cb38dfc-5031-4485-96a6-e884c9e8d266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 08 14:47:17.125606 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:17.125571    2577 patch_prober.go:28] interesting pod/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 08 14:47:17.126191 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:17.126159    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn" podUID="3cb38dfc-5031-4485-96a6-e884c9e8d266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 08 14:47:18.129629 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:18.129594    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:47:18.130015 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:18.129849    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:47:18.130545 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:18.130526    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:47:22.938507 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:22.938412    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl"]
Sep 08 14:47:22.938881 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:22.938634    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl" podUID="6d795ce5-4974-4b7b-94cf-fdb33011d0b8" containerName="maas-api" containerID="cri-o://c8fd4fcb4dc0f86a574ee13cf879863f51588bef66459a3eb1c80301a4a46dea" gracePeriod=30
Sep 08 14:47:23.196547 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:23.196491    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl"
Sep 08 14:47:23.325993 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:23.325956    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fp5sb\" (UniqueName: \"kubernetes.io/projected/6d795ce5-4974-4b7b-94cf-fdb33011d0b8-kube-api-access-fp5sb\") pod \"6d795ce5-4974-4b7b-94cf-fdb33011d0b8\" (UID: \"6d795ce5-4974-4b7b-94cf-fdb33011d0b8\") "
Sep 08 14:47:23.326167 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:23.326020    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d795ce5-4974-4b7b-94cf-fdb33011d0b8-openshift-service-ca\") pod \"6d795ce5-4974-4b7b-94cf-fdb33011d0b8\" (UID: \"6d795ce5-4974-4b7b-94cf-fdb33011d0b8\") "
Sep 08 14:47:23.326167 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:23.326054    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d795ce5-4974-4b7b-94cf-fdb33011d0b8-maas-api-tls\") pod \"6d795ce5-4974-4b7b-94cf-fdb33011d0b8\" (UID: \"6d795ce5-4974-4b7b-94cf-fdb33011d0b8\") "
Sep 08 14:47:23.326167 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:23.326111    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d795ce5-4974-4b7b-94cf-fdb33011d0b8-metrics-certs\") pod \"6d795ce5-4974-4b7b-94cf-fdb33011d0b8\" (UID: \"6d795ce5-4974-4b7b-94cf-fdb33011d0b8\") "
Sep 08 14:47:23.326354 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:23.326320    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d795ce5-4974-4b7b-94cf-fdb33011d0b8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6d795ce5-4974-4b7b-94cf-fdb33011d0b8" (UID: "6d795ce5-4974-4b7b-94cf-fdb33011d0b8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:47:23.328182 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:23.328153    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d795ce5-4974-4b7b-94cf-fdb33011d0b8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6d795ce5-4974-4b7b-94cf-fdb33011d0b8" (UID: "6d795ce5-4974-4b7b-94cf-fdb33011d0b8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:47:23.328306 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:23.328178    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d795ce5-4974-4b7b-94cf-fdb33011d0b8-kube-api-access-fp5sb" (OuterVolumeSpecName: "kube-api-access-fp5sb") pod "6d795ce5-4974-4b7b-94cf-fdb33011d0b8" (UID: "6d795ce5-4974-4b7b-94cf-fdb33011d0b8"). InnerVolumeSpecName "kube-api-access-fp5sb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:47:23.328306 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:23.328240    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d795ce5-4974-4b7b-94cf-fdb33011d0b8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6d795ce5-4974-4b7b-94cf-fdb33011d0b8" (UID: "6d795ce5-4974-4b7b-94cf-fdb33011d0b8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:47:23.359956 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:23.359930    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"]
Sep 08 14:47:23.360201 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:23.360177    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn" podUID="3cb38dfc-5031-4485-96a6-e884c9e8d266" containerName="istio-proxy" containerID="cri-o://49ce05f441a482525fab39ff6aebf5d3d635caa3b9540e45dab5b5b3c437cebd" gracePeriod=30
Sep 08 14:47:23.426907 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:23.426879    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fp5sb\" (UniqueName: \"kubernetes.io/projected/6d795ce5-4974-4b7b-94cf-fdb33011d0b8-kube-api-access-fp5sb\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:47:23.426907 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:23.426902    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d795ce5-4974-4b7b-94cf-fdb33011d0b8-openshift-service-ca\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:47:23.427054 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:23.426913    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d795ce5-4974-4b7b-94cf-fdb33011d0b8-maas-api-tls\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:47:23.427054 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:23.426921    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d795ce5-4974-4b7b-94cf-fdb33011d0b8-metrics-certs\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:47:23.544641 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:23.544613    2577 generic.go:356] "Generic (PLEG): container finished" podID="6d795ce5-4974-4b7b-94cf-fdb33011d0b8" containerID="c8fd4fcb4dc0f86a574ee13cf879863f51588bef66459a3eb1c80301a4a46dea" exitCode=0
Sep 08 14:47:23.544776 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:23.544648    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl"
Sep 08 14:47:23.544776 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:23.544688    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl" event={"ID":"6d795ce5-4974-4b7b-94cf-fdb33011d0b8","Type":"ContainerDied","Data":"c8fd4fcb4dc0f86a574ee13cf879863f51588bef66459a3eb1c80301a4a46dea"}
Sep 08 14:47:23.544776 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:23.544734    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl" event={"ID":"6d795ce5-4974-4b7b-94cf-fdb33011d0b8","Type":"ContainerDied","Data":"f7433f9f99d891f93eebc9f1ad17561b74428f593b1ece9134eefad942bded6c"}
Sep 08 14:47:23.544776 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:23.544754    2577 scope.go:117] "RemoveContainer" containerID="c8fd4fcb4dc0f86a574ee13cf879863f51588bef66459a3eb1c80301a4a46dea"
Sep 08 14:47:23.553795 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:23.553778    2577 scope.go:117] "RemoveContainer" containerID="c8fd4fcb4dc0f86a574ee13cf879863f51588bef66459a3eb1c80301a4a46dea"
Sep 08 14:47:23.554081 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:47:23.554062    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8fd4fcb4dc0f86a574ee13cf879863f51588bef66459a3eb1c80301a4a46dea\": container with ID starting with c8fd4fcb4dc0f86a574ee13cf879863f51588bef66459a3eb1c80301a4a46dea not found: ID does not exist" containerID="c8fd4fcb4dc0f86a574ee13cf879863f51588bef66459a3eb1c80301a4a46dea"
Sep 08 14:47:23.554153 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:23.554087    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8fd4fcb4dc0f86a574ee13cf879863f51588bef66459a3eb1c80301a4a46dea"} err="failed to get container status \"c8fd4fcb4dc0f86a574ee13cf879863f51588bef66459a3eb1c80301a4a46dea\": rpc error: code = NotFound desc = could not find container \"c8fd4fcb4dc0f86a574ee13cf879863f51588bef66459a3eb1c80301a4a46dea\": container with ID starting with c8fd4fcb4dc0f86a574ee13cf879863f51588bef66459a3eb1c80301a4a46dea not found: ID does not exist"
Sep 08 14:47:23.575960 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:23.575936    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl"]
Sep 08 14:47:23.578824 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:23.578803    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8ac49eaa-5c7966f894-hmjjl"]
Sep 08 14:47:25.491286 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:25.491253    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d795ce5-4974-4b7b-94cf-fdb33011d0b8" path="/var/lib/kubelet/pods/6d795ce5-4974-4b7b-94cf-fdb33011d0b8/volumes"
Sep 08 14:47:27.658022 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:27.657990    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-5988864584-7frx9"]
Sep 08 14:47:27.661216 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:27.660204    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d795ce5-4974-4b7b-94cf-fdb33011d0b8" containerName="maas-api"
Sep 08 14:47:27.661216 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:27.660231    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d795ce5-4974-4b7b-94cf-fdb33011d0b8" containerName="maas-api"
Sep 08 14:47:27.661216 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:27.660354    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d795ce5-4974-4b7b-94cf-fdb33011d0b8" containerName="maas-api"
Sep 08 14:47:27.664151 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:27.664129    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-5988864584-7frx9"
Sep 08 14:47:27.667165 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:27.667141    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-8066138e-serving-cert\""
Sep 08 14:47:27.675164 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:27.673925    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-5988864584-7frx9"]
Sep 08 14:47:27.765280 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:27.765246    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e36b2e35-11ba-470a-a651-e9958f9627db-maas-api-tls\") pod \"maas-api-e2e-ait-8066138e-5988864584-7frx9\" (UID: \"e36b2e35-11ba-470a-a651-e9958f9627db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-5988864584-7frx9"
Sep 08 14:47:27.765487 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:27.765322    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e36b2e35-11ba-470a-a651-e9958f9627db-metrics-certs\") pod \"maas-api-e2e-ait-8066138e-5988864584-7frx9\" (UID: \"e36b2e35-11ba-470a-a651-e9958f9627db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-5988864584-7frx9"
Sep 08 14:47:27.765487 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:27.765401    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e36b2e35-11ba-470a-a651-e9958f9627db-openshift-service-ca\") pod \"maas-api-e2e-ait-8066138e-5988864584-7frx9\" (UID: \"e36b2e35-11ba-470a-a651-e9958f9627db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-5988864584-7frx9"
Sep 08 14:47:27.765487 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:27.765452    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms6cs\" (UniqueName: \"kubernetes.io/projected/e36b2e35-11ba-470a-a651-e9958f9627db-kube-api-access-ms6cs\") pod \"maas-api-e2e-ait-8066138e-5988864584-7frx9\" (UID: \"e36b2e35-11ba-470a-a651-e9958f9627db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-5988864584-7frx9"
Sep 08 14:47:27.866837 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:27.866806    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e36b2e35-11ba-470a-a651-e9958f9627db-maas-api-tls\") pod \"maas-api-e2e-ait-8066138e-5988864584-7frx9\" (UID: \"e36b2e35-11ba-470a-a651-e9958f9627db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-5988864584-7frx9"
Sep 08 14:47:27.867021 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:27.866866    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e36b2e35-11ba-470a-a651-e9958f9627db-metrics-certs\") pod \"maas-api-e2e-ait-8066138e-5988864584-7frx9\" (UID: \"e36b2e35-11ba-470a-a651-e9958f9627db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-5988864584-7frx9"
Sep 08 14:47:27.867021 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:27.866912    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e36b2e35-11ba-470a-a651-e9958f9627db-openshift-service-ca\") pod \"maas-api-e2e-ait-8066138e-5988864584-7frx9\" (UID: \"e36b2e35-11ba-470a-a651-e9958f9627db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-5988864584-7frx9"
Sep 08 14:47:27.867021 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:27.866953    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms6cs\" (UniqueName: \"kubernetes.io/projected/e36b2e35-11ba-470a-a651-e9958f9627db-kube-api-access-ms6cs\") pod \"maas-api-e2e-ait-8066138e-5988864584-7frx9\" (UID: \"e36b2e35-11ba-470a-a651-e9958f9627db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-5988864584-7frx9"
Sep 08 14:47:27.867021 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:47:27.866969    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-serving-cert: secret "maas-api-e2e-ait-8066138e-serving-cert" not found
Sep 08 14:47:27.867257 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:47:27.867058    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e36b2e35-11ba-470a-a651-e9958f9627db-maas-api-tls podName:e36b2e35-11ba-470a-a651-e9958f9627db nodeName:}" failed. No retries permitted until 2026-09-08 14:47:28.367035298 +0000 UTC m=+809.405436200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e36b2e35-11ba-470a-a651-e9958f9627db-maas-api-tls") pod "maas-api-e2e-ait-8066138e-5988864584-7frx9" (UID: "e36b2e35-11ba-470a-a651-e9958f9627db") : secret "maas-api-e2e-ait-8066138e-serving-cert" not found
Sep 08 14:47:27.867604 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:27.867584    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e36b2e35-11ba-470a-a651-e9958f9627db-openshift-service-ca\") pod \"maas-api-e2e-ait-8066138e-5988864584-7frx9\" (UID: \"e36b2e35-11ba-470a-a651-e9958f9627db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-5988864584-7frx9"
Sep 08 14:47:27.869412 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:27.869393    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e36b2e35-11ba-470a-a651-e9958f9627db-metrics-certs\") pod \"maas-api-e2e-ait-8066138e-5988864584-7frx9\" (UID: \"e36b2e35-11ba-470a-a651-e9958f9627db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-5988864584-7frx9"
Sep 08 14:47:27.876985 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:27.876964    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms6cs\" (UniqueName: \"kubernetes.io/projected/e36b2e35-11ba-470a-a651-e9958f9627db-kube-api-access-ms6cs\") pod \"maas-api-e2e-ait-8066138e-5988864584-7frx9\" (UID: \"e36b2e35-11ba-470a-a651-e9958f9627db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-5988864584-7frx9"
Sep 08 14:47:28.371778 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.371753    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e36b2e35-11ba-470a-a651-e9958f9627db-maas-api-tls\") pod \"maas-api-e2e-ait-8066138e-5988864584-7frx9\" (UID: \"e36b2e35-11ba-470a-a651-e9958f9627db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-5988864584-7frx9"
Sep 08 14:47:28.374355 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.374331    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e36b2e35-11ba-470a-a651-e9958f9627db-maas-api-tls\") pod \"maas-api-e2e-ait-8066138e-5988864584-7frx9\" (UID: \"e36b2e35-11ba-470a-a651-e9958f9627db\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-5988864584-7frx9"
Sep 08 14:47:28.575830 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.575800    2577 generic.go:356] "Generic (PLEG): container finished" podID="3cb38dfc-5031-4485-96a6-e884c9e8d266" containerID="49ce05f441a482525fab39ff6aebf5d3d635caa3b9540e45dab5b5b3c437cebd" exitCode=0
Sep 08 14:47:28.575970 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.575874    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn" event={"ID":"3cb38dfc-5031-4485-96a6-e884c9e8d266","Type":"ContainerDied","Data":"49ce05f441a482525fab39ff6aebf5d3d635caa3b9540e45dab5b5b3c437cebd"}
Sep 08 14:47:28.575970 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.575935    2577 scope.go:117] "RemoveContainer" containerID="8efd87d780efd0cbdec8c3dd1f5256d45d0105f639420c5902e59d9e8fbd892d"
Sep 08 14:47:28.579165 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.579144    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-5988864584-7frx9"
Sep 08 14:47:28.614209 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.614182    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:47:28.775763 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.775732    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cb38dfc-5031-4485-96a6-e884c9e8d266-workload-socket\") pod \"3cb38dfc-5031-4485-96a6-e884c9e8d266\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") "
Sep 08 14:47:28.776243 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.775791    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cb38dfc-5031-4485-96a6-e884c9e8d266-credential-socket\") pod \"3cb38dfc-5031-4485-96a6-e884c9e8d266\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") "
Sep 08 14:47:28.776243 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.775836    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cb38dfc-5031-4485-96a6-e884c9e8d266-istiod-ca-cert\") pod \"3cb38dfc-5031-4485-96a6-e884c9e8d266\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") "
Sep 08 14:47:28.776243 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.775891    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cb38dfc-5031-4485-96a6-e884c9e8d266-istio-token\") pod \"3cb38dfc-5031-4485-96a6-e884c9e8d266\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") "
Sep 08 14:47:28.776243 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.775918    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cb38dfc-5031-4485-96a6-e884c9e8d266-istio-podinfo\") pod \"3cb38dfc-5031-4485-96a6-e884c9e8d266\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") "
Sep 08 14:47:28.776243 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.775940    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cb38dfc-5031-4485-96a6-e884c9e8d266-workload-certs\") pod \"3cb38dfc-5031-4485-96a6-e884c9e8d266\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") "
Sep 08 14:47:28.776243 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.775963    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4m6g\" (UniqueName: \"kubernetes.io/projected/3cb38dfc-5031-4485-96a6-e884c9e8d266-kube-api-access-f4m6g\") pod \"3cb38dfc-5031-4485-96a6-e884c9e8d266\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") "
Sep 08 14:47:28.776243 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.776022    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cb38dfc-5031-4485-96a6-e884c9e8d266-istio-data\") pod \"3cb38dfc-5031-4485-96a6-e884c9e8d266\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") "
Sep 08 14:47:28.776243 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.776039    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cb38dfc-5031-4485-96a6-e884c9e8d266-istio-envoy\") pod \"3cb38dfc-5031-4485-96a6-e884c9e8d266\" (UID: \"3cb38dfc-5031-4485-96a6-e884c9e8d266\") "
Sep 08 14:47:28.776243 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.776081    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cb38dfc-5031-4485-96a6-e884c9e8d266-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3cb38dfc-5031-4485-96a6-e884c9e8d266" (UID: "3cb38dfc-5031-4485-96a6-e884c9e8d266"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:47:28.776243 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.776157    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cb38dfc-5031-4485-96a6-e884c9e8d266-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3cb38dfc-5031-4485-96a6-e884c9e8d266" (UID: "3cb38dfc-5031-4485-96a6-e884c9e8d266"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:47:28.776243 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.776196    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cb38dfc-5031-4485-96a6-e884c9e8d266-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3cb38dfc-5031-4485-96a6-e884c9e8d266" (UID: "3cb38dfc-5031-4485-96a6-e884c9e8d266"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:47:28.776819 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.776345    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cb38dfc-5031-4485-96a6-e884c9e8d266-credential-socket\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:47:28.776819 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.776365    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3cb38dfc-5031-4485-96a6-e884c9e8d266-workload-certs\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:47:28.776819 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.776380    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3cb38dfc-5031-4485-96a6-e884c9e8d266-workload-socket\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:47:28.776819 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.776385    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cb38dfc-5031-4485-96a6-e884c9e8d266-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3cb38dfc-5031-4485-96a6-e884c9e8d266" (UID: "3cb38dfc-5031-4485-96a6-e884c9e8d266"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:47:28.776819 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.776600    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cb38dfc-5031-4485-96a6-e884c9e8d266-istio-data" (OuterVolumeSpecName: "istio-data") pod "3cb38dfc-5031-4485-96a6-e884c9e8d266" (UID: "3cb38dfc-5031-4485-96a6-e884c9e8d266"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:47:28.778225 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.778203    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cb38dfc-5031-4485-96a6-e884c9e8d266-kube-api-access-f4m6g" (OuterVolumeSpecName: "kube-api-access-f4m6g") pod "3cb38dfc-5031-4485-96a6-e884c9e8d266" (UID: "3cb38dfc-5031-4485-96a6-e884c9e8d266"). InnerVolumeSpecName "kube-api-access-f4m6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:47:28.778348 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.778312    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cb38dfc-5031-4485-96a6-e884c9e8d266-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3cb38dfc-5031-4485-96a6-e884c9e8d266" (UID: "3cb38dfc-5031-4485-96a6-e884c9e8d266"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:47:28.778643 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.778620    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3cb38dfc-5031-4485-96a6-e884c9e8d266-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3cb38dfc-5031-4485-96a6-e884c9e8d266" (UID: "3cb38dfc-5031-4485-96a6-e884c9e8d266"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:47:28.778682 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.778641    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cb38dfc-5031-4485-96a6-e884c9e8d266-istio-token" (OuterVolumeSpecName: "istio-token") pod "3cb38dfc-5031-4485-96a6-e884c9e8d266" (UID: "3cb38dfc-5031-4485-96a6-e884c9e8d266"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:47:28.865673 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.865641    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-5988864584-7frx9"]
Sep 08 14:47:28.866822 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:47:28.866797    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode36b2e35_11ba_470a_a651_e9958f9627db.slice/crio-aab5252f00b8bed7966630852be637e4f388bbc7825699c05da1d6efea0e9eb1 WatchSource:0}: Error finding container aab5252f00b8bed7966630852be637e4f388bbc7825699c05da1d6efea0e9eb1: Status 404 returned error can't find the container with id aab5252f00b8bed7966630852be637e4f388bbc7825699c05da1d6efea0e9eb1
Sep 08 14:47:28.877099 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.877072    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3cb38dfc-5031-4485-96a6-e884c9e8d266-istiod-ca-cert\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:47:28.877196 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.877105    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3cb38dfc-5031-4485-96a6-e884c9e8d266-istio-token\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:47:28.877196 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.877120    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3cb38dfc-5031-4485-96a6-e884c9e8d266-istio-podinfo\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:47:28.877196 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.877133    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4m6g\" (UniqueName: \"kubernetes.io/projected/3cb38dfc-5031-4485-96a6-e884c9e8d266-kube-api-access-f4m6g\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:47:28.877196 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.877148    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3cb38dfc-5031-4485-96a6-e884c9e8d266-istio-data\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:47:28.877196 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:28.877161    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3cb38dfc-5031-4485-96a6-e884c9e8d266-istio-envoy\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:47:29.583369 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:29.583294    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"
Sep 08 14:47:29.583369 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:29.583338    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn" event={"ID":"3cb38dfc-5031-4485-96a6-e884c9e8d266","Type":"ContainerDied","Data":"68bb167681850eae0b4b57ae942927af5307f910e4e2ee8d0ef6ac70e0056025"}
Sep 08 14:47:29.583601 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:29.583398    2577 scope.go:117] "RemoveContainer" containerID="49ce05f441a482525fab39ff6aebf5d3d635caa3b9540e45dab5b5b3c437cebd"
Sep 08 14:47:29.585174 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:29.585148    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-5988864584-7frx9" event={"ID":"e36b2e35-11ba-470a-a651-e9958f9627db","Type":"ContainerStarted","Data":"e26a5b1b245805e335618abafca3a8034261b8cb7db8dfb199b29e374c5b025b"}
Sep 08 14:47:29.585294 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:29.585195    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-5988864584-7frx9" event={"ID":"e36b2e35-11ba-470a-a651-e9958f9627db","Type":"ContainerStarted","Data":"aab5252f00b8bed7966630852be637e4f388bbc7825699c05da1d6efea0e9eb1"}
Sep 08 14:47:29.585294 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:29.585271    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-5988864584-7frx9"
Sep 08 14:47:29.602817 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:29.602796    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"]
Sep 08 14:47:29.609118 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:29.609090    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-8ac49eaa-gw-openshift-default-9ffffc8bd-d2jhn"]
Sep 08 14:47:29.626075 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:29.626038    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-5988864584-7frx9" podStartSLOduration=2.2058445620000002 podStartE2EDuration="2.626022801s" totalImagesPullingTime="420.178239ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:47:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:47:29.623706421 +0000 UTC m=+810.662107345" watchObservedRunningTime="2026-09-08 14:47:29.626022801 +0000 UTC m=+810.664423723"
Sep 08 14:47:31.491421 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:31.491386    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cb38dfc-5031-4485-96a6-e884c9e8d266" path="/var/lib/kubelet/pods/3cb38dfc-5031-4485-96a6-e884c9e8d266/volumes"
Sep 08 14:47:33.034368 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:33.034333    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:47:35.597617 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:35.597590    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-5988864584-7frx9"
Sep 08 14:47:49.563640 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.563598    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"]
Sep 08 14:47:49.564222 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.564060    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cb38dfc-5031-4485-96a6-e884c9e8d266" containerName="istio-proxy"
Sep 08 14:47:49.564222 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.564078    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cb38dfc-5031-4485-96a6-e884c9e8d266" containerName="istio-proxy"
Sep 08 14:47:49.564222 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.564106    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cb38dfc-5031-4485-96a6-e884c9e8d266" containerName="istio-proxy"
Sep 08 14:47:49.564222 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.564113    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cb38dfc-5031-4485-96a6-e884c9e8d266" containerName="istio-proxy"
Sep 08 14:47:49.564419 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.564238    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cb38dfc-5031-4485-96a6-e884c9e8d266" containerName="istio-proxy"
Sep 08 14:47:49.564419 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.564251    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cb38dfc-5031-4485-96a6-e884c9e8d266" containerName="istio-proxy"
Sep 08 14:47:49.568486 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.568454    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"
Sep 08 14:47:49.571106 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.571084    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-798a5d\"/\"kube-root-ca.crt\""
Sep 08 14:47:49.572328 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.572309    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-798a5d\"/\"default-dockercfg-tllvx\""
Sep 08 14:47:49.572425 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.572346    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-798a5d\"/\"test-model-798a5d-kserve-self-signed-certs\""
Sep 08 14:47:49.572425 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.572351    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-798a5d\"/\"openshift-service-ca.crt\""
Sep 08 14:47:49.580280 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.580258    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"]
Sep 08 14:47:49.660513 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.660483    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-dshm\") pod \"test-model-798a5d-kserve-757d7997fc-cswrm\" (UID: \"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25\") " pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"
Sep 08 14:47:49.660693 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.660586    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-model-cache\") pod \"test-model-798a5d-kserve-757d7997fc-cswrm\" (UID: \"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25\") " pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"
Sep 08 14:47:49.660693 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.660619    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-home\") pod \"test-model-798a5d-kserve-757d7997fc-cswrm\" (UID: \"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25\") " pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"
Sep 08 14:47:49.660805 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.660756    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-tls-certs\") pod \"test-model-798a5d-kserve-757d7997fc-cswrm\" (UID: \"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25\") " pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"
Sep 08 14:47:49.660805 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.660778    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws65d\" (UniqueName: \"kubernetes.io/projected/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-kube-api-access-ws65d\") pod \"test-model-798a5d-kserve-757d7997fc-cswrm\" (UID: \"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25\") " pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"
Sep 08 14:47:49.660881 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.660807    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-tmp-dir\") pod \"test-model-798a5d-kserve-757d7997fc-cswrm\" (UID: \"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25\") " pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"
Sep 08 14:47:49.761823 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.761788    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-tls-certs\") pod \"test-model-798a5d-kserve-757d7997fc-cswrm\" (UID: \"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25\") " pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"
Sep 08 14:47:49.761823 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.761833    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws65d\" (UniqueName: \"kubernetes.io/projected/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-kube-api-access-ws65d\") pod \"test-model-798a5d-kserve-757d7997fc-cswrm\" (UID: \"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25\") " pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"
Sep 08 14:47:49.762118 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.761871    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-tmp-dir\") pod \"test-model-798a5d-kserve-757d7997fc-cswrm\" (UID: \"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25\") " pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"
Sep 08 14:47:49.762118 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.761908    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-dshm\") pod \"test-model-798a5d-kserve-757d7997fc-cswrm\" (UID: \"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25\") " pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"
Sep 08 14:47:49.762118 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.761953    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-model-cache\") pod \"test-model-798a5d-kserve-757d7997fc-cswrm\" (UID: \"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25\") " pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"
Sep 08 14:47:49.762118 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.761982    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-home\") pod \"test-model-798a5d-kserve-757d7997fc-cswrm\" (UID: \"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25\") " pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"
Sep 08 14:47:49.762368 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.762351    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-home\") pod \"test-model-798a5d-kserve-757d7997fc-cswrm\" (UID: \"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25\") " pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"
Sep 08 14:47:49.762422 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.762396    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-tmp-dir\") pod \"test-model-798a5d-kserve-757d7997fc-cswrm\" (UID: \"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25\") " pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"
Sep 08 14:47:49.762461 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.762416    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-model-cache\") pod \"test-model-798a5d-kserve-757d7997fc-cswrm\" (UID: \"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25\") " pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"
Sep 08 14:47:49.764231 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.764201    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-dshm\") pod \"test-model-798a5d-kserve-757d7997fc-cswrm\" (UID: \"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25\") " pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"
Sep 08 14:47:49.764373 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.764357    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-tls-certs\") pod \"test-model-798a5d-kserve-757d7997fc-cswrm\" (UID: \"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25\") " pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"
Sep 08 14:47:49.770822 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.770803    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws65d\" (UniqueName: \"kubernetes.io/projected/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-kube-api-access-ws65d\") pod \"test-model-798a5d-kserve-757d7997fc-cswrm\" (UID: \"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25\") " pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"
Sep 08 14:47:49.878495 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:49.878387    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"
Sep 08 14:47:50.153606 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:50.153582    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"]
Sep 08 14:47:50.155210 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:47:50.155181    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6f2f1d8_d7fc_445f_9b27_08ccb365eb25.slice/crio-ac93ef6bae2c13c32bdaad1f9f27aa9d19c689dbfcddc02f0f24e87112050cce WatchSource:0}: Error finding container ac93ef6bae2c13c32bdaad1f9f27aa9d19c689dbfcddc02f0f24e87112050cce: Status 404 returned error can't find the container with id ac93ef6bae2c13c32bdaad1f9f27aa9d19c689dbfcddc02f0f24e87112050cce
Sep 08 14:47:50.719121 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:50.719087    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm" event={"ID":"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25","Type":"ContainerStarted","Data":"75f53334df80f4cfd3e83b14063c2ee94ab867ece2bbc96977d693ca0cd91ac1"}
Sep 08 14:47:50.719534 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:50.719136    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm" event={"ID":"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25","Type":"ContainerStarted","Data":"ac93ef6bae2c13c32bdaad1f9f27aa9d19c689dbfcddc02f0f24e87112050cce"}
Sep 08 14:47:50.740286 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:50.740231    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm" podStartSLOduration=1.740214709 podStartE2EDuration="1.740214709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:47:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:47:50.737893546 +0000 UTC m=+831.776294470" watchObservedRunningTime="2026-09-08 14:47:50.740214709 +0000 UTC m=+831.778615633"
Sep 08 14:47:51.465695 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:51.465653    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:47:58.457702 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:58.457662    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-5988864584-7frx9"]
Sep 08 14:47:58.458174 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:58.457933    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-5988864584-7frx9" podUID="e36b2e35-11ba-470a-a651-e9958f9627db" containerName="maas-api" containerID="cri-o://e26a5b1b245805e335618abafca3a8034261b8cb7db8dfb199b29e374c5b025b" gracePeriod=30
Sep 08 14:47:58.704423 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:58.704397    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-5988864584-7frx9"
Sep 08 14:47:58.768630 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:58.768541    2577 generic.go:356] "Generic (PLEG): container finished" podID="e36b2e35-11ba-470a-a651-e9958f9627db" containerID="e26a5b1b245805e335618abafca3a8034261b8cb7db8dfb199b29e374c5b025b" exitCode=0
Sep 08 14:47:58.768630 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:58.768588    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-5988864584-7frx9"
Sep 08 14:47:58.768804 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:58.768629    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-5988864584-7frx9" event={"ID":"e36b2e35-11ba-470a-a651-e9958f9627db","Type":"ContainerDied","Data":"e26a5b1b245805e335618abafca3a8034261b8cb7db8dfb199b29e374c5b025b"}
Sep 08 14:47:58.768804 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:58.768678    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-5988864584-7frx9" event={"ID":"e36b2e35-11ba-470a-a651-e9958f9627db","Type":"ContainerDied","Data":"aab5252f00b8bed7966630852be637e4f388bbc7825699c05da1d6efea0e9eb1"}
Sep 08 14:47:58.768804 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:58.768702    2577 scope.go:117] "RemoveContainer" containerID="e26a5b1b245805e335618abafca3a8034261b8cb7db8dfb199b29e374c5b025b"
Sep 08 14:47:58.778314 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:58.778296    2577 scope.go:117] "RemoveContainer" containerID="e26a5b1b245805e335618abafca3a8034261b8cb7db8dfb199b29e374c5b025b"
Sep 08 14:47:58.778629 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:47:58.778606    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e26a5b1b245805e335618abafca3a8034261b8cb7db8dfb199b29e374c5b025b\": container with ID starting with e26a5b1b245805e335618abafca3a8034261b8cb7db8dfb199b29e374c5b025b not found: ID does not exist" containerID="e26a5b1b245805e335618abafca3a8034261b8cb7db8dfb199b29e374c5b025b"
Sep 08 14:47:58.778703 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:58.778643    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e26a5b1b245805e335618abafca3a8034261b8cb7db8dfb199b29e374c5b025b"} err="failed to get container status \"e26a5b1b245805e335618abafca3a8034261b8cb7db8dfb199b29e374c5b025b\": rpc error: code = NotFound desc = could not find container \"e26a5b1b245805e335618abafca3a8034261b8cb7db8dfb199b29e374c5b025b\": container with ID starting with e26a5b1b245805e335618abafca3a8034261b8cb7db8dfb199b29e374c5b025b not found: ID does not exist"
Sep 08 14:47:58.849166 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:58.849132    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e36b2e35-11ba-470a-a651-e9958f9627db-openshift-service-ca\") pod \"e36b2e35-11ba-470a-a651-e9958f9627db\" (UID: \"e36b2e35-11ba-470a-a651-e9958f9627db\") "
Sep 08 14:47:58.849353 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:58.849199    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ms6cs\" (UniqueName: \"kubernetes.io/projected/e36b2e35-11ba-470a-a651-e9958f9627db-kube-api-access-ms6cs\") pod \"e36b2e35-11ba-470a-a651-e9958f9627db\" (UID: \"e36b2e35-11ba-470a-a651-e9958f9627db\") "
Sep 08 14:47:58.849353 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:58.849290    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e36b2e35-11ba-470a-a651-e9958f9627db-metrics-certs\") pod \"e36b2e35-11ba-470a-a651-e9958f9627db\" (UID: \"e36b2e35-11ba-470a-a651-e9958f9627db\") "
Sep 08 14:47:58.849353 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:58.849320    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e36b2e35-11ba-470a-a651-e9958f9627db-maas-api-tls\") pod \"e36b2e35-11ba-470a-a651-e9958f9627db\" (UID: \"e36b2e35-11ba-470a-a651-e9958f9627db\") "
Sep 08 14:47:58.849736 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:58.849551    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e36b2e35-11ba-470a-a651-e9958f9627db-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e36b2e35-11ba-470a-a651-e9958f9627db" (UID: "e36b2e35-11ba-470a-a651-e9958f9627db"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:47:58.849736 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:58.849708    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e36b2e35-11ba-470a-a651-e9958f9627db-openshift-service-ca\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:47:58.851672 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:58.851648    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e36b2e35-11ba-470a-a651-e9958f9627db-kube-api-access-ms6cs" (OuterVolumeSpecName: "kube-api-access-ms6cs") pod "e36b2e35-11ba-470a-a651-e9958f9627db" (UID: "e36b2e35-11ba-470a-a651-e9958f9627db"). InnerVolumeSpecName "kube-api-access-ms6cs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:47:58.851866 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:58.851850    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e36b2e35-11ba-470a-a651-e9958f9627db-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e36b2e35-11ba-470a-a651-e9958f9627db" (UID: "e36b2e35-11ba-470a-a651-e9958f9627db"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:47:58.852212 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:58.852184    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e36b2e35-11ba-470a-a651-e9958f9627db-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e36b2e35-11ba-470a-a651-e9958f9627db" (UID: "e36b2e35-11ba-470a-a651-e9958f9627db"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:47:58.950811 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:58.950778    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e36b2e35-11ba-470a-a651-e9958f9627db-metrics-certs\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:47:58.950811 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:58.950803    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e36b2e35-11ba-470a-a651-e9958f9627db-maas-api-tls\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:47:58.950811 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:58.950812    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ms6cs\" (UniqueName: \"kubernetes.io/projected/e36b2e35-11ba-470a-a651-e9958f9627db-kube-api-access-ms6cs\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:47:59.093220 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:59.093189    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-5988864584-7frx9"]
Sep 08 14:47:59.099746 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:59.099719    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8066138e-5988864584-7frx9"]
Sep 08 14:47:59.491830 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:59.491798    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e36b2e35-11ba-470a-a651-e9958f9627db" path="/var/lib/kubelet/pods/e36b2e35-11ba-470a-a651-e9958f9627db/volumes"
Sep 08 14:47:59.879014 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:59.878928    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"
Sep 08 14:47:59.879014 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:59.878982    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"
Sep 08 14:47:59.891907 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:47:59.891883    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"
Sep 08 14:48:00.590303 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.590267    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"]
Sep 08 14:48:00.590924 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.590904    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e36b2e35-11ba-470a-a651-e9958f9627db" containerName="maas-api"
Sep 08 14:48:00.591021 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.590926    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e36b2e35-11ba-470a-a651-e9958f9627db" containerName="maas-api"
Sep 08 14:48:00.591077 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.591022    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e36b2e35-11ba-470a-a651-e9958f9627db" containerName="maas-api"
Sep 08 14:48:00.595503 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.595483    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:00.598192 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.598170    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 14:48:00.598359 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.598341    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-02cfd933-openshift-default-dockercfg-7h6sv\""
Sep 08 14:48:00.609388 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.609359    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"]
Sep 08 14:48:00.667220 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.667185    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n25kt\" (UniqueName: \"kubernetes.io/projected/241f8bde-92f7-4a17-9d0e-e906425add7e-kube-api-access-n25kt\") pod \"e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") " pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:00.667385 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.667222    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/241f8bde-92f7-4a17-9d0e-e906425add7e-workload-certs\") pod \"e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") " pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:00.667385 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.667246    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/241f8bde-92f7-4a17-9d0e-e906425add7e-istio-token\") pod \"e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") " pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:00.667385 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.667313    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/241f8bde-92f7-4a17-9d0e-e906425add7e-istio-data\") pod \"e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") " pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:00.667554 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.667398    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/241f8bde-92f7-4a17-9d0e-e906425add7e-istio-envoy\") pod \"e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") " pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:00.667554 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.667452    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/241f8bde-92f7-4a17-9d0e-e906425add7e-credential-socket\") pod \"e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") " pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:00.667554 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.667491    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/241f8bde-92f7-4a17-9d0e-e906425add7e-workload-socket\") pod \"e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") " pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:00.667554 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.667516    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/241f8bde-92f7-4a17-9d0e-e906425add7e-istio-podinfo\") pod \"e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") " pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:00.667554 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.667533    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/241f8bde-92f7-4a17-9d0e-e906425add7e-istiod-ca-cert\") pod \"e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") " pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:00.768656 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.768614    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/241f8bde-92f7-4a17-9d0e-e906425add7e-credential-socket\") pod \"e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") " pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:00.768656 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.768659    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/241f8bde-92f7-4a17-9d0e-e906425add7e-workload-socket\") pod \"e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") " pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:00.768907 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.768690    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/241f8bde-92f7-4a17-9d0e-e906425add7e-istio-podinfo\") pod \"e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") " pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:00.768907 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.768712    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/241f8bde-92f7-4a17-9d0e-e906425add7e-istiod-ca-cert\") pod \"e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") " pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:00.768907 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.768755    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n25kt\" (UniqueName: \"kubernetes.io/projected/241f8bde-92f7-4a17-9d0e-e906425add7e-kube-api-access-n25kt\") pod \"e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") " pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:00.768907 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.768878    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/241f8bde-92f7-4a17-9d0e-e906425add7e-workload-certs\") pod \"e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") " pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:00.769124 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.768917    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/241f8bde-92f7-4a17-9d0e-e906425add7e-istio-token\") pod \"e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") " pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:00.769124 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.768956    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/241f8bde-92f7-4a17-9d0e-e906425add7e-istio-data\") pod \"e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") " pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:00.769124 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.769023    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/241f8bde-92f7-4a17-9d0e-e906425add7e-workload-socket\") pod \"e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") " pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:00.769124 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.769043    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/241f8bde-92f7-4a17-9d0e-e906425add7e-istio-envoy\") pod \"e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") " pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:00.769124 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.769058    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/241f8bde-92f7-4a17-9d0e-e906425add7e-credential-socket\") pod \"e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") " pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:00.769377 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.769306    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/241f8bde-92f7-4a17-9d0e-e906425add7e-workload-certs\") pod \"e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") " pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:00.769377 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.769334    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/241f8bde-92f7-4a17-9d0e-e906425add7e-istio-data\") pod \"e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") " pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:00.769580 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.769562    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/241f8bde-92f7-4a17-9d0e-e906425add7e-istiod-ca-cert\") pod \"e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") " pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:00.771291 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.771274    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/241f8bde-92f7-4a17-9d0e-e906425add7e-istio-envoy\") pod \"e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") " pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:00.771349 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.771321    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/241f8bde-92f7-4a17-9d0e-e906425add7e-istio-podinfo\") pod \"e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") " pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:00.778025 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.777997    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n25kt\" (UniqueName: \"kubernetes.io/projected/241f8bde-92f7-4a17-9d0e-e906425add7e-kube-api-access-n25kt\") pod \"e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") " pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:00.778299 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.778279    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/241f8bde-92f7-4a17-9d0e-e906425add7e-istio-token\") pod \"e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") " pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:00.792014 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.791995    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"
Sep 08 14:48:00.907724 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:00.907625    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:01.189091 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:01.189068    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"]
Sep 08 14:48:01.189886 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:48:01.189864    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod241f8bde_92f7_4a17_9d0e_e906425add7e.slice/crio-fc716893c0841874a942f9d8249b309b6067f41ebbc2f003fb132c0ca60a7ba9 WatchSource:0}: Error finding container fc716893c0841874a942f9d8249b309b6067f41ebbc2f003fb132c0ca60a7ba9: Status 404 returned error can't find the container with id fc716893c0841874a942f9d8249b309b6067f41ebbc2f003fb132c0ca60a7ba9
Sep 08 14:48:01.192190 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:01.192161    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:48:01.192261 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:01.192223    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:48:01.192261 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:01.192249    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:48:01.788359 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:01.788322    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs" event={"ID":"241f8bde-92f7-4a17-9d0e-e906425add7e","Type":"ContainerStarted","Data":"bc9007d784824ccca5c7480e878f9b17fb0708dd73dcb89bfaf3033f493edb5e"}
Sep 08 14:48:01.788759 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:01.788373    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs" event={"ID":"241f8bde-92f7-4a17-9d0e-e906425add7e","Type":"ContainerStarted","Data":"fc716893c0841874a942f9d8249b309b6067f41ebbc2f003fb132c0ca60a7ba9"}
Sep 08 14:48:01.814894 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:01.814847    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs" podStartSLOduration=1.814831176 podStartE2EDuration="1.814831176s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:48:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:48:01.812014514 +0000 UTC m=+842.850415437" watchObservedRunningTime="2026-09-08 14:48:01.814831176 +0000 UTC m=+842.853232099"
Sep 08 14:48:01.908099 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:01.908071    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:02.914187 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:02.914158    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:03.509853 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.509821    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-71518b-5776ffbf88-hpsgb"]
Sep 08 14:48:03.510061 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.510039    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-71518b-5776ffbf88-hpsgb" podUID="dec73e6c-462c-4c13-adf0-e6574f38ca2f" containerName="maas-api" containerID="cri-o://1f2140070cf9bccb9cd24a96c87060cf88d3ea0657bf1cfa9e6a4734f994a272" gracePeriod=30
Sep 08 14:48:03.622242 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.622195    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww"]
Sep 08 14:48:03.622879 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.622816    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww" podUID="f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463" containerName="payload-pre-processing" containerID="cri-o://23cb85e87d38b081a922e02eb99ec27d3f7080841bdbff499e12618fdd70829d" gracePeriod=30
Sep 08 14:48:03.787537 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.787512    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-71518b-5776ffbf88-hpsgb"
Sep 08 14:48:03.804372 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.804345    2577 generic.go:356] "Generic (PLEG): container finished" podID="f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463" containerID="23cb85e87d38b081a922e02eb99ec27d3f7080841bdbff499e12618fdd70829d" exitCode=0
Sep 08 14:48:03.804550 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.804425    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww" event={"ID":"f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463","Type":"ContainerDied","Data":"23cb85e87d38b081a922e02eb99ec27d3f7080841bdbff499e12618fdd70829d"}
Sep 08 14:48:03.807245 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.807142    2577 generic.go:356] "Generic (PLEG): container finished" podID="dec73e6c-462c-4c13-adf0-e6574f38ca2f" containerID="1f2140070cf9bccb9cd24a96c87060cf88d3ea0657bf1cfa9e6a4734f994a272" exitCode=0
Sep 08 14:48:03.807824 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.807610    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-71518b-5776ffbf88-hpsgb"
Sep 08 14:48:03.807824 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.807740    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-71518b-5776ffbf88-hpsgb" event={"ID":"dec73e6c-462c-4c13-adf0-e6574f38ca2f","Type":"ContainerDied","Data":"1f2140070cf9bccb9cd24a96c87060cf88d3ea0657bf1cfa9e6a4734f994a272"}
Sep 08 14:48:03.809510 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.808247    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:03.809510 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.808317    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-71518b-5776ffbf88-hpsgb" event={"ID":"dec73e6c-462c-4c13-adf0-e6574f38ca2f","Type":"ContainerDied","Data":"127f1057f42a4a60e1f4b605798985b97939fdd44314743141a60f178f97e489"}
Sep 08 14:48:03.809510 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.808362    2577 scope.go:117] "RemoveContainer" containerID="1f2140070cf9bccb9cd24a96c87060cf88d3ea0657bf1cfa9e6a4734f994a272"
Sep 08 14:48:03.809510 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.809144    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:03.826556 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.826362    2577 scope.go:117] "RemoveContainer" containerID="1f2140070cf9bccb9cd24a96c87060cf88d3ea0657bf1cfa9e6a4734f994a272"
Sep 08 14:48:03.826835 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:48:03.826798    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f2140070cf9bccb9cd24a96c87060cf88d3ea0657bf1cfa9e6a4734f994a272\": container with ID starting with 1f2140070cf9bccb9cd24a96c87060cf88d3ea0657bf1cfa9e6a4734f994a272 not found: ID does not exist" containerID="1f2140070cf9bccb9cd24a96c87060cf88d3ea0657bf1cfa9e6a4734f994a272"
Sep 08 14:48:03.826966 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.826840    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f2140070cf9bccb9cd24a96c87060cf88d3ea0657bf1cfa9e6a4734f994a272"} err="failed to get container status \"1f2140070cf9bccb9cd24a96c87060cf88d3ea0657bf1cfa9e6a4734f994a272\": rpc error: code = NotFound desc = could not find container \"1f2140070cf9bccb9cd24a96c87060cf88d3ea0657bf1cfa9e6a4734f994a272\": container with ID starting with 1f2140070cf9bccb9cd24a96c87060cf88d3ea0657bf1cfa9e6a4734f994a272 not found: ID does not exist"
Sep 08 14:48:03.883393 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.883367    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww"
Sep 08 14:48:03.897388 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.897362    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hxfz\" (UniqueName: \"kubernetes.io/projected/dec73e6c-462c-4c13-adf0-e6574f38ca2f-kube-api-access-9hxfz\") pod \"dec73e6c-462c-4c13-adf0-e6574f38ca2f\" (UID: \"dec73e6c-462c-4c13-adf0-e6574f38ca2f\") "
Sep 08 14:48:03.897567 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.897425    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dec73e6c-462c-4c13-adf0-e6574f38ca2f-openshift-service-ca\") pod \"dec73e6c-462c-4c13-adf0-e6574f38ca2f\" (UID: \"dec73e6c-462c-4c13-adf0-e6574f38ca2f\") "
Sep 08 14:48:03.897567 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.897453    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dec73e6c-462c-4c13-adf0-e6574f38ca2f-metrics-certs\") pod \"dec73e6c-462c-4c13-adf0-e6574f38ca2f\" (UID: \"dec73e6c-462c-4c13-adf0-e6574f38ca2f\") "
Sep 08 14:48:03.897567 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.897533    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dec73e6c-462c-4c13-adf0-e6574f38ca2f-maas-api-tls\") pod \"dec73e6c-462c-4c13-adf0-e6574f38ca2f\" (UID: \"dec73e6c-462c-4c13-adf0-e6574f38ca2f\") "
Sep 08 14:48:03.898149 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.898121    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dec73e6c-462c-4c13-adf0-e6574f38ca2f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dec73e6c-462c-4c13-adf0-e6574f38ca2f" (UID: "dec73e6c-462c-4c13-adf0-e6574f38ca2f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:48:03.899730 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.899700    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dec73e6c-462c-4c13-adf0-e6574f38ca2f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dec73e6c-462c-4c13-adf0-e6574f38ca2f" (UID: "dec73e6c-462c-4c13-adf0-e6574f38ca2f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:48:03.899827 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.899746    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dec73e6c-462c-4c13-adf0-e6574f38ca2f-kube-api-access-9hxfz" (OuterVolumeSpecName: "kube-api-access-9hxfz") pod "dec73e6c-462c-4c13-adf0-e6574f38ca2f" (UID: "dec73e6c-462c-4c13-adf0-e6574f38ca2f"). InnerVolumeSpecName "kube-api-access-9hxfz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:48:03.899956 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.899940    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dec73e6c-462c-4c13-adf0-e6574f38ca2f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "dec73e6c-462c-4c13-adf0-e6574f38ca2f" (UID: "dec73e6c-462c-4c13-adf0-e6574f38ca2f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:48:03.998989 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.998946    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnp7c\" (UniqueName: \"kubernetes.io/projected/f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463-kube-api-access-pnp7c\") pod \"f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463\" (UID: \"f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463\") "
Sep 08 14:48:03.998989 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.999002    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463-plugins-config-volume\") pod \"f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463\" (UID: \"f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463\") "
Sep 08 14:48:03.999415 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.999348    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hxfz\" (UniqueName: \"kubernetes.io/projected/dec73e6c-462c-4c13-adf0-e6574f38ca2f-kube-api-access-9hxfz\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:48:03.999415 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.999370    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dec73e6c-462c-4c13-adf0-e6574f38ca2f-openshift-service-ca\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:48:03.999415 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.999380    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dec73e6c-462c-4c13-adf0-e6574f38ca2f-metrics-certs\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:48:03.999415 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.999381    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463" (UID: "f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:48:03.999415 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:03.999388    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dec73e6c-462c-4c13-adf0-e6574f38ca2f-maas-api-tls\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:48:04.001189 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:04.001169    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463-kube-api-access-pnp7c" (OuterVolumeSpecName: "kube-api-access-pnp7c") pod "f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463" (UID: "f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463"). InnerVolumeSpecName "kube-api-access-pnp7c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:48:04.100879 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:04.100797    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnp7c\" (UniqueName: \"kubernetes.io/projected/f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463-kube-api-access-pnp7c\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:48:04.100879 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:04.100824    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463-plugins-config-volume\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:48:04.134807 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:04.134782    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-71518b-5776ffbf88-hpsgb"]
Sep 08 14:48:04.141161 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:04.141133    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-71518b-5776ffbf88-hpsgb"]
Sep 08 14:48:04.344084 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:04.344054    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7"]
Sep 08 14:48:04.344464 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:04.344452    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463" containerName="payload-pre-processing"
Sep 08 14:48:04.344540 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:04.344482    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463" containerName="payload-pre-processing"
Sep 08 14:48:04.344540 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:04.344502    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dec73e6c-462c-4c13-adf0-e6574f38ca2f" containerName="maas-api"
Sep 08 14:48:04.344540 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:04.344507    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="dec73e6c-462c-4c13-adf0-e6574f38ca2f" containerName="maas-api"
Sep 08 14:48:04.344638 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:04.344567    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="dec73e6c-462c-4c13-adf0-e6574f38ca2f" containerName="maas-api"
Sep 08 14:48:04.344638 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:04.344578    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463" containerName="payload-pre-processing"
Sep 08 14:48:04.347860 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:04.347843    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7"
Sep 08 14:48:04.350373 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:04.350350    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-02cfd933-serving-cert\""
Sep 08 14:48:04.361072 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:04.361047    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7"]
Sep 08 14:48:04.504559 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:04.504517    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrh6j\" (UniqueName: \"kubernetes.io/projected/1215de8c-0b63-4b68-852a-7cc50d1bb6f0-kube-api-access-zrh6j\") pod \"maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7\" (UID: \"1215de8c-0b63-4b68-852a-7cc50d1bb6f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7"
Sep 08 14:48:04.504761 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:04.504656    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1215de8c-0b63-4b68-852a-7cc50d1bb6f0-maas-api-tls\") pod \"maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7\" (UID: \"1215de8c-0b63-4b68-852a-7cc50d1bb6f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7"
Sep 08 14:48:04.504761 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:04.504738    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1215de8c-0b63-4b68-852a-7cc50d1bb6f0-openshift-service-ca\") pod \"maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7\" (UID: \"1215de8c-0b63-4b68-852a-7cc50d1bb6f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7"
Sep 08 14:48:04.504872 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:04.504773    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1215de8c-0b63-4b68-852a-7cc50d1bb6f0-metrics-certs\") pod \"maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7\" (UID: \"1215de8c-0b63-4b68-852a-7cc50d1bb6f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7"
Sep 08 14:48:04.605792 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:04.605705    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrh6j\" (UniqueName: \"kubernetes.io/projected/1215de8c-0b63-4b68-852a-7cc50d1bb6f0-kube-api-access-zrh6j\") pod \"maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7\" (UID: \"1215de8c-0b63-4b68-852a-7cc50d1bb6f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7"
Sep 08 14:48:04.605792 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:04.605780    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1215de8c-0b63-4b68-852a-7cc50d1bb6f0-maas-api-tls\") pod \"maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7\" (UID: \"1215de8c-0b63-4b68-852a-7cc50d1bb6f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7"
Sep 08 14:48:04.606028 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:04.605823    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1215de8c-0b63-4b68-852a-7cc50d1bb6f0-openshift-service-ca\") pod \"maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7\" (UID: \"1215de8c-0b63-4b68-852a-7cc50d1bb6f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7"
Sep 08 14:48:04.606028 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:04.605846    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1215de8c-0b63-4b68-852a-7cc50d1bb6f0-metrics-certs\") pod \"maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7\" (UID: \"1215de8c-0b63-4b68-852a-7cc50d1bb6f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7"
Sep 08 14:48:04.606028 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:48:04.605933    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-serving-cert: secret "maas-api-e2e-derive-02cfd933-serving-cert" not found
Sep 08 14:48:04.606028 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:48:04.606007    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1215de8c-0b63-4b68-852a-7cc50d1bb6f0-maas-api-tls podName:1215de8c-0b63-4b68-852a-7cc50d1bb6f0 nodeName:}" failed. No retries permitted until 2026-09-08 14:48:05.105985003 +0000 UTC m=+846.144385904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1215de8c-0b63-4b68-852a-7cc50d1bb6f0-maas-api-tls") pod "maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7" (UID: "1215de8c-0b63-4b68-852a-7cc50d1bb6f0") : secret "maas-api-e2e-derive-02cfd933-serving-cert" not found
Sep 08 14:48:04.606615 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:04.606592    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1215de8c-0b63-4b68-852a-7cc50d1bb6f0-openshift-service-ca\") pod \"maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7\" (UID: \"1215de8c-0b63-4b68-852a-7cc50d1bb6f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7"
Sep 08 14:48:04.608642 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:04.608619    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1215de8c-0b63-4b68-852a-7cc50d1bb6f0-metrics-certs\") pod \"maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7\" (UID: \"1215de8c-0b63-4b68-852a-7cc50d1bb6f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7"
Sep 08 14:48:04.617112 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:04.617088    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrh6j\" (UniqueName: \"kubernetes.io/projected/1215de8c-0b63-4b68-852a-7cc50d1bb6f0-kube-api-access-zrh6j\") pod \"maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7\" (UID: \"1215de8c-0b63-4b68-852a-7cc50d1bb6f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7"
Sep 08 14:48:04.815656 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:04.815624    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww"
Sep 08 14:48:04.815832 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:04.815671    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww" event={"ID":"f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463","Type":"ContainerDied","Data":"41f8a5204f432e5000f0e5a653f3a3756e699902e39aa712fb606dba52b274a6"}
Sep 08 14:48:04.815832 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:04.815740    2577 scope.go:117] "RemoveContainer" containerID="23cb85e87d38b081a922e02eb99ec27d3f7080841bdbff499e12618fdd70829d"
Sep 08 14:48:04.853116 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:04.853087    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww"]
Sep 08 14:48:04.860985 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:04.860911    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-71518b-7c457df46b-njlww"]
Sep 08 14:48:05.110759 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:05.110726    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1215de8c-0b63-4b68-852a-7cc50d1bb6f0-maas-api-tls\") pod \"maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7\" (UID: \"1215de8c-0b63-4b68-852a-7cc50d1bb6f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7"
Sep 08 14:48:05.113420 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:05.113357    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1215de8c-0b63-4b68-852a-7cc50d1bb6f0-maas-api-tls\") pod \"maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7\" (UID: \"1215de8c-0b63-4b68-852a-7cc50d1bb6f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7"
Sep 08 14:48:05.258576 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:05.258542    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7"
Sep 08 14:48:05.491416 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:05.491386    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dec73e6c-462c-4c13-adf0-e6574f38ca2f" path="/var/lib/kubelet/pods/dec73e6c-462c-4c13-adf0-e6574f38ca2f/volumes"
Sep 08 14:48:05.491775 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:05.491761    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463" path="/var/lib/kubelet/pods/f2f5fc0c-0c2f-4cd6-a5a5-ee730649d463/volumes"
Sep 08 14:48:05.542891 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:05.542860    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7"]
Sep 08 14:48:05.544024 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:48:05.544001    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1215de8c_0b63_4b68_852a_7cc50d1bb6f0.slice/crio-1ea0e9b6262b94ac0e8c720f3a3663112df6182da93bcce5a7b4d9c9ab2ef539 WatchSource:0}: Error finding container 1ea0e9b6262b94ac0e8c720f3a3663112df6182da93bcce5a7b4d9c9ab2ef539: Status 404 returned error can't find the container with id 1ea0e9b6262b94ac0e8c720f3a3663112df6182da93bcce5a7b4d9c9ab2ef539
Sep 08 14:48:05.823192 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:05.823059    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7" event={"ID":"1215de8c-0b63-4b68-852a-7cc50d1bb6f0","Type":"ContainerStarted","Data":"1ea0e9b6262b94ac0e8c720f3a3663112df6182da93bcce5a7b4d9c9ab2ef539"}
Sep 08 14:48:06.832500 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:06.832439    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7" event={"ID":"1215de8c-0b63-4b68-852a-7cc50d1bb6f0","Type":"ContainerStarted","Data":"7de97abea9508c335b1e3887a2c68c7f4063ae2311dfb5c7286089ab0001261e"}
Sep 08 14:48:06.832965 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:06.832564    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7"
Sep 08 14:48:06.858071 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:06.851852    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7" podStartSLOduration=2.354643341 podStartE2EDuration="2.851831063s" totalImagesPullingTime="497.187722ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:48:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:48:06.850781767 +0000 UTC m=+847.889182693" watchObservedRunningTime="2026-09-08 14:48:06.851831063 +0000 UTC m=+847.890231988"
Sep 08 14:48:08.831245 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:08.831209    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:48:11.584007 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.583976    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"]
Sep 08 14:48:11.588098 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.588074    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:11.594896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.594872    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-222cd5-openshift-default-dockercfg-7lgbj\""
Sep 08 14:48:11.644654 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.624340    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"]
Sep 08 14:48:11.672814 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.672779    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31411c2f-547d-4b5e-a203-a52e061879b0-istio-data\") pod \"e2e-explicit-222cd5-openshift-default-9764c596-x2rrd\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") " pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:11.672814 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.672814    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31411c2f-547d-4b5e-a203-a52e061879b0-istio-podinfo\") pod \"e2e-explicit-222cd5-openshift-default-9764c596-x2rrd\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") " pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:11.673073 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.672835    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31411c2f-547d-4b5e-a203-a52e061879b0-workload-socket\") pod \"e2e-explicit-222cd5-openshift-default-9764c596-x2rrd\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") " pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:11.673073 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.672950    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31411c2f-547d-4b5e-a203-a52e061879b0-istiod-ca-cert\") pod \"e2e-explicit-222cd5-openshift-default-9764c596-x2rrd\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") " pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:11.673073 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.672987    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31411c2f-547d-4b5e-a203-a52e061879b0-credential-socket\") pod \"e2e-explicit-222cd5-openshift-default-9764c596-x2rrd\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") " pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:11.673073 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.673015    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9ktt\" (UniqueName: \"kubernetes.io/projected/31411c2f-547d-4b5e-a203-a52e061879b0-kube-api-access-k9ktt\") pod \"e2e-explicit-222cd5-openshift-default-9764c596-x2rrd\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") " pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:11.673073 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.673058    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31411c2f-547d-4b5e-a203-a52e061879b0-workload-certs\") pod \"e2e-explicit-222cd5-openshift-default-9764c596-x2rrd\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") " pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:11.673280 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.673083    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31411c2f-547d-4b5e-a203-a52e061879b0-istio-envoy\") pod \"e2e-explicit-222cd5-openshift-default-9764c596-x2rrd\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") " pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:11.673280 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.673139    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31411c2f-547d-4b5e-a203-a52e061879b0-istio-token\") pod \"e2e-explicit-222cd5-openshift-default-9764c596-x2rrd\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") " pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:11.774351 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.774318    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31411c2f-547d-4b5e-a203-a52e061879b0-istiod-ca-cert\") pod \"e2e-explicit-222cd5-openshift-default-9764c596-x2rrd\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") " pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:11.774588 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.774363    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31411c2f-547d-4b5e-a203-a52e061879b0-credential-socket\") pod \"e2e-explicit-222cd5-openshift-default-9764c596-x2rrd\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") " pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:11.774588 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.774395    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9ktt\" (UniqueName: \"kubernetes.io/projected/31411c2f-547d-4b5e-a203-a52e061879b0-kube-api-access-k9ktt\") pod \"e2e-explicit-222cd5-openshift-default-9764c596-x2rrd\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") " pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:11.774588 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.774434    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31411c2f-547d-4b5e-a203-a52e061879b0-workload-certs\") pod \"e2e-explicit-222cd5-openshift-default-9764c596-x2rrd\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") " pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:11.774588 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.774463    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31411c2f-547d-4b5e-a203-a52e061879b0-istio-envoy\") pod \"e2e-explicit-222cd5-openshift-default-9764c596-x2rrd\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") " pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:11.774588 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.774543    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31411c2f-547d-4b5e-a203-a52e061879b0-istio-token\") pod \"e2e-explicit-222cd5-openshift-default-9764c596-x2rrd\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") " pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:11.774860 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.774629    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31411c2f-547d-4b5e-a203-a52e061879b0-istio-data\") pod \"e2e-explicit-222cd5-openshift-default-9764c596-x2rrd\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") " pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:11.774860 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.774655    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31411c2f-547d-4b5e-a203-a52e061879b0-istio-podinfo\") pod \"e2e-explicit-222cd5-openshift-default-9764c596-x2rrd\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") " pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:11.774860 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.774686    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31411c2f-547d-4b5e-a203-a52e061879b0-workload-socket\") pod \"e2e-explicit-222cd5-openshift-default-9764c596-x2rrd\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") " pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:11.775068 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.775043    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31411c2f-547d-4b5e-a203-a52e061879b0-istio-data\") pod \"e2e-explicit-222cd5-openshift-default-9764c596-x2rrd\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") " pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:11.775236 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.775114    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31411c2f-547d-4b5e-a203-a52e061879b0-workload-certs\") pod \"e2e-explicit-222cd5-openshift-default-9764c596-x2rrd\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") " pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:11.775363 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.775129    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31411c2f-547d-4b5e-a203-a52e061879b0-istiod-ca-cert\") pod \"e2e-explicit-222cd5-openshift-default-9764c596-x2rrd\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") " pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:11.775507 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.775133    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31411c2f-547d-4b5e-a203-a52e061879b0-credential-socket\") pod \"e2e-explicit-222cd5-openshift-default-9764c596-x2rrd\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") " pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:11.775589 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.775371    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31411c2f-547d-4b5e-a203-a52e061879b0-workload-socket\") pod \"e2e-explicit-222cd5-openshift-default-9764c596-x2rrd\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") " pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:11.777518 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.777492    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31411c2f-547d-4b5e-a203-a52e061879b0-istio-envoy\") pod \"e2e-explicit-222cd5-openshift-default-9764c596-x2rrd\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") " pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:11.777999 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.777976    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31411c2f-547d-4b5e-a203-a52e061879b0-istio-podinfo\") pod \"e2e-explicit-222cd5-openshift-default-9764c596-x2rrd\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") " pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:11.784631 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.784611    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31411c2f-547d-4b5e-a203-a52e061879b0-istio-token\") pod \"e2e-explicit-222cd5-openshift-default-9764c596-x2rrd\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") " pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:11.784796 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.784777    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9ktt\" (UniqueName: \"kubernetes.io/projected/31411c2f-547d-4b5e-a203-a52e061879b0-kube-api-access-k9ktt\") pod \"e2e-explicit-222cd5-openshift-default-9764c596-x2rrd\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") " pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:11.899855 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:11.899772    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:12.201212 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:12.201187    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"]
Sep 08 14:48:12.202887 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:48:12.202856    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31411c2f_547d_4b5e_a203_a52e061879b0.slice/crio-54bf3625c7a0a3425b80c23d1a002d67cf694ecbe659ca4645cc62fdba169f81 WatchSource:0}: Error finding container 54bf3625c7a0a3425b80c23d1a002d67cf694ecbe659ca4645cc62fdba169f81: Status 404 returned error can't find the container with id 54bf3625c7a0a3425b80c23d1a002d67cf694ecbe659ca4645cc62fdba169f81
Sep 08 14:48:12.205277 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:12.205232    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:48:12.205374 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:12.205346    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:48:12.205434 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:12.205393    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:48:12.845664 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:12.845637    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7"
Sep 08 14:48:12.873421 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:12.873385    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd" event={"ID":"31411c2f-547d-4b5e-a203-a52e061879b0","Type":"ContainerStarted","Data":"f0692c0984d687b7e2dcde90669cec6fbc0af54df763ba27e4539633769a4460"}
Sep 08 14:48:12.873620 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:12.873432    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd" event={"ID":"31411c2f-547d-4b5e-a203-a52e061879b0","Type":"ContainerStarted","Data":"54bf3625c7a0a3425b80c23d1a002d67cf694ecbe659ca4645cc62fdba169f81"}
Sep 08 14:48:12.902088 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:12.900690    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:12.902088 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:12.901410    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd" podStartSLOduration=1.901390063 podStartE2EDuration="1.901390063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:48:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:48:12.898910978 +0000 UTC m=+853.937311907" watchObservedRunningTime="2026-09-08 14:48:12.901390063 +0000 UTC m=+853.939790989"
Sep 08 14:48:13.909326 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:13.909058    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:14.885778 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:14.885751    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:14.886974 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:14.886954    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:16.073656 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:16.073612    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl"]
Sep 08 14:48:16.078291 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:16.078262    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl"
Sep 08 14:48:16.080880 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:16.080847    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-222cd5-serving-cert\""
Sep 08 14:48:16.092100 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:16.092072    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl"]
Sep 08 14:48:16.221402 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:16.221365    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7682ba4-6137-499a-84bf-6c742b8053d0-maas-api-tls\") pod \"maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl\" (UID: \"e7682ba4-6137-499a-84bf-6c742b8053d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl"
Sep 08 14:48:16.221402 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:16.221414    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7682ba4-6137-499a-84bf-6c742b8053d0-openshift-service-ca\") pod \"maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl\" (UID: \"e7682ba4-6137-499a-84bf-6c742b8053d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl"
Sep 08 14:48:16.221670 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:16.221449    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7682ba4-6137-499a-84bf-6c742b8053d0-metrics-certs\") pod \"maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl\" (UID: \"e7682ba4-6137-499a-84bf-6c742b8053d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl"
Sep 08 14:48:16.221670 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:16.221544    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjmp4\" (UniqueName: \"kubernetes.io/projected/e7682ba4-6137-499a-84bf-6c742b8053d0-kube-api-access-gjmp4\") pod \"maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl\" (UID: \"e7682ba4-6137-499a-84bf-6c742b8053d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl"
Sep 08 14:48:16.322639 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:16.322595    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjmp4\" (UniqueName: \"kubernetes.io/projected/e7682ba4-6137-499a-84bf-6c742b8053d0-kube-api-access-gjmp4\") pod \"maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl\" (UID: \"e7682ba4-6137-499a-84bf-6c742b8053d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl"
Sep 08 14:48:16.322826 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:16.322698    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7682ba4-6137-499a-84bf-6c742b8053d0-maas-api-tls\") pod \"maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl\" (UID: \"e7682ba4-6137-499a-84bf-6c742b8053d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl"
Sep 08 14:48:16.322826 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:16.322738    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7682ba4-6137-499a-84bf-6c742b8053d0-openshift-service-ca\") pod \"maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl\" (UID: \"e7682ba4-6137-499a-84bf-6c742b8053d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl"
Sep 08 14:48:16.322826 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:16.322777    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7682ba4-6137-499a-84bf-6c742b8053d0-metrics-certs\") pod \"maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl\" (UID: \"e7682ba4-6137-499a-84bf-6c742b8053d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl"
Sep 08 14:48:16.323643 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:16.323553    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7682ba4-6137-499a-84bf-6c742b8053d0-openshift-service-ca\") pod \"maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl\" (UID: \"e7682ba4-6137-499a-84bf-6c742b8053d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl"
Sep 08 14:48:16.325666 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:16.325602    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7682ba4-6137-499a-84bf-6c742b8053d0-metrics-certs\") pod \"maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl\" (UID: \"e7682ba4-6137-499a-84bf-6c742b8053d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl"
Sep 08 14:48:16.325764 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:16.325663    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7682ba4-6137-499a-84bf-6c742b8053d0-maas-api-tls\") pod \"maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl\" (UID: \"e7682ba4-6137-499a-84bf-6c742b8053d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl"
Sep 08 14:48:16.332897 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:16.332864    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjmp4\" (UniqueName: \"kubernetes.io/projected/e7682ba4-6137-499a-84bf-6c742b8053d0-kube-api-access-gjmp4\") pod \"maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl\" (UID: \"e7682ba4-6137-499a-84bf-6c742b8053d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl"
Sep 08 14:48:16.391320 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:16.391277    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl"
Sep 08 14:48:16.677257 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:16.677063    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl"]
Sep 08 14:48:16.678083 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:48:16.678055    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7682ba4_6137_499a_84bf_6c742b8053d0.slice/crio-aa258be6e75bc31ca7fc19424940253a910b8976272bd3a6e28d211dcc23961b WatchSource:0}: Error finding container aa258be6e75bc31ca7fc19424940253a910b8976272bd3a6e28d211dcc23961b: Status 404 returned error can't find the container with id aa258be6e75bc31ca7fc19424940253a910b8976272bd3a6e28d211dcc23961b
Sep 08 14:48:16.912953 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:16.912907    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl" event={"ID":"e7682ba4-6137-499a-84bf-6c742b8053d0","Type":"ContainerStarted","Data":"aa258be6e75bc31ca7fc19424940253a910b8976272bd3a6e28d211dcc23961b"}
Sep 08 14:48:17.922149 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:17.922109    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl" event={"ID":"e7682ba4-6137-499a-84bf-6c742b8053d0","Type":"ContainerStarted","Data":"8ccf988036d76b598c08f3962c317a108dc4ba2660a76ebc0a50a046c7c277e0"}
Sep 08 14:48:17.922675 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:17.922218    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl"
Sep 08 14:48:17.943878 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:17.943813    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl" podStartSLOduration=1.090056306 podStartE2EDuration="1.943795762s" totalImagesPullingTime="853.739456ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:48:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:48:17.940764451 +0000 UTC m=+858.979165373" watchObservedRunningTime="2026-09-08 14:48:17.943795762 +0000 UTC m=+858.982196721"
Sep 08 14:48:18.810265 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:18.810169    2577 patch_prober.go:28] interesting pod/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 08 14:48:18.810265 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:18.810226    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs" podUID="241f8bde-92f7-4a17-9d0e-e906425add7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 08 14:48:18.929723 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:18.929686    2577 generic.go:356] "Generic (PLEG): container finished" podID="241f8bde-92f7-4a17-9d0e-e906425add7e" containerID="bc9007d784824ccca5c7480e878f9b17fb0708dd73dcb89bfaf3033f493edb5e" exitCode=0
Sep 08 14:48:18.930202 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:18.929765    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs" event={"ID":"241f8bde-92f7-4a17-9d0e-e906425add7e","Type":"ContainerDied","Data":"bc9007d784824ccca5c7480e878f9b17fb0708dd73dcb89bfaf3033f493edb5e"}
Sep 08 14:48:18.930312 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:18.930296    2577 scope.go:117] "RemoveContainer" containerID="bc9007d784824ccca5c7480e878f9b17fb0708dd73dcb89bfaf3033f493edb5e"
Sep 08 14:48:18.931311 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:18.931286    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:48:18.931367 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:18.931349    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:48:18.931403 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:18.931381    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:48:19.938515 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:19.938457    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs" event={"ID":"241f8bde-92f7-4a17-9d0e-e906425add7e","Type":"ContainerStarted","Data":"6d086672b070f5b3708fcac239fd283846ea2dab9360ecf6fb6e19ee8197819b"}
Sep 08 14:48:20.908386 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:20.908338    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:20.908732 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:20.908500    2577 patch_prober.go:28] interesting pod/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 08 14:48:20.908732 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:20.908568    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs" podUID="241f8bde-92f7-4a17-9d0e-e906425add7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 08 14:48:21.908906 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:21.908866    2577 patch_prober.go:28] interesting pod/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 08 14:48:21.909547 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:21.909510    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs" podUID="241f8bde-92f7-4a17-9d0e-e906425add7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 08 14:48:22.908296 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:22.908249    2577 patch_prober.go:28] interesting pod/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 08 14:48:22.908537 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:22.908319    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs" podUID="241f8bde-92f7-4a17-9d0e-e906425add7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 08 14:48:23.908462 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:23.908425    2577 patch_prober.go:28] interesting pod/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 08 14:48:23.909062 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:23.909028    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs" podUID="241f8bde-92f7-4a17-9d0e-e906425add7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 08 14:48:23.940585 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:23.940556    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl"
Sep 08 14:48:24.909039 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:24.908989    2577 patch_prober.go:28] interesting pod/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 08 14:48:24.909599 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:24.909060    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs" podUID="241f8bde-92f7-4a17-9d0e-e906425add7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 08 14:48:25.908317 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:25.908280    2577 patch_prober.go:28] interesting pod/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 08 14:48:25.908630 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:25.908595    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs" podUID="241f8bde-92f7-4a17-9d0e-e906425add7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 08 14:48:26.927653 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:26.927619    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:26.928926 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:26.928904    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:26.932049 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:26.932022    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:30.809712 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:30.808337    2577 patch_prober.go:28] interesting pod/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": read tcp 10.132.0.2:37528->10.132.0.61:15021: read: connection reset by peer" start-of-body=
Sep 08 14:48:30.809712 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:30.808403    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd" podUID="31411c2f-547d-4b5e-a203-a52e061879b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": read tcp 10.132.0.2:37528->10.132.0.61:15021: read: connection reset by peer"
Sep 08 14:48:31.028261 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:31.028182    2577 generic.go:356] "Generic (PLEG): container finished" podID="31411c2f-547d-4b5e-a203-a52e061879b0" containerID="f0692c0984d687b7e2dcde90669cec6fbc0af54df763ba27e4539633769a4460" exitCode=0
Sep 08 14:48:31.028261 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:31.028247    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd" event={"ID":"31411c2f-547d-4b5e-a203-a52e061879b0","Type":"ContainerDied","Data":"f0692c0984d687b7e2dcde90669cec6fbc0af54df763ba27e4539633769a4460"}
Sep 08 14:48:31.028651 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:31.028636    2577 scope.go:117] "RemoveContainer" containerID="f0692c0984d687b7e2dcde90669cec6fbc0af54df763ba27e4539633769a4460"
Sep 08 14:48:31.029708 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:31.029680    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:48:31.029814 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:31.029759    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:48:31.029883 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:31.029813    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:48:32.039242 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:32.039205    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd" event={"ID":"31411c2f-547d-4b5e-a203-a52e061879b0","Type":"ContainerStarted","Data":"6f0c53f9253a6f58c4dfba9667c078b3a939afa572f411368c94d53bb37894bd"}
Sep 08 14:48:32.900966 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:32.900932    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:32.901138 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:32.901069    2577 patch_prober.go:28] interesting pod/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 08 14:48:32.901138 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:32.901114    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd" podUID="31411c2f-547d-4b5e-a203-a52e061879b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 08 14:48:33.900723 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:33.900678    2577 patch_prober.go:28] interesting pod/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 08 14:48:33.901102 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:33.900744    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd" podUID="31411c2f-547d-4b5e-a203-a52e061879b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 08 14:48:34.480747 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:34.480713    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:48:34.901169 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:34.901078    2577 patch_prober.go:28] interesting pod/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 08 14:48:34.901169 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:34.901139    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd" podUID="31411c2f-547d-4b5e-a203-a52e061879b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 08 14:48:35.049979 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:35.049931    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7"]
Sep 08 14:48:35.050534 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:35.050507    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7" podUID="1215de8c-0b63-4b68-852a-7cc50d1bb6f0" containerName="maas-api" containerID="cri-o://7de97abea9508c335b1e3887a2c68c7f4063ae2311dfb5c7286089ab0001261e" gracePeriod=30
Sep 08 14:48:35.358290 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:35.358269    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7"
Sep 08 14:48:35.401556 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:35.401066    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrh6j\" (UniqueName: \"kubernetes.io/projected/1215de8c-0b63-4b68-852a-7cc50d1bb6f0-kube-api-access-zrh6j\") pod \"1215de8c-0b63-4b68-852a-7cc50d1bb6f0\" (UID: \"1215de8c-0b63-4b68-852a-7cc50d1bb6f0\") "
Sep 08 14:48:35.401556 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:35.401133    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1215de8c-0b63-4b68-852a-7cc50d1bb6f0-metrics-certs\") pod \"1215de8c-0b63-4b68-852a-7cc50d1bb6f0\" (UID: \"1215de8c-0b63-4b68-852a-7cc50d1bb6f0\") "
Sep 08 14:48:35.401556 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:35.401150    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1215de8c-0b63-4b68-852a-7cc50d1bb6f0-maas-api-tls\") pod \"1215de8c-0b63-4b68-852a-7cc50d1bb6f0\" (UID: \"1215de8c-0b63-4b68-852a-7cc50d1bb6f0\") "
Sep 08 14:48:35.401556 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:35.401190    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1215de8c-0b63-4b68-852a-7cc50d1bb6f0-openshift-service-ca\") pod \"1215de8c-0b63-4b68-852a-7cc50d1bb6f0\" (UID: \"1215de8c-0b63-4b68-852a-7cc50d1bb6f0\") "
Sep 08 14:48:35.402241 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:35.402201    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1215de8c-0b63-4b68-852a-7cc50d1bb6f0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1215de8c-0b63-4b68-852a-7cc50d1bb6f0" (UID: "1215de8c-0b63-4b68-852a-7cc50d1bb6f0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:48:35.404405 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:35.404379    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1215de8c-0b63-4b68-852a-7cc50d1bb6f0-kube-api-access-zrh6j" (OuterVolumeSpecName: "kube-api-access-zrh6j") pod "1215de8c-0b63-4b68-852a-7cc50d1bb6f0" (UID: "1215de8c-0b63-4b68-852a-7cc50d1bb6f0"). InnerVolumeSpecName "kube-api-access-zrh6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:48:35.404519 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:35.404461    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1215de8c-0b63-4b68-852a-7cc50d1bb6f0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1215de8c-0b63-4b68-852a-7cc50d1bb6f0" (UID: "1215de8c-0b63-4b68-852a-7cc50d1bb6f0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:48:35.411507 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:35.410610    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1215de8c-0b63-4b68-852a-7cc50d1bb6f0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1215de8c-0b63-4b68-852a-7cc50d1bb6f0" (UID: "1215de8c-0b63-4b68-852a-7cc50d1bb6f0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:48:35.458972 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:35.458933    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"]
Sep 08 14:48:35.459208 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:35.459184    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs" podUID="241f8bde-92f7-4a17-9d0e-e906425add7e" containerName="istio-proxy" containerID="cri-o://6d086672b070f5b3708fcac239fd283846ea2dab9360ecf6fb6e19ee8197819b" gracePeriod=30
Sep 08 14:48:35.501883 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:35.501855    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1215de8c-0b63-4b68-852a-7cc50d1bb6f0-metrics-certs\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:48:35.501883 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:35.501880    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1215de8c-0b63-4b68-852a-7cc50d1bb6f0-maas-api-tls\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:48:35.502074 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:35.501892    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1215de8c-0b63-4b68-852a-7cc50d1bb6f0-openshift-service-ca\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:48:35.502074 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:35.501905    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrh6j\" (UniqueName: \"kubernetes.io/projected/1215de8c-0b63-4b68-852a-7cc50d1bb6f0-kube-api-access-zrh6j\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:48:35.900311 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:35.900223    2577 patch_prober.go:28] interesting pod/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 08 14:48:35.900311 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:35.900279    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd" podUID="31411c2f-547d-4b5e-a203-a52e061879b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 08 14:48:36.067625 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:36.067585    2577 generic.go:356] "Generic (PLEG): container finished" podID="1215de8c-0b63-4b68-852a-7cc50d1bb6f0" containerID="7de97abea9508c335b1e3887a2c68c7f4063ae2311dfb5c7286089ab0001261e" exitCode=0
Sep 08 14:48:36.068067 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:36.067651    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7"
Sep 08 14:48:36.068067 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:36.067663    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7" event={"ID":"1215de8c-0b63-4b68-852a-7cc50d1bb6f0","Type":"ContainerDied","Data":"7de97abea9508c335b1e3887a2c68c7f4063ae2311dfb5c7286089ab0001261e"}
Sep 08 14:48:36.068067 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:36.067720    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7" event={"ID":"1215de8c-0b63-4b68-852a-7cc50d1bb6f0","Type":"ContainerDied","Data":"1ea0e9b6262b94ac0e8c720f3a3663112df6182da93bcce5a7b4d9c9ab2ef539"}
Sep 08 14:48:36.068067 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:36.067743    2577 scope.go:117] "RemoveContainer" containerID="7de97abea9508c335b1e3887a2c68c7f4063ae2311dfb5c7286089ab0001261e"
Sep 08 14:48:36.077358 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:36.077343    2577 scope.go:117] "RemoveContainer" containerID="7de97abea9508c335b1e3887a2c68c7f4063ae2311dfb5c7286089ab0001261e"
Sep 08 14:48:36.077704 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:48:36.077679    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7de97abea9508c335b1e3887a2c68c7f4063ae2311dfb5c7286089ab0001261e\": container with ID starting with 7de97abea9508c335b1e3887a2c68c7f4063ae2311dfb5c7286089ab0001261e not found: ID does not exist" containerID="7de97abea9508c335b1e3887a2c68c7f4063ae2311dfb5c7286089ab0001261e"
Sep 08 14:48:36.077803 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:36.077763    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7de97abea9508c335b1e3887a2c68c7f4063ae2311dfb5c7286089ab0001261e"} err="failed to get container status \"7de97abea9508c335b1e3887a2c68c7f4063ae2311dfb5c7286089ab0001261e\": rpc error: code = NotFound desc = could not find container \"7de97abea9508c335b1e3887a2c68c7f4063ae2311dfb5c7286089ab0001261e\": container with ID starting with 7de97abea9508c335b1e3887a2c68c7f4063ae2311dfb5c7286089ab0001261e not found: ID does not exist"
Sep 08 14:48:36.101858 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:36.101832    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7"]
Sep 08 14:48:36.104674 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:36.104645    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-02cfd933-dfb785dc8-rczs7"]
Sep 08 14:48:36.900382 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:36.900351    2577 patch_prober.go:28] interesting pod/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 08 14:48:36.900583 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:36.900401    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd" podUID="31411c2f-547d-4b5e-a203-a52e061879b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 08 14:48:37.491378 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:37.491344    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1215de8c-0b63-4b68-852a-7cc50d1bb6f0" path="/var/lib/kubelet/pods/1215de8c-0b63-4b68-852a-7cc50d1bb6f0/volumes"
Sep 08 14:48:37.904386 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:37.904314    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:37.904998 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:37.904937    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:37.905995 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:37.905965    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:48:40.713906 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:40.713882    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:40.753046 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:40.752974    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n25kt\" (UniqueName: \"kubernetes.io/projected/241f8bde-92f7-4a17-9d0e-e906425add7e-kube-api-access-n25kt\") pod \"241f8bde-92f7-4a17-9d0e-e906425add7e\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") "
Sep 08 14:48:40.753046 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:40.753026    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/241f8bde-92f7-4a17-9d0e-e906425add7e-istio-podinfo\") pod \"241f8bde-92f7-4a17-9d0e-e906425add7e\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") "
Sep 08 14:48:40.753263 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:40.753217    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/241f8bde-92f7-4a17-9d0e-e906425add7e-workload-certs\") pod \"241f8bde-92f7-4a17-9d0e-e906425add7e\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") "
Sep 08 14:48:40.753325 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:40.753313    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/241f8bde-92f7-4a17-9d0e-e906425add7e-istiod-ca-cert\") pod \"241f8bde-92f7-4a17-9d0e-e906425add7e\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") "
Sep 08 14:48:40.753380 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:40.753346    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/241f8bde-92f7-4a17-9d0e-e906425add7e-istio-token\") pod \"241f8bde-92f7-4a17-9d0e-e906425add7e\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") "
Sep 08 14:48:40.753431 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:40.753403    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/241f8bde-92f7-4a17-9d0e-e906425add7e-istio-data\") pod \"241f8bde-92f7-4a17-9d0e-e906425add7e\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") "
Sep 08 14:48:40.753523 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:40.753439    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/241f8bde-92f7-4a17-9d0e-e906425add7e-credential-socket\") pod \"241f8bde-92f7-4a17-9d0e-e906425add7e\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") "
Sep 08 14:48:40.753523 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:40.753441    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/241f8bde-92f7-4a17-9d0e-e906425add7e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "241f8bde-92f7-4a17-9d0e-e906425add7e" (UID: "241f8bde-92f7-4a17-9d0e-e906425add7e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:48:40.753523 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:40.753509    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/241f8bde-92f7-4a17-9d0e-e906425add7e-istio-envoy\") pod \"241f8bde-92f7-4a17-9d0e-e906425add7e\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") "
Sep 08 14:48:40.753691 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:40.753534    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/241f8bde-92f7-4a17-9d0e-e906425add7e-workload-socket\") pod \"241f8bde-92f7-4a17-9d0e-e906425add7e\" (UID: \"241f8bde-92f7-4a17-9d0e-e906425add7e\") "
Sep 08 14:48:40.753691 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:40.753683    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/241f8bde-92f7-4a17-9d0e-e906425add7e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "241f8bde-92f7-4a17-9d0e-e906425add7e" (UID: "241f8bde-92f7-4a17-9d0e-e906425add7e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:48:40.753806 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:40.753609    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/241f8bde-92f7-4a17-9d0e-e906425add7e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "241f8bde-92f7-4a17-9d0e-e906425add7e" (UID: "241f8bde-92f7-4a17-9d0e-e906425add7e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:48:40.753866 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:40.753811    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/241f8bde-92f7-4a17-9d0e-e906425add7e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "241f8bde-92f7-4a17-9d0e-e906425add7e" (UID: "241f8bde-92f7-4a17-9d0e-e906425add7e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:48:40.753922 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:40.753892    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/241f8bde-92f7-4a17-9d0e-e906425add7e-istiod-ca-cert\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:48:40.753922 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:40.753905    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/241f8bde-92f7-4a17-9d0e-e906425add7e-credential-socket\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:48:40.754021 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:40.753923    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/241f8bde-92f7-4a17-9d0e-e906425add7e-workload-socket\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:48:40.754021 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:40.753940    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/241f8bde-92f7-4a17-9d0e-e906425add7e-workload-certs\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:48:40.754021 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:40.753967    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/241f8bde-92f7-4a17-9d0e-e906425add7e-istio-data" (OuterVolumeSpecName: "istio-data") pod "241f8bde-92f7-4a17-9d0e-e906425add7e" (UID: "241f8bde-92f7-4a17-9d0e-e906425add7e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:48:40.755725 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:40.755698    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/241f8bde-92f7-4a17-9d0e-e906425add7e-istio-token" (OuterVolumeSpecName: "istio-token") pod "241f8bde-92f7-4a17-9d0e-e906425add7e" (UID: "241f8bde-92f7-4a17-9d0e-e906425add7e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:48:40.755927 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:40.755900    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/241f8bde-92f7-4a17-9d0e-e906425add7e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "241f8bde-92f7-4a17-9d0e-e906425add7e" (UID: "241f8bde-92f7-4a17-9d0e-e906425add7e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:48:40.755927 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:40.755903    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/241f8bde-92f7-4a17-9d0e-e906425add7e-kube-api-access-n25kt" (OuterVolumeSpecName: "kube-api-access-n25kt") pod "241f8bde-92f7-4a17-9d0e-e906425add7e" (UID: "241f8bde-92f7-4a17-9d0e-e906425add7e"). InnerVolumeSpecName "kube-api-access-n25kt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:48:40.756139 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:40.756118    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/241f8bde-92f7-4a17-9d0e-e906425add7e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "241f8bde-92f7-4a17-9d0e-e906425add7e" (UID: "241f8bde-92f7-4a17-9d0e-e906425add7e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:48:40.855304 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:40.855272    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/241f8bde-92f7-4a17-9d0e-e906425add7e-istio-token\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:48:40.855304 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:40.855299    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/241f8bde-92f7-4a17-9d0e-e906425add7e-istio-data\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:48:40.855304 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:40.855309    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/241f8bde-92f7-4a17-9d0e-e906425add7e-istio-envoy\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:48:40.855551 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:40.855317    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n25kt\" (UniqueName: \"kubernetes.io/projected/241f8bde-92f7-4a17-9d0e-e906425add7e-kube-api-access-n25kt\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:48:40.855551 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:40.855327    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/241f8bde-92f7-4a17-9d0e-e906425add7e-istio-podinfo\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:48:41.100896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:41.100796    2577 generic.go:356] "Generic (PLEG): container finished" podID="241f8bde-92f7-4a17-9d0e-e906425add7e" containerID="6d086672b070f5b3708fcac239fd283846ea2dab9360ecf6fb6e19ee8197819b" exitCode=0
Sep 08 14:48:41.100896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:41.100842    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"
Sep 08 14:48:41.100896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:41.100883    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs" event={"ID":"241f8bde-92f7-4a17-9d0e-e906425add7e","Type":"ContainerDied","Data":"6d086672b070f5b3708fcac239fd283846ea2dab9360ecf6fb6e19ee8197819b"}
Sep 08 14:48:41.101160 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:41.100958    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs" event={"ID":"241f8bde-92f7-4a17-9d0e-e906425add7e","Type":"ContainerDied","Data":"fc716893c0841874a942f9d8249b309b6067f41ebbc2f003fb132c0ca60a7ba9"}
Sep 08 14:48:41.101160 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:41.100980    2577 scope.go:117] "RemoveContainer" containerID="6d086672b070f5b3708fcac239fd283846ea2dab9360ecf6fb6e19ee8197819b"
Sep 08 14:48:41.112715 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:41.112693    2577 scope.go:117] "RemoveContainer" containerID="bc9007d784824ccca5c7480e878f9b17fb0708dd73dcb89bfaf3033f493edb5e"
Sep 08 14:48:41.123019 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:41.123004    2577 scope.go:117] "RemoveContainer" containerID="6d086672b070f5b3708fcac239fd283846ea2dab9360ecf6fb6e19ee8197819b"
Sep 08 14:48:41.123281 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:48:41.123259    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d086672b070f5b3708fcac239fd283846ea2dab9360ecf6fb6e19ee8197819b\": container with ID starting with 6d086672b070f5b3708fcac239fd283846ea2dab9360ecf6fb6e19ee8197819b not found: ID does not exist" containerID="6d086672b070f5b3708fcac239fd283846ea2dab9360ecf6fb6e19ee8197819b"
Sep 08 14:48:41.123352 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:41.123289    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d086672b070f5b3708fcac239fd283846ea2dab9360ecf6fb6e19ee8197819b"} err="failed to get container status \"6d086672b070f5b3708fcac239fd283846ea2dab9360ecf6fb6e19ee8197819b\": rpc error: code = NotFound desc = could not find container \"6d086672b070f5b3708fcac239fd283846ea2dab9360ecf6fb6e19ee8197819b\": container with ID starting with 6d086672b070f5b3708fcac239fd283846ea2dab9360ecf6fb6e19ee8197819b not found: ID does not exist"
Sep 08 14:48:41.123352 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:41.123307    2577 scope.go:117] "RemoveContainer" containerID="bc9007d784824ccca5c7480e878f9b17fb0708dd73dcb89bfaf3033f493edb5e"
Sep 08 14:48:41.123620 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:48:41.123603    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc9007d784824ccca5c7480e878f9b17fb0708dd73dcb89bfaf3033f493edb5e\": container with ID starting with bc9007d784824ccca5c7480e878f9b17fb0708dd73dcb89bfaf3033f493edb5e not found: ID does not exist" containerID="bc9007d784824ccca5c7480e878f9b17fb0708dd73dcb89bfaf3033f493edb5e"
Sep 08 14:48:41.123692 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:41.123625    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc9007d784824ccca5c7480e878f9b17fb0708dd73dcb89bfaf3033f493edb5e"} err="failed to get container status \"bc9007d784824ccca5c7480e878f9b17fb0708dd73dcb89bfaf3033f493edb5e\": rpc error: code = NotFound desc = could not find container \"bc9007d784824ccca5c7480e878f9b17fb0708dd73dcb89bfaf3033f493edb5e\": container with ID starting with bc9007d784824ccca5c7480e878f9b17fb0708dd73dcb89bfaf3033f493edb5e not found: ID does not exist"
Sep 08 14:48:41.127871 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:41.127851    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"]
Sep 08 14:48:41.132046 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:41.132020    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-02cfd933-openshift-default-5c5b486d44-q8kzs"]
Sep 08 14:48:41.491609 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:41.491578    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="241f8bde-92f7-4a17-9d0e-e906425add7e" path="/var/lib/kubelet/pods/241f8bde-92f7-4a17-9d0e-e906425add7e/volumes"
Sep 08 14:48:48.267047 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:48.267007    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:48:57.782444 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:48:57.782362    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:49:14.473204 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:14.473162    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:49:19.612416 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:19.612386    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl"]
Sep 08 14:49:19.612837 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:19.612622    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl" podUID="e7682ba4-6137-499a-84bf-6c742b8053d0" containerName="maas-api" containerID="cri-o://8ccf988036d76b598c08f3962c317a108dc4ba2660a76ebc0a50a046c7c277e0" gracePeriod=30
Sep 08 14:49:19.865011 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:19.864950    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl"
Sep 08 14:49:19.919200 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:19.919167    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7682ba4-6137-499a-84bf-6c742b8053d0-metrics-certs\") pod \"e7682ba4-6137-499a-84bf-6c742b8053d0\" (UID: \"e7682ba4-6137-499a-84bf-6c742b8053d0\") "
Sep 08 14:49:19.919200 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:19.919201    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7682ba4-6137-499a-84bf-6c742b8053d0-openshift-service-ca\") pod \"e7682ba4-6137-499a-84bf-6c742b8053d0\" (UID: \"e7682ba4-6137-499a-84bf-6c742b8053d0\") "
Sep 08 14:49:19.919448 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:19.919235    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjmp4\" (UniqueName: \"kubernetes.io/projected/e7682ba4-6137-499a-84bf-6c742b8053d0-kube-api-access-gjmp4\") pod \"e7682ba4-6137-499a-84bf-6c742b8053d0\" (UID: \"e7682ba4-6137-499a-84bf-6c742b8053d0\") "
Sep 08 14:49:19.919448 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:19.919273    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7682ba4-6137-499a-84bf-6c742b8053d0-maas-api-tls\") pod \"e7682ba4-6137-499a-84bf-6c742b8053d0\" (UID: \"e7682ba4-6137-499a-84bf-6c742b8053d0\") "
Sep 08 14:49:19.919600 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:19.919583    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7682ba4-6137-499a-84bf-6c742b8053d0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e7682ba4-6137-499a-84bf-6c742b8053d0" (UID: "e7682ba4-6137-499a-84bf-6c742b8053d0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:49:19.921585 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:19.921547    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7682ba4-6137-499a-84bf-6c742b8053d0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e7682ba4-6137-499a-84bf-6c742b8053d0" (UID: "e7682ba4-6137-499a-84bf-6c742b8053d0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:49:19.921740 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:19.921715    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7682ba4-6137-499a-84bf-6c742b8053d0-kube-api-access-gjmp4" (OuterVolumeSpecName: "kube-api-access-gjmp4") pod "e7682ba4-6137-499a-84bf-6c742b8053d0" (UID: "e7682ba4-6137-499a-84bf-6c742b8053d0"). InnerVolumeSpecName "kube-api-access-gjmp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:49:19.921813 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:19.921722    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7682ba4-6137-499a-84bf-6c742b8053d0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e7682ba4-6137-499a-84bf-6c742b8053d0" (UID: "e7682ba4-6137-499a-84bf-6c742b8053d0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:49:20.020243 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:20.020204    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7682ba4-6137-499a-84bf-6c742b8053d0-maas-api-tls\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:49:20.020243 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:20.020237    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7682ba4-6137-499a-84bf-6c742b8053d0-metrics-certs\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:49:20.020243 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:20.020250    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7682ba4-6137-499a-84bf-6c742b8053d0-openshift-service-ca\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:49:20.020503 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:20.020264    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjmp4\" (UniqueName: \"kubernetes.io/projected/e7682ba4-6137-499a-84bf-6c742b8053d0-kube-api-access-gjmp4\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:49:20.342220 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:20.342187    2577 generic.go:356] "Generic (PLEG): container finished" podID="e7682ba4-6137-499a-84bf-6c742b8053d0" containerID="8ccf988036d76b598c08f3962c317a108dc4ba2660a76ebc0a50a046c7c277e0" exitCode=0
Sep 08 14:49:20.342378 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:20.342226    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl" event={"ID":"e7682ba4-6137-499a-84bf-6c742b8053d0","Type":"ContainerDied","Data":"8ccf988036d76b598c08f3962c317a108dc4ba2660a76ebc0a50a046c7c277e0"}
Sep 08 14:49:20.342378 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:20.342262    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl" event={"ID":"e7682ba4-6137-499a-84bf-6c742b8053d0","Type":"ContainerDied","Data":"aa258be6e75bc31ca7fc19424940253a910b8976272bd3a6e28d211dcc23961b"}
Sep 08 14:49:20.342378 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:20.342283    2577 scope.go:117] "RemoveContainer" containerID="8ccf988036d76b598c08f3962c317a108dc4ba2660a76ebc0a50a046c7c277e0"
Sep 08 14:49:20.342378 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:20.342228    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl"
Sep 08 14:49:20.355220 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:20.355200    2577 scope.go:117] "RemoveContainer" containerID="8ccf988036d76b598c08f3962c317a108dc4ba2660a76ebc0a50a046c7c277e0"
Sep 08 14:49:20.355679 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:49:20.355654    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ccf988036d76b598c08f3962c317a108dc4ba2660a76ebc0a50a046c7c277e0\": container with ID starting with 8ccf988036d76b598c08f3962c317a108dc4ba2660a76ebc0a50a046c7c277e0 not found: ID does not exist" containerID="8ccf988036d76b598c08f3962c317a108dc4ba2660a76ebc0a50a046c7c277e0"
Sep 08 14:49:20.355776 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:20.355683    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ccf988036d76b598c08f3962c317a108dc4ba2660a76ebc0a50a046c7c277e0"} err="failed to get container status \"8ccf988036d76b598c08f3962c317a108dc4ba2660a76ebc0a50a046c7c277e0\": rpc error: code = NotFound desc = could not find container \"8ccf988036d76b598c08f3962c317a108dc4ba2660a76ebc0a50a046c7c277e0\": container with ID starting with 8ccf988036d76b598c08f3962c317a108dc4ba2660a76ebc0a50a046c7c277e0 not found: ID does not exist"
Sep 08 14:49:20.366459 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:20.366435    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl"]
Sep 08 14:49:20.370761 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:20.370740    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-222cd5-5645f6488c-r8xrl"]
Sep 08 14:49:21.491294 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:21.491262    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7682ba4-6137-499a-84bf-6c742b8053d0" path="/var/lib/kubelet/pods/e7682ba4-6137-499a-84bf-6c742b8053d0/volumes"
Sep 08 14:49:26.781798 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:26.781768    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"]
Sep 08 14:49:26.782184 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:26.781984    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd" podUID="31411c2f-547d-4b5e-a203-a52e061879b0" containerName="istio-proxy" containerID="cri-o://6f0c53f9253a6f58c4dfba9667c078b3a939afa572f411368c94d53bb37894bd" gracePeriod=30
Sep 08 14:49:31.268212 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:31.268171    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:49:32.027899 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.027875    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:49:32.131720 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.131646    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31411c2f-547d-4b5e-a203-a52e061879b0-istiod-ca-cert\") pod \"31411c2f-547d-4b5e-a203-a52e061879b0\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") "
Sep 08 14:49:32.131720 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.131708    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31411c2f-547d-4b5e-a203-a52e061879b0-workload-socket\") pod \"31411c2f-547d-4b5e-a203-a52e061879b0\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") "
Sep 08 14:49:32.131935 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.131885    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31411c2f-547d-4b5e-a203-a52e061879b0-istio-podinfo\") pod \"31411c2f-547d-4b5e-a203-a52e061879b0\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") "
Sep 08 14:49:32.131935 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.131919    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31411c2f-547d-4b5e-a203-a52e061879b0-workload-certs\") pod \"31411c2f-547d-4b5e-a203-a52e061879b0\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") "
Sep 08 14:49:32.132050 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.131960    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31411c2f-547d-4b5e-a203-a52e061879b0-istio-data\") pod \"31411c2f-547d-4b5e-a203-a52e061879b0\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") "
Sep 08 14:49:32.132050 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.131975    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31411c2f-547d-4b5e-a203-a52e061879b0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "31411c2f-547d-4b5e-a203-a52e061879b0" (UID: "31411c2f-547d-4b5e-a203-a52e061879b0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:49:32.132050 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.131984    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31411c2f-547d-4b5e-a203-a52e061879b0-credential-socket\") pod \"31411c2f-547d-4b5e-a203-a52e061879b0\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") "
Sep 08 14:49:32.132217 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.132066    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31411c2f-547d-4b5e-a203-a52e061879b0-istio-envoy\") pod \"31411c2f-547d-4b5e-a203-a52e061879b0\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") "
Sep 08 14:49:32.132217 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.131977    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31411c2f-547d-4b5e-a203-a52e061879b0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "31411c2f-547d-4b5e-a203-a52e061879b0" (UID: "31411c2f-547d-4b5e-a203-a52e061879b0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:49:32.132217 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.132119    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31411c2f-547d-4b5e-a203-a52e061879b0-istio-token\") pod \"31411c2f-547d-4b5e-a203-a52e061879b0\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") "
Sep 08 14:49:32.132217 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.132160    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9ktt\" (UniqueName: \"kubernetes.io/projected/31411c2f-547d-4b5e-a203-a52e061879b0-kube-api-access-k9ktt\") pod \"31411c2f-547d-4b5e-a203-a52e061879b0\" (UID: \"31411c2f-547d-4b5e-a203-a52e061879b0\") "
Sep 08 14:49:32.132217 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.132197    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31411c2f-547d-4b5e-a203-a52e061879b0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "31411c2f-547d-4b5e-a203-a52e061879b0" (UID: "31411c2f-547d-4b5e-a203-a52e061879b0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:49:32.132423 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.132234    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31411c2f-547d-4b5e-a203-a52e061879b0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "31411c2f-547d-4b5e-a203-a52e061879b0" (UID: "31411c2f-547d-4b5e-a203-a52e061879b0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:49:32.132423 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.132247    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31411c2f-547d-4b5e-a203-a52e061879b0-istio-data" (OuterVolumeSpecName: "istio-data") pod "31411c2f-547d-4b5e-a203-a52e061879b0" (UID: "31411c2f-547d-4b5e-a203-a52e061879b0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:49:32.132565 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.132501    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31411c2f-547d-4b5e-a203-a52e061879b0-workload-socket\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:49:32.132565 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.132519    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31411c2f-547d-4b5e-a203-a52e061879b0-workload-certs\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:49:32.132565 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.132531    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31411c2f-547d-4b5e-a203-a52e061879b0-istio-data\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:49:32.132565 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.132542    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31411c2f-547d-4b5e-a203-a52e061879b0-credential-socket\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:49:32.132945 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.132566    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31411c2f-547d-4b5e-a203-a52e061879b0-istiod-ca-cert\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:49:32.134205 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.134171    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/31411c2f-547d-4b5e-a203-a52e061879b0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "31411c2f-547d-4b5e-a203-a52e061879b0" (UID: "31411c2f-547d-4b5e-a203-a52e061879b0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:49:32.134314 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.134278    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31411c2f-547d-4b5e-a203-a52e061879b0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "31411c2f-547d-4b5e-a203-a52e061879b0" (UID: "31411c2f-547d-4b5e-a203-a52e061879b0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:49:32.134314 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.134285    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31411c2f-547d-4b5e-a203-a52e061879b0-istio-token" (OuterVolumeSpecName: "istio-token") pod "31411c2f-547d-4b5e-a203-a52e061879b0" (UID: "31411c2f-547d-4b5e-a203-a52e061879b0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:49:32.134314 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.134292    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31411c2f-547d-4b5e-a203-a52e061879b0-kube-api-access-k9ktt" (OuterVolumeSpecName: "kube-api-access-k9ktt") pod "31411c2f-547d-4b5e-a203-a52e061879b0" (UID: "31411c2f-547d-4b5e-a203-a52e061879b0"). InnerVolumeSpecName "kube-api-access-k9ktt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:49:32.233972 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.233946    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31411c2f-547d-4b5e-a203-a52e061879b0-istio-envoy\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:49:32.233972 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.233972    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31411c2f-547d-4b5e-a203-a52e061879b0-istio-token\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:49:32.234112 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.233985    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9ktt\" (UniqueName: \"kubernetes.io/projected/31411c2f-547d-4b5e-a203-a52e061879b0-kube-api-access-k9ktt\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:49:32.234112 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.233997    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31411c2f-547d-4b5e-a203-a52e061879b0-istio-podinfo\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:49:32.416401 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.416366    2577 generic.go:356] "Generic (PLEG): container finished" podID="31411c2f-547d-4b5e-a203-a52e061879b0" containerID="6f0c53f9253a6f58c4dfba9667c078b3a939afa572f411368c94d53bb37894bd" exitCode=0
Sep 08 14:49:32.416803 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.416419    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"
Sep 08 14:49:32.416803 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.416430    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd" event={"ID":"31411c2f-547d-4b5e-a203-a52e061879b0","Type":"ContainerDied","Data":"6f0c53f9253a6f58c4dfba9667c078b3a939afa572f411368c94d53bb37894bd"}
Sep 08 14:49:32.416803 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.416499    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd" event={"ID":"31411c2f-547d-4b5e-a203-a52e061879b0","Type":"ContainerDied","Data":"54bf3625c7a0a3425b80c23d1a002d67cf694ecbe659ca4645cc62fdba169f81"}
Sep 08 14:49:32.416803 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.416523    2577 scope.go:117] "RemoveContainer" containerID="6f0c53f9253a6f58c4dfba9667c078b3a939afa572f411368c94d53bb37894bd"
Sep 08 14:49:32.426447 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.426425    2577 scope.go:117] "RemoveContainer" containerID="f0692c0984d687b7e2dcde90669cec6fbc0af54df763ba27e4539633769a4460"
Sep 08 14:49:32.434428 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.434413    2577 scope.go:117] "RemoveContainer" containerID="6f0c53f9253a6f58c4dfba9667c078b3a939afa572f411368c94d53bb37894bd"
Sep 08 14:49:32.434775 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:49:32.434752    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f0c53f9253a6f58c4dfba9667c078b3a939afa572f411368c94d53bb37894bd\": container with ID starting with 6f0c53f9253a6f58c4dfba9667c078b3a939afa572f411368c94d53bb37894bd not found: ID does not exist" containerID="6f0c53f9253a6f58c4dfba9667c078b3a939afa572f411368c94d53bb37894bd"
Sep 08 14:49:32.434853 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.434786    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f0c53f9253a6f58c4dfba9667c078b3a939afa572f411368c94d53bb37894bd"} err="failed to get container status \"6f0c53f9253a6f58c4dfba9667c078b3a939afa572f411368c94d53bb37894bd\": rpc error: code = NotFound desc = could not find container \"6f0c53f9253a6f58c4dfba9667c078b3a939afa572f411368c94d53bb37894bd\": container with ID starting with 6f0c53f9253a6f58c4dfba9667c078b3a939afa572f411368c94d53bb37894bd not found: ID does not exist"
Sep 08 14:49:32.434853 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.434810    2577 scope.go:117] "RemoveContainer" containerID="f0692c0984d687b7e2dcde90669cec6fbc0af54df763ba27e4539633769a4460"
Sep 08 14:49:32.435065 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:49:32.435047    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0692c0984d687b7e2dcde90669cec6fbc0af54df763ba27e4539633769a4460\": container with ID starting with f0692c0984d687b7e2dcde90669cec6fbc0af54df763ba27e4539633769a4460 not found: ID does not exist" containerID="f0692c0984d687b7e2dcde90669cec6fbc0af54df763ba27e4539633769a4460"
Sep 08 14:49:32.435104 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.435071    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0692c0984d687b7e2dcde90669cec6fbc0af54df763ba27e4539633769a4460"} err="failed to get container status \"f0692c0984d687b7e2dcde90669cec6fbc0af54df763ba27e4539633769a4460\": rpc error: code = NotFound desc = could not find container \"f0692c0984d687b7e2dcde90669cec6fbc0af54df763ba27e4539633769a4460\": container with ID starting with f0692c0984d687b7e2dcde90669cec6fbc0af54df763ba27e4539633769a4460 not found: ID does not exist"
Sep 08 14:49:32.440244 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.440223    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"]
Sep 08 14:49:32.447415 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:32.447395    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-222cd5-openshift-default-9764c596-x2rrd"]
Sep 08 14:49:33.490869 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:49:33.490835    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31411c2f-547d-4b5e-a203-a52e061879b0" path="/var/lib/kubelet/pods/31411c2f-547d-4b5e-a203-a52e061879b0/volumes"
Sep 08 14:50:00.810368 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:00.810338    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"]
Sep 08 14:50:03.790628 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:03.790596    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:50:12.388020 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.387986    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw"]
Sep 08 14:50:12.388402 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.388190    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw" podUID="b08c26ea-8fe6-4cb4-ab5d-e02faae77f69" containerName="maas-api" containerID="cri-o://d1ebc890c05e1b69f436ef00cf3369a74c6912c1e658fc038d2f6f9f54cad0e3" gracePeriod=30
Sep 08 14:50:12.644297 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.644243    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw"
Sep 08 14:50:12.648994 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.648969    2577 generic.go:356] "Generic (PLEG): container finished" podID="b08c26ea-8fe6-4cb4-ab5d-e02faae77f69" containerID="d1ebc890c05e1b69f436ef00cf3369a74c6912c1e658fc038d2f6f9f54cad0e3" exitCode=0
Sep 08 14:50:12.649117 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.649002    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw"
Sep 08 14:50:12.649117 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.649037    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw" event={"ID":"b08c26ea-8fe6-4cb4-ab5d-e02faae77f69","Type":"ContainerDied","Data":"d1ebc890c05e1b69f436ef00cf3369a74c6912c1e658fc038d2f6f9f54cad0e3"}
Sep 08 14:50:12.649117 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.649089    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw" event={"ID":"b08c26ea-8fe6-4cb4-ab5d-e02faae77f69","Type":"ContainerDied","Data":"93b4f75b62950ff875e63c1a724bd788af559de020d46eed7675b8d932421c54"}
Sep 08 14:50:12.649117 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.649112    2577 scope.go:117] "RemoveContainer" containerID="d1ebc890c05e1b69f436ef00cf3369a74c6912c1e658fc038d2f6f9f54cad0e3"
Sep 08 14:50:12.658133 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.658114    2577 scope.go:117] "RemoveContainer" containerID="d1ebc890c05e1b69f436ef00cf3369a74c6912c1e658fc038d2f6f9f54cad0e3"
Sep 08 14:50:12.658431 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:50:12.658394    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1ebc890c05e1b69f436ef00cf3369a74c6912c1e658fc038d2f6f9f54cad0e3\": container with ID starting with d1ebc890c05e1b69f436ef00cf3369a74c6912c1e658fc038d2f6f9f54cad0e3 not found: ID does not exist" containerID="d1ebc890c05e1b69f436ef00cf3369a74c6912c1e658fc038d2f6f9f54cad0e3"
Sep 08 14:50:12.658576 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.658440    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1ebc890c05e1b69f436ef00cf3369a74c6912c1e658fc038d2f6f9f54cad0e3"} err="failed to get container status \"d1ebc890c05e1b69f436ef00cf3369a74c6912c1e658fc038d2f6f9f54cad0e3\": rpc error: code = NotFound desc = could not find container \"d1ebc890c05e1b69f436ef00cf3369a74c6912c1e658fc038d2f6f9f54cad0e3\": container with ID starting with d1ebc890c05e1b69f436ef00cf3369a74c6912c1e658fc038d2f6f9f54cad0e3 not found: ID does not exist"
Sep 08 14:50:12.667056 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.667033    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b08c26ea-8fe6-4cb4-ab5d-e02faae77f69-maas-api-tls\") pod \"b08c26ea-8fe6-4cb4-ab5d-e02faae77f69\" (UID: \"b08c26ea-8fe6-4cb4-ab5d-e02faae77f69\") "
Sep 08 14:50:12.667161 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.667115    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fn52\" (UniqueName: \"kubernetes.io/projected/b08c26ea-8fe6-4cb4-ab5d-e02faae77f69-kube-api-access-9fn52\") pod \"b08c26ea-8fe6-4cb4-ab5d-e02faae77f69\" (UID: \"b08c26ea-8fe6-4cb4-ab5d-e02faae77f69\") "
Sep 08 14:50:12.667161 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.667142    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b08c26ea-8fe6-4cb4-ab5d-e02faae77f69-openshift-service-ca\") pod \"b08c26ea-8fe6-4cb4-ab5d-e02faae77f69\" (UID: \"b08c26ea-8fe6-4cb4-ab5d-e02faae77f69\") "
Sep 08 14:50:12.667263 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.667194    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b08c26ea-8fe6-4cb4-ab5d-e02faae77f69-metrics-certs\") pod \"b08c26ea-8fe6-4cb4-ab5d-e02faae77f69\" (UID: \"b08c26ea-8fe6-4cb4-ab5d-e02faae77f69\") "
Sep 08 14:50:12.667759 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.667715    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b08c26ea-8fe6-4cb4-ab5d-e02faae77f69-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b08c26ea-8fe6-4cb4-ab5d-e02faae77f69" (UID: "b08c26ea-8fe6-4cb4-ab5d-e02faae77f69"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:50:12.670214 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.670137    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b08c26ea-8fe6-4cb4-ab5d-e02faae77f69-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b08c26ea-8fe6-4cb4-ab5d-e02faae77f69" (UID: "b08c26ea-8fe6-4cb4-ab5d-e02faae77f69"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:50:12.670321 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.670245    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b08c26ea-8fe6-4cb4-ab5d-e02faae77f69-kube-api-access-9fn52" (OuterVolumeSpecName: "kube-api-access-9fn52") pod "b08c26ea-8fe6-4cb4-ab5d-e02faae77f69" (UID: "b08c26ea-8fe6-4cb4-ab5d-e02faae77f69"). InnerVolumeSpecName "kube-api-access-9fn52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:50:12.671260 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.671238    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b08c26ea-8fe6-4cb4-ab5d-e02faae77f69-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b08c26ea-8fe6-4cb4-ab5d-e02faae77f69" (UID: "b08c26ea-8fe6-4cb4-ab5d-e02faae77f69"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:50:12.708238 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.708207    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"]
Sep 08 14:50:12.709053 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.709027    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b08c26ea-8fe6-4cb4-ab5d-e02faae77f69" containerName="maas-api"
Sep 08 14:50:12.709053 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.709054    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b08c26ea-8fe6-4cb4-ab5d-e02faae77f69" containerName="maas-api"
Sep 08 14:50:12.709268 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.709067    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7682ba4-6137-499a-84bf-6c742b8053d0" containerName="maas-api"
Sep 08 14:50:12.709268 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.709076    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7682ba4-6137-499a-84bf-6c742b8053d0" containerName="maas-api"
Sep 08 14:50:12.709268 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.709090    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="241f8bde-92f7-4a17-9d0e-e906425add7e" containerName="istio-proxy"
Sep 08 14:50:12.709268 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.709099    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="241f8bde-92f7-4a17-9d0e-e906425add7e" containerName="istio-proxy"
Sep 08 14:50:12.709268 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.709120    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31411c2f-547d-4b5e-a203-a52e061879b0" containerName="istio-proxy"
Sep 08 14:50:12.709268 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.709130    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="31411c2f-547d-4b5e-a203-a52e061879b0" containerName="istio-proxy"
Sep 08 14:50:12.709268 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.709145    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1215de8c-0b63-4b68-852a-7cc50d1bb6f0" containerName="maas-api"
Sep 08 14:50:12.709268 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.709152    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1215de8c-0b63-4b68-852a-7cc50d1bb6f0" containerName="maas-api"
Sep 08 14:50:12.709268 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.709175    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31411c2f-547d-4b5e-a203-a52e061879b0" containerName="istio-proxy"
Sep 08 14:50:12.709268 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.709183    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="31411c2f-547d-4b5e-a203-a52e061879b0" containerName="istio-proxy"
Sep 08 14:50:12.709796 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.709290    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="31411c2f-547d-4b5e-a203-a52e061879b0" containerName="istio-proxy"
Sep 08 14:50:12.709796 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.709303    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="241f8bde-92f7-4a17-9d0e-e906425add7e" containerName="istio-proxy"
Sep 08 14:50:12.709796 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.709312    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1215de8c-0b63-4b68-852a-7cc50d1bb6f0" containerName="maas-api"
Sep 08 14:50:12.709796 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.709321    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7682ba4-6137-499a-84bf-6c742b8053d0" containerName="maas-api"
Sep 08 14:50:12.709796 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.709331    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="31411c2f-547d-4b5e-a203-a52e061879b0" containerName="istio-proxy"
Sep 08 14:50:12.709796 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.709338    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="241f8bde-92f7-4a17-9d0e-e906425add7e" containerName="istio-proxy"
Sep 08 14:50:12.709796 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.709346    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b08c26ea-8fe6-4cb4-ab5d-e02faae77f69" containerName="maas-api"
Sep 08 14:50:12.714788 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.714770    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:12.717896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.717873    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 14:50:12.718585 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.718565    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-653c2a83-openshift-default-dockercfg-pvmsm\""
Sep 08 14:50:12.734067 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.734045    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"]
Sep 08 14:50:12.768377 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.768358    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a0d69bf-0f86-45a0-8830-8e526816d8f0-istio-envoy\") pod \"e2e-mt-653c2a83-openshift-default-858787d556-kcjp4\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") " pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:12.768518 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.768402    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a0d69bf-0f86-45a0-8830-8e526816d8f0-istio-podinfo\") pod \"e2e-mt-653c2a83-openshift-default-858787d556-kcjp4\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") " pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:12.768518 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.768421    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a0d69bf-0f86-45a0-8830-8e526816d8f0-istio-token\") pod \"e2e-mt-653c2a83-openshift-default-858787d556-kcjp4\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") " pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:12.768606 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.768540    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a0d69bf-0f86-45a0-8830-8e526816d8f0-istiod-ca-cert\") pod \"e2e-mt-653c2a83-openshift-default-858787d556-kcjp4\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") " pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:12.768606 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.768574    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0d69bf-0f86-45a0-8830-8e526816d8f0-credential-socket\") pod \"e2e-mt-653c2a83-openshift-default-858787d556-kcjp4\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") " pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:12.768676 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.768609    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0d69bf-0f86-45a0-8830-8e526816d8f0-workload-socket\") pod \"e2e-mt-653c2a83-openshift-default-858787d556-kcjp4\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") " pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:12.768676 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.768636    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg544\" (UniqueName: \"kubernetes.io/projected/1a0d69bf-0f86-45a0-8830-8e526816d8f0-kube-api-access-qg544\") pod \"e2e-mt-653c2a83-openshift-default-858787d556-kcjp4\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") " pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:12.768741 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.768678    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a0d69bf-0f86-45a0-8830-8e526816d8f0-istio-data\") pod \"e2e-mt-653c2a83-openshift-default-858787d556-kcjp4\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") " pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:12.768741 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.768699    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a0d69bf-0f86-45a0-8830-8e526816d8f0-workload-certs\") pod \"e2e-mt-653c2a83-openshift-default-858787d556-kcjp4\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") " pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:12.768807 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.768773    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b08c26ea-8fe6-4cb4-ab5d-e02faae77f69-maas-api-tls\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:50:12.768807 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.768786    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fn52\" (UniqueName: \"kubernetes.io/projected/b08c26ea-8fe6-4cb4-ab5d-e02faae77f69-kube-api-access-9fn52\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:50:12.768807 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.768798    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b08c26ea-8fe6-4cb4-ab5d-e02faae77f69-openshift-service-ca\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:50:12.768902 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.768808    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b08c26ea-8fe6-4cb4-ab5d-e02faae77f69-metrics-certs\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:50:12.869793 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.869762    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a0d69bf-0f86-45a0-8830-8e526816d8f0-istiod-ca-cert\") pod \"e2e-mt-653c2a83-openshift-default-858787d556-kcjp4\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") " pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:12.869793 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.869793    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0d69bf-0f86-45a0-8830-8e526816d8f0-credential-socket\") pod \"e2e-mt-653c2a83-openshift-default-858787d556-kcjp4\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") " pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:12.870003 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.869819    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0d69bf-0f86-45a0-8830-8e526816d8f0-workload-socket\") pod \"e2e-mt-653c2a83-openshift-default-858787d556-kcjp4\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") " pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:12.870003 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.869836    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg544\" (UniqueName: \"kubernetes.io/projected/1a0d69bf-0f86-45a0-8830-8e526816d8f0-kube-api-access-qg544\") pod \"e2e-mt-653c2a83-openshift-default-858787d556-kcjp4\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") " pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:12.870003 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.869863    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a0d69bf-0f86-45a0-8830-8e526816d8f0-istio-data\") pod \"e2e-mt-653c2a83-openshift-default-858787d556-kcjp4\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") " pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:12.870003 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.869881    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a0d69bf-0f86-45a0-8830-8e526816d8f0-workload-certs\") pod \"e2e-mt-653c2a83-openshift-default-858787d556-kcjp4\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") " pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:12.870003 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.869989    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a0d69bf-0f86-45a0-8830-8e526816d8f0-istio-envoy\") pod \"e2e-mt-653c2a83-openshift-default-858787d556-kcjp4\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") " pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:12.870230 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.870042    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a0d69bf-0f86-45a0-8830-8e526816d8f0-istio-podinfo\") pod \"e2e-mt-653c2a83-openshift-default-858787d556-kcjp4\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") " pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:12.870230 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.870064    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a0d69bf-0f86-45a0-8830-8e526816d8f0-istio-token\") pod \"e2e-mt-653c2a83-openshift-default-858787d556-kcjp4\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") " pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:12.870333 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.870233    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0d69bf-0f86-45a0-8830-8e526816d8f0-credential-socket\") pod \"e2e-mt-653c2a83-openshift-default-858787d556-kcjp4\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") " pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:12.870333 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.870251    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0d69bf-0f86-45a0-8830-8e526816d8f0-workload-socket\") pod \"e2e-mt-653c2a83-openshift-default-858787d556-kcjp4\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") " pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:12.870333 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.870317    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a0d69bf-0f86-45a0-8830-8e526816d8f0-workload-certs\") pod \"e2e-mt-653c2a83-openshift-default-858787d556-kcjp4\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") " pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:12.870570 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.870549    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a0d69bf-0f86-45a0-8830-8e526816d8f0-istiod-ca-cert\") pod \"e2e-mt-653c2a83-openshift-default-858787d556-kcjp4\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") " pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:12.870690 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.870634    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a0d69bf-0f86-45a0-8830-8e526816d8f0-istio-data\") pod \"e2e-mt-653c2a83-openshift-default-858787d556-kcjp4\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") " pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:12.872339 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.872321    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a0d69bf-0f86-45a0-8830-8e526816d8f0-istio-envoy\") pod \"e2e-mt-653c2a83-openshift-default-858787d556-kcjp4\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") " pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:12.872680 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.872664    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a0d69bf-0f86-45a0-8830-8e526816d8f0-istio-podinfo\") pod \"e2e-mt-653c2a83-openshift-default-858787d556-kcjp4\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") " pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:12.878627 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.878607    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a0d69bf-0f86-45a0-8830-8e526816d8f0-istio-token\") pod \"e2e-mt-653c2a83-openshift-default-858787d556-kcjp4\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") " pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:12.878976 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.878958    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg544\" (UniqueName: \"kubernetes.io/projected/1a0d69bf-0f86-45a0-8830-8e526816d8f0-kube-api-access-qg544\") pod \"e2e-mt-653c2a83-openshift-default-858787d556-kcjp4\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") " pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:12.976007 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.975984    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw"]
Sep 08 14:50:12.980849 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:12.980827    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-798a5d-785f747cfb-l5gcw"]
Sep 08 14:50:13.024850 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:13.024829    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:13.316540 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:13.316438    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"]
Sep 08 14:50:13.324315 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:50:13.324285    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a0d69bf_0f86_45a0_8830_8e526816d8f0.slice/crio-5da9b9535ffdc7a8cc4a042acd8124dcbe8022cb002cf52cc6c6916b191b863b WatchSource:0}: Error finding container 5da9b9535ffdc7a8cc4a042acd8124dcbe8022cb002cf52cc6c6916b191b863b: Status 404 returned error can't find the container with id 5da9b9535ffdc7a8cc4a042acd8124dcbe8022cb002cf52cc6c6916b191b863b
Sep 08 14:50:13.326419 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:13.326373    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:50:13.326519 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:13.326492    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:50:13.326565 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:13.326536    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:50:13.334329 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:13.334302    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:50:13.491970 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:13.491932    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b08c26ea-8fe6-4cb4-ab5d-e02faae77f69" path="/var/lib/kubelet/pods/b08c26ea-8fe6-4cb4-ab5d-e02faae77f69/volumes"
Sep 08 14:50:13.658752 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:13.658671    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4" event={"ID":"1a0d69bf-0f86-45a0-8830-8e526816d8f0","Type":"ContainerStarted","Data":"1b74614b036ea0e417a975d4bc74f49a8a6f9b8b56ab84edd9696fd53fb6cf0d"}
Sep 08 14:50:13.658752 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:13.658720    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4" event={"ID":"1a0d69bf-0f86-45a0-8830-8e526816d8f0","Type":"ContainerStarted","Data":"5da9b9535ffdc7a8cc4a042acd8124dcbe8022cb002cf52cc6c6916b191b863b"}
Sep 08 14:50:13.685454 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:13.685411    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4" podStartSLOduration=1.6853938080000002 podStartE2EDuration="1.685393808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:50:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:50:13.681661441 +0000 UTC m=+974.720062364" watchObservedRunningTime="2026-09-08 14:50:13.685393808 +0000 UTC m=+974.723794730"
Sep 08 14:50:14.025353 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:14.025318    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:14.030207 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:14.030183    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:14.664187 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:14.664159    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:14.665110 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:14.665089    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:15.830310 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:15.830266    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm" podUID="c6f2f1d8-d7fc-445f-9b27-08ccb365eb25" containerName="main" containerID="cri-o://75f53334df80f4cfd3e83b14063c2ee94ab867ece2bbc96977d693ca0cd91ac1" gracePeriod=45
Sep 08 14:50:16.078845 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.078821    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"
Sep 08 14:50:16.200857 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.200829    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-dshm\") pod \"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25\" (UID: \"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25\") "
Sep 08 14:50:16.201044 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.200881    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ws65d\" (UniqueName: \"kubernetes.io/projected/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-kube-api-access-ws65d\") pod \"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25\" (UID: \"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25\") "
Sep 08 14:50:16.201044 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.200930    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-model-cache\") pod \"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25\" (UID: \"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25\") "
Sep 08 14:50:16.201044 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.200946    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-tls-certs\") pod \"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25\" (UID: \"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25\") "
Sep 08 14:50:16.201044 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.200965    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-home\") pod \"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25\" (UID: \"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25\") "
Sep 08 14:50:16.201044 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.201028    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-tmp-dir\") pod \"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25\" (UID: \"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25\") "
Sep 08 14:50:16.201320 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.201198    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-model-cache" (OuterVolumeSpecName: "model-cache") pod "c6f2f1d8-d7fc-445f-9b27-08ccb365eb25" (UID: "c6f2f1d8-d7fc-445f-9b27-08ccb365eb25"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:50:16.201320 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.201291    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-home" (OuterVolumeSpecName: "home") pod "c6f2f1d8-d7fc-445f-9b27-08ccb365eb25" (UID: "c6f2f1d8-d7fc-445f-9b27-08ccb365eb25"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:50:16.201413 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.201331    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-model-cache\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:50:16.201413 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.201321    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c6f2f1d8-d7fc-445f-9b27-08ccb365eb25" (UID: "c6f2f1d8-d7fc-445f-9b27-08ccb365eb25"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:50:16.203284 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.203261    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-kube-api-access-ws65d" (OuterVolumeSpecName: "kube-api-access-ws65d") pod "c6f2f1d8-d7fc-445f-9b27-08ccb365eb25" (UID: "c6f2f1d8-d7fc-445f-9b27-08ccb365eb25"). InnerVolumeSpecName "kube-api-access-ws65d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:50:16.203511 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.203492    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-dshm" (OuterVolumeSpecName: "dshm") pod "c6f2f1d8-d7fc-445f-9b27-08ccb365eb25" (UID: "c6f2f1d8-d7fc-445f-9b27-08ccb365eb25"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:50:16.203571 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.203490    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c6f2f1d8-d7fc-445f-9b27-08ccb365eb25" (UID: "c6f2f1d8-d7fc-445f-9b27-08ccb365eb25"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:50:16.302266 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.302236    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ws65d\" (UniqueName: \"kubernetes.io/projected/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-kube-api-access-ws65d\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:50:16.302266 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.302260    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-tls-certs\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:50:16.302266 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.302273    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-home\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:50:16.302523 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.302280    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-tmp-dir\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:50:16.302523 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.302288    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25-dshm\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:50:16.678116 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.678082    2577 generic.go:356] "Generic (PLEG): container finished" podID="c6f2f1d8-d7fc-445f-9b27-08ccb365eb25" containerID="75f53334df80f4cfd3e83b14063c2ee94ab867ece2bbc96977d693ca0cd91ac1" exitCode=0
Sep 08 14:50:16.678273 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.678125    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"
Sep 08 14:50:16.678273 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.678162    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm" event={"ID":"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25","Type":"ContainerDied","Data":"75f53334df80f4cfd3e83b14063c2ee94ab867ece2bbc96977d693ca0cd91ac1"}
Sep 08 14:50:16.678273 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.678205    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm" event={"ID":"c6f2f1d8-d7fc-445f-9b27-08ccb365eb25","Type":"ContainerDied","Data":"ac93ef6bae2c13c32bdaad1f9f27aa9d19c689dbfcddc02f0f24e87112050cce"}
Sep 08 14:50:16.678273 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.678228    2577 scope.go:117] "RemoveContainer" containerID="75f53334df80f4cfd3e83b14063c2ee94ab867ece2bbc96977d693ca0cd91ac1"
Sep 08 14:50:16.691446 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.691425    2577 scope.go:117] "RemoveContainer" containerID="75f53334df80f4cfd3e83b14063c2ee94ab867ece2bbc96977d693ca0cd91ac1"
Sep 08 14:50:16.691803 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:50:16.691784    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75f53334df80f4cfd3e83b14063c2ee94ab867ece2bbc96977d693ca0cd91ac1\": container with ID starting with 75f53334df80f4cfd3e83b14063c2ee94ab867ece2bbc96977d693ca0cd91ac1 not found: ID does not exist" containerID="75f53334df80f4cfd3e83b14063c2ee94ab867ece2bbc96977d693ca0cd91ac1"
Sep 08 14:50:16.691885 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.691811    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75f53334df80f4cfd3e83b14063c2ee94ab867ece2bbc96977d693ca0cd91ac1"} err="failed to get container status \"75f53334df80f4cfd3e83b14063c2ee94ab867ece2bbc96977d693ca0cd91ac1\": rpc error: code = NotFound desc = could not find container \"75f53334df80f4cfd3e83b14063c2ee94ab867ece2bbc96977d693ca0cd91ac1\": container with ID starting with 75f53334df80f4cfd3e83b14063c2ee94ab867ece2bbc96977d693ca0cd91ac1 not found: ID does not exist"
Sep 08 14:50:16.704545 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.704522    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"]
Sep 08 14:50:16.711255 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.711227    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-798a5d/test-model-798a5d-kserve-757d7997fc-cswrm"]
Sep 08 14:50:16.788910 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.788881    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-64b7995879-kz5zz"]
Sep 08 14:50:16.789305 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.789288    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6f2f1d8-d7fc-445f-9b27-08ccb365eb25" containerName="main"
Sep 08 14:50:16.789371 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.789308    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6f2f1d8-d7fc-445f-9b27-08ccb365eb25" containerName="main"
Sep 08 14:50:16.789371 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.789327    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="241f8bde-92f7-4a17-9d0e-e906425add7e" containerName="istio-proxy"
Sep 08 14:50:16.789371 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.789337    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="241f8bde-92f7-4a17-9d0e-e906425add7e" containerName="istio-proxy"
Sep 08 14:50:16.789514 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.789501    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6f2f1d8-d7fc-445f-9b27-08ccb365eb25" containerName="main"
Sep 08 14:50:16.793558 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.793537    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-64b7995879-kz5zz"
Sep 08 14:50:16.796343 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.796322    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-653c2a83-serving-cert\""
Sep 08 14:50:16.805358 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.805332    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-64b7995879-kz5zz"]
Sep 08 14:50:16.908694 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.908654    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d058c150-525f-43f6-931e-b068291d22c0-maas-api-tls\") pod \"maas-api-e2e-mt-653c2a83-64b7995879-kz5zz\" (UID: \"d058c150-525f-43f6-931e-b068291d22c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-64b7995879-kz5zz"
Sep 08 14:50:16.909085 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.908730    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d058c150-525f-43f6-931e-b068291d22c0-openshift-service-ca\") pod \"maas-api-e2e-mt-653c2a83-64b7995879-kz5zz\" (UID: \"d058c150-525f-43f6-931e-b068291d22c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-64b7995879-kz5zz"
Sep 08 14:50:16.909085 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.908770    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xflft\" (UniqueName: \"kubernetes.io/projected/d058c150-525f-43f6-931e-b068291d22c0-kube-api-access-xflft\") pod \"maas-api-e2e-mt-653c2a83-64b7995879-kz5zz\" (UID: \"d058c150-525f-43f6-931e-b068291d22c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-64b7995879-kz5zz"
Sep 08 14:50:16.909085 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:16.908868    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d058c150-525f-43f6-931e-b068291d22c0-metrics-certs\") pod \"maas-api-e2e-mt-653c2a83-64b7995879-kz5zz\" (UID: \"d058c150-525f-43f6-931e-b068291d22c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-64b7995879-kz5zz"
Sep 08 14:50:17.010215 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:17.010119    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xflft\" (UniqueName: \"kubernetes.io/projected/d058c150-525f-43f6-931e-b068291d22c0-kube-api-access-xflft\") pod \"maas-api-e2e-mt-653c2a83-64b7995879-kz5zz\" (UID: \"d058c150-525f-43f6-931e-b068291d22c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-64b7995879-kz5zz"
Sep 08 14:50:17.010215 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:17.010175    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d058c150-525f-43f6-931e-b068291d22c0-metrics-certs\") pod \"maas-api-e2e-mt-653c2a83-64b7995879-kz5zz\" (UID: \"d058c150-525f-43f6-931e-b068291d22c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-64b7995879-kz5zz"
Sep 08 14:50:17.010215 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:17.010216    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d058c150-525f-43f6-931e-b068291d22c0-maas-api-tls\") pod \"maas-api-e2e-mt-653c2a83-64b7995879-kz5zz\" (UID: \"d058c150-525f-43f6-931e-b068291d22c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-64b7995879-kz5zz"
Sep 08 14:50:17.010499 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:17.010256    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d058c150-525f-43f6-931e-b068291d22c0-openshift-service-ca\") pod \"maas-api-e2e-mt-653c2a83-64b7995879-kz5zz\" (UID: \"d058c150-525f-43f6-931e-b068291d22c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-64b7995879-kz5zz"
Sep 08 14:50:17.010499 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:50:17.010366    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-serving-cert: secret "maas-api-e2e-mt-653c2a83-serving-cert" not found
Sep 08 14:50:17.010499 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:50:17.010441    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d058c150-525f-43f6-931e-b068291d22c0-maas-api-tls podName:d058c150-525f-43f6-931e-b068291d22c0 nodeName:}" failed. No retries permitted until 2026-09-08 14:50:17.510419195 +0000 UTC m=+978.548820113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d058c150-525f-43f6-931e-b068291d22c0-maas-api-tls") pod "maas-api-e2e-mt-653c2a83-64b7995879-kz5zz" (UID: "d058c150-525f-43f6-931e-b068291d22c0") : secret "maas-api-e2e-mt-653c2a83-serving-cert" not found
Sep 08 14:50:17.010843 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:17.010826    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d058c150-525f-43f6-931e-b068291d22c0-openshift-service-ca\") pod \"maas-api-e2e-mt-653c2a83-64b7995879-kz5zz\" (UID: \"d058c150-525f-43f6-931e-b068291d22c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-64b7995879-kz5zz"
Sep 08 14:50:17.012788 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:17.012770    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d058c150-525f-43f6-931e-b068291d22c0-metrics-certs\") pod \"maas-api-e2e-mt-653c2a83-64b7995879-kz5zz\" (UID: \"d058c150-525f-43f6-931e-b068291d22c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-64b7995879-kz5zz"
Sep 08 14:50:17.027638 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:17.027613    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xflft\" (UniqueName: \"kubernetes.io/projected/d058c150-525f-43f6-931e-b068291d22c0-kube-api-access-xflft\") pod \"maas-api-e2e-mt-653c2a83-64b7995879-kz5zz\" (UID: \"d058c150-525f-43f6-931e-b068291d22c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-64b7995879-kz5zz"
Sep 08 14:50:17.493293 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:17.493251    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6f2f1d8-d7fc-445f-9b27-08ccb365eb25" path="/var/lib/kubelet/pods/c6f2f1d8-d7fc-445f-9b27-08ccb365eb25/volumes"
Sep 08 14:50:17.515614 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:17.515585    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d058c150-525f-43f6-931e-b068291d22c0-maas-api-tls\") pod \"maas-api-e2e-mt-653c2a83-64b7995879-kz5zz\" (UID: \"d058c150-525f-43f6-931e-b068291d22c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-64b7995879-kz5zz"
Sep 08 14:50:17.518272 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:17.518244    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d058c150-525f-43f6-931e-b068291d22c0-maas-api-tls\") pod \"maas-api-e2e-mt-653c2a83-64b7995879-kz5zz\" (UID: \"d058c150-525f-43f6-931e-b068291d22c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-64b7995879-kz5zz"
Sep 08 14:50:17.705154 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:17.705126    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-64b7995879-kz5zz"
Sep 08 14:50:17.982301 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:17.982273    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-64b7995879-kz5zz"]
Sep 08 14:50:17.983376 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:50:17.983351    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd058c150_525f_43f6_931e_b068291d22c0.slice/crio-7feb0bab75f4838dc477cdacb5b8d4ad7c91605649cd9cd59c09918536977538 WatchSource:0}: Error finding container 7feb0bab75f4838dc477cdacb5b8d4ad7c91605649cd9cd59c09918536977538: Status 404 returned error can't find the container with id 7feb0bab75f4838dc477cdacb5b8d4ad7c91605649cd9cd59c09918536977538
Sep 08 14:50:17.984838 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:17.984819    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 14:50:18.693731 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:18.693697    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-64b7995879-kz5zz" event={"ID":"d058c150-525f-43f6-931e-b068291d22c0","Type":"ContainerStarted","Data":"fe56f39eee2f9ccd7c13896528e0c62258b8a2afe5d18ae2380e96612e463088"}
Sep 08 14:50:18.693896 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:18.693756    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-64b7995879-kz5zz" event={"ID":"d058c150-525f-43f6-931e-b068291d22c0","Type":"ContainerStarted","Data":"7feb0bab75f4838dc477cdacb5b8d4ad7c91605649cd9cd59c09918536977538"}
Sep 08 14:50:18.693962 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:18.693910    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-64b7995879-kz5zz"
Sep 08 14:50:18.721178 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:18.721125    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-64b7995879-kz5zz" podStartSLOduration=2.106633396 podStartE2EDuration="2.721108289s" totalImagesPullingTime="614.474893ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:50:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:50:18.721031746 +0000 UTC m=+979.759432669" watchObservedRunningTime="2026-09-08 14:50:18.721108289 +0000 UTC m=+979.759509211"
Sep 08 14:50:22.299662 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:22.299588    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:50:24.706262 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:24.706217    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-64b7995879-kz5zz"
Sep 08 14:50:30.706658 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:30.706616    2577 patch_prober.go:28] interesting pod/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 14:50:30.707120 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:30.706689    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4" podUID="1a0d69bf-0f86-45a0-8830-8e526816d8f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 14:50:31.311314 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:31.311278    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv"]
Sep 08 14:50:31.311589 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:31.311541    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv" podUID="1f3ecf81-fddc-46a0-a5ea-cea5b05854a1" containerName="maas-api" containerID="cri-o://df8928753d46318f18381bb0730cd05f97395e6c3230589b30e2ae18a0d14cce" gracePeriod=30
Sep 08 14:50:31.566919 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:31.566853    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv"
Sep 08 14:50:31.640389 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:31.640359    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fq2t9\" (UniqueName: \"kubernetes.io/projected/1f3ecf81-fddc-46a0-a5ea-cea5b05854a1-kube-api-access-fq2t9\") pod \"1f3ecf81-fddc-46a0-a5ea-cea5b05854a1\" (UID: \"1f3ecf81-fddc-46a0-a5ea-cea5b05854a1\") "
Sep 08 14:50:31.640652 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:31.640425    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f3ecf81-fddc-46a0-a5ea-cea5b05854a1-maas-api-tls\") pod \"1f3ecf81-fddc-46a0-a5ea-cea5b05854a1\" (UID: \"1f3ecf81-fddc-46a0-a5ea-cea5b05854a1\") "
Sep 08 14:50:31.640652 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:31.640451    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f3ecf81-fddc-46a0-a5ea-cea5b05854a1-metrics-certs\") pod \"1f3ecf81-fddc-46a0-a5ea-cea5b05854a1\" (UID: \"1f3ecf81-fddc-46a0-a5ea-cea5b05854a1\") "
Sep 08 14:50:31.640652 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:31.640491    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f3ecf81-fddc-46a0-a5ea-cea5b05854a1-openshift-service-ca\") pod \"1f3ecf81-fddc-46a0-a5ea-cea5b05854a1\" (UID: \"1f3ecf81-fddc-46a0-a5ea-cea5b05854a1\") "
Sep 08 14:50:31.640914 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:31.640889    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f3ecf81-fddc-46a0-a5ea-cea5b05854a1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1f3ecf81-fddc-46a0-a5ea-cea5b05854a1" (UID: "1f3ecf81-fddc-46a0-a5ea-cea5b05854a1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:50:31.642733 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:31.642704    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f3ecf81-fddc-46a0-a5ea-cea5b05854a1-kube-api-access-fq2t9" (OuterVolumeSpecName: "kube-api-access-fq2t9") pod "1f3ecf81-fddc-46a0-a5ea-cea5b05854a1" (UID: "1f3ecf81-fddc-46a0-a5ea-cea5b05854a1"). InnerVolumeSpecName "kube-api-access-fq2t9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:50:31.642827 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:31.642734    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f3ecf81-fddc-46a0-a5ea-cea5b05854a1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1f3ecf81-fddc-46a0-a5ea-cea5b05854a1" (UID: "1f3ecf81-fddc-46a0-a5ea-cea5b05854a1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:50:31.642827 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:31.642765    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f3ecf81-fddc-46a0-a5ea-cea5b05854a1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1f3ecf81-fddc-46a0-a5ea-cea5b05854a1" (UID: "1f3ecf81-fddc-46a0-a5ea-cea5b05854a1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:50:31.742079 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:31.742040    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f3ecf81-fddc-46a0-a5ea-cea5b05854a1-metrics-certs\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:50:31.742079 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:31.742078    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f3ecf81-fddc-46a0-a5ea-cea5b05854a1-openshift-service-ca\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:50:31.742461 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:31.742094    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fq2t9\" (UniqueName: \"kubernetes.io/projected/1f3ecf81-fddc-46a0-a5ea-cea5b05854a1-kube-api-access-fq2t9\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:50:31.742461 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:31.742107    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f3ecf81-fddc-46a0-a5ea-cea5b05854a1-maas-api-tls\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:50:31.776590 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:31.776550    2577 generic.go:356] "Generic (PLEG): container finished" podID="1f3ecf81-fddc-46a0-a5ea-cea5b05854a1" containerID="df8928753d46318f18381bb0730cd05f97395e6c3230589b30e2ae18a0d14cce" exitCode=0
Sep 08 14:50:31.776871 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:31.776608    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv"
Sep 08 14:50:31.776871 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:31.776606    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv" event={"ID":"1f3ecf81-fddc-46a0-a5ea-cea5b05854a1","Type":"ContainerDied","Data":"df8928753d46318f18381bb0730cd05f97395e6c3230589b30e2ae18a0d14cce"}
Sep 08 14:50:31.776871 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:31.776676    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv" event={"ID":"1f3ecf81-fddc-46a0-a5ea-cea5b05854a1","Type":"ContainerDied","Data":"efda3536048be01a6b69d94fe5842fcc48c0d4bb3abce0a1647239f8fb658205"}
Sep 08 14:50:31.776871 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:31.776713    2577 scope.go:117] "RemoveContainer" containerID="df8928753d46318f18381bb0730cd05f97395e6c3230589b30e2ae18a0d14cce"
Sep 08 14:50:31.788336 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:31.788318    2577 scope.go:117] "RemoveContainer" containerID="df8928753d46318f18381bb0730cd05f97395e6c3230589b30e2ae18a0d14cce"
Sep 08 14:50:31.788639 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:50:31.788622    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df8928753d46318f18381bb0730cd05f97395e6c3230589b30e2ae18a0d14cce\": container with ID starting with df8928753d46318f18381bb0730cd05f97395e6c3230589b30e2ae18a0d14cce not found: ID does not exist" containerID="df8928753d46318f18381bb0730cd05f97395e6c3230589b30e2ae18a0d14cce"
Sep 08 14:50:31.788701 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:31.788649    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df8928753d46318f18381bb0730cd05f97395e6c3230589b30e2ae18a0d14cce"} err="failed to get container status \"df8928753d46318f18381bb0730cd05f97395e6c3230589b30e2ae18a0d14cce\": rpc error: code = NotFound desc = could not find container \"df8928753d46318f18381bb0730cd05f97395e6c3230589b30e2ae18a0d14cce\": container with ID starting with df8928753d46318f18381bb0730cd05f97395e6c3230589b30e2ae18a0d14cce not found: ID does not exist"
Sep 08 14:50:31.801863 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:31.801839    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv"]
Sep 08 14:50:31.806669 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:31.806640    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-02a199-5f547bbbfc-5j5wv"]
Sep 08 14:50:32.784905 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:32.784816    2577 generic.go:356] "Generic (PLEG): container finished" podID="1a0d69bf-0f86-45a0-8830-8e526816d8f0" containerID="1b74614b036ea0e417a975d4bc74f49a8a6f9b8b56ab84edd9696fd53fb6cf0d" exitCode=0
Sep 08 14:50:32.784905 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:32.784851    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4" event={"ID":"1a0d69bf-0f86-45a0-8830-8e526816d8f0","Type":"ContainerDied","Data":"1b74614b036ea0e417a975d4bc74f49a8a6f9b8b56ab84edd9696fd53fb6cf0d"}
Sep 08 14:50:32.785405 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:32.785181    2577 scope.go:117] "RemoveContainer" containerID="1b74614b036ea0e417a975d4bc74f49a8a6f9b8b56ab84edd9696fd53fb6cf0d"
Sep 08 14:50:32.786148 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:32.786120    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:50:32.786204 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:32.786190    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:50:32.786238 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:32.786219    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:50:33.490537 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:33.490506    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f3ecf81-fddc-46a0-a5ea-cea5b05854a1" path="/var/lib/kubelet/pods/1f3ecf81-fddc-46a0-a5ea-cea5b05854a1/volumes"
Sep 08 14:50:33.792051 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:33.791958    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4" event={"ID":"1a0d69bf-0f86-45a0-8830-8e526816d8f0","Type":"ContainerStarted","Data":"04c4d4d2bd832d156e3e9c206f3129bd91c430a11b52f3c04e0f4f359270f465"}
Sep 08 14:50:34.026246 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:34.025834    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:34.026246 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:34.025961    2577 patch_prober.go:28] interesting pod/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 08 14:50:34.026246 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:34.026002    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4" podUID="1a0d69bf-0f86-45a0-8830-8e526816d8f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 08 14:50:34.782092 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:34.782063    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:50:35.025586 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:35.025543    2577 patch_prober.go:28] interesting pod/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 08 14:50:35.026053 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:35.025612    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4" podUID="1a0d69bf-0f86-45a0-8830-8e526816d8f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 08 14:50:36.026027 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:36.025988    2577 patch_prober.go:28] interesting pod/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 08 14:50:36.026650 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:36.026614    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4" podUID="1a0d69bf-0f86-45a0-8830-8e526816d8f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 08 14:50:37.025889 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:37.025852    2577 patch_prober.go:28] interesting pod/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 08 14:50:37.026203 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:37.026172    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4" podUID="1a0d69bf-0f86-45a0-8830-8e526816d8f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 08 14:50:38.025792 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:38.025752    2577 patch_prober.go:28] interesting pod/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 08 14:50:38.026069 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:38.026038    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4" podUID="1a0d69bf-0f86-45a0-8830-8e526816d8f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 08 14:50:39.028523 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:39.028492    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:39.029019 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:39.028894    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:39.029636 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:39.029620    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:50:43.662177 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:43.662130    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws"]
Sep 08 14:50:43.663086 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:43.663059    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f3ecf81-fddc-46a0-a5ea-cea5b05854a1" containerName="maas-api"
Sep 08 14:50:43.663086 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:43.663088    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f3ecf81-fddc-46a0-a5ea-cea5b05854a1" containerName="maas-api"
Sep 08 14:50:43.663299 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:43.663283    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f3ecf81-fddc-46a0-a5ea-cea5b05854a1" containerName="maas-api"
Sep 08 14:50:43.668785 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:43.668762    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws"
Sep 08 14:50:43.673132 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:43.673108    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-ef8f61-serving-cert\""
Sep 08 14:50:43.688141 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:43.688118    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws"]
Sep 08 14:50:43.857422 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:43.857384    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68f7c1cd-ce93-4940-9e58-c99097594b95-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws\" (UID: \"68f7c1cd-ce93-4940-9e58-c99097594b95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws"
Sep 08 14:50:43.857630 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:43.857543    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ng5w\" (UniqueName: \"kubernetes.io/projected/68f7c1cd-ce93-4940-9e58-c99097594b95-kube-api-access-9ng5w\") pod \"maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws\" (UID: \"68f7c1cd-ce93-4940-9e58-c99097594b95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws"
Sep 08 14:50:43.857630 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:43.857601    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68f7c1cd-ce93-4940-9e58-c99097594b95-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws\" (UID: \"68f7c1cd-ce93-4940-9e58-c99097594b95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws"
Sep 08 14:50:43.857736 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:43.857642    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68f7c1cd-ce93-4940-9e58-c99097594b95-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws\" (UID: \"68f7c1cd-ce93-4940-9e58-c99097594b95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws"
Sep 08 14:50:43.958288 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:43.958204    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68f7c1cd-ce93-4940-9e58-c99097594b95-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws\" (UID: \"68f7c1cd-ce93-4940-9e58-c99097594b95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws"
Sep 08 14:50:43.958288 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:43.958261    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ng5w\" (UniqueName: \"kubernetes.io/projected/68f7c1cd-ce93-4940-9e58-c99097594b95-kube-api-access-9ng5w\") pod \"maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws\" (UID: \"68f7c1cd-ce93-4940-9e58-c99097594b95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws"
Sep 08 14:50:43.958555 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:43.958297    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68f7c1cd-ce93-4940-9e58-c99097594b95-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws\" (UID: \"68f7c1cd-ce93-4940-9e58-c99097594b95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws"
Sep 08 14:50:43.958555 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:43.958320    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68f7c1cd-ce93-4940-9e58-c99097594b95-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws\" (UID: \"68f7c1cd-ce93-4940-9e58-c99097594b95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws"
Sep 08 14:50:43.958940 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:43.958920    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68f7c1cd-ce93-4940-9e58-c99097594b95-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws\" (UID: \"68f7c1cd-ce93-4940-9e58-c99097594b95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws"
Sep 08 14:50:43.960822 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:43.960791    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68f7c1cd-ce93-4940-9e58-c99097594b95-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws\" (UID: \"68f7c1cd-ce93-4940-9e58-c99097594b95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws"
Sep 08 14:50:43.960922 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:43.960826    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68f7c1cd-ce93-4940-9e58-c99097594b95-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws\" (UID: \"68f7c1cd-ce93-4940-9e58-c99097594b95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws"
Sep 08 14:50:43.966981 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:43.966962    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ng5w\" (UniqueName: \"kubernetes.io/projected/68f7c1cd-ce93-4940-9e58-c99097594b95-kube-api-access-9ng5w\") pod \"maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws\" (UID: \"68f7c1cd-ce93-4940-9e58-c99097594b95\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws"
Sep 08 14:50:43.979132 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:43.979113    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws"
Sep 08 14:50:44.261449 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:44.261417    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws"]
Sep 08 14:50:44.262614 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:50:44.262587    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f7c1cd_ce93_4940_9e58_c99097594b95.slice/crio-43593e7f459d177539efc782dd4f8b0522fa84c512366d6b2ebbc70046ae68a1 WatchSource:0}: Error finding container 43593e7f459d177539efc782dd4f8b0522fa84c512366d6b2ebbc70046ae68a1: Status 404 returned error can't find the container with id 43593e7f459d177539efc782dd4f8b0522fa84c512366d6b2ebbc70046ae68a1
Sep 08 14:50:44.863611 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:44.863514    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws" event={"ID":"68f7c1cd-ce93-4940-9e58-c99097594b95","Type":"ContainerStarted","Data":"e5d0ce962b8e1a7318750a64c9c36ff7f38ff9e73df5a356ea08b88add4a7653"}
Sep 08 14:50:44.863611 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:44.863581    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws" event={"ID":"68f7c1cd-ce93-4940-9e58-c99097594b95","Type":"ContainerStarted","Data":"43593e7f459d177539efc782dd4f8b0522fa84c512366d6b2ebbc70046ae68a1"}
Sep 08 14:50:44.864010 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:44.863713    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws"
Sep 08 14:50:44.885169 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:44.885120    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws" podStartSLOduration=1.5399067290000001 podStartE2EDuration="1.885104494s" totalImagesPullingTime="345.197765ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:50:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:50:44.883043049 +0000 UTC m=+1005.921443971" watchObservedRunningTime="2026-09-08 14:50:44.885104494 +0000 UTC m=+1005.923505420"
Sep 08 14:50:46.873549 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:46.873515    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:50:50.875378 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:50.875351    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws"
Sep 08 14:50:58.897279 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:58.897233    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-64b7995879-kz5zz"]
Sep 08 14:50:58.897694 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:58.897457    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-64b7995879-kz5zz" podUID="d058c150-525f-43f6-931e-b068291d22c0" containerName="maas-api" containerID="cri-o://fe56f39eee2f9ccd7c13896528e0c62258b8a2afe5d18ae2380e96612e463088" gracePeriod=30
Sep 08 14:50:59.153757 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:59.153703    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-64b7995879-kz5zz"
Sep 08 14:50:59.189614 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:59.189588    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xflft\" (UniqueName: \"kubernetes.io/projected/d058c150-525f-43f6-931e-b068291d22c0-kube-api-access-xflft\") pod \"d058c150-525f-43f6-931e-b068291d22c0\" (UID: \"d058c150-525f-43f6-931e-b068291d22c0\") "
Sep 08 14:50:59.189781 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:59.189675    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d058c150-525f-43f6-931e-b068291d22c0-maas-api-tls\") pod \"d058c150-525f-43f6-931e-b068291d22c0\" (UID: \"d058c150-525f-43f6-931e-b068291d22c0\") "
Sep 08 14:50:59.189781 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:59.189698    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d058c150-525f-43f6-931e-b068291d22c0-openshift-service-ca\") pod \"d058c150-525f-43f6-931e-b068291d22c0\" (UID: \"d058c150-525f-43f6-931e-b068291d22c0\") "
Sep 08 14:50:59.189781 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:59.189719    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d058c150-525f-43f6-931e-b068291d22c0-metrics-certs\") pod \"d058c150-525f-43f6-931e-b068291d22c0\" (UID: \"d058c150-525f-43f6-931e-b068291d22c0\") "
Sep 08 14:50:59.190269 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:59.190234    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d058c150-525f-43f6-931e-b068291d22c0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d058c150-525f-43f6-931e-b068291d22c0" (UID: "d058c150-525f-43f6-931e-b068291d22c0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:50:59.192337 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:59.192310    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d058c150-525f-43f6-931e-b068291d22c0-kube-api-access-xflft" (OuterVolumeSpecName: "kube-api-access-xflft") pod "d058c150-525f-43f6-931e-b068291d22c0" (UID: "d058c150-525f-43f6-931e-b068291d22c0"). InnerVolumeSpecName "kube-api-access-xflft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:50:59.192555 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:59.192527    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d058c150-525f-43f6-931e-b068291d22c0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d058c150-525f-43f6-931e-b068291d22c0" (UID: "d058c150-525f-43f6-931e-b068291d22c0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:50:59.192651 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:59.192564    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d058c150-525f-43f6-931e-b068291d22c0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d058c150-525f-43f6-931e-b068291d22c0" (UID: "d058c150-525f-43f6-931e-b068291d22c0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:50:59.290770 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:59.290742    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xflft\" (UniqueName: \"kubernetes.io/projected/d058c150-525f-43f6-931e-b068291d22c0-kube-api-access-xflft\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:50:59.290770 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:59.290767    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d058c150-525f-43f6-931e-b068291d22c0-maas-api-tls\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:50:59.290770 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:59.290776    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d058c150-525f-43f6-931e-b068291d22c0-openshift-service-ca\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:50:59.290985 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:59.290784    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d058c150-525f-43f6-931e-b068291d22c0-metrics-certs\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:50:59.953109 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:59.953074    2577 generic.go:356] "Generic (PLEG): container finished" podID="d058c150-525f-43f6-931e-b068291d22c0" containerID="fe56f39eee2f9ccd7c13896528e0c62258b8a2afe5d18ae2380e96612e463088" exitCode=0
Sep 08 14:50:59.953603 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:59.953116    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-64b7995879-kz5zz"
Sep 08 14:50:59.953603 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:59.953160    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-64b7995879-kz5zz" event={"ID":"d058c150-525f-43f6-931e-b068291d22c0","Type":"ContainerDied","Data":"fe56f39eee2f9ccd7c13896528e0c62258b8a2afe5d18ae2380e96612e463088"}
Sep 08 14:50:59.953603 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:59.953230    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-64b7995879-kz5zz" event={"ID":"d058c150-525f-43f6-931e-b068291d22c0","Type":"ContainerDied","Data":"7feb0bab75f4838dc477cdacb5b8d4ad7c91605649cd9cd59c09918536977538"}
Sep 08 14:50:59.953603 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:59.953265    2577 scope.go:117] "RemoveContainer" containerID="fe56f39eee2f9ccd7c13896528e0c62258b8a2afe5d18ae2380e96612e463088"
Sep 08 14:50:59.964933 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:59.964917    2577 scope.go:117] "RemoveContainer" containerID="fe56f39eee2f9ccd7c13896528e0c62258b8a2afe5d18ae2380e96612e463088"
Sep 08 14:50:59.965220 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:50:59.965202    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe56f39eee2f9ccd7c13896528e0c62258b8a2afe5d18ae2380e96612e463088\": container with ID starting with fe56f39eee2f9ccd7c13896528e0c62258b8a2afe5d18ae2380e96612e463088 not found: ID does not exist" containerID="fe56f39eee2f9ccd7c13896528e0c62258b8a2afe5d18ae2380e96612e463088"
Sep 08 14:50:59.965292 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:59.965230    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe56f39eee2f9ccd7c13896528e0c62258b8a2afe5d18ae2380e96612e463088"} err="failed to get container status \"fe56f39eee2f9ccd7c13896528e0c62258b8a2afe5d18ae2380e96612e463088\": rpc error: code = NotFound desc = could not find container \"fe56f39eee2f9ccd7c13896528e0c62258b8a2afe5d18ae2380e96612e463088\": container with ID starting with fe56f39eee2f9ccd7c13896528e0c62258b8a2afe5d18ae2380e96612e463088 not found: ID does not exist"
Sep 08 14:50:59.975651 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:59.975629    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-64b7995879-kz5zz"]
Sep 08 14:50:59.982646 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:50:59.982622    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-653c2a83-64b7995879-kz5zz"]
Sep 08 14:51:01.494095 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:01.494043    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d058c150-525f-43f6-931e-b068291d22c0" path="/var/lib/kubelet/pods/d058c150-525f-43f6-931e-b068291d22c0/volumes"
Sep 08 14:51:02.377019 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:02.376981    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:51:05.922065 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:05.922034    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"]
Sep 08 14:51:05.922664 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:05.922250    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4" podUID="1a0d69bf-0f86-45a0-8830-8e526816d8f0" containerName="istio-proxy" containerID="cri-o://04c4d4d2bd832d156e3e9c206f3129bd91c430a11b52f3c04e0f4f359270f465" gracePeriod=30
Sep 08 14:51:07.749206 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.749172    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"]
Sep 08 14:51:07.749669 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.749602    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d058c150-525f-43f6-931e-b068291d22c0" containerName="maas-api"
Sep 08 14:51:07.749669 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.749616    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d058c150-525f-43f6-931e-b068291d22c0" containerName="maas-api"
Sep 08 14:51:07.749767 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.749694    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d058c150-525f-43f6-931e-b068291d22c0" containerName="maas-api"
Sep 08 14:51:07.754231 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.754209    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:07.757032 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.757015    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-f83533-openshift-default-dockercfg-8789g\""
Sep 08 14:51:07.776886 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.776861    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"]
Sep 08 14:51:07.874203 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.874153    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f27e38e8-b96f-4062-8fc1-bbe082a13b40-istio-data\") pod \"e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") " pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:07.874203 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.874209    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f27e38e8-b96f-4062-8fc1-bbe082a13b40-credential-socket\") pod \"e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") " pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:07.874404 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.874232    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f27e38e8-b96f-4062-8fc1-bbe082a13b40-workload-certs\") pod \"e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") " pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:07.874404 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.874253    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f27e38e8-b96f-4062-8fc1-bbe082a13b40-istio-envoy\") pod \"e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") " pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:07.874404 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.874273    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f27e38e8-b96f-4062-8fc1-bbe082a13b40-istiod-ca-cert\") pod \"e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") " pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:07.874404 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.874290    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f27e38e8-b96f-4062-8fc1-bbe082a13b40-workload-socket\") pod \"e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") " pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:07.874404 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.874376    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f27e38e8-b96f-4062-8fc1-bbe082a13b40-istio-podinfo\") pod \"e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") " pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:07.874590 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.874406    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f27e38e8-b96f-4062-8fc1-bbe082a13b40-istio-token\") pod \"e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") " pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:07.874590 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.874423    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgwg4\" (UniqueName: \"kubernetes.io/projected/f27e38e8-b96f-4062-8fc1-bbe082a13b40-kube-api-access-tgwg4\") pod \"e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") " pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:07.975214 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.975164    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f27e38e8-b96f-4062-8fc1-bbe082a13b40-istio-podinfo\") pod \"e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") " pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:07.975214 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.975214    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f27e38e8-b96f-4062-8fc1-bbe082a13b40-istio-token\") pod \"e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") " pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:07.975449 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.975231    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgwg4\" (UniqueName: \"kubernetes.io/projected/f27e38e8-b96f-4062-8fc1-bbe082a13b40-kube-api-access-tgwg4\") pod \"e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") " pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:07.975449 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.975261    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f27e38e8-b96f-4062-8fc1-bbe082a13b40-istio-data\") pod \"e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") " pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:07.975449 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.975288    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f27e38e8-b96f-4062-8fc1-bbe082a13b40-credential-socket\") pod \"e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") " pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:07.975449 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.975310    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f27e38e8-b96f-4062-8fc1-bbe082a13b40-workload-certs\") pod \"e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") " pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:07.975449 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.975344    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f27e38e8-b96f-4062-8fc1-bbe082a13b40-istio-envoy\") pod \"e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") " pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:07.975449 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.975379    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f27e38e8-b96f-4062-8fc1-bbe082a13b40-istiod-ca-cert\") pod \"e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") " pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:07.975449 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.975406    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f27e38e8-b96f-4062-8fc1-bbe082a13b40-workload-socket\") pod \"e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") " pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:07.975828 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.975770    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f27e38e8-b96f-4062-8fc1-bbe082a13b40-credential-socket\") pod \"e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") " pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:07.975883 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.975848    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f27e38e8-b96f-4062-8fc1-bbe082a13b40-workload-certs\") pod \"e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") " pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:07.975883 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.975872    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f27e38e8-b96f-4062-8fc1-bbe082a13b40-workload-socket\") pod \"e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") " pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:07.975963 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.975921    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f27e38e8-b96f-4062-8fc1-bbe082a13b40-istio-data\") pod \"e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") " pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:07.976164 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.976146    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f27e38e8-b96f-4062-8fc1-bbe082a13b40-istiod-ca-cert\") pod \"e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") " pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:07.977752 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.977735    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f27e38e8-b96f-4062-8fc1-bbe082a13b40-istio-envoy\") pod \"e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") " pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:07.977860 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.977845    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f27e38e8-b96f-4062-8fc1-bbe082a13b40-istio-podinfo\") pod \"e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") " pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:07.985051 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.985027    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f27e38e8-b96f-4062-8fc1-bbe082a13b40-istio-token\") pod \"e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") " pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:07.986847 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:07.986826    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgwg4\" (UniqueName: \"kubernetes.io/projected/f27e38e8-b96f-4062-8fc1-bbe082a13b40-kube-api-access-tgwg4\") pod \"e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") " pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:08.063870 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:08.063798    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:08.352393 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:08.352374    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"]
Sep 08 14:51:08.354778 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:51:08.354754    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf27e38e8_b96f_4062_8fc1_bbe082a13b40.slice/crio-ff361cb0faca4b503e33c88b39a98c796cdbdd143864c7b884a79fba40522fae WatchSource:0}: Error finding container ff361cb0faca4b503e33c88b39a98c796cdbdd143864c7b884a79fba40522fae: Status 404 returned error can't find the container with id ff361cb0faca4b503e33c88b39a98c796cdbdd143864c7b884a79fba40522fae
Sep 08 14:51:08.356836 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:08.356804    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:51:08.356930 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:08.356871    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:51:08.356930 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:08.356901    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:51:09.009009 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:09.008972    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr" event={"ID":"f27e38e8-b96f-4062-8fc1-bbe082a13b40","Type":"ContainerStarted","Data":"996269b5a903602ffe543faf4fa6d0e76c1972c92793ab4db09b9a6cfa11c10b"}
Sep 08 14:51:09.009492 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:09.009027    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr" event={"ID":"f27e38e8-b96f-4062-8fc1-bbe082a13b40","Type":"ContainerStarted","Data":"ff361cb0faca4b503e33c88b39a98c796cdbdd143864c7b884a79fba40522fae"}
Sep 08 14:51:09.030665 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:09.030614    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr" podStartSLOduration=2.030593272 podStartE2EDuration="2.030593272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:51:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:51:09.029260554 +0000 UTC m=+1030.067661477" watchObservedRunningTime="2026-09-08 14:51:09.030593272 +0000 UTC m=+1030.068994195"
Sep 08 14:51:09.031239 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:09.031200    2577 patch_prober.go:28] interesting pod/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 14:51:09.031363 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:09.031296    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4" podUID="1a0d69bf-0f86-45a0-8830-8e526816d8f0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 14:51:09.064833 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:09.064807    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:09.066124 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:09.066106    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 08 14:51:09.066182 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:09.066144    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr" podUID="f27e38e8-b96f-4062-8fc1-bbe082a13b40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 08 14:51:10.067967 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:10.067934    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:11.021238 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:11.021209    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:11.022175 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:11.022158    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:11.175392 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:11.175365    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:51:11.307769 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:11.307687    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a0d69bf-0f86-45a0-8830-8e526816d8f0-istio-data\") pod \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") "
Sep 08 14:51:11.307769 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:11.307743    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a0d69bf-0f86-45a0-8830-8e526816d8f0-istio-token\") pod \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") "
Sep 08 14:51:11.307985 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:11.307772    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a0d69bf-0f86-45a0-8830-8e526816d8f0-istio-podinfo\") pod \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") "
Sep 08 14:51:11.307985 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:11.307800    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0d69bf-0f86-45a0-8830-8e526816d8f0-credential-socket\") pod \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") "
Sep 08 14:51:11.307985 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:11.307848    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a0d69bf-0f86-45a0-8830-8e526816d8f0-istiod-ca-cert\") pod \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") "
Sep 08 14:51:11.307985 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:11.307890    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a0d69bf-0f86-45a0-8830-8e526816d8f0-workload-certs\") pod \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") "
Sep 08 14:51:11.307985 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:11.307918    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qg544\" (UniqueName: \"kubernetes.io/projected/1a0d69bf-0f86-45a0-8830-8e526816d8f0-kube-api-access-qg544\") pod \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") "
Sep 08 14:51:11.307985 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:11.307958    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0d69bf-0f86-45a0-8830-8e526816d8f0-workload-socket\") pod \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") "
Sep 08 14:51:11.307985 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:11.307971    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a0d69bf-0f86-45a0-8830-8e526816d8f0-istio-data" (OuterVolumeSpecName: "istio-data") pod "1a0d69bf-0f86-45a0-8830-8e526816d8f0" (UID: "1a0d69bf-0f86-45a0-8830-8e526816d8f0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:51:11.308359 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:11.308073    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a0d69bf-0f86-45a0-8830-8e526816d8f0-istio-envoy\") pod \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\" (UID: \"1a0d69bf-0f86-45a0-8830-8e526816d8f0\") "
Sep 08 14:51:11.308359 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:11.308180    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a0d69bf-0f86-45a0-8830-8e526816d8f0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1a0d69bf-0f86-45a0-8830-8e526816d8f0" (UID: "1a0d69bf-0f86-45a0-8830-8e526816d8f0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:51:11.308359 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:11.308339    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a0d69bf-0f86-45a0-8830-8e526816d8f0-istio-data\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:51:11.308359 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:11.308351    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a0d69bf-0f86-45a0-8830-8e526816d8f0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1a0d69bf-0f86-45a0-8830-8e526816d8f0" (UID: "1a0d69bf-0f86-45a0-8830-8e526816d8f0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:51:11.308610 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:11.308358    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0d69bf-0f86-45a0-8830-8e526816d8f0-credential-socket\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:51:11.308610 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:11.308373    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a0d69bf-0f86-45a0-8830-8e526816d8f0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1a0d69bf-0f86-45a0-8830-8e526816d8f0" (UID: "1a0d69bf-0f86-45a0-8830-8e526816d8f0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:51:11.308610 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:11.308551    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a0d69bf-0f86-45a0-8830-8e526816d8f0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1a0d69bf-0f86-45a0-8830-8e526816d8f0" (UID: "1a0d69bf-0f86-45a0-8830-8e526816d8f0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:51:11.310953 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:11.310907    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1a0d69bf-0f86-45a0-8830-8e526816d8f0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1a0d69bf-0f86-45a0-8830-8e526816d8f0" (UID: "1a0d69bf-0f86-45a0-8830-8e526816d8f0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:51:11.311065 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:11.310947    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a0d69bf-0f86-45a0-8830-8e526816d8f0-istio-token" (OuterVolumeSpecName: "istio-token") pod "1a0d69bf-0f86-45a0-8830-8e526816d8f0" (UID: "1a0d69bf-0f86-45a0-8830-8e526816d8f0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:51:11.311065 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:11.310993    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a0d69bf-0f86-45a0-8830-8e526816d8f0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1a0d69bf-0f86-45a0-8830-8e526816d8f0" (UID: "1a0d69bf-0f86-45a0-8830-8e526816d8f0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:51:11.311065 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:11.311007    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a0d69bf-0f86-45a0-8830-8e526816d8f0-kube-api-access-qg544" (OuterVolumeSpecName: "kube-api-access-qg544") pod "1a0d69bf-0f86-45a0-8830-8e526816d8f0" (UID: "1a0d69bf-0f86-45a0-8830-8e526816d8f0"). InnerVolumeSpecName "kube-api-access-qg544". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:51:11.408932 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:11.408901    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a0d69bf-0f86-45a0-8830-8e526816d8f0-istio-envoy\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:51:11.408932 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:11.408926    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a0d69bf-0f86-45a0-8830-8e526816d8f0-istio-token\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:51:11.408932 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:11.408935    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a0d69bf-0f86-45a0-8830-8e526816d8f0-istio-podinfo\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:51:11.408932 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:11.408943    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a0d69bf-0f86-45a0-8830-8e526816d8f0-istiod-ca-cert\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:51:11.409283 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:11.408951    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a0d69bf-0f86-45a0-8830-8e526816d8f0-workload-certs\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:51:11.409283 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:11.408962    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qg544\" (UniqueName: \"kubernetes.io/projected/1a0d69bf-0f86-45a0-8830-8e526816d8f0-kube-api-access-qg544\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:51:11.409283 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:11.408970    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0d69bf-0f86-45a0-8830-8e526816d8f0-workload-socket\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:51:12.028292 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.028254    2577 generic.go:356] "Generic (PLEG): container finished" podID="1a0d69bf-0f86-45a0-8830-8e526816d8f0" containerID="04c4d4d2bd832d156e3e9c206f3129bd91c430a11b52f3c04e0f4f359270f465" exitCode=0
Sep 08 14:51:12.028292 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.028294    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"
Sep 08 14:51:12.028579 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.028329    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4" event={"ID":"1a0d69bf-0f86-45a0-8830-8e526816d8f0","Type":"ContainerDied","Data":"04c4d4d2bd832d156e3e9c206f3129bd91c430a11b52f3c04e0f4f359270f465"}
Sep 08 14:51:12.028579 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.028398    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4" event={"ID":"1a0d69bf-0f86-45a0-8830-8e526816d8f0","Type":"ContainerDied","Data":"5da9b9535ffdc7a8cc4a042acd8124dcbe8022cb002cf52cc6c6916b191b863b"}
Sep 08 14:51:12.028579 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.028424    2577 scope.go:117] "RemoveContainer" containerID="04c4d4d2bd832d156e3e9c206f3129bd91c430a11b52f3c04e0f4f359270f465"
Sep 08 14:51:12.038566 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.038548    2577 scope.go:117] "RemoveContainer" containerID="1b74614b036ea0e417a975d4bc74f49a8a6f9b8b56ab84edd9696fd53fb6cf0d"
Sep 08 14:51:12.047422 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.047263    2577 scope.go:117] "RemoveContainer" containerID="04c4d4d2bd832d156e3e9c206f3129bd91c430a11b52f3c04e0f4f359270f465"
Sep 08 14:51:12.047574 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:51:12.047556    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04c4d4d2bd832d156e3e9c206f3129bd91c430a11b52f3c04e0f4f359270f465\": container with ID starting with 04c4d4d2bd832d156e3e9c206f3129bd91c430a11b52f3c04e0f4f359270f465 not found: ID does not exist" containerID="04c4d4d2bd832d156e3e9c206f3129bd91c430a11b52f3c04e0f4f359270f465"
Sep 08 14:51:12.047616 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.047582    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04c4d4d2bd832d156e3e9c206f3129bd91c430a11b52f3c04e0f4f359270f465"} err="failed to get container status \"04c4d4d2bd832d156e3e9c206f3129bd91c430a11b52f3c04e0f4f359270f465\": rpc error: code = NotFound desc = could not find container \"04c4d4d2bd832d156e3e9c206f3129bd91c430a11b52f3c04e0f4f359270f465\": container with ID starting with 04c4d4d2bd832d156e3e9c206f3129bd91c430a11b52f3c04e0f4f359270f465 not found: ID does not exist"
Sep 08 14:51:12.047616 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.047601    2577 scope.go:117] "RemoveContainer" containerID="1b74614b036ea0e417a975d4bc74f49a8a6f9b8b56ab84edd9696fd53fb6cf0d"
Sep 08 14:51:12.047866 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:51:12.047849    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b74614b036ea0e417a975d4bc74f49a8a6f9b8b56ab84edd9696fd53fb6cf0d\": container with ID starting with 1b74614b036ea0e417a975d4bc74f49a8a6f9b8b56ab84edd9696fd53fb6cf0d not found: ID does not exist" containerID="1b74614b036ea0e417a975d4bc74f49a8a6f9b8b56ab84edd9696fd53fb6cf0d"
Sep 08 14:51:12.047910 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.047872    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b74614b036ea0e417a975d4bc74f49a8a6f9b8b56ab84edd9696fd53fb6cf0d"} err="failed to get container status \"1b74614b036ea0e417a975d4bc74f49a8a6f9b8b56ab84edd9696fd53fb6cf0d\": rpc error: code = NotFound desc = could not find container \"1b74614b036ea0e417a975d4bc74f49a8a6f9b8b56ab84edd9696fd53fb6cf0d\": container with ID starting with 1b74614b036ea0e417a975d4bc74f49a8a6f9b8b56ab84edd9696fd53fb6cf0d not found: ID does not exist"
Sep 08 14:51:12.059053 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.059020    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"]
Sep 08 14:51:12.059179 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.059074    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-653c2a83-openshift-default-858787d556-kcjp4"]
Sep 08 14:51:12.158413 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.158374    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4"]
Sep 08 14:51:12.158868 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.158850    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a0d69bf-0f86-45a0-8830-8e526816d8f0" containerName="istio-proxy"
Sep 08 14:51:12.158977 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.158869    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a0d69bf-0f86-45a0-8830-8e526816d8f0" containerName="istio-proxy"
Sep 08 14:51:12.158977 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.158899    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a0d69bf-0f86-45a0-8830-8e526816d8f0" containerName="istio-proxy"
Sep 08 14:51:12.158977 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.158908    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a0d69bf-0f86-45a0-8830-8e526816d8f0" containerName="istio-proxy"
Sep 08 14:51:12.159119 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.159002    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a0d69bf-0f86-45a0-8830-8e526816d8f0" containerName="istio-proxy"
Sep 08 14:51:12.159119 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.159021    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a0d69bf-0f86-45a0-8830-8e526816d8f0" containerName="istio-proxy"
Sep 08 14:51:12.163721 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.163691    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4"
Sep 08 14:51:12.166543 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.166520    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-f83533-serving-cert\""
Sep 08 14:51:12.174103 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.174086    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4"]
Sep 08 14:51:12.215300 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.215275    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e4ae60d-fc01-4ee9-abc2-782e8bb2660b-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4\" (UID: \"0e4ae60d-fc01-4ee9-abc2-782e8bb2660b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4"
Sep 08 14:51:12.215688 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.215318    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpc5x\" (UniqueName: \"kubernetes.io/projected/0e4ae60d-fc01-4ee9-abc2-782e8bb2660b-kube-api-access-xpc5x\") pod \"maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4\" (UID: \"0e4ae60d-fc01-4ee9-abc2-782e8bb2660b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4"
Sep 08 14:51:12.215688 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.215350    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e4ae60d-fc01-4ee9-abc2-782e8bb2660b-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4\" (UID: \"0e4ae60d-fc01-4ee9-abc2-782e8bb2660b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4"
Sep 08 14:51:12.215688 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.215443    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e4ae60d-fc01-4ee9-abc2-782e8bb2660b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4\" (UID: \"0e4ae60d-fc01-4ee9-abc2-782e8bb2660b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4"
Sep 08 14:51:12.316142 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.316062    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e4ae60d-fc01-4ee9-abc2-782e8bb2660b-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4\" (UID: \"0e4ae60d-fc01-4ee9-abc2-782e8bb2660b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4"
Sep 08 14:51:12.316142 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.316101    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpc5x\" (UniqueName: \"kubernetes.io/projected/0e4ae60d-fc01-4ee9-abc2-782e8bb2660b-kube-api-access-xpc5x\") pod \"maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4\" (UID: \"0e4ae60d-fc01-4ee9-abc2-782e8bb2660b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4"
Sep 08 14:51:12.316142 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.316120    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e4ae60d-fc01-4ee9-abc2-782e8bb2660b-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4\" (UID: \"0e4ae60d-fc01-4ee9-abc2-782e8bb2660b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4"
Sep 08 14:51:12.316142 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.316144    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e4ae60d-fc01-4ee9-abc2-782e8bb2660b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4\" (UID: \"0e4ae60d-fc01-4ee9-abc2-782e8bb2660b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4"
Sep 08 14:51:12.316458 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:51:12.316231    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-serving-cert: secret "maas-api-e2e-shared-b-w3-f83533-serving-cert" not found
Sep 08 14:51:12.316458 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:51:12.316304    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e4ae60d-fc01-4ee9-abc2-782e8bb2660b-maas-api-tls podName:0e4ae60d-fc01-4ee9-abc2-782e8bb2660b nodeName:}" failed. No retries permitted until 2026-09-08 14:51:12.816283889 +0000 UTC m=+1033.854684797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0e4ae60d-fc01-4ee9-abc2-782e8bb2660b-maas-api-tls") pod "maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4" (UID: "0e4ae60d-fc01-4ee9-abc2-782e8bb2660b") : secret "maas-api-e2e-shared-b-w3-f83533-serving-cert" not found
Sep 08 14:51:12.316750 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.316699    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e4ae60d-fc01-4ee9-abc2-782e8bb2660b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4\" (UID: \"0e4ae60d-fc01-4ee9-abc2-782e8bb2660b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4"
Sep 08 14:51:12.318714 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.318692    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e4ae60d-fc01-4ee9-abc2-782e8bb2660b-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4\" (UID: \"0e4ae60d-fc01-4ee9-abc2-782e8bb2660b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4"
Sep 08 14:51:12.331846 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.331821    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpc5x\" (UniqueName: \"kubernetes.io/projected/0e4ae60d-fc01-4ee9-abc2-782e8bb2660b-kube-api-access-xpc5x\") pod \"maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4\" (UID: \"0e4ae60d-fc01-4ee9-abc2-782e8bb2660b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4"
Sep 08 14:51:12.821661 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.821611    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e4ae60d-fc01-4ee9-abc2-782e8bb2660b-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4\" (UID: \"0e4ae60d-fc01-4ee9-abc2-782e8bb2660b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4"
Sep 08 14:51:12.824306 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:12.824278    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e4ae60d-fc01-4ee9-abc2-782e8bb2660b-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4\" (UID: \"0e4ae60d-fc01-4ee9-abc2-782e8bb2660b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4"
Sep 08 14:51:13.074623 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:13.074542    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4"
Sep 08 14:51:13.356707 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:13.356676    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4"]
Sep 08 14:51:13.357986 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:51:13.357959    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e4ae60d_fc01_4ee9_abc2_782e8bb2660b.slice/crio-52eb0fa9daef2f80fc7673d0a798c448ce6c0ec79bb1ce8479fadf57f9a8f995 WatchSource:0}: Error finding container 52eb0fa9daef2f80fc7673d0a798c448ce6c0ec79bb1ce8479fadf57f9a8f995: Status 404 returned error can't find the container with id 52eb0fa9daef2f80fc7673d0a798c448ce6c0ec79bb1ce8479fadf57f9a8f995
Sep 08 14:51:13.492083 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:13.492043    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a0d69bf-0f86-45a0-8830-8e526816d8f0" path="/var/lib/kubelet/pods/1a0d69bf-0f86-45a0-8830-8e526816d8f0/volumes"
Sep 08 14:51:14.043486 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:14.043364    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4" event={"ID":"0e4ae60d-fc01-4ee9-abc2-782e8bb2660b","Type":"ContainerStarted","Data":"a5f9677dc619cf9c113d771238eff15cdb24efecfcc69e98d7c0da22df7babe9"}
Sep 08 14:51:14.043486 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:14.043434    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4" event={"ID":"0e4ae60d-fc01-4ee9-abc2-782e8bb2660b","Type":"ContainerStarted","Data":"52eb0fa9daef2f80fc7673d0a798c448ce6c0ec79bb1ce8479fadf57f9a8f995"}
Sep 08 14:51:14.043717 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:14.043555    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4"
Sep 08 14:51:14.066654 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:14.066605    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4" podStartSLOduration=1.728464931 podStartE2EDuration="2.06658682s" totalImagesPullingTime="338.121889ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:51:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:51:14.065195177 +0000 UTC m=+1035.103596112" watchObservedRunningTime="2026-09-08 14:51:14.06658682 +0000 UTC m=+1035.104987739"
Sep 08 14:51:15.976929 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:15.976887    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:51:20.054753 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:20.054725    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4"
Sep 08 14:51:25.595151 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:25.595047    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f"]
Sep 08 14:51:25.598540 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:25.598522    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f"
Sep 08 14:51:25.601035 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:25.601018    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-11dfb4-serving-cert\""
Sep 08 14:51:25.610177 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:25.610154    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f"]
Sep 08 14:51:25.741080 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:25.741043    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh4wc\" (UniqueName: \"kubernetes.io/projected/f736e0af-f837-4e67-95db-3ec971055ce1-kube-api-access-mh4wc\") pod \"maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f\" (UID: \"f736e0af-f837-4e67-95db-3ec971055ce1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f"
Sep 08 14:51:25.741245 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:25.741111    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f736e0af-f837-4e67-95db-3ec971055ce1-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f\" (UID: \"f736e0af-f837-4e67-95db-3ec971055ce1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f"
Sep 08 14:51:25.741245 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:25.741148    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f736e0af-f837-4e67-95db-3ec971055ce1-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f\" (UID: \"f736e0af-f837-4e67-95db-3ec971055ce1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f"
Sep 08 14:51:25.741245 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:25.741206    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f736e0af-f837-4e67-95db-3ec971055ce1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f\" (UID: \"f736e0af-f837-4e67-95db-3ec971055ce1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f"
Sep 08 14:51:25.842249 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:25.842220    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f736e0af-f837-4e67-95db-3ec971055ce1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f\" (UID: \"f736e0af-f837-4e67-95db-3ec971055ce1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f"
Sep 08 14:51:25.842418 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:25.842268    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh4wc\" (UniqueName: \"kubernetes.io/projected/f736e0af-f837-4e67-95db-3ec971055ce1-kube-api-access-mh4wc\") pod \"maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f\" (UID: \"f736e0af-f837-4e67-95db-3ec971055ce1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f"
Sep 08 14:51:25.842418 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:25.842305    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f736e0af-f837-4e67-95db-3ec971055ce1-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f\" (UID: \"f736e0af-f837-4e67-95db-3ec971055ce1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f"
Sep 08 14:51:25.842418 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:25.842321    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f736e0af-f837-4e67-95db-3ec971055ce1-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f\" (UID: \"f736e0af-f837-4e67-95db-3ec971055ce1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f"
Sep 08 14:51:25.842583 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:51:25.842434    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-serving-cert: secret "maas-api-e2e-shared-a-w2-11dfb4-serving-cert" not found
Sep 08 14:51:25.842583 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:51:25.842516    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f736e0af-f837-4e67-95db-3ec971055ce1-maas-api-tls podName:f736e0af-f837-4e67-95db-3ec971055ce1 nodeName:}" failed. No retries permitted until 2026-09-08 14:51:26.34249598 +0000 UTC m=+1047.380896900 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f736e0af-f837-4e67-95db-3ec971055ce1-maas-api-tls") pod "maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f" (UID: "f736e0af-f837-4e67-95db-3ec971055ce1") : secret "maas-api-e2e-shared-a-w2-11dfb4-serving-cert" not found
Sep 08 14:51:25.842960 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:25.842934    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f736e0af-f837-4e67-95db-3ec971055ce1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f\" (UID: \"f736e0af-f837-4e67-95db-3ec971055ce1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f"
Sep 08 14:51:25.844848 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:25.844827    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f736e0af-f837-4e67-95db-3ec971055ce1-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f\" (UID: \"f736e0af-f837-4e67-95db-3ec971055ce1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f"
Sep 08 14:51:25.853318 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:25.853265    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh4wc\" (UniqueName: \"kubernetes.io/projected/f736e0af-f837-4e67-95db-3ec971055ce1-kube-api-access-mh4wc\") pod \"maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f\" (UID: \"f736e0af-f837-4e67-95db-3ec971055ce1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f"
Sep 08 14:51:26.022757 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:26.022724    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 08 14:51:26.022913 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:26.022783    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr" podUID="f27e38e8-b96f-4062-8fc1-bbe082a13b40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 08 14:51:26.118016 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:26.117925    2577 generic.go:356] "Generic (PLEG): container finished" podID="f27e38e8-b96f-4062-8fc1-bbe082a13b40" containerID="996269b5a903602ffe543faf4fa6d0e76c1972c92793ab4db09b9a6cfa11c10b" exitCode=0
Sep 08 14:51:26.118016 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:26.118000    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr" event={"ID":"f27e38e8-b96f-4062-8fc1-bbe082a13b40","Type":"ContainerDied","Data":"996269b5a903602ffe543faf4fa6d0e76c1972c92793ab4db09b9a6cfa11c10b"}
Sep 08 14:51:26.118456 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:26.118439    2577 scope.go:117] "RemoveContainer" containerID="996269b5a903602ffe543faf4fa6d0e76c1972c92793ab4db09b9a6cfa11c10b"
Sep 08 14:51:26.119509 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:26.119484    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:51:26.119592 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:26.119551    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:51:26.119592 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:26.119580    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:51:26.346958 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:26.346923    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f736e0af-f837-4e67-95db-3ec971055ce1-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f\" (UID: \"f736e0af-f837-4e67-95db-3ec971055ce1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f"
Sep 08 14:51:26.349729 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:26.349703    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f736e0af-f837-4e67-95db-3ec971055ce1-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f\" (UID: \"f736e0af-f837-4e67-95db-3ec971055ce1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f"
Sep 08 14:51:26.511265 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:26.511218    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f"
Sep 08 14:51:26.796722 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:26.796695    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f"]
Sep 08 14:51:26.798982 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:51:26.798956    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf736e0af_f837_4e67_95db_3ec971055ce1.slice/crio-3559cfbf9c74863d25dde3c5e9d79dcf2e85b8a218f816400caf37afc1dbb7ae WatchSource:0}: Error finding container 3559cfbf9c74863d25dde3c5e9d79dcf2e85b8a218f816400caf37afc1dbb7ae: Status 404 returned error can't find the container with id 3559cfbf9c74863d25dde3c5e9d79dcf2e85b8a218f816400caf37afc1dbb7ae
Sep 08 14:51:27.133009 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:27.132908    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr" event={"ID":"f27e38e8-b96f-4062-8fc1-bbe082a13b40","Type":"ContainerStarted","Data":"ea42dea95e423a70facb2da499e12ae9b9d07e013dac8235c75c533fe6679dec"}
Sep 08 14:51:27.135558 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:27.135524    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f" event={"ID":"f736e0af-f837-4e67-95db-3ec971055ce1","Type":"ContainerStarted","Data":"3559cfbf9c74863d25dde3c5e9d79dcf2e85b8a218f816400caf37afc1dbb7ae"}
Sep 08 14:51:28.064350 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:28.064319    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:28.064731 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:28.064518    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 08 14:51:28.064731 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:28.064556    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr" podUID="f27e38e8-b96f-4062-8fc1-bbe082a13b40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 08 14:51:28.144030 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:28.143986    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f" event={"ID":"f736e0af-f837-4e67-95db-3ec971055ce1","Type":"ContainerStarted","Data":"2ee335075003d43c1fb6792b3c76a6255574c6bcb8215fee2df99dcf440aec38"}
Sep 08 14:51:28.144209 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:28.144182    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f"
Sep 08 14:51:28.164334 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:28.164293    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f" podStartSLOduration=2.736356443 podStartE2EDuration="3.164279038s" totalImagesPullingTime="427.922595ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:51:28.162638533 +0000 UTC m=+1049.201039454" watchObservedRunningTime="2026-09-08 14:51:28.164279038 +0000 UTC m=+1049.202680002"
Sep 08 14:51:29.064311 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:29.064275    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 08 14:51:29.064462 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:29.064341    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr" podUID="f27e38e8-b96f-4062-8fc1-bbe082a13b40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 08 14:51:30.064516 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:30.064458    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 08 14:51:30.064882 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:30.064534    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr" podUID="f27e38e8-b96f-4062-8fc1-bbe082a13b40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 08 14:51:31.064905 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:31.064871    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 08 14:51:31.065280 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:31.064928    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr" podUID="f27e38e8-b96f-4062-8fc1-bbe082a13b40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 08 14:51:31.377984 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:31.377905    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:51:32.068437 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:32.068403    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:32.068993 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:32.068969    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:32.069652 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:32.069632    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 14:51:34.155653 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:34.155621    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f"
Sep 08 14:51:48.672023 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:48.671967    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:51:50.052134 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.052098    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"]
Sep 08 14:51:50.056867 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.056845    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:50.059517 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.059493    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-f8c7bd-openshift-default-dockercfg-779dz\""
Sep 08 14:51:50.071386 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.071366    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"]
Sep 08 14:51:50.153410 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.153379    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0161dfd4-99d0-4104-88f1-412634ea41c1-credential-socket\") pod \"e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") " pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:50.153608 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.153417    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0161dfd4-99d0-4104-88f1-412634ea41c1-istio-data\") pod \"e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") " pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:50.153608 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.153444    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0161dfd4-99d0-4104-88f1-412634ea41c1-istio-token\") pod \"e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") " pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:50.153608 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.153563    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0161dfd4-99d0-4104-88f1-412634ea41c1-workload-socket\") pod \"e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") " pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:50.153608 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.153599    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0161dfd4-99d0-4104-88f1-412634ea41c1-workload-certs\") pod \"e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") " pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:50.153841 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.153627    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0161dfd4-99d0-4104-88f1-412634ea41c1-istio-envoy\") pod \"e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") " pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:50.153841 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.153651    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0161dfd4-99d0-4104-88f1-412634ea41c1-istio-podinfo\") pod \"e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") " pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:50.153841 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.153696    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0161dfd4-99d0-4104-88f1-412634ea41c1-istiod-ca-cert\") pod \"e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") " pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:50.153841 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.153743    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7wzx\" (UniqueName: \"kubernetes.io/projected/0161dfd4-99d0-4104-88f1-412634ea41c1-kube-api-access-c7wzx\") pod \"e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") " pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:50.254726 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.254690    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0161dfd4-99d0-4104-88f1-412634ea41c1-workload-socket\") pod \"e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") " pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:50.254726 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.254726    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0161dfd4-99d0-4104-88f1-412634ea41c1-workload-certs\") pod \"e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") " pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:50.254963 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.254754    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0161dfd4-99d0-4104-88f1-412634ea41c1-istio-envoy\") pod \"e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") " pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:50.254963 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.254776    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0161dfd4-99d0-4104-88f1-412634ea41c1-istio-podinfo\") pod \"e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") " pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:50.254963 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.254812    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0161dfd4-99d0-4104-88f1-412634ea41c1-istiod-ca-cert\") pod \"e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") " pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:50.254963 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.254859    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7wzx\" (UniqueName: \"kubernetes.io/projected/0161dfd4-99d0-4104-88f1-412634ea41c1-kube-api-access-c7wzx\") pod \"e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") " pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:50.254963 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.254914    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0161dfd4-99d0-4104-88f1-412634ea41c1-credential-socket\") pod \"e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") " pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:50.255230 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.255128    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0161dfd4-99d0-4104-88f1-412634ea41c1-workload-certs\") pod \"e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") " pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:50.255230 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.255165    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0161dfd4-99d0-4104-88f1-412634ea41c1-workload-socket\") pod \"e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") " pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:50.255336 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.255246    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0161dfd4-99d0-4104-88f1-412634ea41c1-credential-socket\") pod \"e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") " pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:50.255336 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.255286    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0161dfd4-99d0-4104-88f1-412634ea41c1-istio-data\") pod \"e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") " pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:50.255437 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.255346    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0161dfd4-99d0-4104-88f1-412634ea41c1-istio-token\") pod \"e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") " pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:50.255437 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.255384    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0161dfd4-99d0-4104-88f1-412634ea41c1-istio-data\") pod \"e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") " pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:50.255549 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.255532    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0161dfd4-99d0-4104-88f1-412634ea41c1-istiod-ca-cert\") pod \"e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") " pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:50.257197 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.257172    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0161dfd4-99d0-4104-88f1-412634ea41c1-istio-envoy\") pod \"e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") " pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:50.257416 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.257398    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0161dfd4-99d0-4104-88f1-412634ea41c1-istio-podinfo\") pod \"e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") " pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:50.263994 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.263950    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0161dfd4-99d0-4104-88f1-412634ea41c1-istio-token\") pod \"e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") " pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:50.264581 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.264557    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7wzx\" (UniqueName: \"kubernetes.io/projected/0161dfd4-99d0-4104-88f1-412634ea41c1-kube-api-access-c7wzx\") pod \"e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") " pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:50.366529 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.366444    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:50.652970 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.652943    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"]
Sep 08 14:51:50.654799 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:51:50.654762    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0161dfd4_99d0_4104_88f1_412634ea41c1.slice/crio-0d4acf422e9b3ed0b153e41bc44ef840784df8d538125993ead91af177e29d9b WatchSource:0}: Error finding container 0d4acf422e9b3ed0b153e41bc44ef840784df8d538125993ead91af177e29d9b: Status 404 returned error can't find the container with id 0d4acf422e9b3ed0b153e41bc44ef840784df8d538125993ead91af177e29d9b
Sep 08 14:51:50.657222 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.657186    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:51:50.657307 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.657291    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:51:50.657351 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:50.657336    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:51:51.282678 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:51.282644    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst" event={"ID":"0161dfd4-99d0-4104-88f1-412634ea41c1","Type":"ContainerStarted","Data":"f15cf2592fc5c10d24d624ba576d00a5bef171dedd85759d93822c4b71b92f4f"}
Sep 08 14:51:51.283054 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:51.282697    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst" event={"ID":"0161dfd4-99d0-4104-88f1-412634ea41c1","Type":"ContainerStarted","Data":"0d4acf422e9b3ed0b153e41bc44ef840784df8d538125993ead91af177e29d9b"}
Sep 08 14:51:51.309366 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:51.309308    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst" podStartSLOduration=1.309286626 podStartE2EDuration="1.309286626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:51:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:51:51.306436583 +0000 UTC m=+1072.344837508" watchObservedRunningTime="2026-09-08 14:51:51.309286626 +0000 UTC m=+1072.347687550"
Sep 08 14:51:51.367443 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:51.367411    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:51.372384 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:51.372360    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:52.288982 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:52.288954    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:52.289906 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:52.289883    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:51:54.296517 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:54.296452    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5"]
Sep 08 14:51:54.300462 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:54.300440    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5"
Sep 08 14:51:54.304140 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:54.304111    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-f8c7bd-serving-cert\""
Sep 08 14:51:54.316367 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:54.316345    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5"]
Sep 08 14:51:54.392126 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:54.392093    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be78af7a-a8ff-45fc-adaf-ef5368012990-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5\" (UID: \"be78af7a-a8ff-45fc-adaf-ef5368012990\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5"
Sep 08 14:51:54.392462 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:54.392435    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t88vt\" (UniqueName: \"kubernetes.io/projected/be78af7a-a8ff-45fc-adaf-ef5368012990-kube-api-access-t88vt\") pod \"maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5\" (UID: \"be78af7a-a8ff-45fc-adaf-ef5368012990\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5"
Sep 08 14:51:54.392632 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:54.392614    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be78af7a-a8ff-45fc-adaf-ef5368012990-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5\" (UID: \"be78af7a-a8ff-45fc-adaf-ef5368012990\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5"
Sep 08 14:51:54.392706 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:54.392648    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be78af7a-a8ff-45fc-adaf-ef5368012990-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5\" (UID: \"be78af7a-a8ff-45fc-adaf-ef5368012990\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5"
Sep 08 14:51:54.493693 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:54.493656    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be78af7a-a8ff-45fc-adaf-ef5368012990-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5\" (UID: \"be78af7a-a8ff-45fc-adaf-ef5368012990\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5"
Sep 08 14:51:54.493854 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:54.493709    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t88vt\" (UniqueName: \"kubernetes.io/projected/be78af7a-a8ff-45fc-adaf-ef5368012990-kube-api-access-t88vt\") pod \"maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5\" (UID: \"be78af7a-a8ff-45fc-adaf-ef5368012990\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5"
Sep 08 14:51:54.493854 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:54.493760    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be78af7a-a8ff-45fc-adaf-ef5368012990-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5\" (UID: \"be78af7a-a8ff-45fc-adaf-ef5368012990\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5"
Sep 08 14:51:54.493854 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:54.493785    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be78af7a-a8ff-45fc-adaf-ef5368012990-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5\" (UID: \"be78af7a-a8ff-45fc-adaf-ef5368012990\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5"
Sep 08 14:51:54.494032 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:51:54.493903    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-serving-cert: secret "maas-api-e2e-shared-b-w2-f8c7bd-serving-cert" not found
Sep 08 14:51:54.494032 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:51:54.493965    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be78af7a-a8ff-45fc-adaf-ef5368012990-maas-api-tls podName:be78af7a-a8ff-45fc-adaf-ef5368012990 nodeName:}" failed. No retries permitted until 2026-09-08 14:51:54.993944961 +0000 UTC m=+1076.032345881 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/be78af7a-a8ff-45fc-adaf-ef5368012990-maas-api-tls") pod "maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5" (UID: "be78af7a-a8ff-45fc-adaf-ef5368012990") : secret "maas-api-e2e-shared-b-w2-f8c7bd-serving-cert" not found
Sep 08 14:51:54.494397 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:54.494377    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be78af7a-a8ff-45fc-adaf-ef5368012990-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5\" (UID: \"be78af7a-a8ff-45fc-adaf-ef5368012990\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5"
Sep 08 14:51:54.496169 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:54.496140    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be78af7a-a8ff-45fc-adaf-ef5368012990-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5\" (UID: \"be78af7a-a8ff-45fc-adaf-ef5368012990\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5"
Sep 08 14:51:54.502976 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:54.502955    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t88vt\" (UniqueName: \"kubernetes.io/projected/be78af7a-a8ff-45fc-adaf-ef5368012990-kube-api-access-t88vt\") pod \"maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5\" (UID: \"be78af7a-a8ff-45fc-adaf-ef5368012990\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5"
Sep 08 14:51:54.998347 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:54.998299    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be78af7a-a8ff-45fc-adaf-ef5368012990-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5\" (UID: \"be78af7a-a8ff-45fc-adaf-ef5368012990\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5"
Sep 08 14:51:54.998549 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:51:54.998455    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-serving-cert: secret "maas-api-e2e-shared-b-w2-f8c7bd-serving-cert" not found
Sep 08 14:51:54.998603 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:51:54.998547    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be78af7a-a8ff-45fc-adaf-ef5368012990-maas-api-tls podName:be78af7a-a8ff-45fc-adaf-ef5368012990 nodeName:}" failed. No retries permitted until 2026-09-08 14:51:55.998526788 +0000 UTC m=+1077.036927691 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/be78af7a-a8ff-45fc-adaf-ef5368012990-maas-api-tls") pod "maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5" (UID: "be78af7a-a8ff-45fc-adaf-ef5368012990") : secret "maas-api-e2e-shared-b-w2-f8c7bd-serving-cert" not found
Sep 08 14:51:56.007666 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:56.007625    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be78af7a-a8ff-45fc-adaf-ef5368012990-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5\" (UID: \"be78af7a-a8ff-45fc-adaf-ef5368012990\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5"
Sep 08 14:51:56.010510 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:56.010405    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be78af7a-a8ff-45fc-adaf-ef5368012990-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5\" (UID: \"be78af7a-a8ff-45fc-adaf-ef5368012990\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5"
Sep 08 14:51:56.115297 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:56.115260    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5"
Sep 08 14:51:56.390787 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:56.390757    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5"]
Sep 08 14:51:56.391769 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:51:56.391744    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe78af7a_a8ff_45fc_adaf_ef5368012990.slice/crio-9bfc2adc7a547769b81cdd591202cac87949f94432a3affd06d589dd44b9c774 WatchSource:0}: Error finding container 9bfc2adc7a547769b81cdd591202cac87949f94432a3affd06d589dd44b9c774: Status 404 returned error can't find the container with id 9bfc2adc7a547769b81cdd591202cac87949f94432a3affd06d589dd44b9c774
Sep 08 14:51:57.321150 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:57.321114    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5" event={"ID":"be78af7a-a8ff-45fc-adaf-ef5368012990","Type":"ContainerStarted","Data":"7483b15b67ee76517ed198b380aff38d6ff3003fde2913c83f296f32439cd0c1"}
Sep 08 14:51:57.321518 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:57.321166    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5" event={"ID":"be78af7a-a8ff-45fc-adaf-ef5368012990","Type":"ContainerStarted","Data":"9bfc2adc7a547769b81cdd591202cac87949f94432a3affd06d589dd44b9c774"}
Sep 08 14:51:57.321518 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:57.321205    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5"
Sep 08 14:51:57.341246 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:51:57.341198    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5" podStartSLOduration=2.996768993 podStartE2EDuration="3.341183897s" totalImagesPullingTime="344.414904ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:51:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:51:57.339157545 +0000 UTC m=+1078.377558467" watchObservedRunningTime="2026-09-08 14:51:57.341183897 +0000 UTC m=+1078.379584819"
Sep 08 14:52:02.283742 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:02.283708    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:52:03.332619 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:03.332586    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5"
Sep 08 14:52:12.422211 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:12.422172    2577 generic.go:356] "Generic (PLEG): container finished" podID="0161dfd4-99d0-4104-88f1-412634ea41c1" containerID="f15cf2592fc5c10d24d624ba576d00a5bef171dedd85759d93822c4b71b92f4f" exitCode=0
Sep 08 14:52:12.422649 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:12.422250    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst" event={"ID":"0161dfd4-99d0-4104-88f1-412634ea41c1","Type":"ContainerDied","Data":"f15cf2592fc5c10d24d624ba576d00a5bef171dedd85759d93822c4b71b92f4f"}
Sep 08 14:52:12.422709 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:12.422675    2577 scope.go:117] "RemoveContainer" containerID="f15cf2592fc5c10d24d624ba576d00a5bef171dedd85759d93822c4b71b92f4f"
Sep 08 14:52:12.423715 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:12.423689    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:52:12.423779 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:12.423754    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:52:12.423823 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:12.423785    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:52:13.433841 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:13.433803    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst" event={"ID":"0161dfd4-99d0-4104-88f1-412634ea41c1","Type":"ContainerStarted","Data":"2c713e2d024bf7141b99ac9d2c46e90e0e04088301a43315aec4eb96b561ad77"}
Sep 08 14:52:14.367679 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:14.367641    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:52:14.367897 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:14.367862    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 08 14:52:14.368047 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:14.367934    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst" podUID="0161dfd4-99d0-4104-88f1-412634ea41c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 08 14:52:15.367331 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:15.367294    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 08 14:52:15.367741 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:15.367360    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst" podUID="0161dfd4-99d0-4104-88f1-412634ea41c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 08 14:52:16.367355 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:16.367323    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 08 14:52:16.367754 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:16.367383    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst" podUID="0161dfd4-99d0-4104-88f1-412634ea41c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 08 14:52:17.367597 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:17.367563    2577 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 08 14:52:17.368082 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:17.367638    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst" podUID="0161dfd4-99d0-4104-88f1-412634ea41c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 08 14:52:18.614559 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:18.614524    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:52:18.615253 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:18.615227    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:52:18.616326 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:18.616305    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:52:18.812316 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:18.812277    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7868-139679228187968"]
Sep 08 14:52:18.816573 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:18.816554    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7868-139679228187968"
Sep 08 14:52:18.820133 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:18.820107    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-2sfkk\""
Sep 08 14:52:18.823728 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:18.823701    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7868-139679228187968"]
Sep 08 14:52:18.930382 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:18.930354    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz2pr\" (UniqueName: \"kubernetes.io/projected/9a5c787a-61fc-4b0f-9429-f24cc008b78d-kube-api-access-hz2pr\") pod \"test-curl-7868-139679228187968\" (UID: \"9a5c787a-61fc-4b0f-9429-f24cc008b78d\") " pod="opendatahub/test-curl-7868-139679228187968"
Sep 08 14:52:19.031754 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:19.031721    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz2pr\" (UniqueName: \"kubernetes.io/projected/9a5c787a-61fc-4b0f-9429-f24cc008b78d-kube-api-access-hz2pr\") pod \"test-curl-7868-139679228187968\" (UID: \"9a5c787a-61fc-4b0f-9429-f24cc008b78d\") " pod="opendatahub/test-curl-7868-139679228187968"
Sep 08 14:52:19.041259 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:19.041236    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz2pr\" (UniqueName: \"kubernetes.io/projected/9a5c787a-61fc-4b0f-9429-f24cc008b78d-kube-api-access-hz2pr\") pod \"test-curl-7868-139679228187968\" (UID: \"9a5c787a-61fc-4b0f-9429-f24cc008b78d\") " pod="opendatahub/test-curl-7868-139679228187968"
Sep 08 14:52:19.128395 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:19.128366    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7868-139679228187968"
Sep 08 14:52:19.401944 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:19.401920    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7868-139679228187968"]
Sep 08 14:52:19.403674 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:52:19.403646    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a5c787a_61fc_4b0f_9429_f24cc008b78d.slice/crio-1e8be22fbbdcc9def36d3e2716894e89d37469f179a4a3adac8fd60b26046a19 WatchSource:0}: Error finding container 1e8be22fbbdcc9def36d3e2716894e89d37469f179a4a3adac8fd60b26046a19: Status 404 returned error can't find the container with id 1e8be22fbbdcc9def36d3e2716894e89d37469f179a4a3adac8fd60b26046a19
Sep 08 14:52:19.473866 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:19.473788    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7868-139679228187968" event={"ID":"9a5c787a-61fc-4b0f-9429-f24cc008b78d","Type":"ContainerStarted","Data":"1e8be22fbbdcc9def36d3e2716894e89d37469f179a4a3adac8fd60b26046a19"}
Sep 08 14:52:20.480565 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:20.480523    2577 generic.go:356] "Generic (PLEG): container finished" podID="9a5c787a-61fc-4b0f-9429-f24cc008b78d" containerID="2df0cc52e77bdd15d158785c2ef1dbd8f9d613dce068fda39e782319b4dadf94" exitCode=0
Sep 08 14:52:20.480990 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:20.480602    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7868-139679228187968" event={"ID":"9a5c787a-61fc-4b0f-9429-f24cc008b78d","Type":"ContainerDied","Data":"2df0cc52e77bdd15d158785c2ef1dbd8f9d613dce068fda39e782319b4dadf94"}
Sep 08 14:52:21.625928 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:21.625904    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7868-139679228187968"
Sep 08 14:52:21.665504 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:21.665461    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7868-139679228187968_9a5c787a-61fc-4b0f-9429-f24cc008b78d/test-curl-7868-139679228187968/0.log"
Sep 08 14:52:21.700116 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:21.700088    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7868-139679228187968"]
Sep 08 14:52:21.703338 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:21.703303    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7868-139679228187968"]
Sep 08 14:52:21.757484 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:21.757407    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hz2pr\" (UniqueName: \"kubernetes.io/projected/9a5c787a-61fc-4b0f-9429-f24cc008b78d-kube-api-access-hz2pr\") pod \"9a5c787a-61fc-4b0f-9429-f24cc008b78d\" (UID: \"9a5c787a-61fc-4b0f-9429-f24cc008b78d\") "
Sep 08 14:52:21.759497 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:21.759458    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a5c787a-61fc-4b0f-9429-f24cc008b78d-kube-api-access-hz2pr" (OuterVolumeSpecName: "kube-api-access-hz2pr") pod "9a5c787a-61fc-4b0f-9429-f24cc008b78d" (UID: "9a5c787a-61fc-4b0f-9429-f24cc008b78d"). InnerVolumeSpecName "kube-api-access-hz2pr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:52:21.858257 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:21.858224    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hz2pr\" (UniqueName: \"kubernetes.io/projected/9a5c787a-61fc-4b0f-9429-f24cc008b78d-kube-api-access-hz2pr\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:52:22.493738 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:22.493707    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e8be22fbbdcc9def36d3e2716894e89d37469f179a4a3adac8fd60b26046a19"
Sep 08 14:52:22.493738 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:22.493719    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7868-139679228187968"
Sep 08 14:52:22.503409 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:52:22.503381    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7868-139679228187968\" is forbidden: User \"system:node:ip-10-0-142-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-20.ec2.internal' and this object" podUID="9a5c787a-61fc-4b0f-9429-f24cc008b78d" pod="opendatahub/test-curl-7868-139679228187968"
Sep 08 14:52:23.491070 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:23.491034    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a5c787a-61fc-4b0f-9429-f24cc008b78d" path="/var/lib/kubelet/pods/9a5c787a-61fc-4b0f-9429-f24cc008b78d/volumes"
Sep 08 14:52:26.373370 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:26.373337    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7868-139679228188544"]
Sep 08 14:52:26.373774 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:26.373761    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a5c787a-61fc-4b0f-9429-f24cc008b78d" containerName="test-curl-7868-139679228187968"
Sep 08 14:52:26.373820 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:26.373776    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a5c787a-61fc-4b0f-9429-f24cc008b78d" containerName="test-curl-7868-139679228187968"
Sep 08 14:52:26.373862 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:26.373852    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a5c787a-61fc-4b0f-9429-f24cc008b78d" containerName="test-curl-7868-139679228187968"
Sep 08 14:52:26.376881 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:26.376865    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7868-139679228188544"
Sep 08 14:52:26.379565 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:26.379530    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-2sfkk\""
Sep 08 14:52:26.382907 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:26.382880    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7868-139679228188544"]
Sep 08 14:52:26.502580 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:26.502541    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6brv\" (UniqueName: \"kubernetes.io/projected/45828414-aabd-44fe-a36a-b5bde7569341-kube-api-access-v6brv\") pod \"test-curl-7868-139679228188544\" (UID: \"45828414-aabd-44fe-a36a-b5bde7569341\") " pod="opendatahub/test-curl-7868-139679228188544"
Sep 08 14:52:26.603600 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:26.603559    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6brv\" (UniqueName: \"kubernetes.io/projected/45828414-aabd-44fe-a36a-b5bde7569341-kube-api-access-v6brv\") pod \"test-curl-7868-139679228188544\" (UID: \"45828414-aabd-44fe-a36a-b5bde7569341\") " pod="opendatahub/test-curl-7868-139679228188544"
Sep 08 14:52:26.612665 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:26.612636    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6brv\" (UniqueName: \"kubernetes.io/projected/45828414-aabd-44fe-a36a-b5bde7569341-kube-api-access-v6brv\") pod \"test-curl-7868-139679228188544\" (UID: \"45828414-aabd-44fe-a36a-b5bde7569341\") " pod="opendatahub/test-curl-7868-139679228188544"
Sep 08 14:52:26.688396 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:26.688365    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7868-139679228188544"
Sep 08 14:52:26.963395 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:26.963370    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7868-139679228188544"]
Sep 08 14:52:26.965134 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:52:26.965087    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45828414_aabd_44fe_a36a_b5bde7569341.slice/crio-c998bcbb279cc3ead4c05aea902d09e5f61fd1047be522fc01961a43758670a6 WatchSource:0}: Error finding container c998bcbb279cc3ead4c05aea902d09e5f61fd1047be522fc01961a43758670a6: Status 404 returned error can't find the container with id c998bcbb279cc3ead4c05aea902d09e5f61fd1047be522fc01961a43758670a6
Sep 08 14:52:27.527569 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:27.527541    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7868-139679228188544" event={"ID":"45828414-aabd-44fe-a36a-b5bde7569341","Type":"ContainerStarted","Data":"96fb33cba33669ee10c403abc1211fddf459ac75044ded0c4dadaf1f23b43413"}
Sep 08 14:52:27.527850 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:27.527581    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7868-139679228188544" event={"ID":"45828414-aabd-44fe-a36a-b5bde7569341","Type":"ContainerStarted","Data":"c998bcbb279cc3ead4c05aea902d09e5f61fd1047be522fc01961a43758670a6"}
Sep 08 14:52:27.543326 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:27.543283    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7868-139679228188544" podStartSLOduration=1.054143066 podStartE2EDuration="1.543268751s" totalImagesPullingTime="489.125685ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:52:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:52:27.541676215 +0000 UTC m=+1108.580077136" watchObservedRunningTime="2026-09-08 14:52:27.543268751 +0000 UTC m=+1108.581669672"
Sep 08 14:52:27.643741 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:27.643720    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7868-139679228188544_45828414-aabd-44fe-a36a-b5bde7569341/test-curl-7868-139679228188544/0.log"
Sep 08 14:52:28.535677 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:28.535645    2577 generic.go:356] "Generic (PLEG): container finished" podID="45828414-aabd-44fe-a36a-b5bde7569341" containerID="96fb33cba33669ee10c403abc1211fddf459ac75044ded0c4dadaf1f23b43413" exitCode=0
Sep 08 14:52:28.536107 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:28.535741    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7868-139679228188544" event={"ID":"45828414-aabd-44fe-a36a-b5bde7569341","Type":"ContainerDied","Data":"96fb33cba33669ee10c403abc1211fddf459ac75044ded0c4dadaf1f23b43413"}
Sep 08 14:52:29.676868 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:29.676846    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7868-139679228188544"
Sep 08 14:52:29.709512 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:29.709477    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7868-139679228188544"]
Sep 08 14:52:29.714929 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:29.714901    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7868-139679228188544"]
Sep 08 14:52:29.734620 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:29.734593    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6brv\" (UniqueName: \"kubernetes.io/projected/45828414-aabd-44fe-a36a-b5bde7569341-kube-api-access-v6brv\") pod \"45828414-aabd-44fe-a36a-b5bde7569341\" (UID: \"45828414-aabd-44fe-a36a-b5bde7569341\") "
Sep 08 14:52:29.736677 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:29.736655    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45828414-aabd-44fe-a36a-b5bde7569341-kube-api-access-v6brv" (OuterVolumeSpecName: "kube-api-access-v6brv") pod "45828414-aabd-44fe-a36a-b5bde7569341" (UID: "45828414-aabd-44fe-a36a-b5bde7569341"). InnerVolumeSpecName "kube-api-access-v6brv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:52:29.835444 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:29.835365    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6brv\" (UniqueName: \"kubernetes.io/projected/45828414-aabd-44fe-a36a-b5bde7569341-kube-api-access-v6brv\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:52:29.841680 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:29.841653    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7868-139679228188544"]
Sep 08 14:52:29.842076 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:29.842063    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45828414-aabd-44fe-a36a-b5bde7569341" containerName="test-curl-7868-139679228188544"
Sep 08 14:52:29.842122 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:29.842078    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="45828414-aabd-44fe-a36a-b5bde7569341" containerName="test-curl-7868-139679228188544"
Sep 08 14:52:29.842160 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:29.842141    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="45828414-aabd-44fe-a36a-b5bde7569341" containerName="test-curl-7868-139679228188544"
Sep 08 14:52:29.845151 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:29.845125    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7868-139679228188544"
Sep 08 14:52:29.853335 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:29.853315    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7868-139679228188544"]
Sep 08 14:52:29.936107 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:29.936075    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx29h\" (UniqueName: \"kubernetes.io/projected/61ed7b04-8108-4e0a-bb4b-14a93ba8a196-kube-api-access-bx29h\") pod \"test-curl-7868-139679228188544\" (UID: \"61ed7b04-8108-4e0a-bb4b-14a93ba8a196\") " pod="opendatahub/test-curl-7868-139679228188544"
Sep 08 14:52:30.037342 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:30.037306    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx29h\" (UniqueName: \"kubernetes.io/projected/61ed7b04-8108-4e0a-bb4b-14a93ba8a196-kube-api-access-bx29h\") pod \"test-curl-7868-139679228188544\" (UID: \"61ed7b04-8108-4e0a-bb4b-14a93ba8a196\") " pod="opendatahub/test-curl-7868-139679228188544"
Sep 08 14:52:30.046843 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:30.046822    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx29h\" (UniqueName: \"kubernetes.io/projected/61ed7b04-8108-4e0a-bb4b-14a93ba8a196-kube-api-access-bx29h\") pod \"test-curl-7868-139679228188544\" (UID: \"61ed7b04-8108-4e0a-bb4b-14a93ba8a196\") " pod="opendatahub/test-curl-7868-139679228188544"
Sep 08 14:52:30.155209 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:30.155140    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7868-139679228188544"
Sep 08 14:52:30.430682 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:30.430653    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7868-139679228188544"]
Sep 08 14:52:30.431533 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:52:30.431510    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61ed7b04_8108_4e0a_bb4b_14a93ba8a196.slice/crio-3c416bb56da093b6f63a18ed444e35f0ba92a90e56e532dfae7b8bbf504ea979 WatchSource:0}: Error finding container 3c416bb56da093b6f63a18ed444e35f0ba92a90e56e532dfae7b8bbf504ea979: Status 404 returned error can't find the container with id 3c416bb56da093b6f63a18ed444e35f0ba92a90e56e532dfae7b8bbf504ea979
Sep 08 14:52:30.547794 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:30.547755    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7868-139679228188544" event={"ID":"61ed7b04-8108-4e0a-bb4b-14a93ba8a196","Type":"ContainerStarted","Data":"3c416bb56da093b6f63a18ed444e35f0ba92a90e56e532dfae7b8bbf504ea979"}
Sep 08 14:52:30.548954 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:30.548930    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c998bcbb279cc3ead4c05aea902d09e5f61fd1047be522fc01961a43758670a6"
Sep 08 14:52:30.548954 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:30.548951    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7868-139679228188544"
Sep 08 14:52:30.560423 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:30.560394    2577 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7868-139679228188544" oldPodUID="45828414-aabd-44fe-a36a-b5bde7569341" podUID="61ed7b04-8108-4e0a-bb4b-14a93ba8a196"
Sep 08 14:52:31.478706 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:31.478675    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:52:31.490761 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:31.490727    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45828414-aabd-44fe-a36a-b5bde7569341" path="/var/lib/kubelet/pods/45828414-aabd-44fe-a36a-b5bde7569341/volumes"
Sep 08 14:52:31.560830 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:31.560796    2577 generic.go:356] "Generic (PLEG): container finished" podID="61ed7b04-8108-4e0a-bb4b-14a93ba8a196" containerID="098a146f95d39b6f982d7a5e70bd12898d2ea146f2e009c01f39ab0f1349a5bf" exitCode=0
Sep 08 14:52:31.560994 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:31.560888    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7868-139679228188544" event={"ID":"61ed7b04-8108-4e0a-bb4b-14a93ba8a196","Type":"ContainerDied","Data":"098a146f95d39b6f982d7a5e70bd12898d2ea146f2e009c01f39ab0f1349a5bf"}
Sep 08 14:52:32.705773 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:32.705746    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7868-139679228188544"
Sep 08 14:52:32.743522 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:32.743490    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7868-139679228188544_61ed7b04-8108-4e0a-bb4b-14a93ba8a196/test-curl-7868-139679228188544/0.log"
Sep 08 14:52:32.758761 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:32.758729    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bx29h\" (UniqueName: \"kubernetes.io/projected/61ed7b04-8108-4e0a-bb4b-14a93ba8a196-kube-api-access-bx29h\") pod \"61ed7b04-8108-4e0a-bb4b-14a93ba8a196\" (UID: \"61ed7b04-8108-4e0a-bb4b-14a93ba8a196\") "
Sep 08 14:52:32.760952 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:32.760919    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61ed7b04-8108-4e0a-bb4b-14a93ba8a196-kube-api-access-bx29h" (OuterVolumeSpecName: "kube-api-access-bx29h") pod "61ed7b04-8108-4e0a-bb4b-14a93ba8a196" (UID: "61ed7b04-8108-4e0a-bb4b-14a93ba8a196"). InnerVolumeSpecName "kube-api-access-bx29h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:52:32.777424 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:32.777400    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7868-139679228188544"]
Sep 08 14:52:32.779653 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:32.779637    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7868-139679228188544"]
Sep 08 14:52:32.859481 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:32.859410    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bx29h\" (UniqueName: \"kubernetes.io/projected/61ed7b04-8108-4e0a-bb4b-14a93ba8a196-kube-api-access-bx29h\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:52:33.490998 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:33.490966    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61ed7b04-8108-4e0a-bb4b-14a93ba8a196" path="/var/lib/kubelet/pods/61ed7b04-8108-4e0a-bb4b-14a93ba8a196/volumes"
Sep 08 14:52:33.574051 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:33.574025    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7868-139679228188544"
Sep 08 14:52:33.574192 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:33.574074    2577 scope.go:117] "RemoveContainer" containerID="098a146f95d39b6f982d7a5e70bd12898d2ea146f2e009c01f39ab0f1349a5bf"
Sep 08 14:52:37.993776 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:37.993742    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9"]
Sep 08 14:52:37.994268 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:37.994247    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61ed7b04-8108-4e0a-bb4b-14a93ba8a196" containerName="test-curl-7868-139679228188544"
Sep 08 14:52:37.994268 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:37.994266    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="61ed7b04-8108-4e0a-bb4b-14a93ba8a196" containerName="test-curl-7868-139679228188544"
Sep 08 14:52:37.994445 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:37.994333    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="61ed7b04-8108-4e0a-bb4b-14a93ba8a196" containerName="test-curl-7868-139679228188544"
Sep 08 14:52:37.998843 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:37.998829    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9"
Sep 08 14:52:38.001563 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:38.001537    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-3bb80f8b-serving-cert\""
Sep 08 14:52:38.014194 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:38.014169    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9"]
Sep 08 14:52:38.114714 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:38.114684    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e246287-9ec8-4575-9353-efd149f5d26f-openshift-service-ca\") pod \"maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9\" (UID: \"9e246287-9ec8-4575-9353-efd149f5d26f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9"
Sep 08 14:52:38.114829 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:38.114725    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rl8f\" (UniqueName: \"kubernetes.io/projected/9e246287-9ec8-4575-9353-efd149f5d26f-kube-api-access-8rl8f\") pod \"maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9\" (UID: \"9e246287-9ec8-4575-9353-efd149f5d26f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9"
Sep 08 14:52:38.114829 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:38.114813    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e246287-9ec8-4575-9353-efd149f5d26f-maas-api-tls\") pod \"maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9\" (UID: \"9e246287-9ec8-4575-9353-efd149f5d26f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9"
Sep 08 14:52:38.114934 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:38.114860    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e246287-9ec8-4575-9353-efd149f5d26f-metrics-certs\") pod \"maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9\" (UID: \"9e246287-9ec8-4575-9353-efd149f5d26f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9"
Sep 08 14:52:38.215373 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:38.215331    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e246287-9ec8-4575-9353-efd149f5d26f-openshift-service-ca\") pod \"maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9\" (UID: \"9e246287-9ec8-4575-9353-efd149f5d26f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9"
Sep 08 14:52:38.215373 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:38.215367    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rl8f\" (UniqueName: \"kubernetes.io/projected/9e246287-9ec8-4575-9353-efd149f5d26f-kube-api-access-8rl8f\") pod \"maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9\" (UID: \"9e246287-9ec8-4575-9353-efd149f5d26f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9"
Sep 08 14:52:38.215666 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:38.215390    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e246287-9ec8-4575-9353-efd149f5d26f-maas-api-tls\") pod \"maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9\" (UID: \"9e246287-9ec8-4575-9353-efd149f5d26f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9"
Sep 08 14:52:38.215666 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:38.215450    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e246287-9ec8-4575-9353-efd149f5d26f-metrics-certs\") pod \"maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9\" (UID: \"9e246287-9ec8-4575-9353-efd149f5d26f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9"
Sep 08 14:52:38.216056 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:38.216031    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e246287-9ec8-4575-9353-efd149f5d26f-openshift-service-ca\") pod \"maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9\" (UID: \"9e246287-9ec8-4575-9353-efd149f5d26f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9"
Sep 08 14:52:38.218043 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:38.218018    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e246287-9ec8-4575-9353-efd149f5d26f-maas-api-tls\") pod \"maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9\" (UID: \"9e246287-9ec8-4575-9353-efd149f5d26f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9"
Sep 08 14:52:38.218168 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:38.218150    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e246287-9ec8-4575-9353-efd149f5d26f-metrics-certs\") pod \"maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9\" (UID: \"9e246287-9ec8-4575-9353-efd149f5d26f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9"
Sep 08 14:52:38.226909 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:38.226875    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rl8f\" (UniqueName: \"kubernetes.io/projected/9e246287-9ec8-4575-9353-efd149f5d26f-kube-api-access-8rl8f\") pod \"maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9\" (UID: \"9e246287-9ec8-4575-9353-efd149f5d26f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9"
Sep 08 14:52:38.314853 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:38.314775    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9"
Sep 08 14:52:38.591742 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:38.591716    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9"]
Sep 08 14:52:38.593746 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:52:38.593715    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e246287_9ec8_4575_9353_efd149f5d26f.slice/crio-e7878d7acb7bafd255421990baf6459b4c1aadcd3f237c5baa167a0d47470307 WatchSource:0}: Error finding container e7878d7acb7bafd255421990baf6459b4c1aadcd3f237c5baa167a0d47470307: Status 404 returned error can't find the container with id e7878d7acb7bafd255421990baf6459b4c1aadcd3f237c5baa167a0d47470307
Sep 08 14:52:38.607671 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:38.607643    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9" event={"ID":"9e246287-9ec8-4575-9353-efd149f5d26f","Type":"ContainerStarted","Data":"e7878d7acb7bafd255421990baf6459b4c1aadcd3f237c5baa167a0d47470307"}
Sep 08 14:52:39.615699 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:39.615658    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9" event={"ID":"9e246287-9ec8-4575-9353-efd149f5d26f","Type":"ContainerStarted","Data":"2eee57f7b1805eccc64c8873e12304edf685e26510e5d5ec2adf46d425b96a30"}
Sep 08 14:52:39.616172 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:39.615811    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9"
Sep 08 14:52:39.637524 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:39.637477    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9" podStartSLOduration=2.271582929 podStartE2EDuration="2.637451309s" totalImagesPullingTime="365.86838ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:52:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:52:39.63440003 +0000 UTC m=+1120.672800963" watchObservedRunningTime="2026-09-08 14:52:39.637451309 +0000 UTC m=+1120.675852266"
Sep 08 14:52:45.626576 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:45.626549    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9"
Sep 08 14:52:48.477749 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:48.477710    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:52:59.613829 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:52:59.613801    2577 scope.go:117] "RemoveContainer" containerID="33435c1357cdefbc010432b8165c595f64a1a275738240b30b31d5860dd33303"
Sep 08 14:53:00.976106 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:53:00.976069    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:53:20.063989 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:53:20.063951    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:53:36.063284 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:53:36.063195    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:53:46.634812 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:53:46.634765    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9"]
Sep 08 14:53:46.635502 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:53:46.635101    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9" podUID="9e246287-9ec8-4575-9353-efd149f5d26f" containerName="maas-api" containerID="cri-o://2eee57f7b1805eccc64c8873e12304edf685e26510e5d5ec2adf46d425b96a30" gracePeriod=30
Sep 08 14:53:46.885371 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:53:46.885320    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9"
Sep 08 14:53:47.019851 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:53:47.019817    2577 generic.go:356] "Generic (PLEG): container finished" podID="9e246287-9ec8-4575-9353-efd149f5d26f" containerID="2eee57f7b1805eccc64c8873e12304edf685e26510e5d5ec2adf46d425b96a30" exitCode=0
Sep 08 14:53:47.020025 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:53:47.019876    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9"
Sep 08 14:53:47.020025 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:53:47.019909    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9" event={"ID":"9e246287-9ec8-4575-9353-efd149f5d26f","Type":"ContainerDied","Data":"2eee57f7b1805eccc64c8873e12304edf685e26510e5d5ec2adf46d425b96a30"}
Sep 08 14:53:47.020025 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:53:47.019971    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9" event={"ID":"9e246287-9ec8-4575-9353-efd149f5d26f","Type":"ContainerDied","Data":"e7878d7acb7bafd255421990baf6459b4c1aadcd3f237c5baa167a0d47470307"}
Sep 08 14:53:47.020025 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:53:47.019998    2577 scope.go:117] "RemoveContainer" containerID="2eee57f7b1805eccc64c8873e12304edf685e26510e5d5ec2adf46d425b96a30"
Sep 08 14:53:47.031263 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:53:47.031242    2577 scope.go:117] "RemoveContainer" containerID="2eee57f7b1805eccc64c8873e12304edf685e26510e5d5ec2adf46d425b96a30"
Sep 08 14:53:47.031583 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:53:47.031564    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2eee57f7b1805eccc64c8873e12304edf685e26510e5d5ec2adf46d425b96a30\": container with ID starting with 2eee57f7b1805eccc64c8873e12304edf685e26510e5d5ec2adf46d425b96a30 not found: ID does not exist" containerID="2eee57f7b1805eccc64c8873e12304edf685e26510e5d5ec2adf46d425b96a30"
Sep 08 14:53:47.031639 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:53:47.031594    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eee57f7b1805eccc64c8873e12304edf685e26510e5d5ec2adf46d425b96a30"} err="failed to get container status \"2eee57f7b1805eccc64c8873e12304edf685e26510e5d5ec2adf46d425b96a30\": rpc error: code = NotFound desc = could not find container \"2eee57f7b1805eccc64c8873e12304edf685e26510e5d5ec2adf46d425b96a30\": container with ID starting with 2eee57f7b1805eccc64c8873e12304edf685e26510e5d5ec2adf46d425b96a30 not found: ID does not exist"
Sep 08 14:53:47.066640 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:53:47.066617    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e246287-9ec8-4575-9353-efd149f5d26f-openshift-service-ca\") pod \"9e246287-9ec8-4575-9353-efd149f5d26f\" (UID: \"9e246287-9ec8-4575-9353-efd149f5d26f\") "
Sep 08 14:53:47.066795 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:53:47.066720    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e246287-9ec8-4575-9353-efd149f5d26f-maas-api-tls\") pod \"9e246287-9ec8-4575-9353-efd149f5d26f\" (UID: \"9e246287-9ec8-4575-9353-efd149f5d26f\") "
Sep 08 14:53:47.067013 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:53:47.066992    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e246287-9ec8-4575-9353-efd149f5d26f-metrics-certs\") pod \"9e246287-9ec8-4575-9353-efd149f5d26f\" (UID: \"9e246287-9ec8-4575-9353-efd149f5d26f\") "
Sep 08 14:53:47.067139 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:53:47.067058    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e246287-9ec8-4575-9353-efd149f5d26f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9e246287-9ec8-4575-9353-efd149f5d26f" (UID: "9e246287-9ec8-4575-9353-efd149f5d26f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:53:47.067139 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:53:47.067101    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rl8f\" (UniqueName: \"kubernetes.io/projected/9e246287-9ec8-4575-9353-efd149f5d26f-kube-api-access-8rl8f\") pod \"9e246287-9ec8-4575-9353-efd149f5d26f\" (UID: \"9e246287-9ec8-4575-9353-efd149f5d26f\") "
Sep 08 14:53:47.067485 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:53:47.067443    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e246287-9ec8-4575-9353-efd149f5d26f-openshift-service-ca\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:53:47.069247 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:53:47.069221    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e246287-9ec8-4575-9353-efd149f5d26f-kube-api-access-8rl8f" (OuterVolumeSpecName: "kube-api-access-8rl8f") pod "9e246287-9ec8-4575-9353-efd149f5d26f" (UID: "9e246287-9ec8-4575-9353-efd149f5d26f"). InnerVolumeSpecName "kube-api-access-8rl8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:53:47.069377 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:53:47.069346    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e246287-9ec8-4575-9353-efd149f5d26f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9e246287-9ec8-4575-9353-efd149f5d26f" (UID: "9e246287-9ec8-4575-9353-efd149f5d26f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:53:47.069377 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:53:47.069355    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e246287-9ec8-4575-9353-efd149f5d26f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9e246287-9ec8-4575-9353-efd149f5d26f" (UID: "9e246287-9ec8-4575-9353-efd149f5d26f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:53:47.168405 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:53:47.168381    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e246287-9ec8-4575-9353-efd149f5d26f-maas-api-tls\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:53:47.168405 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:53:47.168404    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e246287-9ec8-4575-9353-efd149f5d26f-metrics-certs\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:53:47.168405 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:53:47.168413    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rl8f\" (UniqueName: \"kubernetes.io/projected/9e246287-9ec8-4575-9353-efd149f5d26f-kube-api-access-8rl8f\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:53:47.342358 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:53:47.342325    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9"]
Sep 08 14:53:47.346107 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:53:47.346078    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3bb80f8b-9668d6f79-rbxf9"]
Sep 08 14:53:47.490880 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:53:47.490807    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e246287-9ec8-4575-9353-efd149f5d26f" path="/var/lib/kubelet/pods/9e246287-9ec8-4575-9353-efd149f5d26f/volumes"
Sep 08 14:53:53.564797 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:53:53.564757    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:54:05.572430 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:54:05.572395    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:54:17.779806 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:54:17.779768    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:54:33.199615 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:54:33.199577    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:54:45.872408 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:54:45.872373    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7871-26498f"]
Sep 08 14:54:45.872903 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:54:45.872833    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e246287-9ec8-4575-9353-efd149f5d26f" containerName="maas-api"
Sep 08 14:54:45.872903 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:54:45.872847    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e246287-9ec8-4575-9353-efd149f5d26f" containerName="maas-api"
Sep 08 14:54:45.873087 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:54:45.872929    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e246287-9ec8-4575-9353-efd149f5d26f" containerName="maas-api"
Sep 08 14:54:45.875819 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:54:45.875803    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7871-26498f"
Sep 08 14:54:45.878522 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:54:45.878506    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-2sfkk\""
Sep 08 14:54:45.883953 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:54:45.883917    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7871-26498f"]
Sep 08 14:54:45.907952 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:54:45.907928    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c657g\" (UniqueName: \"kubernetes.io/projected/b44cdcb6-62cd-4bf0-b44f-fb9713a78f97-kube-api-access-c657g\") pod \"mt-curl-7871-26498f\" (UID: \"b44cdcb6-62cd-4bf0-b44f-fb9713a78f97\") " pod="opendatahub/mt-curl-7871-26498f"
Sep 08 14:54:46.009364 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:54:46.009332    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c657g\" (UniqueName: \"kubernetes.io/projected/b44cdcb6-62cd-4bf0-b44f-fb9713a78f97-kube-api-access-c657g\") pod \"mt-curl-7871-26498f\" (UID: \"b44cdcb6-62cd-4bf0-b44f-fb9713a78f97\") " pod="opendatahub/mt-curl-7871-26498f"
Sep 08 14:54:46.018261 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:54:46.018235    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c657g\" (UniqueName: \"kubernetes.io/projected/b44cdcb6-62cd-4bf0-b44f-fb9713a78f97-kube-api-access-c657g\") pod \"mt-curl-7871-26498f\" (UID: \"b44cdcb6-62cd-4bf0-b44f-fb9713a78f97\") " pod="opendatahub/mt-curl-7871-26498f"
Sep 08 14:54:46.187038 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:54:46.187008    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7871-26498f"
Sep 08 14:54:46.461284 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:54:46.460793    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7871-26498f"]
Sep 08 14:54:46.464393 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:54:46.464367    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb44cdcb6_62cd_4bf0_b44f_fb9713a78f97.slice/crio-cdc14ee0b86f57c7644f534abe11403e9d40e1be28b1c407b3d31cffc2db29b4 WatchSource:0}: Error finding container cdc14ee0b86f57c7644f534abe11403e9d40e1be28b1c407b3d31cffc2db29b4: Status 404 returned error can't find the container with id cdc14ee0b86f57c7644f534abe11403e9d40e1be28b1c407b3d31cffc2db29b4
Sep 08 14:54:47.374220 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:54:47.374194    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7871-26498f" event={"ID":"b44cdcb6-62cd-4bf0-b44f-fb9713a78f97","Type":"ContainerStarted","Data":"cdc14ee0b86f57c7644f534abe11403e9d40e1be28b1c407b3d31cffc2db29b4"}
Sep 08 14:54:48.388643 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:54:48.388601    2577 generic.go:356] "Generic (PLEG): container finished" podID="b44cdcb6-62cd-4bf0-b44f-fb9713a78f97" containerID="9ade3000fb22136a6791d837aabbcff3256119a54723a77ede88fc630d59df3f" exitCode=0
Sep 08 14:54:48.389037 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:54:48.388691    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7871-26498f" event={"ID":"b44cdcb6-62cd-4bf0-b44f-fb9713a78f97","Type":"ContainerDied","Data":"9ade3000fb22136a6791d837aabbcff3256119a54723a77ede88fc630d59df3f"}
Sep 08 14:54:49.528858 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:54:49.528838    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7871-26498f"
Sep 08 14:54:49.562313 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:54:49.562285    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7871-26498f_b44cdcb6-62cd-4bf0-b44f-fb9713a78f97/mt-curl-7871-26498f/0.log"
Sep 08 14:54:49.588575 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:54:49.588549    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7871-26498f"]
Sep 08 14:54:49.592622 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:54:49.592591    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7871-26498f"]
Sep 08 14:54:49.642746 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:54:49.642720    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c657g\" (UniqueName: \"kubernetes.io/projected/b44cdcb6-62cd-4bf0-b44f-fb9713a78f97-kube-api-access-c657g\") pod \"b44cdcb6-62cd-4bf0-b44f-fb9713a78f97\" (UID: \"b44cdcb6-62cd-4bf0-b44f-fb9713a78f97\") "
Sep 08 14:54:49.644901 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:54:49.644876    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b44cdcb6-62cd-4bf0-b44f-fb9713a78f97-kube-api-access-c657g" (OuterVolumeSpecName: "kube-api-access-c657g") pod "b44cdcb6-62cd-4bf0-b44f-fb9713a78f97" (UID: "b44cdcb6-62cd-4bf0-b44f-fb9713a78f97"). InnerVolumeSpecName "kube-api-access-c657g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:54:49.744282 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:54:49.744249    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c657g\" (UniqueName: \"kubernetes.io/projected/b44cdcb6-62cd-4bf0-b44f-fb9713a78f97-kube-api-access-c657g\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:54:50.402795 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:54:50.402764    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7871-26498f"
Sep 08 14:54:50.402795 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:54:50.402784    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cdc14ee0b86f57c7644f534abe11403e9d40e1be28b1c407b3d31cffc2db29b4"
Sep 08 14:54:50.414493 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:54:50.414440    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7871-26498f\" is forbidden: User \"system:node:ip-10-0-142-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-20.ec2.internal' and this object" podUID="b44cdcb6-62cd-4bf0-b44f-fb9713a78f97" pod="opendatahub/mt-curl-7871-26498f"
Sep 08 14:54:51.491490 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:54:51.491430    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b44cdcb6-62cd-4bf0-b44f-fb9713a78f97" path="/var/lib/kubelet/pods/b44cdcb6-62cd-4bf0-b44f-fb9713a78f97/volumes"
Sep 08 14:54:51.666608 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:54:51.666576    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:55:02.063899 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:02.063864    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:55:10.966368 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:10.966337    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:55:32.512286 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.512252    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"]
Sep 08 14:55:32.512910 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.512891    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b44cdcb6-62cd-4bf0-b44f-fb9713a78f97" containerName="mt-curl-7871-26498f"
Sep 08 14:55:32.512956 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.512914    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b44cdcb6-62cd-4bf0-b44f-fb9713a78f97" containerName="mt-curl-7871-26498f"
Sep 08 14:55:32.513047 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.513036    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b44cdcb6-62cd-4bf0-b44f-fb9713a78f97" containerName="mt-curl-7871-26498f"
Sep 08 14:55:32.516672 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.516653    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:32.519600 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.519580    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-1145ca-openshift-default-dockercfg-vlnsb\""
Sep 08 14:55:32.528195 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.528170    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"]
Sep 08 14:55:32.627986 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.627955    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87a9dd59-25f5-4635-b7c0-4175320df5c9-istio-token\") pod \"e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") " pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:32.627986 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.627987    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87a9dd59-25f5-4635-b7c0-4175320df5c9-workload-certs\") pod \"e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") " pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:32.628239 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.628016    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87a9dd59-25f5-4635-b7c0-4175320df5c9-istiod-ca-cert\") pod \"e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") " pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:32.628239 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.628073    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87a9dd59-25f5-4635-b7c0-4175320df5c9-istio-envoy\") pod \"e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") " pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:32.628239 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.628100    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87a9dd59-25f5-4635-b7c0-4175320df5c9-workload-socket\") pod \"e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") " pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:32.628239 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.628167    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87a9dd59-25f5-4635-b7c0-4175320df5c9-credential-socket\") pod \"e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") " pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:32.628239 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.628198    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87a9dd59-25f5-4635-b7c0-4175320df5c9-istio-data\") pod \"e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") " pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:32.628239 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.628219    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87a9dd59-25f5-4635-b7c0-4175320df5c9-istio-podinfo\") pod \"e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") " pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:32.628239 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.628235    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pktzk\" (UniqueName: \"kubernetes.io/projected/87a9dd59-25f5-4635-b7c0-4175320df5c9-kube-api-access-pktzk\") pod \"e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") " pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:32.729070 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.729040    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87a9dd59-25f5-4635-b7c0-4175320df5c9-credential-socket\") pod \"e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") " pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:32.729206 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.729075    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87a9dd59-25f5-4635-b7c0-4175320df5c9-istio-data\") pod \"e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") " pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:32.729206 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.729096    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87a9dd59-25f5-4635-b7c0-4175320df5c9-istio-podinfo\") pod \"e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") " pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:32.729206 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.729114    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pktzk\" (UniqueName: \"kubernetes.io/projected/87a9dd59-25f5-4635-b7c0-4175320df5c9-kube-api-access-pktzk\") pod \"e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") " pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:32.729206 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.729179    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87a9dd59-25f5-4635-b7c0-4175320df5c9-istio-token\") pod \"e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") " pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:32.729408 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.729208    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87a9dd59-25f5-4635-b7c0-4175320df5c9-workload-certs\") pod \"e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") " pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:32.729408 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.729238    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87a9dd59-25f5-4635-b7c0-4175320df5c9-istiod-ca-cert\") pod \"e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") " pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:32.729408 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.729279    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87a9dd59-25f5-4635-b7c0-4175320df5c9-istio-envoy\") pod \"e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") " pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:32.729408 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.729325    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87a9dd59-25f5-4635-b7c0-4175320df5c9-workload-socket\") pod \"e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") " pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:32.729625 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.729420    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87a9dd59-25f5-4635-b7c0-4175320df5c9-credential-socket\") pod \"e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") " pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:32.729625 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.729587    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87a9dd59-25f5-4635-b7c0-4175320df5c9-workload-certs\") pod \"e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") " pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:32.729710 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.729694    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87a9dd59-25f5-4635-b7c0-4175320df5c9-workload-socket\") pod \"e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") " pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:32.729950 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.729927    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87a9dd59-25f5-4635-b7c0-4175320df5c9-istiod-ca-cert\") pod \"e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") " pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:32.730035 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.730020    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87a9dd59-25f5-4635-b7c0-4175320df5c9-istio-data\") pod \"e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") " pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:32.731630 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.731612    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87a9dd59-25f5-4635-b7c0-4175320df5c9-istio-envoy\") pod \"e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") " pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:32.731758 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.731742    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87a9dd59-25f5-4635-b7c0-4175320df5c9-istio-podinfo\") pod \"e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") " pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:32.737873 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.737849    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87a9dd59-25f5-4635-b7c0-4175320df5c9-istio-token\") pod \"e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") " pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:32.738155 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.738138    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pktzk\" (UniqueName: \"kubernetes.io/projected/87a9dd59-25f5-4635-b7c0-4175320df5c9-kube-api-access-pktzk\") pod \"e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") " pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:32.827659 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:32.827600    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:33.109166 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:33.109140    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"]
Sep 08 14:55:33.111336 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:55:33.111302    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87a9dd59_25f5_4635_b7c0_4175320df5c9.slice/crio-e0349d7e4dd0ce7f3b8bfd59de8ebbf9b0597aa3b6cc4fa11c3173c914dd8c7e WatchSource:0}: Error finding container e0349d7e4dd0ce7f3b8bfd59de8ebbf9b0597aa3b6cc4fa11c3173c914dd8c7e: Status 404 returned error can't find the container with id e0349d7e4dd0ce7f3b8bfd59de8ebbf9b0597aa3b6cc4fa11c3173c914dd8c7e
Sep 08 14:55:33.113765 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:33.113732    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:55:33.113852 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:33.113796    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:55:33.113852 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:33.113823    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:55:33.668083 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:33.668035    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79" event={"ID":"87a9dd59-25f5-4635-b7c0-4175320df5c9","Type":"ContainerStarted","Data":"8c204d42dbcb81000766e9a62bd0debf1adaa4b59e699a0f21e40c27451ce815"}
Sep 08 14:55:33.668450 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:33.668106    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79" event={"ID":"87a9dd59-25f5-4635-b7c0-4175320df5c9","Type":"ContainerStarted","Data":"e0349d7e4dd0ce7f3b8bfd59de8ebbf9b0597aa3b6cc4fa11c3173c914dd8c7e"}
Sep 08 14:55:33.692854 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:33.692810    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79" podStartSLOduration=1.6927924650000001 podStartE2EDuration="1.692792465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:55:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:55:33.690308521 +0000 UTC m=+1294.728709443" watchObservedRunningTime="2026-09-08 14:55:33.692792465 +0000 UTC m=+1294.731193387"
Sep 08 14:55:33.828546 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:33.828512    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:34.833242 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:34.833212    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:35.680405 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:35.680372    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:35.681140 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:35.681123    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:36.794265 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:36.794235    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr"]
Sep 08 14:55:36.797984 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:36.797963    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr"
Sep 08 14:55:36.800456 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:36.800434    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-1145ca-serving-cert\""
Sep 08 14:55:36.810287 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:36.810266    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr"]
Sep 08 14:55:36.869725 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:36.869695    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b821427-fc1d-48ab-a6c4-34c24c65ce26-maas-api-tls\") pod \"maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr\" (UID: \"2b821427-fc1d-48ab-a6c4-34c24c65ce26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr"
Sep 08 14:55:36.869872 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:36.869734    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frs5x\" (UniqueName: \"kubernetes.io/projected/2b821427-fc1d-48ab-a6c4-34c24c65ce26-kube-api-access-frs5x\") pod \"maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr\" (UID: \"2b821427-fc1d-48ab-a6c4-34c24c65ce26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr"
Sep 08 14:55:36.869872 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:36.869798    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b821427-fc1d-48ab-a6c4-34c24c65ce26-openshift-service-ca\") pod \"maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr\" (UID: \"2b821427-fc1d-48ab-a6c4-34c24c65ce26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr"
Sep 08 14:55:36.869872 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:36.869860    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b821427-fc1d-48ab-a6c4-34c24c65ce26-metrics-certs\") pod \"maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr\" (UID: \"2b821427-fc1d-48ab-a6c4-34c24c65ce26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr"
Sep 08 14:55:36.970545 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:36.970518    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b821427-fc1d-48ab-a6c4-34c24c65ce26-metrics-certs\") pod \"maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr\" (UID: \"2b821427-fc1d-48ab-a6c4-34c24c65ce26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr"
Sep 08 14:55:36.970688 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:36.970581    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b821427-fc1d-48ab-a6c4-34c24c65ce26-maas-api-tls\") pod \"maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr\" (UID: \"2b821427-fc1d-48ab-a6c4-34c24c65ce26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr"
Sep 08 14:55:36.970688 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:36.970606    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frs5x\" (UniqueName: \"kubernetes.io/projected/2b821427-fc1d-48ab-a6c4-34c24c65ce26-kube-api-access-frs5x\") pod \"maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr\" (UID: \"2b821427-fc1d-48ab-a6c4-34c24c65ce26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr"
Sep 08 14:55:36.970688 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:36.970646    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b821427-fc1d-48ab-a6c4-34c24c65ce26-openshift-service-ca\") pod \"maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr\" (UID: \"2b821427-fc1d-48ab-a6c4-34c24c65ce26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr"
Sep 08 14:55:36.971243 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:36.971204    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b821427-fc1d-48ab-a6c4-34c24c65ce26-openshift-service-ca\") pod \"maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr\" (UID: \"2b821427-fc1d-48ab-a6c4-34c24c65ce26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr"
Sep 08 14:55:36.973007 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:36.972984    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b821427-fc1d-48ab-a6c4-34c24c65ce26-maas-api-tls\") pod \"maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr\" (UID: \"2b821427-fc1d-48ab-a6c4-34c24c65ce26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr"
Sep 08 14:55:36.973101 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:36.973044    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b821427-fc1d-48ab-a6c4-34c24c65ce26-metrics-certs\") pod \"maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr\" (UID: \"2b821427-fc1d-48ab-a6c4-34c24c65ce26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr"
Sep 08 14:55:36.978368 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:36.978350    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frs5x\" (UniqueName: \"kubernetes.io/projected/2b821427-fc1d-48ab-a6c4-34c24c65ce26-kube-api-access-frs5x\") pod \"maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr\" (UID: \"2b821427-fc1d-48ab-a6c4-34c24c65ce26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr"
Sep 08 14:55:37.112573 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:37.112501    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr"
Sep 08 14:55:37.389037 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:37.388929    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr"]
Sep 08 14:55:37.390785 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:55:37.390760    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b821427_fc1d_48ab_a6c4_34c24c65ce26.slice/crio-40fd433e49b5c2416c35174aa93dc56596894d7166322b427d02032c8817b697 WatchSource:0}: Error finding container 40fd433e49b5c2416c35174aa93dc56596894d7166322b427d02032c8817b697: Status 404 returned error can't find the container with id 40fd433e49b5c2416c35174aa93dc56596894d7166322b427d02032c8817b697
Sep 08 14:55:37.392162 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:37.392144    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 14:55:37.692651 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:37.692617    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr" event={"ID":"2b821427-fc1d-48ab-a6c4-34c24c65ce26","Type":"ContainerStarted","Data":"40fd433e49b5c2416c35174aa93dc56596894d7166322b427d02032c8817b697"}
Sep 08 14:55:37.777689 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:37.777654    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:55:38.700030 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:38.699989    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr" event={"ID":"2b821427-fc1d-48ab-a6c4-34c24c65ce26","Type":"ContainerStarted","Data":"501c017327b52b33408280fcca23fb9ed3eff9a181d1cbeb5228a313d61d69d1"}
Sep 08 14:55:38.700578 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:38.700127    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr"
Sep 08 14:55:38.719912 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:38.719858    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr" podStartSLOduration=2.154410762 podStartE2EDuration="2.719843221s" totalImagesPullingTime="565.432459ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:55:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:55:38.71753713 +0000 UTC m=+1299.755938051" watchObservedRunningTime="2026-09-08 14:55:38.719843221 +0000 UTC m=+1299.758244142"
Sep 08 14:55:44.713452 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:44.713423    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr"
Sep 08 14:55:56.063652 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:56.063606    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:55:56.810739 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:56.810713    2577 generic.go:356] "Generic (PLEG): container finished" podID="87a9dd59-25f5-4635-b7c0-4175320df5c9" containerID="8c204d42dbcb81000766e9a62bd0debf1adaa4b59e699a0f21e40c27451ce815" exitCode=0
Sep 08 14:55:56.810878 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:56.810775    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79" event={"ID":"87a9dd59-25f5-4635-b7c0-4175320df5c9","Type":"ContainerDied","Data":"8c204d42dbcb81000766e9a62bd0debf1adaa4b59e699a0f21e40c27451ce815"}
Sep 08 14:55:56.811181 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:56.811167    2577 scope.go:117] "RemoveContainer" containerID="8c204d42dbcb81000766e9a62bd0debf1adaa4b59e699a0f21e40c27451ce815"
Sep 08 14:55:56.812278 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:56.812246    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:55:56.812356 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:56.812325    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:55:56.812396 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:56.812363    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:55:57.822436 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:57.822391    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79" event={"ID":"87a9dd59-25f5-4635-b7c0-4175320df5c9","Type":"ContainerStarted","Data":"8a333a614bba399a6192ecab1dd641b36cf498aa76d270e64d2730eaaab3f58e"}
Sep 08 14:55:57.828502 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:57.828456    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:55:57.828696 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:57.828599    2577 patch_prober.go:28] interesting pod/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 08 14:55:57.828696 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:57.828647    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79" podUID="87a9dd59-25f5-4635-b7c0-4175320df5c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 08 14:55:58.828133 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:58.828097    2577 patch_prober.go:28] interesting pod/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 08 14:55:58.828719 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:58.828686    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79" podUID="87a9dd59-25f5-4635-b7c0-4175320df5c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 08 14:55:59.828886 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:59.828848    2577 patch_prober.go:28] interesting pod/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 08 14:55:59.829544 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:55:59.829510    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79" podUID="87a9dd59-25f5-4635-b7c0-4175320df5c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 08 14:56:00.828841 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:00.828795    2577 patch_prober.go:28] interesting pod/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 08 14:56:00.829057 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:00.828900    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79" podUID="87a9dd59-25f5-4635-b7c0-4175320df5c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 08 14:56:01.828938 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:01.828893    2577 patch_prober.go:28] interesting pod/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 08 14:56:01.829141 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:01.828989    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79" podUID="87a9dd59-25f5-4635-b7c0-4175320df5c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 08 14:56:03.019210 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:03.019124    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:56:03.019810 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:03.019784    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:56:03.020964 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:03.020948    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:56:15.465798 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:15.465763    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:56:19.270818 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:19.270782    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7871-ec0028"]
Sep 08 14:56:19.275589 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:19.275573    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7871-ec0028"
Sep 08 14:56:19.278547 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:19.278521    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-2sfkk\""
Sep 08 14:56:19.280506 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:19.280482    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7871-ec0028"]
Sep 08 14:56:19.369177 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:19.369134    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwq7b\" (UniqueName: \"kubernetes.io/projected/fc3e0bc5-34e5-4762-aad7-286aae08470d-kube-api-access-kwq7b\") pod \"mt-curl-7871-ec0028\" (UID: \"fc3e0bc5-34e5-4762-aad7-286aae08470d\") " pod="opendatahub/mt-curl-7871-ec0028"
Sep 08 14:56:19.470448 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:19.470412    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwq7b\" (UniqueName: \"kubernetes.io/projected/fc3e0bc5-34e5-4762-aad7-286aae08470d-kube-api-access-kwq7b\") pod \"mt-curl-7871-ec0028\" (UID: \"fc3e0bc5-34e5-4762-aad7-286aae08470d\") " pod="opendatahub/mt-curl-7871-ec0028"
Sep 08 14:56:19.478972 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:19.478942    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwq7b\" (UniqueName: \"kubernetes.io/projected/fc3e0bc5-34e5-4762-aad7-286aae08470d-kube-api-access-kwq7b\") pod \"mt-curl-7871-ec0028\" (UID: \"fc3e0bc5-34e5-4762-aad7-286aae08470d\") " pod="opendatahub/mt-curl-7871-ec0028"
Sep 08 14:56:19.588168 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:19.588061    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7871-ec0028"
Sep 08 14:56:19.860030 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:19.859992    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7871-ec0028"]
Sep 08 14:56:19.861939 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:56:19.861905    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc3e0bc5_34e5_4762_aad7_286aae08470d.slice/crio-a9b36028159859a7e072b52d4b74f1ecf8bec329b7f3290872b5761595a95010 WatchSource:0}: Error finding container a9b36028159859a7e072b52d4b74f1ecf8bec329b7f3290872b5761595a95010: Status 404 returned error can't find the container with id a9b36028159859a7e072b52d4b74f1ecf8bec329b7f3290872b5761595a95010
Sep 08 14:56:19.965049 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:19.965008    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7871-ec0028" event={"ID":"fc3e0bc5-34e5-4762-aad7-286aae08470d","Type":"ContainerStarted","Data":"a9b36028159859a7e072b52d4b74f1ecf8bec329b7f3290872b5761595a95010"}
Sep 08 14:56:20.972991 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:20.972953    2577 generic.go:356] "Generic (PLEG): container finished" podID="fc3e0bc5-34e5-4762-aad7-286aae08470d" containerID="536de3b53f8b21ebf64a932c485e2badc0ede7c5bed2b60b9d8120f9338b41e3" exitCode=0
Sep 08 14:56:20.973381 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:20.973004    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7871-ec0028" event={"ID":"fc3e0bc5-34e5-4762-aad7-286aae08470d","Type":"ContainerDied","Data":"536de3b53f8b21ebf64a932c485e2badc0ede7c5bed2b60b9d8120f9338b41e3"}
Sep 08 14:56:22.115336 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:22.115307    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7871-ec0028"
Sep 08 14:56:22.148938 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:22.148915    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7871-ec0028_fc3e0bc5-34e5-4762-aad7-286aae08470d/mt-curl-7871-ec0028/0.log"
Sep 08 14:56:22.173439 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:22.173405    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7871-ec0028"]
Sep 08 14:56:22.177129 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:22.177107    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7871-ec0028"]
Sep 08 14:56:22.195909 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:22.195886    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwq7b\" (UniqueName: \"kubernetes.io/projected/fc3e0bc5-34e5-4762-aad7-286aae08470d-kube-api-access-kwq7b\") pod \"fc3e0bc5-34e5-4762-aad7-286aae08470d\" (UID: \"fc3e0bc5-34e5-4762-aad7-286aae08470d\") "
Sep 08 14:56:22.198067 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:22.198043    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc3e0bc5-34e5-4762-aad7-286aae08470d-kube-api-access-kwq7b" (OuterVolumeSpecName: "kube-api-access-kwq7b") pod "fc3e0bc5-34e5-4762-aad7-286aae08470d" (UID: "fc3e0bc5-34e5-4762-aad7-286aae08470d"). InnerVolumeSpecName "kube-api-access-kwq7b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:56:22.296014 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:22.295943    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7871-98bf03"]
Sep 08 14:56:22.296415 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:22.296403    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc3e0bc5-34e5-4762-aad7-286aae08470d" containerName="mt-curl-7871-ec0028"
Sep 08 14:56:22.296464 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:22.296417    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc3e0bc5-34e5-4762-aad7-286aae08470d" containerName="mt-curl-7871-ec0028"
Sep 08 14:56:22.296527 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:22.296490    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc3e0bc5-34e5-4762-aad7-286aae08470d" containerName="mt-curl-7871-ec0028"
Sep 08 14:56:22.298985 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:22.298945    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwq7b\" (UniqueName: \"kubernetes.io/projected/fc3e0bc5-34e5-4762-aad7-286aae08470d-kube-api-access-kwq7b\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:56:22.305621 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:22.305165    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7871-98bf03"
Sep 08 14:56:22.308622 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:22.308596    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7871-98bf03"]
Sep 08 14:56:22.400270 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:22.400233    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db8g6\" (UniqueName: \"kubernetes.io/projected/c0b9de4b-b8b4-4783-b2d6-b2464ad14258-kube-api-access-db8g6\") pod \"mt-curl-7871-98bf03\" (UID: \"c0b9de4b-b8b4-4783-b2d6-b2464ad14258\") " pod="opendatahub/mt-curl-7871-98bf03"
Sep 08 14:56:22.501516 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:22.501456    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db8g6\" (UniqueName: \"kubernetes.io/projected/c0b9de4b-b8b4-4783-b2d6-b2464ad14258-kube-api-access-db8g6\") pod \"mt-curl-7871-98bf03\" (UID: \"c0b9de4b-b8b4-4783-b2d6-b2464ad14258\") " pod="opendatahub/mt-curl-7871-98bf03"
Sep 08 14:56:22.510814 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:22.510768    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-db8g6\" (UniqueName: \"kubernetes.io/projected/c0b9de4b-b8b4-4783-b2d6-b2464ad14258-kube-api-access-db8g6\") pod \"mt-curl-7871-98bf03\" (UID: \"c0b9de4b-b8b4-4783-b2d6-b2464ad14258\") " pod="opendatahub/mt-curl-7871-98bf03"
Sep 08 14:56:22.619143 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:22.619064    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7871-98bf03"
Sep 08 14:56:22.894458 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:22.894383    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7871-98bf03"]
Sep 08 14:56:22.897737 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:56:22.897710    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0b9de4b_b8b4_4783_b2d6_b2464ad14258.slice/crio-9b474340af6dd09a6c876e114506057d30f7232d4b3bd6b0092a481b15b6827c WatchSource:0}: Error finding container 9b474340af6dd09a6c876e114506057d30f7232d4b3bd6b0092a481b15b6827c: Status 404 returned error can't find the container with id 9b474340af6dd09a6c876e114506057d30f7232d4b3bd6b0092a481b15b6827c
Sep 08 14:56:22.987322 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:22.987289    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7871-98bf03" event={"ID":"c0b9de4b-b8b4-4783-b2d6-b2464ad14258","Type":"ContainerStarted","Data":"9b474340af6dd09a6c876e114506057d30f7232d4b3bd6b0092a481b15b6827c"}
Sep 08 14:56:22.988679 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:22.988657    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9b36028159859a7e072b52d4b74f1ecf8bec329b7f3290872b5761595a95010"
Sep 08 14:56:22.988679 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:22.988673    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7871-ec0028"
Sep 08 14:56:22.999582 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:56:22.999559    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7871-ec0028\" is forbidden: User \"system:node:ip-10-0-142-20.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-20.ec2.internal' and this object" podUID="fc3e0bc5-34e5-4762-aad7-286aae08470d" pod="opendatahub/mt-curl-7871-ec0028"
Sep 08 14:56:23.492722 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:23.492629    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc3e0bc5-34e5-4762-aad7-286aae08470d" path="/var/lib/kubelet/pods/fc3e0bc5-34e5-4762-aad7-286aae08470d/volumes"
Sep 08 14:56:23.997458 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:23.997423    2577 generic.go:356] "Generic (PLEG): container finished" podID="c0b9de4b-b8b4-4783-b2d6-b2464ad14258" containerID="59f8eba9b5d55aebe0916addcf456473917e9c7ef4b7530e105c878a3b32b2e7" exitCode=0
Sep 08 14:56:23.997658 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:23.997515    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7871-98bf03" event={"ID":"c0b9de4b-b8b4-4783-b2d6-b2464ad14258","Type":"ContainerDied","Data":"59f8eba9b5d55aebe0916addcf456473917e9c7ef4b7530e105c878a3b32b2e7"}
Sep 08 14:56:25.147743 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:25.147723    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7871-98bf03"
Sep 08 14:56:25.170224 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:25.170199    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7871-98bf03_c0b9de4b-b8b4-4783-b2d6-b2464ad14258/mt-curl-7871-98bf03/0.log"
Sep 08 14:56:25.194944 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:25.194920    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7871-98bf03"]
Sep 08 14:56:25.197590 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:25.197571    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7871-98bf03"]
Sep 08 14:56:25.227766 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:25.227745    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-db8g6\" (UniqueName: \"kubernetes.io/projected/c0b9de4b-b8b4-4783-b2d6-b2464ad14258-kube-api-access-db8g6\") pod \"c0b9de4b-b8b4-4783-b2d6-b2464ad14258\" (UID: \"c0b9de4b-b8b4-4783-b2d6-b2464ad14258\") "
Sep 08 14:56:25.229946 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:25.229916    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0b9de4b-b8b4-4783-b2d6-b2464ad14258-kube-api-access-db8g6" (OuterVolumeSpecName: "kube-api-access-db8g6") pod "c0b9de4b-b8b4-4783-b2d6-b2464ad14258" (UID: "c0b9de4b-b8b4-4783-b2d6-b2464ad14258"). InnerVolumeSpecName "kube-api-access-db8g6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:56:25.329232 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:25.329140    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-db8g6\" (UniqueName: \"kubernetes.io/projected/c0b9de4b-b8b4-4783-b2d6-b2464ad14258-kube-api-access-db8g6\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:56:25.491826 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:25.491784    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0b9de4b-b8b4-4783-b2d6-b2464ad14258" path="/var/lib/kubelet/pods/c0b9de4b-b8b4-4783-b2d6-b2464ad14258/volumes"
Sep 08 14:56:26.010422 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:26.010398    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7871-98bf03"
Sep 08 14:56:26.010642 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:26.010460    2577 scope.go:117] "RemoveContainer" containerID="59f8eba9b5d55aebe0916addcf456473917e9c7ef4b7530e105c878a3b32b2e7"
Sep 08 14:56:31.557584 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:31.557547    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:56:47.182701 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:47.182666    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:56:47.782456 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:47.782423    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr"]
Sep 08 14:56:47.782713 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:47.782683    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr" podUID="2b821427-fc1d-48ab-a6c4-34c24c65ce26" containerName="maas-api" containerID="cri-o://501c017327b52b33408280fcca23fb9ed3eff9a181d1cbeb5228a313d61d69d1" gracePeriod=30
Sep 08 14:56:48.041389 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:48.041330    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr"
Sep 08 14:56:48.149869 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:48.149829    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frs5x\" (UniqueName: \"kubernetes.io/projected/2b821427-fc1d-48ab-a6c4-34c24c65ce26-kube-api-access-frs5x\") pod \"2b821427-fc1d-48ab-a6c4-34c24c65ce26\" (UID: \"2b821427-fc1d-48ab-a6c4-34c24c65ce26\") "
Sep 08 14:56:48.150067 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:48.149879    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b821427-fc1d-48ab-a6c4-34c24c65ce26-metrics-certs\") pod \"2b821427-fc1d-48ab-a6c4-34c24c65ce26\" (UID: \"2b821427-fc1d-48ab-a6c4-34c24c65ce26\") "
Sep 08 14:56:48.150067 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:48.149930    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b821427-fc1d-48ab-a6c4-34c24c65ce26-maas-api-tls\") pod \"2b821427-fc1d-48ab-a6c4-34c24c65ce26\" (UID: \"2b821427-fc1d-48ab-a6c4-34c24c65ce26\") "
Sep 08 14:56:48.150067 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:48.149980    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b821427-fc1d-48ab-a6c4-34c24c65ce26-openshift-service-ca\") pod \"2b821427-fc1d-48ab-a6c4-34c24c65ce26\" (UID: \"2b821427-fc1d-48ab-a6c4-34c24c65ce26\") "
Sep 08 14:56:48.150716 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:48.150687    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b821427-fc1d-48ab-a6c4-34c24c65ce26-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2b821427-fc1d-48ab-a6c4-34c24c65ce26" (UID: "2b821427-fc1d-48ab-a6c4-34c24c65ce26"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:56:48.153909 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:48.152667    2577 generic.go:356] "Generic (PLEG): container finished" podID="2b821427-fc1d-48ab-a6c4-34c24c65ce26" containerID="501c017327b52b33408280fcca23fb9ed3eff9a181d1cbeb5228a313d61d69d1" exitCode=0
Sep 08 14:56:48.153909 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:48.152757    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr" event={"ID":"2b821427-fc1d-48ab-a6c4-34c24c65ce26","Type":"ContainerDied","Data":"501c017327b52b33408280fcca23fb9ed3eff9a181d1cbeb5228a313d61d69d1"}
Sep 08 14:56:48.153909 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:48.152811    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr" event={"ID":"2b821427-fc1d-48ab-a6c4-34c24c65ce26","Type":"ContainerDied","Data":"40fd433e49b5c2416c35174aa93dc56596894d7166322b427d02032c8817b697"}
Sep 08 14:56:48.153909 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:48.152846    2577 scope.go:117] "RemoveContainer" containerID="501c017327b52b33408280fcca23fb9ed3eff9a181d1cbeb5228a313d61d69d1"
Sep 08 14:56:48.153909 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:48.153021    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr"
Sep 08 14:56:48.153909 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:48.153126    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b821427-fc1d-48ab-a6c4-34c24c65ce26-kube-api-access-frs5x" (OuterVolumeSpecName: "kube-api-access-frs5x") pod "2b821427-fc1d-48ab-a6c4-34c24c65ce26" (UID: "2b821427-fc1d-48ab-a6c4-34c24c65ce26"). InnerVolumeSpecName "kube-api-access-frs5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:56:48.155118 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:48.154422    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b821427-fc1d-48ab-a6c4-34c24c65ce26-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2b821427-fc1d-48ab-a6c4-34c24c65ce26" (UID: "2b821427-fc1d-48ab-a6c4-34c24c65ce26"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:56:48.155118 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:48.154538    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b821427-fc1d-48ab-a6c4-34c24c65ce26-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2b821427-fc1d-48ab-a6c4-34c24c65ce26" (UID: "2b821427-fc1d-48ab-a6c4-34c24c65ce26"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:56:48.174886 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:48.174858    2577 scope.go:117] "RemoveContainer" containerID="501c017327b52b33408280fcca23fb9ed3eff9a181d1cbeb5228a313d61d69d1"
Sep 08 14:56:48.175214 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:56:48.175192    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"501c017327b52b33408280fcca23fb9ed3eff9a181d1cbeb5228a313d61d69d1\": container with ID starting with 501c017327b52b33408280fcca23fb9ed3eff9a181d1cbeb5228a313d61d69d1 not found: ID does not exist" containerID="501c017327b52b33408280fcca23fb9ed3eff9a181d1cbeb5228a313d61d69d1"
Sep 08 14:56:48.175288 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:48.175226    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"501c017327b52b33408280fcca23fb9ed3eff9a181d1cbeb5228a313d61d69d1"} err="failed to get container status \"501c017327b52b33408280fcca23fb9ed3eff9a181d1cbeb5228a313d61d69d1\": rpc error: code = NotFound desc = could not find container \"501c017327b52b33408280fcca23fb9ed3eff9a181d1cbeb5228a313d61d69d1\": container with ID starting with 501c017327b52b33408280fcca23fb9ed3eff9a181d1cbeb5228a313d61d69d1 not found: ID does not exist"
Sep 08 14:56:48.251763 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:48.251734    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frs5x\" (UniqueName: \"kubernetes.io/projected/2b821427-fc1d-48ab-a6c4-34c24c65ce26-kube-api-access-frs5x\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:56:48.251763 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:48.251757    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b821427-fc1d-48ab-a6c4-34c24c65ce26-metrics-certs\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:56:48.251763 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:48.251766    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b821427-fc1d-48ab-a6c4-34c24c65ce26-maas-api-tls\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:56:48.252145 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:48.251774    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b821427-fc1d-48ab-a6c4-34c24c65ce26-openshift-service-ca\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:56:48.475947 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:48.475917    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr"]
Sep 08 14:56:48.479062 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:48.479038    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1145ca-7c797c78b6-fztxr"]
Sep 08 14:56:49.491134 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:49.491088    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b821427-fc1d-48ab-a6c4-34c24c65ce26" path="/var/lib/kubelet/pods/2b821427-fc1d-48ab-a6c4-34c24c65ce26/volumes"
Sep 08 14:56:54.574798 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:54.574764    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"]
Sep 08 14:56:54.575382 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:54.574990    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79" podUID="87a9dd59-25f5-4635-b7c0-4175320df5c9" containerName="istio-proxy" containerID="cri-o://8a333a614bba399a6192ecab1dd641b36cf498aa76d270e64d2730eaaab3f58e" gracePeriod=30
Sep 08 14:56:59.062421 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:59.062383    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:56:59.834991 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:59.834964    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:56:59.849961 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:59.847128    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87a9dd59-25f5-4635-b7c0-4175320df5c9-istio-envoy\") pod \"87a9dd59-25f5-4635-b7c0-4175320df5c9\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") "
Sep 08 14:56:59.849961 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:59.847170    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87a9dd59-25f5-4635-b7c0-4175320df5c9-credential-socket\") pod \"87a9dd59-25f5-4635-b7c0-4175320df5c9\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") "
Sep 08 14:56:59.849961 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:59.847210    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87a9dd59-25f5-4635-b7c0-4175320df5c9-istio-podinfo\") pod \"87a9dd59-25f5-4635-b7c0-4175320df5c9\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") "
Sep 08 14:56:59.849961 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:59.847268    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87a9dd59-25f5-4635-b7c0-4175320df5c9-workload-certs\") pod \"87a9dd59-25f5-4635-b7c0-4175320df5c9\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") "
Sep 08 14:56:59.849961 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:59.847493    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87a9dd59-25f5-4635-b7c0-4175320df5c9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "87a9dd59-25f5-4635-b7c0-4175320df5c9" (UID: "87a9dd59-25f5-4635-b7c0-4175320df5c9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:56:59.849961 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:59.847595    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87a9dd59-25f5-4635-b7c0-4175320df5c9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "87a9dd59-25f5-4635-b7c0-4175320df5c9" (UID: "87a9dd59-25f5-4635-b7c0-4175320df5c9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:56:59.849961 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:59.847641    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87a9dd59-25f5-4635-b7c0-4175320df5c9-istio-data\") pod \"87a9dd59-25f5-4635-b7c0-4175320df5c9\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") "
Sep 08 14:56:59.849961 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:59.847700    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87a9dd59-25f5-4635-b7c0-4175320df5c9-istio-data" (OuterVolumeSpecName: "istio-data") pod "87a9dd59-25f5-4635-b7c0-4175320df5c9" (UID: "87a9dd59-25f5-4635-b7c0-4175320df5c9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:56:59.849961 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:59.847719    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87a9dd59-25f5-4635-b7c0-4175320df5c9-istiod-ca-cert\") pod \"87a9dd59-25f5-4635-b7c0-4175320df5c9\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") "
Sep 08 14:56:59.849961 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:59.847761    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87a9dd59-25f5-4635-b7c0-4175320df5c9-workload-socket\") pod \"87a9dd59-25f5-4635-b7c0-4175320df5c9\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") "
Sep 08 14:56:59.849961 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:59.847787    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pktzk\" (UniqueName: \"kubernetes.io/projected/87a9dd59-25f5-4635-b7c0-4175320df5c9-kube-api-access-pktzk\") pod \"87a9dd59-25f5-4635-b7c0-4175320df5c9\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") "
Sep 08 14:56:59.849961 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:59.847819    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87a9dd59-25f5-4635-b7c0-4175320df5c9-istio-token\") pod \"87a9dd59-25f5-4635-b7c0-4175320df5c9\" (UID: \"87a9dd59-25f5-4635-b7c0-4175320df5c9\") "
Sep 08 14:56:59.849961 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:59.847987    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87a9dd59-25f5-4635-b7c0-4175320df5c9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "87a9dd59-25f5-4635-b7c0-4175320df5c9" (UID: "87a9dd59-25f5-4635-b7c0-4175320df5c9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:56:59.849961 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:59.848263    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87a9dd59-25f5-4635-b7c0-4175320df5c9-workload-socket\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:56:59.849961 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:59.848282    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87a9dd59-25f5-4635-b7c0-4175320df5c9-credential-socket\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:56:59.849961 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:59.848300    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87a9dd59-25f5-4635-b7c0-4175320df5c9-workload-certs\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:56:59.849961 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:59.848314    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87a9dd59-25f5-4635-b7c0-4175320df5c9-istio-data\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:56:59.849961 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:59.848322    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87a9dd59-25f5-4635-b7c0-4175320df5c9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "87a9dd59-25f5-4635-b7c0-4175320df5c9" (UID: "87a9dd59-25f5-4635-b7c0-4175320df5c9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:56:59.850998 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:59.850699    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/87a9dd59-25f5-4635-b7c0-4175320df5c9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "87a9dd59-25f5-4635-b7c0-4175320df5c9" (UID: "87a9dd59-25f5-4635-b7c0-4175320df5c9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:56:59.850998 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:59.850843    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87a9dd59-25f5-4635-b7c0-4175320df5c9-kube-api-access-pktzk" (OuterVolumeSpecName: "kube-api-access-pktzk") pod "87a9dd59-25f5-4635-b7c0-4175320df5c9" (UID: "87a9dd59-25f5-4635-b7c0-4175320df5c9"). InnerVolumeSpecName "kube-api-access-pktzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:56:59.851239 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:59.851216    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87a9dd59-25f5-4635-b7c0-4175320df5c9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "87a9dd59-25f5-4635-b7c0-4175320df5c9" (UID: "87a9dd59-25f5-4635-b7c0-4175320df5c9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:56:59.851512 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:59.851490    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87a9dd59-25f5-4635-b7c0-4175320df5c9-istio-token" (OuterVolumeSpecName: "istio-token") pod "87a9dd59-25f5-4635-b7c0-4175320df5c9" (UID: "87a9dd59-25f5-4635-b7c0-4175320df5c9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:56:59.949888 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:59.949852    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87a9dd59-25f5-4635-b7c0-4175320df5c9-istiod-ca-cert\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:56:59.949888 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:59.949884    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pktzk\" (UniqueName: \"kubernetes.io/projected/87a9dd59-25f5-4635-b7c0-4175320df5c9-kube-api-access-pktzk\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:56:59.949888 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:59.949894    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87a9dd59-25f5-4635-b7c0-4175320df5c9-istio-token\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:56:59.950117 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:59.949902    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87a9dd59-25f5-4635-b7c0-4175320df5c9-istio-envoy\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:56:59.950117 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:56:59.949911    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87a9dd59-25f5-4635-b7c0-4175320df5c9-istio-podinfo\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:57:00.237752 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:00.237720    2577 generic.go:356] "Generic (PLEG): container finished" podID="87a9dd59-25f5-4635-b7c0-4175320df5c9" containerID="8a333a614bba399a6192ecab1dd641b36cf498aa76d270e64d2730eaaab3f58e" exitCode=0
Sep 08 14:57:00.238217 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:00.237764    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"
Sep 08 14:57:00.238217 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:00.237807    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79" event={"ID":"87a9dd59-25f5-4635-b7c0-4175320df5c9","Type":"ContainerDied","Data":"8a333a614bba399a6192ecab1dd641b36cf498aa76d270e64d2730eaaab3f58e"}
Sep 08 14:57:00.238217 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:00.237868    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79" event={"ID":"87a9dd59-25f5-4635-b7c0-4175320df5c9","Type":"ContainerDied","Data":"e0349d7e4dd0ce7f3b8bfd59de8ebbf9b0597aa3b6cc4fa11c3173c914dd8c7e"}
Sep 08 14:57:00.238217 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:00.237904    2577 scope.go:117] "RemoveContainer" containerID="8a333a614bba399a6192ecab1dd641b36cf498aa76d270e64d2730eaaab3f58e"
Sep 08 14:57:00.248103 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:00.248087    2577 scope.go:117] "RemoveContainer" containerID="8c204d42dbcb81000766e9a62bd0debf1adaa4b59e699a0f21e40c27451ce815"
Sep 08 14:57:00.256676 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:00.256660    2577 scope.go:117] "RemoveContainer" containerID="8a333a614bba399a6192ecab1dd641b36cf498aa76d270e64d2730eaaab3f58e"
Sep 08 14:57:00.256936 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:57:00.256917    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a333a614bba399a6192ecab1dd641b36cf498aa76d270e64d2730eaaab3f58e\": container with ID starting with 8a333a614bba399a6192ecab1dd641b36cf498aa76d270e64d2730eaaab3f58e not found: ID does not exist" containerID="8a333a614bba399a6192ecab1dd641b36cf498aa76d270e64d2730eaaab3f58e"
Sep 08 14:57:00.256983 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:00.256947    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a333a614bba399a6192ecab1dd641b36cf498aa76d270e64d2730eaaab3f58e"} err="failed to get container status \"8a333a614bba399a6192ecab1dd641b36cf498aa76d270e64d2730eaaab3f58e\": rpc error: code = NotFound desc = could not find container \"8a333a614bba399a6192ecab1dd641b36cf498aa76d270e64d2730eaaab3f58e\": container with ID starting with 8a333a614bba399a6192ecab1dd641b36cf498aa76d270e64d2730eaaab3f58e not found: ID does not exist"
Sep 08 14:57:00.256983 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:00.256964    2577 scope.go:117] "RemoveContainer" containerID="8c204d42dbcb81000766e9a62bd0debf1adaa4b59e699a0f21e40c27451ce815"
Sep 08 14:57:00.257200 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:57:00.257182    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c204d42dbcb81000766e9a62bd0debf1adaa4b59e699a0f21e40c27451ce815\": container with ID starting with 8c204d42dbcb81000766e9a62bd0debf1adaa4b59e699a0f21e40c27451ce815 not found: ID does not exist" containerID="8c204d42dbcb81000766e9a62bd0debf1adaa4b59e699a0f21e40c27451ce815"
Sep 08 14:57:00.257263 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:00.257207    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c204d42dbcb81000766e9a62bd0debf1adaa4b59e699a0f21e40c27451ce815"} err="failed to get container status \"8c204d42dbcb81000766e9a62bd0debf1adaa4b59e699a0f21e40c27451ce815\": rpc error: code = NotFound desc = could not find container \"8c204d42dbcb81000766e9a62bd0debf1adaa4b59e699a0f21e40c27451ce815\": container with ID starting with 8c204d42dbcb81000766e9a62bd0debf1adaa4b59e699a0f21e40c27451ce815 not found: ID does not exist"
Sep 08 14:57:00.260707 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:00.260685    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"]
Sep 08 14:57:00.266794 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:00.266775    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-1145ca-openshift-default-6dffb6f6d6-wxl79"]
Sep 08 14:57:01.491601 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:01.491569    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87a9dd59-25f5-4635-b7c0-4175320df5c9" path="/var/lib/kubelet/pods/87a9dd59-25f5-4635-b7c0-4175320df5c9/volumes"
Sep 08 14:57:16.470678 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:16.470636    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:57:28.171939 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:28.171898    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f"]
Sep 08 14:57:28.172358 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:28.172096    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f" podUID="f736e0af-f837-4e67-95db-3ec971055ce1" containerName="maas-api" containerID="cri-o://2ee335075003d43c1fb6792b3c76a6255574c6bcb8215fee2df99dcf440aec38" gracePeriod=30
Sep 08 14:57:28.179829 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:28.179785    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:57:28.403993 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:28.403959    2577 generic.go:356] "Generic (PLEG): container finished" podID="f736e0af-f837-4e67-95db-3ec971055ce1" containerID="2ee335075003d43c1fb6792b3c76a6255574c6bcb8215fee2df99dcf440aec38" exitCode=0
Sep 08 14:57:28.404148 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:28.404042    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f" event={"ID":"f736e0af-f837-4e67-95db-3ec971055ce1","Type":"ContainerDied","Data":"2ee335075003d43c1fb6792b3c76a6255574c6bcb8215fee2df99dcf440aec38"}
Sep 08 14:57:28.426714 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:28.426656    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f"
Sep 08 14:57:28.519583 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:28.519550    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f736e0af-f837-4e67-95db-3ec971055ce1-maas-api-tls\") pod \"f736e0af-f837-4e67-95db-3ec971055ce1\" (UID: \"f736e0af-f837-4e67-95db-3ec971055ce1\") "
Sep 08 14:57:28.519583 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:28.519588    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mh4wc\" (UniqueName: \"kubernetes.io/projected/f736e0af-f837-4e67-95db-3ec971055ce1-kube-api-access-mh4wc\") pod \"f736e0af-f837-4e67-95db-3ec971055ce1\" (UID: \"f736e0af-f837-4e67-95db-3ec971055ce1\") "
Sep 08 14:57:28.519830 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:28.519627    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f736e0af-f837-4e67-95db-3ec971055ce1-openshift-service-ca\") pod \"f736e0af-f837-4e67-95db-3ec971055ce1\" (UID: \"f736e0af-f837-4e67-95db-3ec971055ce1\") "
Sep 08 14:57:28.519830 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:28.519759    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f736e0af-f837-4e67-95db-3ec971055ce1-metrics-certs\") pod \"f736e0af-f837-4e67-95db-3ec971055ce1\" (UID: \"f736e0af-f837-4e67-95db-3ec971055ce1\") "
Sep 08 14:57:28.520064 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:28.520035    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f736e0af-f837-4e67-95db-3ec971055ce1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f736e0af-f837-4e67-95db-3ec971055ce1" (UID: "f736e0af-f837-4e67-95db-3ec971055ce1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:57:28.522043 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:28.522010    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f736e0af-f837-4e67-95db-3ec971055ce1-kube-api-access-mh4wc" (OuterVolumeSpecName: "kube-api-access-mh4wc") pod "f736e0af-f837-4e67-95db-3ec971055ce1" (UID: "f736e0af-f837-4e67-95db-3ec971055ce1"). InnerVolumeSpecName "kube-api-access-mh4wc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:57:28.522043 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:28.522019    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f736e0af-f837-4e67-95db-3ec971055ce1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f736e0af-f837-4e67-95db-3ec971055ce1" (UID: "f736e0af-f837-4e67-95db-3ec971055ce1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:57:28.522043 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:28.522028    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f736e0af-f837-4e67-95db-3ec971055ce1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f736e0af-f837-4e67-95db-3ec971055ce1" (UID: "f736e0af-f837-4e67-95db-3ec971055ce1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:57:28.621518 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:28.621489    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f736e0af-f837-4e67-95db-3ec971055ce1-openshift-service-ca\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:57:28.621518 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:28.621515    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f736e0af-f837-4e67-95db-3ec971055ce1-metrics-certs\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:57:28.621518 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:28.621524    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f736e0af-f837-4e67-95db-3ec971055ce1-maas-api-tls\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:57:28.621738 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:28.621533    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mh4wc\" (UniqueName: \"kubernetes.io/projected/f736e0af-f837-4e67-95db-3ec971055ce1-kube-api-access-mh4wc\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:57:29.413492 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:29.413434    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f"
Sep 08 14:57:29.413492 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:29.413454    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f" event={"ID":"f736e0af-f837-4e67-95db-3ec971055ce1","Type":"ContainerDied","Data":"3559cfbf9c74863d25dde3c5e9d79dcf2e85b8a218f816400caf37afc1dbb7ae"}
Sep 08 14:57:29.414032 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:29.413547    2577 scope.go:117] "RemoveContainer" containerID="2ee335075003d43c1fb6792b3c76a6255574c6bcb8215fee2df99dcf440aec38"
Sep 08 14:57:29.435867 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:29.435841    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f"]
Sep 08 14:57:29.439550 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:29.439517    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-11dfb4-6dd6c99fd-frm9f"]
Sep 08 14:57:29.491925 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:29.491896    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f736e0af-f837-4e67-95db-3ec971055ce1" path="/var/lib/kubelet/pods/f736e0af-f837-4e67-95db-3ec971055ce1/volumes"
Sep 08 14:57:40.955860 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:40.955826    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:57:45.845287 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:45.845248    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5"]
Sep 08 14:57:45.845803 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:45.845513    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5" podUID="be78af7a-a8ff-45fc-adaf-ef5368012990" containerName="maas-api" containerID="cri-o://7483b15b67ee76517ed198b380aff38d6ff3003fde2913c83f296f32439cd0c1" gracePeriod=30
Sep 08 14:57:46.110581 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:46.110519    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5"
Sep 08 14:57:46.173031 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:46.173005    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be78af7a-a8ff-45fc-adaf-ef5368012990-metrics-certs\") pod \"be78af7a-a8ff-45fc-adaf-ef5368012990\" (UID: \"be78af7a-a8ff-45fc-adaf-ef5368012990\") "
Sep 08 14:57:46.173196 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:46.173062    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t88vt\" (UniqueName: \"kubernetes.io/projected/be78af7a-a8ff-45fc-adaf-ef5368012990-kube-api-access-t88vt\") pod \"be78af7a-a8ff-45fc-adaf-ef5368012990\" (UID: \"be78af7a-a8ff-45fc-adaf-ef5368012990\") "
Sep 08 14:57:46.173196 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:46.173091    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be78af7a-a8ff-45fc-adaf-ef5368012990-openshift-service-ca\") pod \"be78af7a-a8ff-45fc-adaf-ef5368012990\" (UID: \"be78af7a-a8ff-45fc-adaf-ef5368012990\") "
Sep 08 14:57:46.173196 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:46.173134    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be78af7a-a8ff-45fc-adaf-ef5368012990-maas-api-tls\") pod \"be78af7a-a8ff-45fc-adaf-ef5368012990\" (UID: \"be78af7a-a8ff-45fc-adaf-ef5368012990\") "
Sep 08 14:57:46.173424 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:46.173403    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be78af7a-a8ff-45fc-adaf-ef5368012990-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "be78af7a-a8ff-45fc-adaf-ef5368012990" (UID: "be78af7a-a8ff-45fc-adaf-ef5368012990"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:57:46.175377 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:46.175345    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be78af7a-a8ff-45fc-adaf-ef5368012990-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "be78af7a-a8ff-45fc-adaf-ef5368012990" (UID: "be78af7a-a8ff-45fc-adaf-ef5368012990"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:57:46.175530 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:46.175448    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be78af7a-a8ff-45fc-adaf-ef5368012990-kube-api-access-t88vt" (OuterVolumeSpecName: "kube-api-access-t88vt") pod "be78af7a-a8ff-45fc-adaf-ef5368012990" (UID: "be78af7a-a8ff-45fc-adaf-ef5368012990"). InnerVolumeSpecName "kube-api-access-t88vt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:57:46.175530 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:46.175447    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be78af7a-a8ff-45fc-adaf-ef5368012990-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "be78af7a-a8ff-45fc-adaf-ef5368012990" (UID: "be78af7a-a8ff-45fc-adaf-ef5368012990"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:57:46.273805 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:46.273768    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t88vt\" (UniqueName: \"kubernetes.io/projected/be78af7a-a8ff-45fc-adaf-ef5368012990-kube-api-access-t88vt\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:57:46.273805 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:46.273799    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be78af7a-a8ff-45fc-adaf-ef5368012990-openshift-service-ca\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:57:46.273805 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:46.273809    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be78af7a-a8ff-45fc-adaf-ef5368012990-maas-api-tls\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:57:46.274032 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:46.273817    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be78af7a-a8ff-45fc-adaf-ef5368012990-metrics-certs\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:57:46.515248 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:46.515215    2577 generic.go:356] "Generic (PLEG): container finished" podID="be78af7a-a8ff-45fc-adaf-ef5368012990" containerID="7483b15b67ee76517ed198b380aff38d6ff3003fde2913c83f296f32439cd0c1" exitCode=0
Sep 08 14:57:46.515421 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:46.515260    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5"
Sep 08 14:57:46.515421 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:46.515306    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5" event={"ID":"be78af7a-a8ff-45fc-adaf-ef5368012990","Type":"ContainerDied","Data":"7483b15b67ee76517ed198b380aff38d6ff3003fde2913c83f296f32439cd0c1"}
Sep 08 14:57:46.515421 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:46.515360    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5" event={"ID":"be78af7a-a8ff-45fc-adaf-ef5368012990","Type":"ContainerDied","Data":"9bfc2adc7a547769b81cdd591202cac87949f94432a3affd06d589dd44b9c774"}
Sep 08 14:57:46.515421 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:46.515388    2577 scope.go:117] "RemoveContainer" containerID="7483b15b67ee76517ed198b380aff38d6ff3003fde2913c83f296f32439cd0c1"
Sep 08 14:57:46.525236 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:46.525219    2577 scope.go:117] "RemoveContainer" containerID="7483b15b67ee76517ed198b380aff38d6ff3003fde2913c83f296f32439cd0c1"
Sep 08 14:57:46.525524 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:57:46.525507    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7483b15b67ee76517ed198b380aff38d6ff3003fde2913c83f296f32439cd0c1\": container with ID starting with 7483b15b67ee76517ed198b380aff38d6ff3003fde2913c83f296f32439cd0c1 not found: ID does not exist" containerID="7483b15b67ee76517ed198b380aff38d6ff3003fde2913c83f296f32439cd0c1"
Sep 08 14:57:46.525580 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:46.525532    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7483b15b67ee76517ed198b380aff38d6ff3003fde2913c83f296f32439cd0c1"} err="failed to get container status \"7483b15b67ee76517ed198b380aff38d6ff3003fde2913c83f296f32439cd0c1\": rpc error: code = NotFound desc = could not find container \"7483b15b67ee76517ed198b380aff38d6ff3003fde2913c83f296f32439cd0c1\": container with ID starting with 7483b15b67ee76517ed198b380aff38d6ff3003fde2913c83f296f32439cd0c1 not found: ID does not exist"
Sep 08 14:57:46.537790 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:46.537762    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5"]
Sep 08 14:57:46.541410 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:46.541386    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-f8c7bd-758679f67c-l8tr5"]
Sep 08 14:57:47.491179 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:47.491141    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be78af7a-a8ff-45fc-adaf-ef5368012990" path="/var/lib/kubelet/pods/be78af7a-a8ff-45fc-adaf-ef5368012990/volumes"
Sep 08 14:57:52.305760 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:52.305668    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"]
Sep 08 14:57:52.306196 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:52.306063    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst" podUID="0161dfd4-99d0-4104-88f1-412634ea41c1" containerName="istio-proxy" containerID="cri-o://2c713e2d024bf7141b99ac9d2c46e90e0e04088301a43315aec4eb96b561ad77" gracePeriod=30
Sep 08 14:57:57.367568 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.367537    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:57:57.563420 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.563392    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:57:57.582829 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.582769    2577 generic.go:356] "Generic (PLEG): container finished" podID="0161dfd4-99d0-4104-88f1-412634ea41c1" containerID="2c713e2d024bf7141b99ac9d2c46e90e0e04088301a43315aec4eb96b561ad77" exitCode=0
Sep 08 14:57:57.582829 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.582811    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"
Sep 08 14:57:57.582959 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.582840    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst" event={"ID":"0161dfd4-99d0-4104-88f1-412634ea41c1","Type":"ContainerDied","Data":"2c713e2d024bf7141b99ac9d2c46e90e0e04088301a43315aec4eb96b561ad77"}
Sep 08 14:57:57.582959 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.582898    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst" event={"ID":"0161dfd4-99d0-4104-88f1-412634ea41c1","Type":"ContainerDied","Data":"0d4acf422e9b3ed0b153e41bc44ef840784df8d538125993ead91af177e29d9b"}
Sep 08 14:57:57.582959 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.582920    2577 scope.go:117] "RemoveContainer" containerID="2c713e2d024bf7141b99ac9d2c46e90e0e04088301a43315aec4eb96b561ad77"
Sep 08 14:57:57.593556 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.593525    2577 scope.go:117] "RemoveContainer" containerID="f15cf2592fc5c10d24d624ba576d00a5bef171dedd85759d93822c4b71b92f4f"
Sep 08 14:57:57.603862 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.603845    2577 scope.go:117] "RemoveContainer" containerID="2c713e2d024bf7141b99ac9d2c46e90e0e04088301a43315aec4eb96b561ad77"
Sep 08 14:57:57.604133 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:57:57.604114    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c713e2d024bf7141b99ac9d2c46e90e0e04088301a43315aec4eb96b561ad77\": container with ID starting with 2c713e2d024bf7141b99ac9d2c46e90e0e04088301a43315aec4eb96b561ad77 not found: ID does not exist" containerID="2c713e2d024bf7141b99ac9d2c46e90e0e04088301a43315aec4eb96b561ad77"
Sep 08 14:57:57.604206 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.604143    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c713e2d024bf7141b99ac9d2c46e90e0e04088301a43315aec4eb96b561ad77"} err="failed to get container status \"2c713e2d024bf7141b99ac9d2c46e90e0e04088301a43315aec4eb96b561ad77\": rpc error: code = NotFound desc = could not find container \"2c713e2d024bf7141b99ac9d2c46e90e0e04088301a43315aec4eb96b561ad77\": container with ID starting with 2c713e2d024bf7141b99ac9d2c46e90e0e04088301a43315aec4eb96b561ad77 not found: ID does not exist"
Sep 08 14:57:57.604206 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.604159    2577 scope.go:117] "RemoveContainer" containerID="f15cf2592fc5c10d24d624ba576d00a5bef171dedd85759d93822c4b71b92f4f"
Sep 08 14:57:57.604427 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:57:57.604412    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f15cf2592fc5c10d24d624ba576d00a5bef171dedd85759d93822c4b71b92f4f\": container with ID starting with f15cf2592fc5c10d24d624ba576d00a5bef171dedd85759d93822c4b71b92f4f not found: ID does not exist" containerID="f15cf2592fc5c10d24d624ba576d00a5bef171dedd85759d93822c4b71b92f4f"
Sep 08 14:57:57.604516 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.604430    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f15cf2592fc5c10d24d624ba576d00a5bef171dedd85759d93822c4b71b92f4f"} err="failed to get container status \"f15cf2592fc5c10d24d624ba576d00a5bef171dedd85759d93822c4b71b92f4f\": rpc error: code = NotFound desc = could not find container \"f15cf2592fc5c10d24d624ba576d00a5bef171dedd85759d93822c4b71b92f4f\": container with ID starting with f15cf2592fc5c10d24d624ba576d00a5bef171dedd85759d93822c4b71b92f4f not found: ID does not exist"
Sep 08 14:57:57.682921 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.682897    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0161dfd4-99d0-4104-88f1-412634ea41c1-credential-socket\") pod \"0161dfd4-99d0-4104-88f1-412634ea41c1\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") "
Sep 08 14:57:57.683051 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.682940    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0161dfd4-99d0-4104-88f1-412634ea41c1-istiod-ca-cert\") pod \"0161dfd4-99d0-4104-88f1-412634ea41c1\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") "
Sep 08 14:57:57.683051 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.682966    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0161dfd4-99d0-4104-88f1-412634ea41c1-istio-envoy\") pod \"0161dfd4-99d0-4104-88f1-412634ea41c1\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") "
Sep 08 14:57:57.683051 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.682983    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0161dfd4-99d0-4104-88f1-412634ea41c1-istio-token\") pod \"0161dfd4-99d0-4104-88f1-412634ea41c1\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") "
Sep 08 14:57:57.683051 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.683004    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7wzx\" (UniqueName: \"kubernetes.io/projected/0161dfd4-99d0-4104-88f1-412634ea41c1-kube-api-access-c7wzx\") pod \"0161dfd4-99d0-4104-88f1-412634ea41c1\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") "
Sep 08 14:57:57.683051 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.683026    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0161dfd4-99d0-4104-88f1-412634ea41c1-istio-data\") pod \"0161dfd4-99d0-4104-88f1-412634ea41c1\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") "
Sep 08 14:57:57.683310 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.683065    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0161dfd4-99d0-4104-88f1-412634ea41c1-workload-socket\") pod \"0161dfd4-99d0-4104-88f1-412634ea41c1\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") "
Sep 08 14:57:57.683310 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.683092    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0161dfd4-99d0-4104-88f1-412634ea41c1-workload-certs\") pod \"0161dfd4-99d0-4104-88f1-412634ea41c1\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") "
Sep 08 14:57:57.683310 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.683142    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0161dfd4-99d0-4104-88f1-412634ea41c1-istio-podinfo\") pod \"0161dfd4-99d0-4104-88f1-412634ea41c1\" (UID: \"0161dfd4-99d0-4104-88f1-412634ea41c1\") "
Sep 08 14:57:57.683310 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.683171    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0161dfd4-99d0-4104-88f1-412634ea41c1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0161dfd4-99d0-4104-88f1-412634ea41c1" (UID: "0161dfd4-99d0-4104-88f1-412634ea41c1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:57:57.683545 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.683333    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0161dfd4-99d0-4104-88f1-412634ea41c1-istio-data" (OuterVolumeSpecName: "istio-data") pod "0161dfd4-99d0-4104-88f1-412634ea41c1" (UID: "0161dfd4-99d0-4104-88f1-412634ea41c1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:57:57.683545 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.683344    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0161dfd4-99d0-4104-88f1-412634ea41c1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0161dfd4-99d0-4104-88f1-412634ea41c1" (UID: "0161dfd4-99d0-4104-88f1-412634ea41c1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:57:57.683545 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.683488    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0161dfd4-99d0-4104-88f1-412634ea41c1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0161dfd4-99d0-4104-88f1-412634ea41c1" (UID: "0161dfd4-99d0-4104-88f1-412634ea41c1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:57:57.683701 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.683593    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0161dfd4-99d0-4104-88f1-412634ea41c1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0161dfd4-99d0-4104-88f1-412634ea41c1" (UID: "0161dfd4-99d0-4104-88f1-412634ea41c1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:57:57.683807 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.683787    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0161dfd4-99d0-4104-88f1-412634ea41c1-credential-socket\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:57:57.683893 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.683814    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0161dfd4-99d0-4104-88f1-412634ea41c1-istiod-ca-cert\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:57:57.683893 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.683829    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0161dfd4-99d0-4104-88f1-412634ea41c1-istio-data\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:57:57.683893 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.683843    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0161dfd4-99d0-4104-88f1-412634ea41c1-workload-socket\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:57:57.685082 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.685053    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0161dfd4-99d0-4104-88f1-412634ea41c1-kube-api-access-c7wzx" (OuterVolumeSpecName: "kube-api-access-c7wzx") pod "0161dfd4-99d0-4104-88f1-412634ea41c1" (UID: "0161dfd4-99d0-4104-88f1-412634ea41c1"). InnerVolumeSpecName "kube-api-access-c7wzx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:57:57.685170 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.685154    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0161dfd4-99d0-4104-88f1-412634ea41c1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0161dfd4-99d0-4104-88f1-412634ea41c1" (UID: "0161dfd4-99d0-4104-88f1-412634ea41c1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:57:57.685765 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.685744    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0161dfd4-99d0-4104-88f1-412634ea41c1-istio-token" (OuterVolumeSpecName: "istio-token") pod "0161dfd4-99d0-4104-88f1-412634ea41c1" (UID: "0161dfd4-99d0-4104-88f1-412634ea41c1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:57:57.685765 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.685754    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0161dfd4-99d0-4104-88f1-412634ea41c1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0161dfd4-99d0-4104-88f1-412634ea41c1" (UID: "0161dfd4-99d0-4104-88f1-412634ea41c1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:57:57.784266 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.784245    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0161dfd4-99d0-4104-88f1-412634ea41c1-istio-podinfo\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:57:57.784266 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.784263    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0161dfd4-99d0-4104-88f1-412634ea41c1-istio-envoy\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:57:57.784394 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.784271    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0161dfd4-99d0-4104-88f1-412634ea41c1-istio-token\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:57:57.784394 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.784279    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7wzx\" (UniqueName: \"kubernetes.io/projected/0161dfd4-99d0-4104-88f1-412634ea41c1-kube-api-access-c7wzx\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:57:57.784394 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.784287    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0161dfd4-99d0-4104-88f1-412634ea41c1-workload-certs\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 14:57:57.907011 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.906986    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"]
Sep 08 14:57:57.910584 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:57.910561    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f8c7bd-openshift-default-7b6796b6d-xjcst"]
Sep 08 14:57:59.491222 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:57:59.491190    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0161dfd4-99d0-4104-88f1-412634ea41c1" path="/var/lib/kubelet/pods/0161dfd4-99d0-4104-88f1-412634ea41c1/volumes"
Sep 08 14:58:07.366354 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:07.366318    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:58:07.972092 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:07.972057    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv"]
Sep 08 14:58:07.972757 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:07.972736    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87a9dd59-25f5-4635-b7c0-4175320df5c9" containerName="istio-proxy"
Sep 08 14:58:07.972844 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:07.972761    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="87a9dd59-25f5-4635-b7c0-4175320df5c9" containerName="istio-proxy"
Sep 08 14:58:07.972844 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:07.972776    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0b9de4b-b8b4-4783-b2d6-b2464ad14258" containerName="mt-curl-7871-98bf03"
Sep 08 14:58:07.972844 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:07.972785    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0b9de4b-b8b4-4783-b2d6-b2464ad14258" containerName="mt-curl-7871-98bf03"
Sep 08 14:58:07.972844 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:07.972804    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87a9dd59-25f5-4635-b7c0-4175320df5c9" containerName="istio-proxy"
Sep 08 14:58:07.972844 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:07.972813    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="87a9dd59-25f5-4635-b7c0-4175320df5c9" containerName="istio-proxy"
Sep 08 14:58:07.973120 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:07.972850    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f736e0af-f837-4e67-95db-3ec971055ce1" containerName="maas-api"
Sep 08 14:58:07.973120 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:07.972859    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f736e0af-f837-4e67-95db-3ec971055ce1" containerName="maas-api"
Sep 08 14:58:07.973120 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:07.972875    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be78af7a-a8ff-45fc-adaf-ef5368012990" containerName="maas-api"
Sep 08 14:58:07.973120 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:07.972884    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="be78af7a-a8ff-45fc-adaf-ef5368012990" containerName="maas-api"
Sep 08 14:58:07.973120 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:07.972898    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0161dfd4-99d0-4104-88f1-412634ea41c1" containerName="istio-proxy"
Sep 08 14:58:07.973120 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:07.972907    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0161dfd4-99d0-4104-88f1-412634ea41c1" containerName="istio-proxy"
Sep 08 14:58:07.973120 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:07.972917    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b821427-fc1d-48ab-a6c4-34c24c65ce26" containerName="maas-api"
Sep 08 14:58:07.973120 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:07.972925    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b821427-fc1d-48ab-a6c4-34c24c65ce26" containerName="maas-api"
Sep 08 14:58:07.973120 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:07.972937    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0161dfd4-99d0-4104-88f1-412634ea41c1" containerName="istio-proxy"
Sep 08 14:58:07.973120 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:07.972945    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0161dfd4-99d0-4104-88f1-412634ea41c1" containerName="istio-proxy"
Sep 08 14:58:07.973120 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:07.973037    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="be78af7a-a8ff-45fc-adaf-ef5368012990" containerName="maas-api"
Sep 08 14:58:07.973120 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:07.973050    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="87a9dd59-25f5-4635-b7c0-4175320df5c9" containerName="istio-proxy"
Sep 08 14:58:07.973120 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:07.973059    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0161dfd4-99d0-4104-88f1-412634ea41c1" containerName="istio-proxy"
Sep 08 14:58:07.973120 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:07.973067    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b821427-fc1d-48ab-a6c4-34c24c65ce26" containerName="maas-api"
Sep 08 14:58:07.973120 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:07.973079    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="87a9dd59-25f5-4635-b7c0-4175320df5c9" containerName="istio-proxy"
Sep 08 14:58:07.973120 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:07.973090    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0161dfd4-99d0-4104-88f1-412634ea41c1" containerName="istio-proxy"
Sep 08 14:58:07.973120 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:07.973099    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f736e0af-f837-4e67-95db-3ec971055ce1" containerName="maas-api"
Sep 08 14:58:07.973120 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:07.973107    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0b9de4b-b8b4-4783-b2d6-b2464ad14258" containerName="mt-curl-7871-98bf03"
Sep 08 14:58:07.978237 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:07.978211    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv"
Sep 08 14:58:07.981681 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:07.981661    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-28eb2c-serving-cert\""
Sep 08 14:58:07.987355 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:07.987331    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv"]
Sep 08 14:58:08.072422 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:08.072382    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbrss\" (UniqueName: \"kubernetes.io/projected/4206ad3f-ede3-4721-8091-cd183bb78346-kube-api-access-nbrss\") pod \"maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv\" (UID: \"4206ad3f-ede3-4721-8091-cd183bb78346\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv"
Sep 08 14:58:08.072621 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:08.072499    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4206ad3f-ede3-4721-8091-cd183bb78346-maas-api-tls\") pod \"maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv\" (UID: \"4206ad3f-ede3-4721-8091-cd183bb78346\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv"
Sep 08 14:58:08.072621 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:08.072556    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4206ad3f-ede3-4721-8091-cd183bb78346-metrics-certs\") pod \"maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv\" (UID: \"4206ad3f-ede3-4721-8091-cd183bb78346\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv"
Sep 08 14:58:08.072743 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:08.072639    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4206ad3f-ede3-4721-8091-cd183bb78346-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv\" (UID: \"4206ad3f-ede3-4721-8091-cd183bb78346\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv"
Sep 08 14:58:08.173098 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:08.173061    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4206ad3f-ede3-4721-8091-cd183bb78346-maas-api-tls\") pod \"maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv\" (UID: \"4206ad3f-ede3-4721-8091-cd183bb78346\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv"
Sep 08 14:58:08.173098 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:08.173104    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4206ad3f-ede3-4721-8091-cd183bb78346-metrics-certs\") pod \"maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv\" (UID: \"4206ad3f-ede3-4721-8091-cd183bb78346\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv"
Sep 08 14:58:08.173324 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:08.173147    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4206ad3f-ede3-4721-8091-cd183bb78346-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv\" (UID: \"4206ad3f-ede3-4721-8091-cd183bb78346\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv"
Sep 08 14:58:08.173324 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:08.173188    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbrss\" (UniqueName: \"kubernetes.io/projected/4206ad3f-ede3-4721-8091-cd183bb78346-kube-api-access-nbrss\") pod \"maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv\" (UID: \"4206ad3f-ede3-4721-8091-cd183bb78346\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv"
Sep 08 14:58:08.173324 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:58:08.173214    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-serving-cert: secret "maas-api-e2e-ipp-a-28eb2c-serving-cert" not found
Sep 08 14:58:08.173324 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:58:08.173288    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4206ad3f-ede3-4721-8091-cd183bb78346-maas-api-tls podName:4206ad3f-ede3-4721-8091-cd183bb78346 nodeName:}" failed. No retries permitted until 2026-09-08 14:58:08.673272724 +0000 UTC m=+1449.711673629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4206ad3f-ede3-4721-8091-cd183bb78346-maas-api-tls") pod "maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv" (UID: "4206ad3f-ede3-4721-8091-cd183bb78346") : secret "maas-api-e2e-ipp-a-28eb2c-serving-cert" not found
Sep 08 14:58:08.173897 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:08.173875    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4206ad3f-ede3-4721-8091-cd183bb78346-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv\" (UID: \"4206ad3f-ede3-4721-8091-cd183bb78346\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv"
Sep 08 14:58:08.175681 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:08.175660    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4206ad3f-ede3-4721-8091-cd183bb78346-metrics-certs\") pod \"maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv\" (UID: \"4206ad3f-ede3-4721-8091-cd183bb78346\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv"
Sep 08 14:58:08.182082 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:08.182059    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbrss\" (UniqueName: \"kubernetes.io/projected/4206ad3f-ede3-4721-8091-cd183bb78346-kube-api-access-nbrss\") pod \"maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv\" (UID: \"4206ad3f-ede3-4721-8091-cd183bb78346\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv"
Sep 08 14:58:08.678336 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:08.678305    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4206ad3f-ede3-4721-8091-cd183bb78346-maas-api-tls\") pod \"maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv\" (UID: \"4206ad3f-ede3-4721-8091-cd183bb78346\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv"
Sep 08 14:58:08.680804 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:08.680784    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4206ad3f-ede3-4721-8091-cd183bb78346-maas-api-tls\") pod \"maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv\" (UID: \"4206ad3f-ede3-4721-8091-cd183bb78346\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv"
Sep 08 14:58:08.891234 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:08.891196    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv"
Sep 08 14:58:09.167958 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:09.167925    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv"]
Sep 08 14:58:09.169739 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:58:09.169711    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4206ad3f_ede3_4721_8091_cd183bb78346.slice/crio-beaf2890f1d959d5bbb88cc5402963d65a1cef6d3546cf4c5c2d299e4e56ebeb WatchSource:0}: Error finding container beaf2890f1d959d5bbb88cc5402963d65a1cef6d3546cf4c5c2d299e4e56ebeb: Status 404 returned error can't find the container with id beaf2890f1d959d5bbb88cc5402963d65a1cef6d3546cf4c5c2d299e4e56ebeb
Sep 08 14:58:09.653222 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:09.653192    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv" event={"ID":"4206ad3f-ede3-4721-8091-cd183bb78346","Type":"ContainerStarted","Data":"beaf2890f1d959d5bbb88cc5402963d65a1cef6d3546cf4c5c2d299e4e56ebeb"}
Sep 08 14:58:10.660077 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:10.660039    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv" event={"ID":"4206ad3f-ede3-4721-8091-cd183bb78346","Type":"ContainerStarted","Data":"da0605d6314183743e002505f766a83ddd293b80c38c96bab7d2e033598324a0"}
Sep 08 14:58:10.660558 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:10.660098    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv"
Sep 08 14:58:10.680358 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:10.680312    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv" podStartSLOduration=2.801271661 podStartE2EDuration="3.680296283s" totalImagesPullingTime="879.024622ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:58:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:58:10.678501653 +0000 UTC m=+1451.716902578" watchObservedRunningTime="2026-09-08 14:58:10.680296283 +0000 UTC m=+1451.718697206"
Sep 08 14:58:16.670340 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:16.670310    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv"
Sep 08 14:58:17.866666 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:17.866633    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:58:32.869255 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:32.869214    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"]
Sep 08 14:58:32.872861 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:32.872844    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:32.876031 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:32.876002    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-a89cbb-openshift-default-dockercfg-c2j2s\""
Sep 08 14:58:32.894999 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:32.894976    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"]
Sep 08 14:58:32.991169 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:32.991134    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/335c8f00-0edf-489f-8d92-5ce4514e224a-istiod-ca-cert\") pod \"e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") " pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:32.991357 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:32.991196    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/335c8f00-0edf-489f-8d92-5ce4514e224a-credential-socket\") pod \"e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") " pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:32.991357 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:32.991254    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/335c8f00-0edf-489f-8d92-5ce4514e224a-workload-certs\") pod \"e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") " pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:32.991357 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:32.991277    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgwm9\" (UniqueName: \"kubernetes.io/projected/335c8f00-0edf-489f-8d92-5ce4514e224a-kube-api-access-pgwm9\") pod \"e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") " pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:32.991357 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:32.991307    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/335c8f00-0edf-489f-8d92-5ce4514e224a-workload-socket\") pod \"e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") " pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:32.991357 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:32.991333    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/335c8f00-0edf-489f-8d92-5ce4514e224a-istio-data\") pod \"e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") " pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:32.991357 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:32.991353    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/335c8f00-0edf-489f-8d92-5ce4514e224a-istio-token\") pod \"e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") " pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:32.991645 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:32.991414    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/335c8f00-0edf-489f-8d92-5ce4514e224a-istio-podinfo\") pod \"e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") " pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:32.991645 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:32.991449    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/335c8f00-0edf-489f-8d92-5ce4514e224a-istio-envoy\") pod \"e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") " pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:33.092356 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:33.092324    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/335c8f00-0edf-489f-8d92-5ce4514e224a-credential-socket\") pod \"e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") " pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:33.092539 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:33.092371    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/335c8f00-0edf-489f-8d92-5ce4514e224a-workload-certs\") pod \"e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") " pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:33.092539 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:33.092390    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgwm9\" (UniqueName: \"kubernetes.io/projected/335c8f00-0edf-489f-8d92-5ce4514e224a-kube-api-access-pgwm9\") pod \"e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") " pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:33.092539 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:33.092420    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/335c8f00-0edf-489f-8d92-5ce4514e224a-workload-socket\") pod \"e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") " pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:33.092539 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:33.092448    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/335c8f00-0edf-489f-8d92-5ce4514e224a-istio-data\") pod \"e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") " pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:33.092757 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:33.092590    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/335c8f00-0edf-489f-8d92-5ce4514e224a-istio-token\") pod \"e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") " pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:33.092757 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:33.092635    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/335c8f00-0edf-489f-8d92-5ce4514e224a-istio-podinfo\") pod \"e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") " pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:33.092757 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:33.092672    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/335c8f00-0edf-489f-8d92-5ce4514e224a-istio-envoy\") pod \"e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") " pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:33.092757 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:33.092751    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/335c8f00-0edf-489f-8d92-5ce4514e224a-istiod-ca-cert\") pod \"e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") " pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:33.092982 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:33.092787    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/335c8f00-0edf-489f-8d92-5ce4514e224a-credential-socket\") pod \"e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") " pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:33.092982 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:33.092876    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/335c8f00-0edf-489f-8d92-5ce4514e224a-workload-socket\") pod \"e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") " pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:33.092982 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:33.092903    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/335c8f00-0edf-489f-8d92-5ce4514e224a-workload-certs\") pod \"e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") " pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:33.093105 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:33.092992    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/335c8f00-0edf-489f-8d92-5ce4514e224a-istio-data\") pod \"e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") " pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:33.093373 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:33.093352    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/335c8f00-0edf-489f-8d92-5ce4514e224a-istiod-ca-cert\") pod \"e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") " pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:33.094993 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:33.094971    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/335c8f00-0edf-489f-8d92-5ce4514e224a-istio-envoy\") pod \"e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") " pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:33.095219 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:33.095201    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/335c8f00-0edf-489f-8d92-5ce4514e224a-istio-podinfo\") pod \"e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") " pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:33.101978 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:33.101959    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/335c8f00-0edf-489f-8d92-5ce4514e224a-istio-token\") pod \"e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") " pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:33.102119 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:33.102100    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgwm9\" (UniqueName: \"kubernetes.io/projected/335c8f00-0edf-489f-8d92-5ce4514e224a-kube-api-access-pgwm9\") pod \"e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") " pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:33.183285 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:33.183264    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:33.464811 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:33.464777    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"]
Sep 08 14:58:33.465973 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:58:33.465943    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod335c8f00_0edf_489f_8d92_5ce4514e224a.slice/crio-00dcfa5d90665dd3ed4c7e87532fb6b03a5733bec3ef787999d6a2c96cb2549d WatchSource:0}: Error finding container 00dcfa5d90665dd3ed4c7e87532fb6b03a5733bec3ef787999d6a2c96cb2549d: Status 404 returned error can't find the container with id 00dcfa5d90665dd3ed4c7e87532fb6b03a5733bec3ef787999d6a2c96cb2549d
Sep 08 14:58:33.468564 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:33.468522    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:58:33.468639 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:33.468610    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:58:33.468686 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:33.468655    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:58:33.797110 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:33.797034    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk" event={"ID":"335c8f00-0edf-489f-8d92-5ce4514e224a","Type":"ContainerStarted","Data":"9d16659393b3bf80653469af8dc7b7ae0a384737f2b6268f63f010b4fdcd6000"}
Sep 08 14:58:33.797110 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:33.797091    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk" event={"ID":"335c8f00-0edf-489f-8d92-5ce4514e224a","Type":"ContainerStarted","Data":"00dcfa5d90665dd3ed4c7e87532fb6b03a5733bec3ef787999d6a2c96cb2549d"}
Sep 08 14:58:33.817462 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:33.817381    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk" podStartSLOduration=1.817362181 podStartE2EDuration="1.817362181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:58:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:58:33.816970458 +0000 UTC m=+1474.855371382" watchObservedRunningTime="2026-09-08 14:58:33.817362181 +0000 UTC m=+1474.855763107"
Sep 08 14:58:34.183629 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:34.183600    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:34.188772 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:34.188747    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:34.803668 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:34.803638    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:34.804511 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:34.804460    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:36.886545 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:36.886509    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq"]
Sep 08 14:58:36.890784 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:36.890760    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq"
Sep 08 14:58:36.893431 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:36.893412    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-a89cbb-serving-cert\""
Sep 08 14:58:36.903580 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:36.903548    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq"]
Sep 08 14:58:36.929797 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:36.929768    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4b44f24-a04f-47ef-9999-b3a2f7286ca7-metrics-certs\") pod \"maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq\" (UID: \"a4b44f24-a04f-47ef-9999-b3a2f7286ca7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq"
Sep 08 14:58:36.929913 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:36.929834    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4b44f24-a04f-47ef-9999-b3a2f7286ca7-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq\" (UID: \"a4b44f24-a04f-47ef-9999-b3a2f7286ca7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq"
Sep 08 14:58:36.929913 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:36.929902    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4b44f24-a04f-47ef-9999-b3a2f7286ca7-maas-api-tls\") pod \"maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq\" (UID: \"a4b44f24-a04f-47ef-9999-b3a2f7286ca7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq"
Sep 08 14:58:36.930006 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:36.929926    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4p69\" (UniqueName: \"kubernetes.io/projected/a4b44f24-a04f-47ef-9999-b3a2f7286ca7-kube-api-access-h4p69\") pod \"maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq\" (UID: \"a4b44f24-a04f-47ef-9999-b3a2f7286ca7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq"
Sep 08 14:58:37.031230 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:37.031193    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4b44f24-a04f-47ef-9999-b3a2f7286ca7-maas-api-tls\") pod \"maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq\" (UID: \"a4b44f24-a04f-47ef-9999-b3a2f7286ca7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq"
Sep 08 14:58:37.031230 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:37.031226    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4p69\" (UniqueName: \"kubernetes.io/projected/a4b44f24-a04f-47ef-9999-b3a2f7286ca7-kube-api-access-h4p69\") pod \"maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq\" (UID: \"a4b44f24-a04f-47ef-9999-b3a2f7286ca7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq"
Sep 08 14:58:37.031501 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:37.031293    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4b44f24-a04f-47ef-9999-b3a2f7286ca7-metrics-certs\") pod \"maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq\" (UID: \"a4b44f24-a04f-47ef-9999-b3a2f7286ca7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq"
Sep 08 14:58:37.031501 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:37.031328    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4b44f24-a04f-47ef-9999-b3a2f7286ca7-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq\" (UID: \"a4b44f24-a04f-47ef-9999-b3a2f7286ca7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq"
Sep 08 14:58:37.031501 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:58:37.031342    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-serving-cert: secret "maas-api-e2e-ipp-b-a89cbb-serving-cert" not found
Sep 08 14:58:37.031501 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:58:37.031407    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4b44f24-a04f-47ef-9999-b3a2f7286ca7-maas-api-tls podName:a4b44f24-a04f-47ef-9999-b3a2f7286ca7 nodeName:}" failed. No retries permitted until 2026-09-08 14:58:37.531385597 +0000 UTC m=+1478.569786511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a4b44f24-a04f-47ef-9999-b3a2f7286ca7-maas-api-tls") pod "maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq" (UID: "a4b44f24-a04f-47ef-9999-b3a2f7286ca7") : secret "maas-api-e2e-ipp-b-a89cbb-serving-cert" not found
Sep 08 14:58:37.031931 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:37.031912    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4b44f24-a04f-47ef-9999-b3a2f7286ca7-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq\" (UID: \"a4b44f24-a04f-47ef-9999-b3a2f7286ca7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq"
Sep 08 14:58:37.033886 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:37.033866    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4b44f24-a04f-47ef-9999-b3a2f7286ca7-metrics-certs\") pod \"maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq\" (UID: \"a4b44f24-a04f-47ef-9999-b3a2f7286ca7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq"
Sep 08 14:58:37.044788 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:37.044766    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4p69\" (UniqueName: \"kubernetes.io/projected/a4b44f24-a04f-47ef-9999-b3a2f7286ca7-kube-api-access-h4p69\") pod \"maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq\" (UID: \"a4b44f24-a04f-47ef-9999-b3a2f7286ca7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq"
Sep 08 14:58:37.535738 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:37.535707    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4b44f24-a04f-47ef-9999-b3a2f7286ca7-maas-api-tls\") pod \"maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq\" (UID: \"a4b44f24-a04f-47ef-9999-b3a2f7286ca7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq"
Sep 08 14:58:37.538166 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:37.538144    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4b44f24-a04f-47ef-9999-b3a2f7286ca7-maas-api-tls\") pod \"maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq\" (UID: \"a4b44f24-a04f-47ef-9999-b3a2f7286ca7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq"
Sep 08 14:58:37.803551 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:37.803446    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq"
Sep 08 14:58:38.091679 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:38.088499    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq"]
Sep 08 14:58:38.092251 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:58:38.092226    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4b44f24_a04f_47ef_9999_b3a2f7286ca7.slice/crio-5d985dc1ad52fe1e447bf0850d56080a04fc1acfc8097cffd30c63ca880015a5 WatchSource:0}: Error finding container 5d985dc1ad52fe1e447bf0850d56080a04fc1acfc8097cffd30c63ca880015a5: Status 404 returned error can't find the container with id 5d985dc1ad52fe1e447bf0850d56080a04fc1acfc8097cffd30c63ca880015a5
Sep 08 14:58:38.837774 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:38.837675    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq" event={"ID":"a4b44f24-a04f-47ef-9999-b3a2f7286ca7","Type":"ContainerStarted","Data":"ab6df561320b51f11b2487017ce8500c17b3d63f69dd65394c44fc9e7e0216f2"}
Sep 08 14:58:38.837774 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:38.837729    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq" event={"ID":"a4b44f24-a04f-47ef-9999-b3a2f7286ca7","Type":"ContainerStarted","Data":"5d985dc1ad52fe1e447bf0850d56080a04fc1acfc8097cffd30c63ca880015a5"}
Sep 08 14:58:38.837774 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:38.837768    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq"
Sep 08 14:58:38.857838 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:38.857795    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq" podStartSLOduration=2.502047107 podStartE2EDuration="2.857780402s" totalImagesPullingTime="355.733295ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:58:38.855181194 +0000 UTC m=+1479.893582117" watchObservedRunningTime="2026-09-08 14:58:38.857780402 +0000 UTC m=+1479.896181379"
Sep 08 14:58:44.168311 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:44.168277    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:58:44.848770 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:44.848742    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq"
Sep 08 14:58:53.917904 ip-10-0-142-20 kubenswrapper[2577]: E0908 14:58:53.917860    2577 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/system.slice/system-systemd\\\\x2dcoredump.slice/systemd-coredump@7-20313-0.service\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod335c8f00_0edf_489f_8d92_5ce4514e224a.slice/crio-9d16659393b3bf80653469af8dc7b7ae0a384737f2b6268f63f010b4fdcd6000.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod335c8f00_0edf_489f_8d92_5ce4514e224a.slice/crio-conmon-9d16659393b3bf80653469af8dc7b7ae0a384737f2b6268f63f010b4fdcd6000.scope\": RecentStats: unable to find data in memory cache]"
Sep 08 14:58:53.929785 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:53.929756    2577 generic.go:356] "Generic (PLEG): container finished" podID="335c8f00-0edf-489f-8d92-5ce4514e224a" containerID="9d16659393b3bf80653469af8dc7b7ae0a384737f2b6268f63f010b4fdcd6000" exitCode=0
Sep 08 14:58:53.929885 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:53.929793    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk" event={"ID":"335c8f00-0edf-489f-8d92-5ce4514e224a","Type":"ContainerDied","Data":"9d16659393b3bf80653469af8dc7b7ae0a384737f2b6268f63f010b4fdcd6000"}
Sep 08 14:58:53.930179 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:53.930154    2577 scope.go:117] "RemoveContainer" containerID="9d16659393b3bf80653469af8dc7b7ae0a384737f2b6268f63f010b4fdcd6000"
Sep 08 14:58:53.931198 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:53.931170    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:58:53.931287 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:53.931255    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:58:53.931348 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:53.931305    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:58:54.938407 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:54.938372    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk" event={"ID":"335c8f00-0edf-489f-8d92-5ce4514e224a","Type":"ContainerStarted","Data":"f8e4fe40f56e9b923d241083db49582ded4def23e3513aeaf13e223c313608ff"}
Sep 08 14:58:55.184183 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:55.184153    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:58:55.184337 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:55.184272    2577 patch_prober.go:28] interesting pod/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Sep 08 14:58:55.184337 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:55.184323    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk" podUID="335c8f00-0edf-489f-8d92-5ce4514e224a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Sep 08 14:58:56.183603 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:56.183566    2577 patch_prober.go:28] interesting pod/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Sep 08 14:58:56.184051 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:56.183624    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk" podUID="335c8f00-0edf-489f-8d92-5ce4514e224a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Sep 08 14:58:57.183842 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:57.183800    2577 patch_prober.go:28] interesting pod/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Sep 08 14:58:57.184237 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:57.183878    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk" podUID="335c8f00-0edf-489f-8d92-5ce4514e224a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Sep 08 14:58:58.184486 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:58.184445    2577 patch_prober.go:28] interesting pod/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Sep 08 14:58:58.184958 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:58.184534    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk" podUID="335c8f00-0edf-489f-8d92-5ce4514e224a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Sep 08 14:58:59.184122 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:59.184091    2577 patch_prober.go:28] interesting pod/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Sep 08 14:58:59.184290 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:59.184181    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk" podUID="335c8f00-0edf-489f-8d92-5ce4514e224a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Sep 08 14:58:59.724359 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:59.724325    2577 scope.go:117] "RemoveContainer" containerID="96fb33cba33669ee10c403abc1211fddf459ac75044ded0c4dadaf1f23b43413"
Sep 08 14:58:59.736762 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:58:59.736741    2577 scope.go:117] "RemoveContainer" containerID="2df0cc52e77bdd15d158785c2ef1dbd8f9d613dce068fda39e782319b4dadf94"
Sep 08 14:59:00.272509 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:00.272453    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:59:00.272919 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:00.272886    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:59:00.273866 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:00.273842    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 14:59:05.995190 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:05.995158    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-frbc8_ac63e955-806d-44b0-ba92-1e7c94474243/payload-processing/0.log"
Sep 08 14:59:28.867508 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:28.867409    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:59:48.665391 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:48.665358    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 14:59:54.438386 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:54.438357    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-frbc8_ac63e955-806d-44b0-ba92-1e7c94474243/payload-processing/0.log"
Sep 08 14:59:55.182778 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.182747    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"]
Sep 08 14:59:55.186948 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.186927    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:55.189843 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.189821    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-7f92a9-openshift-default-dockercfg-7kvjq\""
Sep 08 14:59:55.198723 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.198697    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"]
Sep 08 14:59:55.365752 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.365724    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98aa8aa5-de96-4259-a634-7e83f71ba2aa-workload-socket\") pod \"e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") " pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:55.365910 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.365766    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98aa8aa5-de96-4259-a634-7e83f71ba2aa-istiod-ca-cert\") pod \"e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") " pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:55.365910 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.365815    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98aa8aa5-de96-4259-a634-7e83f71ba2aa-workload-certs\") pod \"e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") " pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:55.365910 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.365849    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98aa8aa5-de96-4259-a634-7e83f71ba2aa-credential-socket\") pod \"e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") " pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:55.365910 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.365886    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98aa8aa5-de96-4259-a634-7e83f71ba2aa-istio-token\") pod \"e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") " pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:55.366053 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.365911    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98aa8aa5-de96-4259-a634-7e83f71ba2aa-istio-envoy\") pod \"e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") " pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:55.366053 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.365976    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98aa8aa5-de96-4259-a634-7e83f71ba2aa-istio-podinfo\") pod \"e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") " pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:55.366053 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.365993    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4qbj\" (UniqueName: \"kubernetes.io/projected/98aa8aa5-de96-4259-a634-7e83f71ba2aa-kube-api-access-x4qbj\") pod \"e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") " pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:55.366153 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.366069    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98aa8aa5-de96-4259-a634-7e83f71ba2aa-istio-data\") pod \"e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") " pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:55.467140 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.467053    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98aa8aa5-de96-4259-a634-7e83f71ba2aa-istio-token\") pod \"e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") " pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:55.467140 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.467099    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98aa8aa5-de96-4259-a634-7e83f71ba2aa-istio-envoy\") pod \"e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") " pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:55.467689 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.467160    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98aa8aa5-de96-4259-a634-7e83f71ba2aa-istio-podinfo\") pod \"e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") " pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:55.467689 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.467186    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4qbj\" (UniqueName: \"kubernetes.io/projected/98aa8aa5-de96-4259-a634-7e83f71ba2aa-kube-api-access-x4qbj\") pod \"e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") " pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:55.467689 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.467232    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98aa8aa5-de96-4259-a634-7e83f71ba2aa-istio-data\") pod \"e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") " pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:55.467689 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.467268    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98aa8aa5-de96-4259-a634-7e83f71ba2aa-workload-socket\") pod \"e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") " pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:55.467689 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.467314    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98aa8aa5-de96-4259-a634-7e83f71ba2aa-istiod-ca-cert\") pod \"e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") " pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:55.467689 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.467452    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98aa8aa5-de96-4259-a634-7e83f71ba2aa-workload-certs\") pod \"e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") " pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:55.467689 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.467545    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98aa8aa5-de96-4259-a634-7e83f71ba2aa-credential-socket\") pod \"e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") " pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:55.468076 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.467688    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98aa8aa5-de96-4259-a634-7e83f71ba2aa-istio-data\") pod \"e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") " pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:55.468076 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.467884    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98aa8aa5-de96-4259-a634-7e83f71ba2aa-workload-socket\") pod \"e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") " pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:55.468076 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.467943    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98aa8aa5-de96-4259-a634-7e83f71ba2aa-workload-certs\") pod \"e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") " pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:55.468076 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.468027    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98aa8aa5-de96-4259-a634-7e83f71ba2aa-credential-socket\") pod \"e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") " pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:55.468238 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.468218    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98aa8aa5-de96-4259-a634-7e83f71ba2aa-istiod-ca-cert\") pod \"e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") " pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:55.469749 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.469728    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98aa8aa5-de96-4259-a634-7e83f71ba2aa-istio-envoy\") pod \"e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") " pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:55.469919 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.469902    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98aa8aa5-de96-4259-a634-7e83f71ba2aa-istio-podinfo\") pod \"e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") " pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:55.475312 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.475286    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98aa8aa5-de96-4259-a634-7e83f71ba2aa-istio-token\") pod \"e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") " pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:55.475502 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.475463    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4qbj\" (UniqueName: \"kubernetes.io/projected/98aa8aa5-de96-4259-a634-7e83f71ba2aa-kube-api-access-x4qbj\") pod \"e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") " pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:55.498057 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.498034    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:55.781284 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.781260    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"]
Sep 08 14:59:55.782955 ip-10-0-142-20 kubenswrapper[2577]: W0908 14:59:55.782921    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98aa8aa5_de96_4259_a634_7e83f71ba2aa.slice/crio-cc429ac2fb16f657c170c92747f6a88cf6b6277a6415cde63acbe1110138275a WatchSource:0}: Error finding container cc429ac2fb16f657c170c92747f6a88cf6b6277a6415cde63acbe1110138275a: Status 404 returned error can't find the container with id cc429ac2fb16f657c170c92747f6a88cf6b6277a6415cde63acbe1110138275a
Sep 08 14:59:55.785441 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.785402    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:59:55.785539 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.785509    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:59:55.785578 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:55.785552    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 14:59:56.302000 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:56.301955    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5" event={"ID":"98aa8aa5-de96-4259-a634-7e83f71ba2aa","Type":"ContainerStarted","Data":"2da9f5a74d6bade2d8b41527067eefc170c7de3af940bdc4743ff0ed066dbf96"}
Sep 08 14:59:56.302179 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:56.302048    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5" event={"ID":"98aa8aa5-de96-4259-a634-7e83f71ba2aa","Type":"ContainerStarted","Data":"cc429ac2fb16f657c170c92747f6a88cf6b6277a6415cde63acbe1110138275a"}
Sep 08 14:59:56.324385 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:56.324337    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5" podStartSLOduration=1.32432248 podStartE2EDuration="1.32432248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:59:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:59:56.322444193 +0000 UTC m=+1557.360845117" watchObservedRunningTime="2026-09-08 14:59:56.32432248 +0000 UTC m=+1557.362723403"
Sep 08 14:59:56.498975 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:56.498947    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:56.504093 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:56.504069    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:57.308179 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:57.308143    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 14:59:57.309227 ip-10-0-142-20 kubenswrapper[2577]: I0908 14:59:57.309206    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 15:00:09.274837 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:09.274800    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 15:00:20.459460 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:20.459428    2577 generic.go:356] "Generic (PLEG): container finished" podID="98aa8aa5-de96-4259-a634-7e83f71ba2aa" containerID="2da9f5a74d6bade2d8b41527067eefc170c7de3af940bdc4743ff0ed066dbf96" exitCode=0
Sep 08 15:00:20.459880 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:20.459509    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5" event={"ID":"98aa8aa5-de96-4259-a634-7e83f71ba2aa","Type":"ContainerDied","Data":"2da9f5a74d6bade2d8b41527067eefc170c7de3af940bdc4743ff0ed066dbf96"}
Sep 08 15:00:20.459946 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:20.459931    2577 scope.go:117] "RemoveContainer" containerID="2da9f5a74d6bade2d8b41527067eefc170c7de3af940bdc4743ff0ed066dbf96"
Sep 08 15:00:20.461189 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:20.461144    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 15:00:20.461285 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:20.461215    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 15:00:20.461285 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:20.461257    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 15:00:21.467829 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:21.467795    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5" event={"ID":"98aa8aa5-de96-4259-a634-7e83f71ba2aa","Type":"ContainerStarted","Data":"f65b9446e5c9130cb5626057cf8cb66031f672f824e8eb89e2d7a58d5e264c94"}
Sep 08 15:00:21.499027 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:21.498993    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 15:00:21.499271 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:21.499250    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 08 15:00:21.499322 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:21.499296    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5" podUID="98aa8aa5-de96-4259-a634-7e83f71ba2aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 08 15:00:22.498960 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:22.498928    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 08 15:00:22.499362 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:22.498989    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5" podUID="98aa8aa5-de96-4259-a634-7e83f71ba2aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 08 15:00:23.498776 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:23.498744    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 08 15:00:23.498977 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:23.498804    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5" podUID="98aa8aa5-de96-4259-a634-7e83f71ba2aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 08 15:00:24.498679 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:24.498638    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 08 15:00:24.498880 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:24.498716    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5" podUID="98aa8aa5-de96-4259-a634-7e83f71ba2aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 08 15:00:25.498589 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:25.498556    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 08 15:00:25.499051 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:25.498613    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5" podUID="98aa8aa5-de96-4259-a634-7e83f71ba2aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 08 15:00:26.498666 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:26.498637    2577 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 08 15:00:26.499054 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:26.498686    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5" podUID="98aa8aa5-de96-4259-a634-7e83f71ba2aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 08 15:00:27.309045 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:27.309009    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 15:00:27.503169 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:27.503143    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 15:00:27.504351 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:27.504334    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 15:00:33.366124 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:33.366089    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 15:00:36.521697 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:36.521655    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"]
Sep 08 15:00:36.522087 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:36.521908    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5" podUID="98aa8aa5-de96-4259-a634-7e83f71ba2aa" containerName="istio-proxy" containerID="cri-o://f65b9446e5c9130cb5626057cf8cb66031f672f824e8eb89e2d7a58d5e264c94" gracePeriod=30
Sep 08 15:00:41.775149 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:41.775123    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 15:00:41.914735 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:41.914708    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98aa8aa5-de96-4259-a634-7e83f71ba2aa-istiod-ca-cert\") pod \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") "
Sep 08 15:00:41.914929 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:41.914768    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98aa8aa5-de96-4259-a634-7e83f71ba2aa-workload-socket\") pod \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") "
Sep 08 15:00:41.914929 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:41.914792    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98aa8aa5-de96-4259-a634-7e83f71ba2aa-istio-envoy\") pod \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") "
Sep 08 15:00:41.914929 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:41.914901    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98aa8aa5-de96-4259-a634-7e83f71ba2aa-istio-podinfo\") pod \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") "
Sep 08 15:00:41.915095 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:41.914947    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98aa8aa5-de96-4259-a634-7e83f71ba2aa-istio-data\") pod \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") "
Sep 08 15:00:41.915095 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:41.914999    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98aa8aa5-de96-4259-a634-7e83f71ba2aa-credential-socket\") pod \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") "
Sep 08 15:00:41.915095 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:41.915054    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98aa8aa5-de96-4259-a634-7e83f71ba2aa-istio-token\") pod \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") "
Sep 08 15:00:41.915095 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:41.915050    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98aa8aa5-de96-4259-a634-7e83f71ba2aa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "98aa8aa5-de96-4259-a634-7e83f71ba2aa" (UID: "98aa8aa5-de96-4259-a634-7e83f71ba2aa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:00:41.915095 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:41.915079    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4qbj\" (UniqueName: \"kubernetes.io/projected/98aa8aa5-de96-4259-a634-7e83f71ba2aa-kube-api-access-x4qbj\") pod \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") "
Sep 08 15:00:41.915348 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:41.915108    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98aa8aa5-de96-4259-a634-7e83f71ba2aa-workload-certs\") pod \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\" (UID: \"98aa8aa5-de96-4259-a634-7e83f71ba2aa\") "
Sep 08 15:00:41.915348 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:41.915163    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98aa8aa5-de96-4259-a634-7e83f71ba2aa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "98aa8aa5-de96-4259-a634-7e83f71ba2aa" (UID: "98aa8aa5-de96-4259-a634-7e83f71ba2aa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:00:41.915348 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:41.915280    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98aa8aa5-de96-4259-a634-7e83f71ba2aa-istio-data" (OuterVolumeSpecName: "istio-data") pod "98aa8aa5-de96-4259-a634-7e83f71ba2aa" (UID: "98aa8aa5-de96-4259-a634-7e83f71ba2aa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:00:41.915348 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:41.915294    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98aa8aa5-de96-4259-a634-7e83f71ba2aa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "98aa8aa5-de96-4259-a634-7e83f71ba2aa" (UID: "98aa8aa5-de96-4259-a634-7e83f71ba2aa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:00:41.915671 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:41.915593    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98aa8aa5-de96-4259-a634-7e83f71ba2aa-istiod-ca-cert\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:00:41.915671 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:41.915619    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98aa8aa5-de96-4259-a634-7e83f71ba2aa-workload-socket\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:00:41.915671 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:41.915634    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98aa8aa5-de96-4259-a634-7e83f71ba2aa-istio-data\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:00:41.915671 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:41.915648    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98aa8aa5-de96-4259-a634-7e83f71ba2aa-credential-socket\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:00:41.915961 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:41.915673    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98aa8aa5-de96-4259-a634-7e83f71ba2aa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "98aa8aa5-de96-4259-a634-7e83f71ba2aa" (UID: "98aa8aa5-de96-4259-a634-7e83f71ba2aa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:00:41.917187 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:41.917166    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98aa8aa5-de96-4259-a634-7e83f71ba2aa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "98aa8aa5-de96-4259-a634-7e83f71ba2aa" (UID: "98aa8aa5-de96-4259-a634-7e83f71ba2aa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:00:41.917447 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:41.917432    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98aa8aa5-de96-4259-a634-7e83f71ba2aa-kube-api-access-x4qbj" (OuterVolumeSpecName: "kube-api-access-x4qbj") pod "98aa8aa5-de96-4259-a634-7e83f71ba2aa" (UID: "98aa8aa5-de96-4259-a634-7e83f71ba2aa"). InnerVolumeSpecName "kube-api-access-x4qbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:00:41.917728 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:41.917711    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98aa8aa5-de96-4259-a634-7e83f71ba2aa-istio-token" (OuterVolumeSpecName: "istio-token") pod "98aa8aa5-de96-4259-a634-7e83f71ba2aa" (UID: "98aa8aa5-de96-4259-a634-7e83f71ba2aa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:00:41.917794 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:41.917726    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/98aa8aa5-de96-4259-a634-7e83f71ba2aa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "98aa8aa5-de96-4259-a634-7e83f71ba2aa" (UID: "98aa8aa5-de96-4259-a634-7e83f71ba2aa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:00:42.016440 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:42.016404    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98aa8aa5-de96-4259-a634-7e83f71ba2aa-istio-envoy\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:00:42.016440 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:42.016430    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98aa8aa5-de96-4259-a634-7e83f71ba2aa-istio-podinfo\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:00:42.016440 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:42.016439    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98aa8aa5-de96-4259-a634-7e83f71ba2aa-istio-token\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:00:42.016440 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:42.016447    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4qbj\" (UniqueName: \"kubernetes.io/projected/98aa8aa5-de96-4259-a634-7e83f71ba2aa-kube-api-access-x4qbj\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:00:42.016811 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:42.016456    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98aa8aa5-de96-4259-a634-7e83f71ba2aa-workload-certs\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:00:42.592285 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:42.592251    2577 generic.go:356] "Generic (PLEG): container finished" podID="98aa8aa5-de96-4259-a634-7e83f71ba2aa" containerID="f65b9446e5c9130cb5626057cf8cb66031f672f824e8eb89e2d7a58d5e264c94" exitCode=0
Sep 08 15:00:42.592434 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:42.592304    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"
Sep 08 15:00:42.592434 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:42.592316    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5" event={"ID":"98aa8aa5-de96-4259-a634-7e83f71ba2aa","Type":"ContainerDied","Data":"f65b9446e5c9130cb5626057cf8cb66031f672f824e8eb89e2d7a58d5e264c94"}
Sep 08 15:00:42.592434 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:42.592360    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5" event={"ID":"98aa8aa5-de96-4259-a634-7e83f71ba2aa","Type":"ContainerDied","Data":"cc429ac2fb16f657c170c92747f6a88cf6b6277a6415cde63acbe1110138275a"}
Sep 08 15:00:42.592434 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:42.592382    2577 scope.go:117] "RemoveContainer" containerID="f65b9446e5c9130cb5626057cf8cb66031f672f824e8eb89e2d7a58d5e264c94"
Sep 08 15:00:42.603118 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:42.603096    2577 scope.go:117] "RemoveContainer" containerID="2da9f5a74d6bade2d8b41527067eefc170c7de3af940bdc4743ff0ed066dbf96"
Sep 08 15:00:42.612098 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:42.612073    2577 scope.go:117] "RemoveContainer" containerID="f65b9446e5c9130cb5626057cf8cb66031f672f824e8eb89e2d7a58d5e264c94"
Sep 08 15:00:42.612374 ip-10-0-142-20 kubenswrapper[2577]: E0908 15:00:42.612355    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f65b9446e5c9130cb5626057cf8cb66031f672f824e8eb89e2d7a58d5e264c94\": container with ID starting with f65b9446e5c9130cb5626057cf8cb66031f672f824e8eb89e2d7a58d5e264c94 not found: ID does not exist" containerID="f65b9446e5c9130cb5626057cf8cb66031f672f824e8eb89e2d7a58d5e264c94"
Sep 08 15:00:42.612453 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:42.612381    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f65b9446e5c9130cb5626057cf8cb66031f672f824e8eb89e2d7a58d5e264c94"} err="failed to get container status \"f65b9446e5c9130cb5626057cf8cb66031f672f824e8eb89e2d7a58d5e264c94\": rpc error: code = NotFound desc = could not find container \"f65b9446e5c9130cb5626057cf8cb66031f672f824e8eb89e2d7a58d5e264c94\": container with ID starting with f65b9446e5c9130cb5626057cf8cb66031f672f824e8eb89e2d7a58d5e264c94 not found: ID does not exist"
Sep 08 15:00:42.612453 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:42.612399    2577 scope.go:117] "RemoveContainer" containerID="2da9f5a74d6bade2d8b41527067eefc170c7de3af940bdc4743ff0ed066dbf96"
Sep 08 15:00:42.612636 ip-10-0-142-20 kubenswrapper[2577]: E0908 15:00:42.612617    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2da9f5a74d6bade2d8b41527067eefc170c7de3af940bdc4743ff0ed066dbf96\": container with ID starting with 2da9f5a74d6bade2d8b41527067eefc170c7de3af940bdc4743ff0ed066dbf96 not found: ID does not exist" containerID="2da9f5a74d6bade2d8b41527067eefc170c7de3af940bdc4743ff0ed066dbf96"
Sep 08 15:00:42.612691 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:42.612639    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2da9f5a74d6bade2d8b41527067eefc170c7de3af940bdc4743ff0ed066dbf96"} err="failed to get container status \"2da9f5a74d6bade2d8b41527067eefc170c7de3af940bdc4743ff0ed066dbf96\": rpc error: code = NotFound desc = could not find container \"2da9f5a74d6bade2d8b41527067eefc170c7de3af940bdc4743ff0ed066dbf96\": container with ID starting with 2da9f5a74d6bade2d8b41527067eefc170c7de3af940bdc4743ff0ed066dbf96 not found: ID does not exist"
Sep 08 15:00:42.614691 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:42.614670    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"]
Sep 08 15:00:42.618671 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:42.618646    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-7f92a9-openshift-default-6d4796448-qx5l5"]
Sep 08 15:00:43.491562 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:43.491530    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98aa8aa5-de96-4259-a634-7e83f71ba2aa" path="/var/lib/kubelet/pods/98aa8aa5-de96-4259-a634-7e83f71ba2aa/volumes"
Sep 08 15:00:56.073291 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:56.073200    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv"]
Sep 08 15:00:56.073814 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:56.073409    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv" podUID="4206ad3f-ede3-4721-8091-cd183bb78346" containerName="maas-api" containerID="cri-o://da0605d6314183743e002505f766a83ddd293b80c38c96bab7d2e033598324a0" gracePeriod=30
Sep 08 15:00:56.342566 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:56.342538    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv"
Sep 08 15:00:56.445903 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:56.445869    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbrss\" (UniqueName: \"kubernetes.io/projected/4206ad3f-ede3-4721-8091-cd183bb78346-kube-api-access-nbrss\") pod \"4206ad3f-ede3-4721-8091-cd183bb78346\" (UID: \"4206ad3f-ede3-4721-8091-cd183bb78346\") "
Sep 08 15:00:56.445903 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:56.445904    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4206ad3f-ede3-4721-8091-cd183bb78346-maas-api-tls\") pod \"4206ad3f-ede3-4721-8091-cd183bb78346\" (UID: \"4206ad3f-ede3-4721-8091-cd183bb78346\") "
Sep 08 15:00:56.446163 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:56.445938    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4206ad3f-ede3-4721-8091-cd183bb78346-openshift-service-ca\") pod \"4206ad3f-ede3-4721-8091-cd183bb78346\" (UID: \"4206ad3f-ede3-4721-8091-cd183bb78346\") "
Sep 08 15:00:56.446163 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:56.445980    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4206ad3f-ede3-4721-8091-cd183bb78346-metrics-certs\") pod \"4206ad3f-ede3-4721-8091-cd183bb78346\" (UID: \"4206ad3f-ede3-4721-8091-cd183bb78346\") "
Sep 08 15:00:56.446398 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:56.446360    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4206ad3f-ede3-4721-8091-cd183bb78346-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4206ad3f-ede3-4721-8091-cd183bb78346" (UID: "4206ad3f-ede3-4721-8091-cd183bb78346"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:00:56.448339 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:56.448310    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4206ad3f-ede3-4721-8091-cd183bb78346-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4206ad3f-ede3-4721-8091-cd183bb78346" (UID: "4206ad3f-ede3-4721-8091-cd183bb78346"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:00:56.448603 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:56.448581    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4206ad3f-ede3-4721-8091-cd183bb78346-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4206ad3f-ede3-4721-8091-cd183bb78346" (UID: "4206ad3f-ede3-4721-8091-cd183bb78346"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:00:56.448603 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:56.448575    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4206ad3f-ede3-4721-8091-cd183bb78346-kube-api-access-nbrss" (OuterVolumeSpecName: "kube-api-access-nbrss") pod "4206ad3f-ede3-4721-8091-cd183bb78346" (UID: "4206ad3f-ede3-4721-8091-cd183bb78346"). InnerVolumeSpecName "kube-api-access-nbrss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:00:56.547731 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:56.547689    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4206ad3f-ede3-4721-8091-cd183bb78346-metrics-certs\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:00:56.547731 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:56.547727    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbrss\" (UniqueName: \"kubernetes.io/projected/4206ad3f-ede3-4721-8091-cd183bb78346-kube-api-access-nbrss\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:00:56.547731 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:56.547741    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4206ad3f-ede3-4721-8091-cd183bb78346-maas-api-tls\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:00:56.547982 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:56.547754    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4206ad3f-ede3-4721-8091-cd183bb78346-openshift-service-ca\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:00:56.685372 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:56.685336    2577 generic.go:356] "Generic (PLEG): container finished" podID="4206ad3f-ede3-4721-8091-cd183bb78346" containerID="da0605d6314183743e002505f766a83ddd293b80c38c96bab7d2e033598324a0" exitCode=0
Sep 08 15:00:56.685580 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:56.685382    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv"
Sep 08 15:00:56.685580 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:56.685429    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv" event={"ID":"4206ad3f-ede3-4721-8091-cd183bb78346","Type":"ContainerDied","Data":"da0605d6314183743e002505f766a83ddd293b80c38c96bab7d2e033598324a0"}
Sep 08 15:00:56.685580 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:56.685495    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv" event={"ID":"4206ad3f-ede3-4721-8091-cd183bb78346","Type":"ContainerDied","Data":"beaf2890f1d959d5bbb88cc5402963d65a1cef6d3546cf4c5c2d299e4e56ebeb"}
Sep 08 15:00:56.685580 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:56.685520    2577 scope.go:117] "RemoveContainer" containerID="da0605d6314183743e002505f766a83ddd293b80c38c96bab7d2e033598324a0"
Sep 08 15:00:56.698495 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:56.698455    2577 scope.go:117] "RemoveContainer" containerID="da0605d6314183743e002505f766a83ddd293b80c38c96bab7d2e033598324a0"
Sep 08 15:00:56.699007 ip-10-0-142-20 kubenswrapper[2577]: E0908 15:00:56.698979    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da0605d6314183743e002505f766a83ddd293b80c38c96bab7d2e033598324a0\": container with ID starting with da0605d6314183743e002505f766a83ddd293b80c38c96bab7d2e033598324a0 not found: ID does not exist" containerID="da0605d6314183743e002505f766a83ddd293b80c38c96bab7d2e033598324a0"
Sep 08 15:00:56.699113 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:56.699027    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da0605d6314183743e002505f766a83ddd293b80c38c96bab7d2e033598324a0"} err="failed to get container status \"da0605d6314183743e002505f766a83ddd293b80c38c96bab7d2e033598324a0\": rpc error: code = NotFound desc = could not find container \"da0605d6314183743e002505f766a83ddd293b80c38c96bab7d2e033598324a0\": container with ID starting with da0605d6314183743e002505f766a83ddd293b80c38c96bab7d2e033598324a0 not found: ID does not exist"
Sep 08 15:00:56.714399 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:56.714369    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv"]
Sep 08 15:00:56.721340 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:56.721314    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-28eb2c-797c7cf64d-7g9dv"]
Sep 08 15:00:57.491001 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:57.490962    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4206ad3f-ede3-4721-8091-cd183bb78346" path="/var/lib/kubelet/pods/4206ad3f-ede3-4721-8091-cd183bb78346/volumes"
Sep 08 15:00:57.580182 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:57.580151    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 15:00:59.769880 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:00:59.769852    2577 scope.go:117] "RemoveContainer" containerID="9ade3000fb22136a6791d837aabbcff3256119a54723a77ede88fc630d59df3f"
Sep 08 15:01:07.370678 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:01:07.370641    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 15:02:05.607258 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:05.607217    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq"]
Sep 08 15:02:05.607822 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:05.607499    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq" podUID="a4b44f24-a04f-47ef-9999-b3a2f7286ca7" containerName="maas-api" containerID="cri-o://ab6df561320b51f11b2487017ce8500c17b3d63f69dd65394c44fc9e7e0216f2" gracePeriod=30
Sep 08 15:02:05.856736 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:05.856714    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq"
Sep 08 15:02:05.977202 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:05.977172    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4b44f24-a04f-47ef-9999-b3a2f7286ca7-metrics-certs\") pod \"a4b44f24-a04f-47ef-9999-b3a2f7286ca7\" (UID: \"a4b44f24-a04f-47ef-9999-b3a2f7286ca7\") "
Sep 08 15:02:05.977366 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:05.977208    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4p69\" (UniqueName: \"kubernetes.io/projected/a4b44f24-a04f-47ef-9999-b3a2f7286ca7-kube-api-access-h4p69\") pod \"a4b44f24-a04f-47ef-9999-b3a2f7286ca7\" (UID: \"a4b44f24-a04f-47ef-9999-b3a2f7286ca7\") "
Sep 08 15:02:05.977366 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:05.977278    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4b44f24-a04f-47ef-9999-b3a2f7286ca7-maas-api-tls\") pod \"a4b44f24-a04f-47ef-9999-b3a2f7286ca7\" (UID: \"a4b44f24-a04f-47ef-9999-b3a2f7286ca7\") "
Sep 08 15:02:05.977366 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:05.977332    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4b44f24-a04f-47ef-9999-b3a2f7286ca7-openshift-service-ca\") pod \"a4b44f24-a04f-47ef-9999-b3a2f7286ca7\" (UID: \"a4b44f24-a04f-47ef-9999-b3a2f7286ca7\") "
Sep 08 15:02:05.977768 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:05.977735    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4b44f24-a04f-47ef-9999-b3a2f7286ca7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a4b44f24-a04f-47ef-9999-b3a2f7286ca7" (UID: "a4b44f24-a04f-47ef-9999-b3a2f7286ca7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:02:05.979517 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:05.979458    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4b44f24-a04f-47ef-9999-b3a2f7286ca7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a4b44f24-a04f-47ef-9999-b3a2f7286ca7" (UID: "a4b44f24-a04f-47ef-9999-b3a2f7286ca7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:02:05.979966 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:05.979946    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4b44f24-a04f-47ef-9999-b3a2f7286ca7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a4b44f24-a04f-47ef-9999-b3a2f7286ca7" (UID: "a4b44f24-a04f-47ef-9999-b3a2f7286ca7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:02:05.980083 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:05.979963    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4b44f24-a04f-47ef-9999-b3a2f7286ca7-kube-api-access-h4p69" (OuterVolumeSpecName: "kube-api-access-h4p69") pod "a4b44f24-a04f-47ef-9999-b3a2f7286ca7" (UID: "a4b44f24-a04f-47ef-9999-b3a2f7286ca7"). InnerVolumeSpecName "kube-api-access-h4p69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:02:06.078162 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:06.078128    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4b44f24-a04f-47ef-9999-b3a2f7286ca7-metrics-certs\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:06.078162 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:06.078156    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4p69\" (UniqueName: \"kubernetes.io/projected/a4b44f24-a04f-47ef-9999-b3a2f7286ca7-kube-api-access-h4p69\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:06.078162 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:06.078166    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4b44f24-a04f-47ef-9999-b3a2f7286ca7-maas-api-tls\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:06.078394 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:06.078175    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4b44f24-a04f-47ef-9999-b3a2f7286ca7-openshift-service-ca\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:06.094454 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:06.094423    2577 generic.go:356] "Generic (PLEG): container finished" podID="a4b44f24-a04f-47ef-9999-b3a2f7286ca7" containerID="ab6df561320b51f11b2487017ce8500c17b3d63f69dd65394c44fc9e7e0216f2" exitCode=0
Sep 08 15:02:06.094651 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:06.094487    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq"
Sep 08 15:02:06.094651 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:06.094509    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq" event={"ID":"a4b44f24-a04f-47ef-9999-b3a2f7286ca7","Type":"ContainerDied","Data":"ab6df561320b51f11b2487017ce8500c17b3d63f69dd65394c44fc9e7e0216f2"}
Sep 08 15:02:06.094651 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:06.094575    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq" event={"ID":"a4b44f24-a04f-47ef-9999-b3a2f7286ca7","Type":"ContainerDied","Data":"5d985dc1ad52fe1e447bf0850d56080a04fc1acfc8097cffd30c63ca880015a5"}
Sep 08 15:02:06.094651 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:06.094607    2577 scope.go:117] "RemoveContainer" containerID="ab6df561320b51f11b2487017ce8500c17b3d63f69dd65394c44fc9e7e0216f2"
Sep 08 15:02:06.105455 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:06.105434    2577 scope.go:117] "RemoveContainer" containerID="ab6df561320b51f11b2487017ce8500c17b3d63f69dd65394c44fc9e7e0216f2"
Sep 08 15:02:06.105845 ip-10-0-142-20 kubenswrapper[2577]: E0908 15:02:06.105821    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab6df561320b51f11b2487017ce8500c17b3d63f69dd65394c44fc9e7e0216f2\": container with ID starting with ab6df561320b51f11b2487017ce8500c17b3d63f69dd65394c44fc9e7e0216f2 not found: ID does not exist" containerID="ab6df561320b51f11b2487017ce8500c17b3d63f69dd65394c44fc9e7e0216f2"
Sep 08 15:02:06.105941 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:06.105857    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab6df561320b51f11b2487017ce8500c17b3d63f69dd65394c44fc9e7e0216f2"} err="failed to get container status \"ab6df561320b51f11b2487017ce8500c17b3d63f69dd65394c44fc9e7e0216f2\": rpc error: code = NotFound desc = could not find container \"ab6df561320b51f11b2487017ce8500c17b3d63f69dd65394c44fc9e7e0216f2\": container with ID starting with ab6df561320b51f11b2487017ce8500c17b3d63f69dd65394c44fc9e7e0216f2 not found: ID does not exist"
Sep 08 15:02:06.116749 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:06.116728    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq"]
Sep 08 15:02:06.123114 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:06.123093    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-a89cbb-5dcfb4864d-hjtvq"]
Sep 08 15:02:07.491018 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:07.490983    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4b44f24-a04f-47ef-9999-b3a2f7286ca7" path="/var/lib/kubelet/pods/a4b44f24-a04f-47ef-9999-b3a2f7286ca7/volumes"
Sep 08 15:02:09.575938 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:09.575909    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 15:02:12.538237 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:12.538204    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"]
Sep 08 15:02:12.538645 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:12.538419    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk" podUID="335c8f00-0edf-489f-8d92-5ce4514e224a" containerName="istio-proxy" containerID="cri-o://f8e4fe40f56e9b923d241083db49582ded4def23e3513aeaf13e223c313608ff" gracePeriod=30
Sep 08 15:02:15.275911 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:15.275877    2577 patch_prober.go:28] interesting pod/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 15:02:15.276283 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:15.275938    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk" podUID="335c8f00-0edf-489f-8d92-5ce4514e224a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 15:02:17.790066 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:17.790043    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 15:02:17.887955 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:17.887870    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/335c8f00-0edf-489f-8d92-5ce4514e224a-istio-token\") pod \"335c8f00-0edf-489f-8d92-5ce4514e224a\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") "
Sep 08 15:02:17.887955 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:17.887939    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/335c8f00-0edf-489f-8d92-5ce4514e224a-workload-certs\") pod \"335c8f00-0edf-489f-8d92-5ce4514e224a\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") "
Sep 08 15:02:17.887955 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:17.887955    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/335c8f00-0edf-489f-8d92-5ce4514e224a-istio-data\") pod \"335c8f00-0edf-489f-8d92-5ce4514e224a\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") "
Sep 08 15:02:17.888255 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:17.887990    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/335c8f00-0edf-489f-8d92-5ce4514e224a-workload-socket\") pod \"335c8f00-0edf-489f-8d92-5ce4514e224a\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") "
Sep 08 15:02:17.888255 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:17.888016    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/335c8f00-0edf-489f-8d92-5ce4514e224a-istio-envoy\") pod \"335c8f00-0edf-489f-8d92-5ce4514e224a\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") "
Sep 08 15:02:17.888255 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:17.888032    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgwm9\" (UniqueName: \"kubernetes.io/projected/335c8f00-0edf-489f-8d92-5ce4514e224a-kube-api-access-pgwm9\") pod \"335c8f00-0edf-489f-8d92-5ce4514e224a\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") "
Sep 08 15:02:17.888255 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:17.888124    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/335c8f00-0edf-489f-8d92-5ce4514e224a-credential-socket\") pod \"335c8f00-0edf-489f-8d92-5ce4514e224a\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") "
Sep 08 15:02:17.888255 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:17.888192    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/335c8f00-0edf-489f-8d92-5ce4514e224a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "335c8f00-0edf-489f-8d92-5ce4514e224a" (UID: "335c8f00-0edf-489f-8d92-5ce4514e224a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:02:17.888559 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:17.888287    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/335c8f00-0edf-489f-8d92-5ce4514e224a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "335c8f00-0edf-489f-8d92-5ce4514e224a" (UID: "335c8f00-0edf-489f-8d92-5ce4514e224a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:02:17.888559 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:17.888304    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/335c8f00-0edf-489f-8d92-5ce4514e224a-istio-data" (OuterVolumeSpecName: "istio-data") pod "335c8f00-0edf-489f-8d92-5ce4514e224a" (UID: "335c8f00-0edf-489f-8d92-5ce4514e224a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:02:17.888656 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:17.888559    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/335c8f00-0edf-489f-8d92-5ce4514e224a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "335c8f00-0edf-489f-8d92-5ce4514e224a" (UID: "335c8f00-0edf-489f-8d92-5ce4514e224a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:02:17.888656 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:17.888582    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/335c8f00-0edf-489f-8d92-5ce4514e224a-workload-certs\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:17.888656 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:17.888603    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/335c8f00-0edf-489f-8d92-5ce4514e224a-istio-data\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:17.888656 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:17.888617    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/335c8f00-0edf-489f-8d92-5ce4514e224a-workload-socket\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:17.890150 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:17.890124    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/335c8f00-0edf-489f-8d92-5ce4514e224a-istio-token" (OuterVolumeSpecName: "istio-token") pod "335c8f00-0edf-489f-8d92-5ce4514e224a" (UID: "335c8f00-0edf-489f-8d92-5ce4514e224a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:02:17.890240 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:17.890210    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/335c8f00-0edf-489f-8d92-5ce4514e224a-kube-api-access-pgwm9" (OuterVolumeSpecName: "kube-api-access-pgwm9") pod "335c8f00-0edf-489f-8d92-5ce4514e224a" (UID: "335c8f00-0edf-489f-8d92-5ce4514e224a"). InnerVolumeSpecName "kube-api-access-pgwm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:02:17.890298 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:17.890256    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/335c8f00-0edf-489f-8d92-5ce4514e224a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "335c8f00-0edf-489f-8d92-5ce4514e224a" (UID: "335c8f00-0edf-489f-8d92-5ce4514e224a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:02:17.989438 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:17.989408    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/335c8f00-0edf-489f-8d92-5ce4514e224a-istio-podinfo\") pod \"335c8f00-0edf-489f-8d92-5ce4514e224a\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") "
Sep 08 15:02:17.989438 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:17.989442    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/335c8f00-0edf-489f-8d92-5ce4514e224a-istiod-ca-cert\") pod \"335c8f00-0edf-489f-8d92-5ce4514e224a\" (UID: \"335c8f00-0edf-489f-8d92-5ce4514e224a\") "
Sep 08 15:02:17.989633 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:17.989612    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/335c8f00-0edf-489f-8d92-5ce4514e224a-istio-envoy\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:17.989633 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:17.989623    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgwm9\" (UniqueName: \"kubernetes.io/projected/335c8f00-0edf-489f-8d92-5ce4514e224a-kube-api-access-pgwm9\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:17.989633 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:17.989632    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/335c8f00-0edf-489f-8d92-5ce4514e224a-credential-socket\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:17.989733 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:17.989641    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/335c8f00-0edf-489f-8d92-5ce4514e224a-istio-token\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:17.989815 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:17.989794    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/335c8f00-0edf-489f-8d92-5ce4514e224a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "335c8f00-0edf-489f-8d92-5ce4514e224a" (UID: "335c8f00-0edf-489f-8d92-5ce4514e224a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:02:17.991422 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:17.991402    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/335c8f00-0edf-489f-8d92-5ce4514e224a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "335c8f00-0edf-489f-8d92-5ce4514e224a" (UID: "335c8f00-0edf-489f-8d92-5ce4514e224a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:02:18.090108 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:18.090073    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/335c8f00-0edf-489f-8d92-5ce4514e224a-istio-podinfo\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:18.090108 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:18.090101    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/335c8f00-0edf-489f-8d92-5ce4514e224a-istiod-ca-cert\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:18.171894 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:18.171864    2577 generic.go:356] "Generic (PLEG): container finished" podID="335c8f00-0edf-489f-8d92-5ce4514e224a" containerID="f8e4fe40f56e9b923d241083db49582ded4def23e3513aeaf13e223c313608ff" exitCode=0
Sep 08 15:02:18.172062 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:18.171916    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"
Sep 08 15:02:18.172062 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:18.171946    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk" event={"ID":"335c8f00-0edf-489f-8d92-5ce4514e224a","Type":"ContainerDied","Data":"f8e4fe40f56e9b923d241083db49582ded4def23e3513aeaf13e223c313608ff"}
Sep 08 15:02:18.172062 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:18.171997    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk" event={"ID":"335c8f00-0edf-489f-8d92-5ce4514e224a","Type":"ContainerDied","Data":"00dcfa5d90665dd3ed4c7e87532fb6b03a5733bec3ef787999d6a2c96cb2549d"}
Sep 08 15:02:18.172062 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:18.172019    2577 scope.go:117] "RemoveContainer" containerID="f8e4fe40f56e9b923d241083db49582ded4def23e3513aeaf13e223c313608ff"
Sep 08 15:02:18.181853 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:18.181837    2577 scope.go:117] "RemoveContainer" containerID="9d16659393b3bf80653469af8dc7b7ae0a384737f2b6268f63f010b4fdcd6000"
Sep 08 15:02:18.190552 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:18.190534    2577 scope.go:117] "RemoveContainer" containerID="f8e4fe40f56e9b923d241083db49582ded4def23e3513aeaf13e223c313608ff"
Sep 08 15:02:18.190832 ip-10-0-142-20 kubenswrapper[2577]: E0908 15:02:18.190814    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8e4fe40f56e9b923d241083db49582ded4def23e3513aeaf13e223c313608ff\": container with ID starting with f8e4fe40f56e9b923d241083db49582ded4def23e3513aeaf13e223c313608ff not found: ID does not exist" containerID="f8e4fe40f56e9b923d241083db49582ded4def23e3513aeaf13e223c313608ff"
Sep 08 15:02:18.190876 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:18.190842    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8e4fe40f56e9b923d241083db49582ded4def23e3513aeaf13e223c313608ff"} err="failed to get container status \"f8e4fe40f56e9b923d241083db49582ded4def23e3513aeaf13e223c313608ff\": rpc error: code = NotFound desc = could not find container \"f8e4fe40f56e9b923d241083db49582ded4def23e3513aeaf13e223c313608ff\": container with ID starting with f8e4fe40f56e9b923d241083db49582ded4def23e3513aeaf13e223c313608ff not found: ID does not exist"
Sep 08 15:02:18.190876 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:18.190860    2577 scope.go:117] "RemoveContainer" containerID="9d16659393b3bf80653469af8dc7b7ae0a384737f2b6268f63f010b4fdcd6000"
Sep 08 15:02:18.191197 ip-10-0-142-20 kubenswrapper[2577]: E0908 15:02:18.191154    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d16659393b3bf80653469af8dc7b7ae0a384737f2b6268f63f010b4fdcd6000\": container with ID starting with 9d16659393b3bf80653469af8dc7b7ae0a384737f2b6268f63f010b4fdcd6000 not found: ID does not exist" containerID="9d16659393b3bf80653469af8dc7b7ae0a384737f2b6268f63f010b4fdcd6000"
Sep 08 15:02:18.191307 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:18.191204    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d16659393b3bf80653469af8dc7b7ae0a384737f2b6268f63f010b4fdcd6000"} err="failed to get container status \"9d16659393b3bf80653469af8dc7b7ae0a384737f2b6268f63f010b4fdcd6000\": rpc error: code = NotFound desc = could not find container \"9d16659393b3bf80653469af8dc7b7ae0a384737f2b6268f63f010b4fdcd6000\": container with ID starting with 9d16659393b3bf80653469af8dc7b7ae0a384737f2b6268f63f010b4fdcd6000 not found: ID does not exist"
Sep 08 15:02:18.193916 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:18.193896    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"]
Sep 08 15:02:18.200354 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:18.200333    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-a89cbb-openshift-default-d956d64db-2hfdk"]
Sep 08 15:02:19.490773 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:19.490733    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="335c8f00-0edf-489f-8d92-5ce4514e224a" path="/var/lib/kubelet/pods/335c8f00-0edf-489f-8d92-5ce4514e224a/volumes"
Sep 08 15:02:23.507968 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:23.507886    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws"]
Sep 08 15:02:23.508827 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:23.508797    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws" podUID="68f7c1cd-ce93-4940-9e58-c99097594b95" containerName="maas-api" containerID="cri-o://e5d0ce962b8e1a7318750a64c9c36ff7f38ff9e73df5a356ea08b88add4a7653" gracePeriod=30
Sep 08 15:02:23.758310 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:23.758253    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws"
Sep 08 15:02:23.835258 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:23.835231    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ng5w\" (UniqueName: \"kubernetes.io/projected/68f7c1cd-ce93-4940-9e58-c99097594b95-kube-api-access-9ng5w\") pod \"68f7c1cd-ce93-4940-9e58-c99097594b95\" (UID: \"68f7c1cd-ce93-4940-9e58-c99097594b95\") "
Sep 08 15:02:23.835443 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:23.835270    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68f7c1cd-ce93-4940-9e58-c99097594b95-metrics-certs\") pod \"68f7c1cd-ce93-4940-9e58-c99097594b95\" (UID: \"68f7c1cd-ce93-4940-9e58-c99097594b95\") "
Sep 08 15:02:23.835443 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:23.835304    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68f7c1cd-ce93-4940-9e58-c99097594b95-maas-api-tls\") pod \"68f7c1cd-ce93-4940-9e58-c99097594b95\" (UID: \"68f7c1cd-ce93-4940-9e58-c99097594b95\") "
Sep 08 15:02:23.835443 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:23.835349    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68f7c1cd-ce93-4940-9e58-c99097594b95-openshift-service-ca\") pod \"68f7c1cd-ce93-4940-9e58-c99097594b95\" (UID: \"68f7c1cd-ce93-4940-9e58-c99097594b95\") "
Sep 08 15:02:23.835797 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:23.835767    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68f7c1cd-ce93-4940-9e58-c99097594b95-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "68f7c1cd-ce93-4940-9e58-c99097594b95" (UID: "68f7c1cd-ce93-4940-9e58-c99097594b95"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:02:23.837614 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:23.837582    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68f7c1cd-ce93-4940-9e58-c99097594b95-kube-api-access-9ng5w" (OuterVolumeSpecName: "kube-api-access-9ng5w") pod "68f7c1cd-ce93-4940-9e58-c99097594b95" (UID: "68f7c1cd-ce93-4940-9e58-c99097594b95"). InnerVolumeSpecName "kube-api-access-9ng5w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:02:23.837724 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:23.837637    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68f7c1cd-ce93-4940-9e58-c99097594b95-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "68f7c1cd-ce93-4940-9e58-c99097594b95" (UID: "68f7c1cd-ce93-4940-9e58-c99097594b95"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:02:23.837724 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:23.837650    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68f7c1cd-ce93-4940-9e58-c99097594b95-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "68f7c1cd-ce93-4940-9e58-c99097594b95" (UID: "68f7c1cd-ce93-4940-9e58-c99097594b95"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:02:23.936361 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:23.936325    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68f7c1cd-ce93-4940-9e58-c99097594b95-openshift-service-ca\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:23.936361 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:23.936355    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ng5w\" (UniqueName: \"kubernetes.io/projected/68f7c1cd-ce93-4940-9e58-c99097594b95-kube-api-access-9ng5w\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:23.936361 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:23.936364    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68f7c1cd-ce93-4940-9e58-c99097594b95-metrics-certs\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:23.936621 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:23.936372    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68f7c1cd-ce93-4940-9e58-c99097594b95-maas-api-tls\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:24.219580 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:24.219543    2577 generic.go:356] "Generic (PLEG): container finished" podID="68f7c1cd-ce93-4940-9e58-c99097594b95" containerID="e5d0ce962b8e1a7318750a64c9c36ff7f38ff9e73df5a356ea08b88add4a7653" exitCode=0
Sep 08 15:02:24.219741 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:24.219593    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws"
Sep 08 15:02:24.219741 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:24.219622    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws" event={"ID":"68f7c1cd-ce93-4940-9e58-c99097594b95","Type":"ContainerDied","Data":"e5d0ce962b8e1a7318750a64c9c36ff7f38ff9e73df5a356ea08b88add4a7653"}
Sep 08 15:02:24.219741 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:24.219698    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws" event={"ID":"68f7c1cd-ce93-4940-9e58-c99097594b95","Type":"ContainerDied","Data":"43593e7f459d177539efc782dd4f8b0522fa84c512366d6b2ebbc70046ae68a1"}
Sep 08 15:02:24.219741 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:24.219721    2577 scope.go:117] "RemoveContainer" containerID="e5d0ce962b8e1a7318750a64c9c36ff7f38ff9e73df5a356ea08b88add4a7653"
Sep 08 15:02:24.229686 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:24.229669    2577 scope.go:117] "RemoveContainer" containerID="e5d0ce962b8e1a7318750a64c9c36ff7f38ff9e73df5a356ea08b88add4a7653"
Sep 08 15:02:24.229931 ip-10-0-142-20 kubenswrapper[2577]: E0908 15:02:24.229914    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5d0ce962b8e1a7318750a64c9c36ff7f38ff9e73df5a356ea08b88add4a7653\": container with ID starting with e5d0ce962b8e1a7318750a64c9c36ff7f38ff9e73df5a356ea08b88add4a7653 not found: ID does not exist" containerID="e5d0ce962b8e1a7318750a64c9c36ff7f38ff9e73df5a356ea08b88add4a7653"
Sep 08 15:02:24.229999 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:24.229938    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5d0ce962b8e1a7318750a64c9c36ff7f38ff9e73df5a356ea08b88add4a7653"} err="failed to get container status \"e5d0ce962b8e1a7318750a64c9c36ff7f38ff9e73df5a356ea08b88add4a7653\": rpc error: code = NotFound desc = could not find container \"e5d0ce962b8e1a7318750a64c9c36ff7f38ff9e73df5a356ea08b88add4a7653\": container with ID starting with e5d0ce962b8e1a7318750a64c9c36ff7f38ff9e73df5a356ea08b88add4a7653 not found: ID does not exist"
Sep 08 15:02:24.242663 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:24.242643    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws"]
Sep 08 15:02:24.246657 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:24.246628    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ef8f61-67c697b5f9-h8hws"]
Sep 08 15:02:25.490336 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:25.490300    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68f7c1cd-ce93-4940-9e58-c99097594b95" path="/var/lib/kubelet/pods/68f7c1cd-ce93-4940-9e58-c99097594b95/volumes"
Sep 08 15:02:27.201454 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:27.201422    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 15:02:42.734820 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:42.734782    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4"]
Sep 08 15:02:42.735301 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:42.734989    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4" podUID="0e4ae60d-fc01-4ee9-abc2-782e8bb2660b" containerName="maas-api" containerID="cri-o://a5f9677dc619cf9c113d771238eff15cdb24efecfcc69e98d7c0da22df7babe9" gracePeriod=30
Sep 08 15:02:42.983929 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:42.983900    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4"
Sep 08 15:02:43.107360 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:43.107231    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e4ae60d-fc01-4ee9-abc2-782e8bb2660b-maas-api-tls\") pod \"0e4ae60d-fc01-4ee9-abc2-782e8bb2660b\" (UID: \"0e4ae60d-fc01-4ee9-abc2-782e8bb2660b\") "
Sep 08 15:02:43.107552 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:43.107351    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e4ae60d-fc01-4ee9-abc2-782e8bb2660b-metrics-certs\") pod \"0e4ae60d-fc01-4ee9-abc2-782e8bb2660b\" (UID: \"0e4ae60d-fc01-4ee9-abc2-782e8bb2660b\") "
Sep 08 15:02:43.107552 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:43.107425    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpc5x\" (UniqueName: \"kubernetes.io/projected/0e4ae60d-fc01-4ee9-abc2-782e8bb2660b-kube-api-access-xpc5x\") pod \"0e4ae60d-fc01-4ee9-abc2-782e8bb2660b\" (UID: \"0e4ae60d-fc01-4ee9-abc2-782e8bb2660b\") "
Sep 08 15:02:43.107552 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:43.107499    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e4ae60d-fc01-4ee9-abc2-782e8bb2660b-openshift-service-ca\") pod \"0e4ae60d-fc01-4ee9-abc2-782e8bb2660b\" (UID: \"0e4ae60d-fc01-4ee9-abc2-782e8bb2660b\") "
Sep 08 15:02:43.110790 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:43.110395    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e4ae60d-fc01-4ee9-abc2-782e8bb2660b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0e4ae60d-fc01-4ee9-abc2-782e8bb2660b" (UID: "0e4ae60d-fc01-4ee9-abc2-782e8bb2660b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:02:43.110790 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:43.110460    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e4ae60d-fc01-4ee9-abc2-782e8bb2660b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0e4ae60d-fc01-4ee9-abc2-782e8bb2660b" (UID: "0e4ae60d-fc01-4ee9-abc2-782e8bb2660b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:02:43.111512 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:43.111312    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e4ae60d-fc01-4ee9-abc2-782e8bb2660b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0e4ae60d-fc01-4ee9-abc2-782e8bb2660b" (UID: "0e4ae60d-fc01-4ee9-abc2-782e8bb2660b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:02:43.111618 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:43.111571    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e4ae60d-fc01-4ee9-abc2-782e8bb2660b-kube-api-access-xpc5x" (OuterVolumeSpecName: "kube-api-access-xpc5x") pod "0e4ae60d-fc01-4ee9-abc2-782e8bb2660b" (UID: "0e4ae60d-fc01-4ee9-abc2-782e8bb2660b"). InnerVolumeSpecName "kube-api-access-xpc5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:02:43.209335 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:43.209293    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpc5x\" (UniqueName: \"kubernetes.io/projected/0e4ae60d-fc01-4ee9-abc2-782e8bb2660b-kube-api-access-xpc5x\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:43.209335 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:43.209332    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e4ae60d-fc01-4ee9-abc2-782e8bb2660b-openshift-service-ca\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:43.209553 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:43.209351    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e4ae60d-fc01-4ee9-abc2-782e8bb2660b-maas-api-tls\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:43.209553 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:43.209365    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e4ae60d-fc01-4ee9-abc2-782e8bb2660b-metrics-certs\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:43.331215 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:43.331173    2577 generic.go:356] "Generic (PLEG): container finished" podID="0e4ae60d-fc01-4ee9-abc2-782e8bb2660b" containerID="a5f9677dc619cf9c113d771238eff15cdb24efecfcc69e98d7c0da22df7babe9" exitCode=0
Sep 08 15:02:43.331403 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:43.331231    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4"
Sep 08 15:02:43.331403 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:43.331259    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4" event={"ID":"0e4ae60d-fc01-4ee9-abc2-782e8bb2660b","Type":"ContainerDied","Data":"a5f9677dc619cf9c113d771238eff15cdb24efecfcc69e98d7c0da22df7babe9"}
Sep 08 15:02:43.331403 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:43.331344    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4" event={"ID":"0e4ae60d-fc01-4ee9-abc2-782e8bb2660b","Type":"ContainerDied","Data":"52eb0fa9daef2f80fc7673d0a798c448ce6c0ec79bb1ce8479fadf57f9a8f995"}
Sep 08 15:02:43.331403 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:43.331368    2577 scope.go:117] "RemoveContainer" containerID="a5f9677dc619cf9c113d771238eff15cdb24efecfcc69e98d7c0da22df7babe9"
Sep 08 15:02:43.341196 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:43.341177    2577 scope.go:117] "RemoveContainer" containerID="a5f9677dc619cf9c113d771238eff15cdb24efecfcc69e98d7c0da22df7babe9"
Sep 08 15:02:43.341463 ip-10-0-142-20 kubenswrapper[2577]: E0908 15:02:43.341444    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5f9677dc619cf9c113d771238eff15cdb24efecfcc69e98d7c0da22df7babe9\": container with ID starting with a5f9677dc619cf9c113d771238eff15cdb24efecfcc69e98d7c0da22df7babe9 not found: ID does not exist" containerID="a5f9677dc619cf9c113d771238eff15cdb24efecfcc69e98d7c0da22df7babe9"
Sep 08 15:02:43.341530 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:43.341490    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5f9677dc619cf9c113d771238eff15cdb24efecfcc69e98d7c0da22df7babe9"} err="failed to get container status \"a5f9677dc619cf9c113d771238eff15cdb24efecfcc69e98d7c0da22df7babe9\": rpc error: code = NotFound desc = could not find container \"a5f9677dc619cf9c113d771238eff15cdb24efecfcc69e98d7c0da22df7babe9\": container with ID starting with a5f9677dc619cf9c113d771238eff15cdb24efecfcc69e98d7c0da22df7babe9 not found: ID does not exist"
Sep 08 15:02:43.354170 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:43.354140    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4"]
Sep 08 15:02:43.358646 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:43.358593    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f83533-64b77b9bb8-nqbr4"]
Sep 08 15:02:43.491605 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:43.491573    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e4ae60d-fc01-4ee9-abc2-782e8bb2660b" path="/var/lib/kubelet/pods/0e4ae60d-fc01-4ee9-abc2-782e8bb2660b/volumes"
Sep 08 15:02:45.465497 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:45.465448    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 15:02:49.751254 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:49.751225    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"]
Sep 08 15:02:49.751665 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:49.751453    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr" podUID="f27e38e8-b96f-4062-8fc1-bbe082a13b40" containerName="istio-proxy" containerID="cri-o://ea42dea95e423a70facb2da499e12ae9b9d07e013dac8235c75c533fe6679dec" gracePeriod=30
Sep 08 15:02:52.403960 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:52.403923    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b46c4bd46-65pss"]
Sep 08 15:02:52.404427 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:52.404137    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-b46c4bd46-65pss" podUID="8062dfca-292a-4eb3-b57e-c334ba5559e4" containerName="manager" containerID="cri-o://a948593bd709748df23b0e8e1db7d161d668ec6ef3ca75aadb99ab734587af46" gracePeriod=30
Sep 08 15:02:52.657111 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:52.657049    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b46c4bd46-65pss"
Sep 08 15:02:52.797308 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:52.797280    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8062dfca-292a-4eb3-b57e-c334ba5559e4-webhook-cert\") pod \"8062dfca-292a-4eb3-b57e-c334ba5559e4\" (UID: \"8062dfca-292a-4eb3-b57e-c334ba5559e4\") "
Sep 08 15:02:52.797505 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:52.797381    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4fzm\" (UniqueName: \"kubernetes.io/projected/8062dfca-292a-4eb3-b57e-c334ba5559e4-kube-api-access-z4fzm\") pod \"8062dfca-292a-4eb3-b57e-c334ba5559e4\" (UID: \"8062dfca-292a-4eb3-b57e-c334ba5559e4\") "
Sep 08 15:02:52.797505 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:52.797408    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8062dfca-292a-4eb3-b57e-c334ba5559e4-metrics-certs\") pod \"8062dfca-292a-4eb3-b57e-c334ba5559e4\" (UID: \"8062dfca-292a-4eb3-b57e-c334ba5559e4\") "
Sep 08 15:02:52.799619 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:52.799588    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8062dfca-292a-4eb3-b57e-c334ba5559e4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8062dfca-292a-4eb3-b57e-c334ba5559e4" (UID: "8062dfca-292a-4eb3-b57e-c334ba5559e4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:02:52.799714 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:52.799641    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8062dfca-292a-4eb3-b57e-c334ba5559e4-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8062dfca-292a-4eb3-b57e-c334ba5559e4" (UID: "8062dfca-292a-4eb3-b57e-c334ba5559e4"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:02:52.799773 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:52.799758    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8062dfca-292a-4eb3-b57e-c334ba5559e4-kube-api-access-z4fzm" (OuterVolumeSpecName: "kube-api-access-z4fzm") pod "8062dfca-292a-4eb3-b57e-c334ba5559e4" (UID: "8062dfca-292a-4eb3-b57e-c334ba5559e4"). InnerVolumeSpecName "kube-api-access-z4fzm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:02:52.898801 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:52.898761    2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8062dfca-292a-4eb3-b57e-c334ba5559e4-webhook-cert\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:52.898801 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:52.898797    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4fzm\" (UniqueName: \"kubernetes.io/projected/8062dfca-292a-4eb3-b57e-c334ba5559e4-kube-api-access-z4fzm\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:52.898801 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:52.898806    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8062dfca-292a-4eb3-b57e-c334ba5559e4-metrics-certs\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:53.388876 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:53.388833    2577 generic.go:356] "Generic (PLEG): container finished" podID="8062dfca-292a-4eb3-b57e-c334ba5559e4" containerID="a948593bd709748df23b0e8e1db7d161d668ec6ef3ca75aadb99ab734587af46" exitCode=0
Sep 08 15:02:53.389082 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:53.388882    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b46c4bd46-65pss"
Sep 08 15:02:53.389082 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:53.388934    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b46c4bd46-65pss" event={"ID":"8062dfca-292a-4eb3-b57e-c334ba5559e4","Type":"ContainerDied","Data":"a948593bd709748df23b0e8e1db7d161d668ec6ef3ca75aadb99ab734587af46"}
Sep 08 15:02:53.389082 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:53.388988    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b46c4bd46-65pss" event={"ID":"8062dfca-292a-4eb3-b57e-c334ba5559e4","Type":"ContainerDied","Data":"d2a2723098c5157cc910f1f811057ed876ceacdc3440953c82c3e314e6ace32c"}
Sep 08 15:02:53.389082 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:53.389015    2577 scope.go:117] "RemoveContainer" containerID="a948593bd709748df23b0e8e1db7d161d668ec6ef3ca75aadb99ab734587af46"
Sep 08 15:02:53.401262 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:53.401187    2577 scope.go:117] "RemoveContainer" containerID="a948593bd709748df23b0e8e1db7d161d668ec6ef3ca75aadb99ab734587af46"
Sep 08 15:02:53.401698 ip-10-0-142-20 kubenswrapper[2577]: E0908 15:02:53.401633    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a948593bd709748df23b0e8e1db7d161d668ec6ef3ca75aadb99ab734587af46\": container with ID starting with a948593bd709748df23b0e8e1db7d161d668ec6ef3ca75aadb99ab734587af46 not found: ID does not exist" containerID="a948593bd709748df23b0e8e1db7d161d668ec6ef3ca75aadb99ab734587af46"
Sep 08 15:02:53.401698 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:53.401667    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a948593bd709748df23b0e8e1db7d161d668ec6ef3ca75aadb99ab734587af46"} err="failed to get container status \"a948593bd709748df23b0e8e1db7d161d668ec6ef3ca75aadb99ab734587af46\": rpc error: code = NotFound desc = could not find container \"a948593bd709748df23b0e8e1db7d161d668ec6ef3ca75aadb99ab734587af46\": container with ID starting with a948593bd709748df23b0e8e1db7d161d668ec6ef3ca75aadb99ab734587af46 not found: ID does not exist"
Sep 08 15:02:53.414219 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:53.414189    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b46c4bd46-65pss"]
Sep 08 15:02:53.418862 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:53.418840    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-b46c4bd46-65pss"]
Sep 08 15:02:53.490888 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:53.490862    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8062dfca-292a-4eb3-b57e-c334ba5559e4" path="/var/lib/kubelet/pods/8062dfca-292a-4eb3-b57e-c334ba5559e4/volumes"
Sep 08 15:02:54.764691 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:54.764658    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 15:02:55.005433 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.005409    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 15:02:55.118112 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.118029    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f27e38e8-b96f-4062-8fc1-bbe082a13b40-istio-envoy\") pod \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") "
Sep 08 15:02:55.118112 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.118091    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgwg4\" (UniqueName: \"kubernetes.io/projected/f27e38e8-b96f-4062-8fc1-bbe082a13b40-kube-api-access-tgwg4\") pod \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") "
Sep 08 15:02:55.118344 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.118125    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f27e38e8-b96f-4062-8fc1-bbe082a13b40-istio-token\") pod \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") "
Sep 08 15:02:55.118344 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.118167    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f27e38e8-b96f-4062-8fc1-bbe082a13b40-istiod-ca-cert\") pod \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") "
Sep 08 15:02:55.118344 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.118192    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f27e38e8-b96f-4062-8fc1-bbe082a13b40-istio-podinfo\") pod \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") "
Sep 08 15:02:55.118344 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.118220    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f27e38e8-b96f-4062-8fc1-bbe082a13b40-istio-data\") pod \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") "
Sep 08 15:02:55.118344 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.118262    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f27e38e8-b96f-4062-8fc1-bbe082a13b40-credential-socket\") pod \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") "
Sep 08 15:02:55.118344 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.118300    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f27e38e8-b96f-4062-8fc1-bbe082a13b40-workload-socket\") pod \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") "
Sep 08 15:02:55.118344 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.118345    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f27e38e8-b96f-4062-8fc1-bbe082a13b40-workload-certs\") pod \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\" (UID: \"f27e38e8-b96f-4062-8fc1-bbe082a13b40\") "
Sep 08 15:02:55.118763 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.118728    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f27e38e8-b96f-4062-8fc1-bbe082a13b40-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f27e38e8-b96f-4062-8fc1-bbe082a13b40" (UID: "f27e38e8-b96f-4062-8fc1-bbe082a13b40"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:02:55.118763 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.118730    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f27e38e8-b96f-4062-8fc1-bbe082a13b40-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f27e38e8-b96f-4062-8fc1-bbe082a13b40" (UID: "f27e38e8-b96f-4062-8fc1-bbe082a13b40"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:02:55.118962 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.118849    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f27e38e8-b96f-4062-8fc1-bbe082a13b40-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f27e38e8-b96f-4062-8fc1-bbe082a13b40" (UID: "f27e38e8-b96f-4062-8fc1-bbe082a13b40"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:02:55.118962 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.118872    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f27e38e8-b96f-4062-8fc1-bbe082a13b40-istio-data" (OuterVolumeSpecName: "istio-data") pod "f27e38e8-b96f-4062-8fc1-bbe082a13b40" (UID: "f27e38e8-b96f-4062-8fc1-bbe082a13b40"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:02:55.119168 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.118974    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f27e38e8-b96f-4062-8fc1-bbe082a13b40-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f27e38e8-b96f-4062-8fc1-bbe082a13b40" (UID: "f27e38e8-b96f-4062-8fc1-bbe082a13b40"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:02:55.120814 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.120781    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f27e38e8-b96f-4062-8fc1-bbe082a13b40-istio-token" (OuterVolumeSpecName: "istio-token") pod "f27e38e8-b96f-4062-8fc1-bbe082a13b40" (UID: "f27e38e8-b96f-4062-8fc1-bbe082a13b40"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:02:55.120927 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.120819    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f27e38e8-b96f-4062-8fc1-bbe082a13b40-kube-api-access-tgwg4" (OuterVolumeSpecName: "kube-api-access-tgwg4") pod "f27e38e8-b96f-4062-8fc1-bbe082a13b40" (UID: "f27e38e8-b96f-4062-8fc1-bbe082a13b40"). InnerVolumeSpecName "kube-api-access-tgwg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:02:55.120927 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.120826    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f27e38e8-b96f-4062-8fc1-bbe082a13b40-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f27e38e8-b96f-4062-8fc1-bbe082a13b40" (UID: "f27e38e8-b96f-4062-8fc1-bbe082a13b40"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:02:55.121060 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.121038    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f27e38e8-b96f-4062-8fc1-bbe082a13b40-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f27e38e8-b96f-4062-8fc1-bbe082a13b40" (UID: "f27e38e8-b96f-4062-8fc1-bbe082a13b40"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:02:55.219659 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.219627    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgwg4\" (UniqueName: \"kubernetes.io/projected/f27e38e8-b96f-4062-8fc1-bbe082a13b40-kube-api-access-tgwg4\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:55.219659 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.219652    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f27e38e8-b96f-4062-8fc1-bbe082a13b40-istio-token\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:55.219659 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.219660    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f27e38e8-b96f-4062-8fc1-bbe082a13b40-istiod-ca-cert\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:55.219878 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.219670    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f27e38e8-b96f-4062-8fc1-bbe082a13b40-istio-podinfo\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:55.219878 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.219678    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f27e38e8-b96f-4062-8fc1-bbe082a13b40-istio-data\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:55.219878 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.219685    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f27e38e8-b96f-4062-8fc1-bbe082a13b40-credential-socket\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:55.219878 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.219693    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f27e38e8-b96f-4062-8fc1-bbe082a13b40-workload-socket\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:55.219878 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.219701    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f27e38e8-b96f-4062-8fc1-bbe082a13b40-workload-certs\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:55.219878 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.219709    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f27e38e8-b96f-4062-8fc1-bbe082a13b40-istio-envoy\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:02:55.402733 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.402642    2577 generic.go:356] "Generic (PLEG): container finished" podID="f27e38e8-b96f-4062-8fc1-bbe082a13b40" containerID="ea42dea95e423a70facb2da499e12ae9b9d07e013dac8235c75c533fe6679dec" exitCode=0
Sep 08 15:02:55.402733 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.402685    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"
Sep 08 15:02:55.402913 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.402734    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr" event={"ID":"f27e38e8-b96f-4062-8fc1-bbe082a13b40","Type":"ContainerDied","Data":"ea42dea95e423a70facb2da499e12ae9b9d07e013dac8235c75c533fe6679dec"}
Sep 08 15:02:55.402913 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.402789    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr" event={"ID":"f27e38e8-b96f-4062-8fc1-bbe082a13b40","Type":"ContainerDied","Data":"ff361cb0faca4b503e33c88b39a98c796cdbdd143864c7b884a79fba40522fae"}
Sep 08 15:02:55.402913 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.402817    2577 scope.go:117] "RemoveContainer" containerID="ea42dea95e423a70facb2da499e12ae9b9d07e013dac8235c75c533fe6679dec"
Sep 08 15:02:55.413154 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.413137    2577 scope.go:117] "RemoveContainer" containerID="996269b5a903602ffe543faf4fa6d0e76c1972c92793ab4db09b9a6cfa11c10b"
Sep 08 15:02:55.421644 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.421626    2577 scope.go:117] "RemoveContainer" containerID="ea42dea95e423a70facb2da499e12ae9b9d07e013dac8235c75c533fe6679dec"
Sep 08 15:02:55.421928 ip-10-0-142-20 kubenswrapper[2577]: E0908 15:02:55.421907    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea42dea95e423a70facb2da499e12ae9b9d07e013dac8235c75c533fe6679dec\": container with ID starting with ea42dea95e423a70facb2da499e12ae9b9d07e013dac8235c75c533fe6679dec not found: ID does not exist" containerID="ea42dea95e423a70facb2da499e12ae9b9d07e013dac8235c75c533fe6679dec"
Sep 08 15:02:55.421992 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.421936    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea42dea95e423a70facb2da499e12ae9b9d07e013dac8235c75c533fe6679dec"} err="failed to get container status \"ea42dea95e423a70facb2da499e12ae9b9d07e013dac8235c75c533fe6679dec\": rpc error: code = NotFound desc = could not find container \"ea42dea95e423a70facb2da499e12ae9b9d07e013dac8235c75c533fe6679dec\": container with ID starting with ea42dea95e423a70facb2da499e12ae9b9d07e013dac8235c75c533fe6679dec not found: ID does not exist"
Sep 08 15:02:55.421992 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.421952    2577 scope.go:117] "RemoveContainer" containerID="996269b5a903602ffe543faf4fa6d0e76c1972c92793ab4db09b9a6cfa11c10b"
Sep 08 15:02:55.422274 ip-10-0-142-20 kubenswrapper[2577]: E0908 15:02:55.422255    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"996269b5a903602ffe543faf4fa6d0e76c1972c92793ab4db09b9a6cfa11c10b\": container with ID starting with 996269b5a903602ffe543faf4fa6d0e76c1972c92793ab4db09b9a6cfa11c10b not found: ID does not exist" containerID="996269b5a903602ffe543faf4fa6d0e76c1972c92793ab4db09b9a6cfa11c10b"
Sep 08 15:02:55.422366 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.422329    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"996269b5a903602ffe543faf4fa6d0e76c1972c92793ab4db09b9a6cfa11c10b"} err="failed to get container status \"996269b5a903602ffe543faf4fa6d0e76c1972c92793ab4db09b9a6cfa11c10b\": rpc error: code = NotFound desc = could not find container \"996269b5a903602ffe543faf4fa6d0e76c1972c92793ab4db09b9a6cfa11c10b\": container with ID starting with 996269b5a903602ffe543faf4fa6d0e76c1972c92793ab4db09b9a6cfa11c10b not found: ID does not exist"
Sep 08 15:02:55.424965 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.424946    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"]
Sep 08 15:02:55.429614 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.429593    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-f83533-openshift-default-549c4bcb58-8gbfr"]
Sep 08 15:02:55.491123 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:55.491099    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f27e38e8-b96f-4062-8fc1-bbe082a13b40" path="/var/lib/kubelet/pods/f27e38e8-b96f-4062-8fc1-bbe082a13b40/volumes"
Sep 08 15:02:59.807503 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:02:59.807454    2577 scope.go:117] "RemoveContainer" containerID="536de3b53f8b21ebf64a932c485e2badc0ede7c5bed2b60b9d8120f9338b41e3"
Sep 08 15:04:14.259322 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:04:14.259288    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 15:04:42.372556 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:04:42.372518    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 15:04:49.162147 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:04:49.162106    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 15:04:56.159327 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:04:56.159284    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 15:05:05.756993 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:05:05.756957    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 15:05:18.270643 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:05:18.270607    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 15:05:26.567642 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:05:26.567557    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 15:05:35.834591 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:05:35.834560    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xbflb"]
Sep 08 15:05:35.834990 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:05:35.834753    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xbflb" podUID="af1a4809-ced8-4c84-a301-0fd06e5965ce" containerName="manager" containerID="cri-o://4b834e019a3a82b9b9359a1b50d3ff08ce1942756bc653e820c64b1ee544e276" gracePeriod=10
Sep 08 15:05:36.081667 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:05:36.081637    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xbflb"
Sep 08 15:05:36.189387 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:05:36.189349    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/af1a4809-ced8-4c84-a301-0fd06e5965ce-extensions-socket-volume\") pod \"af1a4809-ced8-4c84-a301-0fd06e5965ce\" (UID: \"af1a4809-ced8-4c84-a301-0fd06e5965ce\") "
Sep 08 15:05:36.189571 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:05:36.189534    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9xx8\" (UniqueName: \"kubernetes.io/projected/af1a4809-ced8-4c84-a301-0fd06e5965ce-kube-api-access-h9xx8\") pod \"af1a4809-ced8-4c84-a301-0fd06e5965ce\" (UID: \"af1a4809-ced8-4c84-a301-0fd06e5965ce\") "
Sep 08 15:05:36.189702 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:05:36.189682    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af1a4809-ced8-4c84-a301-0fd06e5965ce-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "af1a4809-ced8-4c84-a301-0fd06e5965ce" (UID: "af1a4809-ced8-4c84-a301-0fd06e5965ce"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:05:36.189793 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:05:36.189781    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/af1a4809-ced8-4c84-a301-0fd06e5965ce-extensions-socket-volume\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:05:36.191660 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:05:36.191639    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af1a4809-ced8-4c84-a301-0fd06e5965ce-kube-api-access-h9xx8" (OuterVolumeSpecName: "kube-api-access-h9xx8") pod "af1a4809-ced8-4c84-a301-0fd06e5965ce" (UID: "af1a4809-ced8-4c84-a301-0fd06e5965ce"). InnerVolumeSpecName "kube-api-access-h9xx8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:05:36.270985 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:05:36.270951    2577 generic.go:356] "Generic (PLEG): container finished" podID="af1a4809-ced8-4c84-a301-0fd06e5965ce" containerID="4b834e019a3a82b9b9359a1b50d3ff08ce1942756bc653e820c64b1ee544e276" exitCode=0
Sep 08 15:05:36.271145 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:05:36.270996    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xbflb"
Sep 08 15:05:36.271145 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:05:36.271044    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xbflb" event={"ID":"af1a4809-ced8-4c84-a301-0fd06e5965ce","Type":"ContainerDied","Data":"4b834e019a3a82b9b9359a1b50d3ff08ce1942756bc653e820c64b1ee544e276"}
Sep 08 15:05:36.271145 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:05:36.271097    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xbflb" event={"ID":"af1a4809-ced8-4c84-a301-0fd06e5965ce","Type":"ContainerDied","Data":"45da89e75538b533a048ac7936a3748ac331b8ae4b7b6f0d225109d2672dfa11"}
Sep 08 15:05:36.271145 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:05:36.271120    2577 scope.go:117] "RemoveContainer" containerID="4b834e019a3a82b9b9359a1b50d3ff08ce1942756bc653e820c64b1ee544e276"
Sep 08 15:05:36.281659 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:05:36.281643    2577 scope.go:117] "RemoveContainer" containerID="4b834e019a3a82b9b9359a1b50d3ff08ce1942756bc653e820c64b1ee544e276"
Sep 08 15:05:36.281892 ip-10-0-142-20 kubenswrapper[2577]: E0908 15:05:36.281876    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b834e019a3a82b9b9359a1b50d3ff08ce1942756bc653e820c64b1ee544e276\": container with ID starting with 4b834e019a3a82b9b9359a1b50d3ff08ce1942756bc653e820c64b1ee544e276 not found: ID does not exist" containerID="4b834e019a3a82b9b9359a1b50d3ff08ce1942756bc653e820c64b1ee544e276"
Sep 08 15:05:36.281937 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:05:36.281900    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b834e019a3a82b9b9359a1b50d3ff08ce1942756bc653e820c64b1ee544e276"} err="failed to get container status \"4b834e019a3a82b9b9359a1b50d3ff08ce1942756bc653e820c64b1ee544e276\": rpc error: code = NotFound desc = could not find container \"4b834e019a3a82b9b9359a1b50d3ff08ce1942756bc653e820c64b1ee544e276\": container with ID starting with 4b834e019a3a82b9b9359a1b50d3ff08ce1942756bc653e820c64b1ee544e276 not found: ID does not exist"
Sep 08 15:05:36.290185 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:05:36.290163    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9xx8\" (UniqueName: \"kubernetes.io/projected/af1a4809-ced8-4c84-a301-0fd06e5965ce-kube-api-access-h9xx8\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:05:36.294603 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:05:36.294581    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xbflb"]
Sep 08 15:05:36.299157 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:05:36.299138    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xbflb"]
Sep 08 15:05:37.496710 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:05:37.496678    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af1a4809-ced8-4c84-a301-0fd06e5965ce" path="/var/lib/kubelet/pods/af1a4809-ced8-4c84-a301-0fd06e5965ce/volumes"
Sep 08 15:06:36.544695 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.544662    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-pfzgd"]
Sep 08 15:06:36.545159 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545014    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4206ad3f-ede3-4721-8091-cd183bb78346" containerName="maas-api"
Sep 08 15:06:36.545159 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545026    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4206ad3f-ede3-4721-8091-cd183bb78346" containerName="maas-api"
Sep 08 15:06:36.545159 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545038    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8062dfca-292a-4eb3-b57e-c334ba5559e4" containerName="manager"
Sep 08 15:06:36.545159 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545044    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8062dfca-292a-4eb3-b57e-c334ba5559e4" containerName="manager"
Sep 08 15:06:36.545159 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545049    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e4ae60d-fc01-4ee9-abc2-782e8bb2660b" containerName="maas-api"
Sep 08 15:06:36.545159 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545054    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e4ae60d-fc01-4ee9-abc2-782e8bb2660b" containerName="maas-api"
Sep 08 15:06:36.545159 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545061    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="335c8f00-0edf-489f-8d92-5ce4514e224a" containerName="istio-proxy"
Sep 08 15:06:36.545159 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545066    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="335c8f00-0edf-489f-8d92-5ce4514e224a" containerName="istio-proxy"
Sep 08 15:06:36.545159 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545071    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98aa8aa5-de96-4259-a634-7e83f71ba2aa" containerName="istio-proxy"
Sep 08 15:06:36.545159 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545076    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="98aa8aa5-de96-4259-a634-7e83f71ba2aa" containerName="istio-proxy"
Sep 08 15:06:36.545159 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545087    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="335c8f00-0edf-489f-8d92-5ce4514e224a" containerName="istio-proxy"
Sep 08 15:06:36.545159 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545092    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="335c8f00-0edf-489f-8d92-5ce4514e224a" containerName="istio-proxy"
Sep 08 15:06:36.545159 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545098    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af1a4809-ced8-4c84-a301-0fd06e5965ce" containerName="manager"
Sep 08 15:06:36.545159 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545103    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="af1a4809-ced8-4c84-a301-0fd06e5965ce" containerName="manager"
Sep 08 15:06:36.545159 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545112    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68f7c1cd-ce93-4940-9e58-c99097594b95" containerName="maas-api"
Sep 08 15:06:36.545159 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545116    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="68f7c1cd-ce93-4940-9e58-c99097594b95" containerName="maas-api"
Sep 08 15:06:36.545159 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545122    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f27e38e8-b96f-4062-8fc1-bbe082a13b40" containerName="istio-proxy"
Sep 08 15:06:36.545159 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545126    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f27e38e8-b96f-4062-8fc1-bbe082a13b40" containerName="istio-proxy"
Sep 08 15:06:36.545159 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545134    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4b44f24-a04f-47ef-9999-b3a2f7286ca7" containerName="maas-api"
Sep 08 15:06:36.545159 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545139    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4b44f24-a04f-47ef-9999-b3a2f7286ca7" containerName="maas-api"
Sep 08 15:06:36.545159 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545148    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f27e38e8-b96f-4062-8fc1-bbe082a13b40" containerName="istio-proxy"
Sep 08 15:06:36.545159 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545153    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f27e38e8-b96f-4062-8fc1-bbe082a13b40" containerName="istio-proxy"
Sep 08 15:06:36.545852 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545206    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="98aa8aa5-de96-4259-a634-7e83f71ba2aa" containerName="istio-proxy"
Sep 08 15:06:36.545852 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545214    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="68f7c1cd-ce93-4940-9e58-c99097594b95" containerName="maas-api"
Sep 08 15:06:36.545852 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545220    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="af1a4809-ced8-4c84-a301-0fd06e5965ce" containerName="manager"
Sep 08 15:06:36.545852 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545225    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="335c8f00-0edf-489f-8d92-5ce4514e224a" containerName="istio-proxy"
Sep 08 15:06:36.545852 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545230    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e4ae60d-fc01-4ee9-abc2-782e8bb2660b" containerName="maas-api"
Sep 08 15:06:36.545852 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545236    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4206ad3f-ede3-4721-8091-cd183bb78346" containerName="maas-api"
Sep 08 15:06:36.545852 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545240    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="98aa8aa5-de96-4259-a634-7e83f71ba2aa" containerName="istio-proxy"
Sep 08 15:06:36.545852 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545245    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4b44f24-a04f-47ef-9999-b3a2f7286ca7" containerName="maas-api"
Sep 08 15:06:36.545852 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545251    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="335c8f00-0edf-489f-8d92-5ce4514e224a" containerName="istio-proxy"
Sep 08 15:06:36.545852 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545256    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8062dfca-292a-4eb3-b57e-c334ba5559e4" containerName="manager"
Sep 08 15:06:36.545852 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545261    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f27e38e8-b96f-4062-8fc1-bbe082a13b40" containerName="istio-proxy"
Sep 08 15:06:36.545852 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.545265    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f27e38e8-b96f-4062-8fc1-bbe082a13b40" containerName="istio-proxy"
Sep 08 15:06:36.547921 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.547905    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-pfzgd"
Sep 08 15:06:36.550607 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.550588    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qzljs\""
Sep 08 15:06:36.560593 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.560570    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-pfzgd"]
Sep 08 15:06:36.700233 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.700193    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/349a4138-64ff-45ca-b8ac-d6dfe2d04e1c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-pfzgd\" (UID: \"349a4138-64ff-45ca-b8ac-d6dfe2d04e1c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-pfzgd"
Sep 08 15:06:36.700389 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.700250    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k56dp\" (UniqueName: \"kubernetes.io/projected/349a4138-64ff-45ca-b8ac-d6dfe2d04e1c-kube-api-access-k56dp\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-pfzgd\" (UID: \"349a4138-64ff-45ca-b8ac-d6dfe2d04e1c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-pfzgd"
Sep 08 15:06:36.800835 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.800762    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/349a4138-64ff-45ca-b8ac-d6dfe2d04e1c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-pfzgd\" (UID: \"349a4138-64ff-45ca-b8ac-d6dfe2d04e1c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-pfzgd"
Sep 08 15:06:36.800835 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.800806    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k56dp\" (UniqueName: \"kubernetes.io/projected/349a4138-64ff-45ca-b8ac-d6dfe2d04e1c-kube-api-access-k56dp\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-pfzgd\" (UID: \"349a4138-64ff-45ca-b8ac-d6dfe2d04e1c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-pfzgd"
Sep 08 15:06:36.801150 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.801131    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/349a4138-64ff-45ca-b8ac-d6dfe2d04e1c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-pfzgd\" (UID: \"349a4138-64ff-45ca-b8ac-d6dfe2d04e1c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-pfzgd"
Sep 08 15:06:36.809571 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.809545    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k56dp\" (UniqueName: \"kubernetes.io/projected/349a4138-64ff-45ca-b8ac-d6dfe2d04e1c-kube-api-access-k56dp\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-pfzgd\" (UID: \"349a4138-64ff-45ca-b8ac-d6dfe2d04e1c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-pfzgd"
Sep 08 15:06:36.857690 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:36.857660    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-pfzgd"
Sep 08 15:06:37.142708 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:37.142681    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-pfzgd"]
Sep 08 15:06:37.143873 ip-10-0-142-20 kubenswrapper[2577]: W0908 15:06:37.143844    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod349a4138_64ff_45ca_b8ac_d6dfe2d04e1c.slice/crio-d4eba9e11807dfe70d472a27dca49edcaac3e92ae5075f44af464ad0eefd5856 WatchSource:0}: Error finding container d4eba9e11807dfe70d472a27dca49edcaac3e92ae5075f44af464ad0eefd5856: Status 404 returned error can't find the container with id d4eba9e11807dfe70d472a27dca49edcaac3e92ae5075f44af464ad0eefd5856
Sep 08 15:06:37.588669 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:37.588628    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-pfzgd" event={"ID":"349a4138-64ff-45ca-b8ac-d6dfe2d04e1c","Type":"ContainerStarted","Data":"7a8cbdef4e457d46aac51e5f87a2c7307b9cf9865ec6bfb1153c581b34f8f413"}
Sep 08 15:06:37.589048 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:37.588681    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-pfzgd" event={"ID":"349a4138-64ff-45ca-b8ac-d6dfe2d04e1c","Type":"ContainerStarted","Data":"d4eba9e11807dfe70d472a27dca49edcaac3e92ae5075f44af464ad0eefd5856"}
Sep 08 15:06:37.589048 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:37.588747    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-pfzgd"
Sep 08 15:06:37.608863 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:37.608808    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-pfzgd" podStartSLOduration=1.6087892849999998 podStartE2EDuration="1.608789285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:06:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:06:37.607014136 +0000 UTC m=+1958.645415060" watchObservedRunningTime="2026-09-08 15:06:37.608789285 +0000 UTC m=+1958.647190210"
Sep 08 15:06:48.595461 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:48.595432    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-pfzgd"
Sep 08 15:06:57.570679 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:06:57.570593    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 15:07:03.963865 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:07:03.963824    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 15:07:13.867421 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:07:13.867384    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 15:07:19.071078 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:07:19.071038    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 15:07:32.979373 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:07:32.979335    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 15:07:56.160638 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:07:56.160595    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 15:08:03.666338 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:03.666302    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 15:08:11.188200 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:11.188167    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-86dc7466b4-bh76r"]
Sep 08 15:08:11.188713 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:11.188607    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98aa8aa5-de96-4259-a634-7e83f71ba2aa" containerName="istio-proxy"
Sep 08 15:08:11.188713 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:11.188621    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="98aa8aa5-de96-4259-a634-7e83f71ba2aa" containerName="istio-proxy"
Sep 08 15:08:11.191677 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:11.191661    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-86dc7466b4-bh76r"
Sep 08 15:08:11.203455 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:11.203431    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-86dc7466b4-bh76r"]
Sep 08 15:08:11.300416 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:11.300380    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed133727-c843-43a0-9018-cd2c8f890f8a-openshift-service-ca\") pod \"maas-api-86dc7466b4-bh76r\" (UID: \"ed133727-c843-43a0-9018-cd2c8f890f8a\") " pod="odh-ai-gateway-infra/maas-api-86dc7466b4-bh76r"
Sep 08 15:08:11.300597 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:11.300448    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed133727-c843-43a0-9018-cd2c8f890f8a-maas-api-tls\") pod \"maas-api-86dc7466b4-bh76r\" (UID: \"ed133727-c843-43a0-9018-cd2c8f890f8a\") " pod="odh-ai-gateway-infra/maas-api-86dc7466b4-bh76r"
Sep 08 15:08:11.300597 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:11.300517    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5txn\" (UniqueName: \"kubernetes.io/projected/ed133727-c843-43a0-9018-cd2c8f890f8a-kube-api-access-v5txn\") pod \"maas-api-86dc7466b4-bh76r\" (UID: \"ed133727-c843-43a0-9018-cd2c8f890f8a\") " pod="odh-ai-gateway-infra/maas-api-86dc7466b4-bh76r"
Sep 08 15:08:11.300597 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:11.300554    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed133727-c843-43a0-9018-cd2c8f890f8a-metrics-certs\") pod \"maas-api-86dc7466b4-bh76r\" (UID: \"ed133727-c843-43a0-9018-cd2c8f890f8a\") " pod="odh-ai-gateway-infra/maas-api-86dc7466b4-bh76r"
Sep 08 15:08:11.401644 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:11.401611    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed133727-c843-43a0-9018-cd2c8f890f8a-metrics-certs\") pod \"maas-api-86dc7466b4-bh76r\" (UID: \"ed133727-c843-43a0-9018-cd2c8f890f8a\") " pod="odh-ai-gateway-infra/maas-api-86dc7466b4-bh76r"
Sep 08 15:08:11.401818 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:11.401658    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed133727-c843-43a0-9018-cd2c8f890f8a-openshift-service-ca\") pod \"maas-api-86dc7466b4-bh76r\" (UID: \"ed133727-c843-43a0-9018-cd2c8f890f8a\") " pod="odh-ai-gateway-infra/maas-api-86dc7466b4-bh76r"
Sep 08 15:08:11.401818 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:11.401709    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed133727-c843-43a0-9018-cd2c8f890f8a-maas-api-tls\") pod \"maas-api-86dc7466b4-bh76r\" (UID: \"ed133727-c843-43a0-9018-cd2c8f890f8a\") " pod="odh-ai-gateway-infra/maas-api-86dc7466b4-bh76r"
Sep 08 15:08:11.401818 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:11.401729    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5txn\" (UniqueName: \"kubernetes.io/projected/ed133727-c843-43a0-9018-cd2c8f890f8a-kube-api-access-v5txn\") pod \"maas-api-86dc7466b4-bh76r\" (UID: \"ed133727-c843-43a0-9018-cd2c8f890f8a\") " pod="odh-ai-gateway-infra/maas-api-86dc7466b4-bh76r"
Sep 08 15:08:11.402402 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:11.402375    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed133727-c843-43a0-9018-cd2c8f890f8a-openshift-service-ca\") pod \"maas-api-86dc7466b4-bh76r\" (UID: \"ed133727-c843-43a0-9018-cd2c8f890f8a\") " pod="odh-ai-gateway-infra/maas-api-86dc7466b4-bh76r"
Sep 08 15:08:11.404165 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:11.404141    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed133727-c843-43a0-9018-cd2c8f890f8a-metrics-certs\") pod \"maas-api-86dc7466b4-bh76r\" (UID: \"ed133727-c843-43a0-9018-cd2c8f890f8a\") " pod="odh-ai-gateway-infra/maas-api-86dc7466b4-bh76r"
Sep 08 15:08:11.404299 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:11.404277    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed133727-c843-43a0-9018-cd2c8f890f8a-maas-api-tls\") pod \"maas-api-86dc7466b4-bh76r\" (UID: \"ed133727-c843-43a0-9018-cd2c8f890f8a\") " pod="odh-ai-gateway-infra/maas-api-86dc7466b4-bh76r"
Sep 08 15:08:11.410684 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:11.410664    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5txn\" (UniqueName: \"kubernetes.io/projected/ed133727-c843-43a0-9018-cd2c8f890f8a-kube-api-access-v5txn\") pod \"maas-api-86dc7466b4-bh76r\" (UID: \"ed133727-c843-43a0-9018-cd2c8f890f8a\") " pod="odh-ai-gateway-infra/maas-api-86dc7466b4-bh76r"
Sep 08 15:08:11.502243 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:11.502168    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-86dc7466b4-bh76r"
Sep 08 15:08:11.767337 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:11.767252    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 15:08:11.779082 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:11.779060    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-86dc7466b4-bh76r"]
Sep 08 15:08:11.780609 ip-10-0-142-20 kubenswrapper[2577]: W0908 15:08:11.780580    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded133727_c843_43a0_9018_cd2c8f890f8a.slice/crio-d108bf409fe2eceaf1e897d46fe08d45d71c30de26a7b83518e554798332f87b WatchSource:0}: Error finding container d108bf409fe2eceaf1e897d46fe08d45d71c30de26a7b83518e554798332f87b: Status 404 returned error can't find the container with id d108bf409fe2eceaf1e897d46fe08d45d71c30de26a7b83518e554798332f87b
Sep 08 15:08:11.782010 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:11.781991    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:08:12.100318 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:12.100238    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-86dc7466b4-bh76r" event={"ID":"ed133727-c843-43a0-9018-cd2c8f890f8a","Type":"ContainerStarted","Data":"d108bf409fe2eceaf1e897d46fe08d45d71c30de26a7b83518e554798332f87b"}
Sep 08 15:08:13.107495 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:13.107439    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-86dc7466b4-bh76r" event={"ID":"ed133727-c843-43a0-9018-cd2c8f890f8a","Type":"ContainerStarted","Data":"29afe34d0875f70624136fd1f77fee60713ab21b9031025540a89709522aab24"}
Sep 08 15:08:13.107948 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:13.107521    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-86dc7466b4-bh76r"
Sep 08 15:08:13.125083 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:13.125034    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-86dc7466b4-bh76r" podStartSLOduration=1.7352687709999999 podStartE2EDuration="2.125016691s" totalImagesPullingTime="389.74792ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:08:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:08:13.124807843 +0000 UTC m=+2054.163208765" watchObservedRunningTime="2026-09-08 15:08:13.125016691 +0000 UTC m=+2054.163417615"
Sep 08 15:08:19.119394 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:19.119365    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-86dc7466b4-bh76r"
Sep 08 15:08:19.180522 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:19.180489    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-84d9df9944-cszm2"]
Sep 08 15:08:19.180958 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:19.180928    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-84d9df9944-cszm2" podUID="4fb51864-7202-4258-add8-e8cb4b735c3c" containerName="maas-api" containerID="cri-o://d0e4bae5ad7f7e1e108fd512800625adc1b31ae286d2658e3106b2bca6b30837" gracePeriod=30
Sep 08 15:08:19.190090 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:19.190064    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 15:08:20.179537 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:20.179489    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-84d9df9944-cszm2" podUID="4fb51864-7202-4258-add8-e8cb4b735c3c" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.45:8443/health\": dial tcp 10.132.0.45:8443: connect: connection refused"
Sep 08 15:08:20.436640 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:20.436559    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84d9df9944-cszm2"
Sep 08 15:08:20.580791 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:20.580760    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krm8r\" (UniqueName: \"kubernetes.io/projected/4fb51864-7202-4258-add8-e8cb4b735c3c-kube-api-access-krm8r\") pod \"4fb51864-7202-4258-add8-e8cb4b735c3c\" (UID: \"4fb51864-7202-4258-add8-e8cb4b735c3c\") "
Sep 08 15:08:20.580944 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:20.580807    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4fb51864-7202-4258-add8-e8cb4b735c3c-metrics-certs\") pod \"4fb51864-7202-4258-add8-e8cb4b735c3c\" (UID: \"4fb51864-7202-4258-add8-e8cb4b735c3c\") "
Sep 08 15:08:20.580944 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:20.580881    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fb51864-7202-4258-add8-e8cb4b735c3c-maas-api-tls\") pod \"4fb51864-7202-4258-add8-e8cb4b735c3c\" (UID: \"4fb51864-7202-4258-add8-e8cb4b735c3c\") "
Sep 08 15:08:20.580944 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:20.580907    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fb51864-7202-4258-add8-e8cb4b735c3c-openshift-service-ca\") pod \"4fb51864-7202-4258-add8-e8cb4b735c3c\" (UID: \"4fb51864-7202-4258-add8-e8cb4b735c3c\") "
Sep 08 15:08:20.581318 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:20.581291    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fb51864-7202-4258-add8-e8cb4b735c3c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4fb51864-7202-4258-add8-e8cb4b735c3c" (UID: "4fb51864-7202-4258-add8-e8cb4b735c3c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:08:20.583065 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:20.583035    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fb51864-7202-4258-add8-e8cb4b735c3c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4fb51864-7202-4258-add8-e8cb4b735c3c" (UID: "4fb51864-7202-4258-add8-e8cb4b735c3c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:08:20.583065 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:20.583056    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fb51864-7202-4258-add8-e8cb4b735c3c-kube-api-access-krm8r" (OuterVolumeSpecName: "kube-api-access-krm8r") pod "4fb51864-7202-4258-add8-e8cb4b735c3c" (UID: "4fb51864-7202-4258-add8-e8cb4b735c3c"). InnerVolumeSpecName "kube-api-access-krm8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:08:20.583238 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:20.583070    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fb51864-7202-4258-add8-e8cb4b735c3c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4fb51864-7202-4258-add8-e8cb4b735c3c" (UID: "4fb51864-7202-4258-add8-e8cb4b735c3c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:08:20.681640 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:20.681609    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fb51864-7202-4258-add8-e8cb4b735c3c-maas-api-tls\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:08:20.681640 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:20.681634    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fb51864-7202-4258-add8-e8cb4b735c3c-openshift-service-ca\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:08:20.681640 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:20.681643    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krm8r\" (UniqueName: \"kubernetes.io/projected/4fb51864-7202-4258-add8-e8cb4b735c3c-kube-api-access-krm8r\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:08:20.681870 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:20.681654    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4fb51864-7202-4258-add8-e8cb4b735c3c-metrics-certs\") on node \"ip-10-0-142-20.ec2.internal\" DevicePath \"\""
Sep 08 15:08:21.153023 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:21.152977    2577 generic.go:356] "Generic (PLEG): container finished" podID="4fb51864-7202-4258-add8-e8cb4b735c3c" containerID="d0e4bae5ad7f7e1e108fd512800625adc1b31ae286d2658e3106b2bca6b30837" exitCode=0
Sep 08 15:08:21.153203 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:21.153026    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84d9df9944-cszm2"
Sep 08 15:08:21.153203 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:21.153077    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84d9df9944-cszm2" event={"ID":"4fb51864-7202-4258-add8-e8cb4b735c3c","Type":"ContainerDied","Data":"d0e4bae5ad7f7e1e108fd512800625adc1b31ae286d2658e3106b2bca6b30837"}
Sep 08 15:08:21.153203 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:21.153133    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84d9df9944-cszm2" event={"ID":"4fb51864-7202-4258-add8-e8cb4b735c3c","Type":"ContainerDied","Data":"401a43385b0e13e0b6f5c005cae9eac53befc4ed7f63be33fae9e2002eef4d3f"}
Sep 08 15:08:21.153203 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:21.153161    2577 scope.go:117] "RemoveContainer" containerID="d0e4bae5ad7f7e1e108fd512800625adc1b31ae286d2658e3106b2bca6b30837"
Sep 08 15:08:21.162773 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:21.162757    2577 scope.go:117] "RemoveContainer" containerID="d0e4bae5ad7f7e1e108fd512800625adc1b31ae286d2658e3106b2bca6b30837"
Sep 08 15:08:21.163038 ip-10-0-142-20 kubenswrapper[2577]: E0908 15:08:21.163021    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0e4bae5ad7f7e1e108fd512800625adc1b31ae286d2658e3106b2bca6b30837\": container with ID starting with d0e4bae5ad7f7e1e108fd512800625adc1b31ae286d2658e3106b2bca6b30837 not found: ID does not exist" containerID="d0e4bae5ad7f7e1e108fd512800625adc1b31ae286d2658e3106b2bca6b30837"
Sep 08 15:08:21.163085 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:21.163048    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0e4bae5ad7f7e1e108fd512800625adc1b31ae286d2658e3106b2bca6b30837"} err="failed to get container status \"d0e4bae5ad7f7e1e108fd512800625adc1b31ae286d2658e3106b2bca6b30837\": rpc error: code = NotFound desc = could not find container \"d0e4bae5ad7f7e1e108fd512800625adc1b31ae286d2658e3106b2bca6b30837\": container with ID starting with d0e4bae5ad7f7e1e108fd512800625adc1b31ae286d2658e3106b2bca6b30837 not found: ID does not exist"
Sep 08 15:08:21.175447 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:21.175419    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-84d9df9944-cszm2"]
Sep 08 15:08:21.179738 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:21.179713    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-84d9df9944-cszm2"]
Sep 08 15:08:21.491227 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:21.491192    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fb51864-7202-4258-add8-e8cb4b735c3c" path="/var/lib/kubelet/pods/4fb51864-7202-4258-add8-e8cb4b735c3c/volumes"
Sep 08 15:08:26.978515 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:26.978483    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 15:08:32.616671 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:32.616633    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 15:08:41.469858 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:41.469817    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-qb8vf"]
Sep 08 15:08:48.371805 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:48.371772    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-c4bll_1232051a-c7cd-47ee-8a03-e3bd498b80b5/manager/0.log"
Sep 08 15:08:48.484844 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:48.484816    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-knv7q_34d6fcec-2abe-4655-a088-48b5910ddca8/manager/0.log"
Sep 08 15:08:49.093859 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:49.093827    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-766f77f8db-99m64_fddac6a4-6507-4d7b-aa5d-3f9058f199ca/copy-manifests/0.log"
Sep 08 15:08:49.101136 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:49.101107    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-766f77f8db-99m64_fddac6a4-6507-4d7b-aa5d-3f9058f199ca/manager/0.log"
Sep 08 15:08:49.650672 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:49.650635    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-86dc7466b4-bh76r_ed133727-c843-43a0-9018-cd2c8f890f8a/maas-api/0.log"
Sep 08 15:08:50.849264 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:50.849222    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-8b7jr_eb857e8d-ff78-4496-a152-70f78a7b96ee/manager/0.log"
Sep 08 15:08:50.956422 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:50.956396    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-5t7wl_ac3a9021-6fce-454d-b70a-1379acad35f8/manager/0.log"
Sep 08 15:08:51.067856 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:51.067832    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-5gtql_bd1541de-0eee-4d92-9aeb-48bde9e40636/kuadrant-console-plugin/0.log"
Sep 08 15:08:51.180026 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:51.179998    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-pfzgd_349a4138-64ff-45ca-b8ac-d6dfe2d04e1c/manager/0.log"
Sep 08 15:08:51.294263 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:51.294236    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-qb8vf_ea2101e6-f241-4059-adf8-efcb76ee2a14/limitador/0.log"
Sep 08 15:08:51.413735 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:51.413686    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-jqd5j_093e1b2b-bab0-46b9-8f74-9928cbbf0a8d/manager/0.log"
Sep 08 15:08:52.099514 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:52.099487    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6dd8bb6964-vtpjp_6e7e0405-a415-4f24-a373-7b8e84a9ece6/kube-auth-proxy/0.log"
Sep 08 15:08:52.451476 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:52.451449    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-frbc8_ac63e955-806d-44b0-ba92-1e7c94474243/payload-processing/0.log"
Sep 08 15:08:53.221636 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:53.221593    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-nd9h2_b3ce564f-a64e-4915-ba91-9891ea8fddc6/main/0.log"
Sep 08 15:08:58.971233 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:58.971200    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gjjks/must-gather-pw5c6"]
Sep 08 15:08:58.971633 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:58.971619    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fb51864-7202-4258-add8-e8cb4b735c3c" containerName="maas-api"
Sep 08 15:08:58.971678 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:58.971635    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fb51864-7202-4258-add8-e8cb4b735c3c" containerName="maas-api"
Sep 08 15:08:58.971715 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:58.971696    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fb51864-7202-4258-add8-e8cb4b735c3c" containerName="maas-api"
Sep 08 15:08:58.975296 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:58.975274    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gjjks/must-gather-pw5c6"
Sep 08 15:08:58.980947 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:58.980924    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gjjks\"/\"kube-root-ca.crt\""
Sep 08 15:08:58.981374 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:58.981331    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gjjks\"/\"openshift-service-ca.crt\""
Sep 08 15:08:58.981520 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:58.981406    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gjjks\"/\"default-dockercfg-vpdf8\""
Sep 08 15:08:58.994163 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:58.994142    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gjjks/must-gather-pw5c6"]
Sep 08 15:08:59.097624 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:59.097596    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8f8t\" (UniqueName: \"kubernetes.io/projected/e9290ed1-d97d-4b5a-9dd4-4fe603a1d105-kube-api-access-c8f8t\") pod \"must-gather-pw5c6\" (UID: \"e9290ed1-d97d-4b5a-9dd4-4fe603a1d105\") " pod="openshift-must-gather-gjjks/must-gather-pw5c6"
Sep 08 15:08:59.097763 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:59.097666    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e9290ed1-d97d-4b5a-9dd4-4fe603a1d105-must-gather-output\") pod \"must-gather-pw5c6\" (UID: \"e9290ed1-d97d-4b5a-9dd4-4fe603a1d105\") " pod="openshift-must-gather-gjjks/must-gather-pw5c6"
Sep 08 15:08:59.198237 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:59.198207    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e9290ed1-d97d-4b5a-9dd4-4fe603a1d105-must-gather-output\") pod \"must-gather-pw5c6\" (UID: \"e9290ed1-d97d-4b5a-9dd4-4fe603a1d105\") " pod="openshift-must-gather-gjjks/must-gather-pw5c6"
Sep 08 15:08:59.198426 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:59.198266    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8f8t\" (UniqueName: \"kubernetes.io/projected/e9290ed1-d97d-4b5a-9dd4-4fe603a1d105-kube-api-access-c8f8t\") pod \"must-gather-pw5c6\" (UID: \"e9290ed1-d97d-4b5a-9dd4-4fe603a1d105\") " pod="openshift-must-gather-gjjks/must-gather-pw5c6"
Sep 08 15:08:59.198624 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:59.198604    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e9290ed1-d97d-4b5a-9dd4-4fe603a1d105-must-gather-output\") pod \"must-gather-pw5c6\" (UID: \"e9290ed1-d97d-4b5a-9dd4-4fe603a1d105\") " pod="openshift-must-gather-gjjks/must-gather-pw5c6"
Sep 08 15:08:59.209954 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:59.209929    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8f8t\" (UniqueName: \"kubernetes.io/projected/e9290ed1-d97d-4b5a-9dd4-4fe603a1d105-kube-api-access-c8f8t\") pod \"must-gather-pw5c6\" (UID: \"e9290ed1-d97d-4b5a-9dd4-4fe603a1d105\") " pod="openshift-must-gather-gjjks/must-gather-pw5c6"
Sep 08 15:08:59.284086 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:59.284025    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gjjks/must-gather-pw5c6"
Sep 08 15:08:59.561812 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:08:59.561786    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gjjks/must-gather-pw5c6"]
Sep 08 15:08:59.563108 ip-10-0-142-20 kubenswrapper[2577]: W0908 15:08:59.563082    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9290ed1_d97d_4b5a_9dd4_4fe603a1d105.slice/crio-1d2e08f9f4bb46c6ea2adcc0b41efc95f4d40bc27cd9d838823eecb24940f2bd WatchSource:0}: Error finding container 1d2e08f9f4bb46c6ea2adcc0b41efc95f4d40bc27cd9d838823eecb24940f2bd: Status 404 returned error can't find the container with id 1d2e08f9f4bb46c6ea2adcc0b41efc95f4d40bc27cd9d838823eecb24940f2bd
Sep 08 15:09:00.375423 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:00.375386    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gjjks/must-gather-pw5c6" event={"ID":"e9290ed1-d97d-4b5a-9dd4-4fe603a1d105","Type":"ContainerStarted","Data":"1d2e08f9f4bb46c6ea2adcc0b41efc95f4d40bc27cd9d838823eecb24940f2bd"}
Sep 08 15:09:03.398684 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:03.398637    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gjjks/must-gather-pw5c6" event={"ID":"e9290ed1-d97d-4b5a-9dd4-4fe603a1d105","Type":"ContainerStarted","Data":"262ce3b393bb08dafda96c2a2907dfbf6a4c2f959195929f526f29ee7eb26a20"}
Sep 08 15:09:03.399176 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:03.398699    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gjjks/must-gather-pw5c6" event={"ID":"e9290ed1-d97d-4b5a-9dd4-4fe603a1d105","Type":"ContainerStarted","Data":"0ae31d1dd7256e83daf2518876535281d6b2220d85abc24ca475a2bac2721160"}
Sep 08 15:09:03.418638 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:03.418579    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gjjks/must-gather-pw5c6" podStartSLOduration=2.387306008 podStartE2EDuration="5.418563286s" totalImagesPullingTime="3.031257278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:09:03.415790393 +0000 UTC m=+2104.454191317" watchObservedRunningTime="2026-09-08 15:09:03.418563286 +0000 UTC m=+2104.456964209"
Sep 08 15:09:04.223331 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:04.223297    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nzr7f_85fae7c9-a2d7-44ee-b3b6-499f4d98cf35/global-pull-secret-syncer/0.log"
Sep 08 15:09:04.389888 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:04.389856    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-k87z4_5ea167eb-ecbe-47f0-afca-1d0d6bccda05/konnectivity-agent/0.log"
Sep 08 15:09:04.462322 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:04.462296    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-20.ec2.internal_e0bff5a7795653f306d187693d0b9c36/haproxy/0.log"
Sep 08 15:09:09.113196 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:09.113154    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-8b7jr_eb857e8d-ff78-4496-a152-70f78a7b96ee/manager/0.log"
Sep 08 15:09:09.147016 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:09.146988    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-5t7wl_ac3a9021-6fce-454d-b70a-1379acad35f8/manager/0.log"
Sep 08 15:09:09.185138 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:09.185111    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-5gtql_bd1541de-0eee-4d92-9aeb-48bde9e40636/kuadrant-console-plugin/0.log"
Sep 08 15:09:09.235718 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:09.235692    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-pfzgd_349a4138-64ff-45ca-b8ac-d6dfe2d04e1c/manager/0.log"
Sep 08 15:09:09.264608 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:09.264580    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-qb8vf_ea2101e6-f241-4059-adf8-efcb76ee2a14/limitador/0.log"
Sep 08 15:09:09.329253 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:09.329224    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-jqd5j_093e1b2b-bab0-46b9-8f74-9928cbbf0a8d/manager/0.log"
Sep 08 15:09:11.233425 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:11.233390    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kgn7g_59765590-520d-48ec-b544-75945952a4f4/node-exporter/0.log"
Sep 08 15:09:11.253777 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:11.253742    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kgn7g_59765590-520d-48ec-b544-75945952a4f4/kube-rbac-proxy/0.log"
Sep 08 15:09:11.274417 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:11.274387    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kgn7g_59765590-520d-48ec-b544-75945952a4f4/init-textfile/0.log"
Sep 08 15:09:11.728635 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:11.728582    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d8cff5c6f-2dmzt_59548e72-9439-41a6-b47e-b7e22ee731a0/telemeter-client/0.log"
Sep 08 15:09:11.755758 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:11.755731    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d8cff5c6f-2dmzt_59548e72-9439-41a6-b47e-b7e22ee731a0/reload/0.log"
Sep 08 15:09:11.785280 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:11.785247    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d8cff5c6f-2dmzt_59548e72-9439-41a6-b47e-b7e22ee731a0/kube-rbac-proxy/0.log"
Sep 08 15:09:11.828525 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:11.828494    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57bbf4f5c7-pj7t5_b2640414-5d50-49f8-a667-27f23590453c/thanos-query/0.log"
Sep 08 15:09:11.852690 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:11.852662    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57bbf4f5c7-pj7t5_b2640414-5d50-49f8-a667-27f23590453c/kube-rbac-proxy-web/0.log"
Sep 08 15:09:11.878513 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:11.878457    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57bbf4f5c7-pj7t5_b2640414-5d50-49f8-a667-27f23590453c/kube-rbac-proxy/0.log"
Sep 08 15:09:11.912945 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:11.912909    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57bbf4f5c7-pj7t5_b2640414-5d50-49f8-a667-27f23590453c/prom-label-proxy/0.log"
Sep 08 15:09:11.942052 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:11.942010    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57bbf4f5c7-pj7t5_b2640414-5d50-49f8-a667-27f23590453c/kube-rbac-proxy-rules/0.log"
Sep 08 15:09:11.964510 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:11.964478    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57bbf4f5c7-pj7t5_b2640414-5d50-49f8-a667-27f23590453c/kube-rbac-proxy-metrics/0.log"
Sep 08 15:09:14.308906 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:14.308874    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-697d967997-2ps7z_7f16fb2c-fc2f-4ede-bb8b-7ed0b62d6083/console/0.log"
Sep 08 15:09:16.124027 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:16.123999    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bl4qh_ee765ac4-29fe-4529-8f78-23d2f886aa15/dns/0.log"
Sep 08 15:09:16.163587 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:16.163549    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bl4qh_ee765ac4-29fe-4529-8f78-23d2f886aa15/kube-rbac-proxy/0.log"
Sep 08 15:09:16.209331 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:16.209301    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gjjks/perf-node-gather-daemonset-7v9ql"]
Sep 08 15:09:16.214566 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:16.214539    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-7v9ql"
Sep 08 15:09:16.228548 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:16.228500    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gjjks/perf-node-gather-daemonset-7v9ql"]
Sep 08 15:09:16.373868 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:16.373833    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9b411fb8-9603-4919-80e4-79d138b7822e-podres\") pod \"perf-node-gather-daemonset-7v9ql\" (UID: \"9b411fb8-9603-4919-80e4-79d138b7822e\") " pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-7v9ql"
Sep 08 15:09:16.374082 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:16.373881    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b411fb8-9603-4919-80e4-79d138b7822e-lib-modules\") pod \"perf-node-gather-daemonset-7v9ql\" (UID: \"9b411fb8-9603-4919-80e4-79d138b7822e\") " pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-7v9ql"
Sep 08 15:09:16.374082 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:16.373937    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b411fb8-9603-4919-80e4-79d138b7822e-sys\") pod \"perf-node-gather-daemonset-7v9ql\" (UID: \"9b411fb8-9603-4919-80e4-79d138b7822e\") " pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-7v9ql"
Sep 08 15:09:16.374082 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:16.373960    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9b411fb8-9603-4919-80e4-79d138b7822e-proc\") pod \"perf-node-gather-daemonset-7v9ql\" (UID: \"9b411fb8-9603-4919-80e4-79d138b7822e\") " pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-7v9ql"
Sep 08 15:09:16.374082 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:16.373975    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg4pp\" (UniqueName: \"kubernetes.io/projected/9b411fb8-9603-4919-80e4-79d138b7822e-kube-api-access-cg4pp\") pod \"perf-node-gather-daemonset-7v9ql\" (UID: \"9b411fb8-9603-4919-80e4-79d138b7822e\") " pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-7v9ql"
Sep 08 15:09:16.426238 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:16.426208    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mjb8g_cab4bd52-c6c1-48e1-9b14-fde47ac2dc46/dns-node-resolver/0.log"
Sep 08 15:09:16.474860 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:16.474824    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b411fb8-9603-4919-80e4-79d138b7822e-sys\") pod \"perf-node-gather-daemonset-7v9ql\" (UID: \"9b411fb8-9603-4919-80e4-79d138b7822e\") " pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-7v9ql"
Sep 08 15:09:16.475271 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:16.475242    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9b411fb8-9603-4919-80e4-79d138b7822e-proc\") pod \"perf-node-gather-daemonset-7v9ql\" (UID: \"9b411fb8-9603-4919-80e4-79d138b7822e\") " pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-7v9ql"
Sep 08 15:09:16.475271 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:16.475281    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg4pp\" (UniqueName: \"kubernetes.io/projected/9b411fb8-9603-4919-80e4-79d138b7822e-kube-api-access-cg4pp\") pod \"perf-node-gather-daemonset-7v9ql\" (UID: \"9b411fb8-9603-4919-80e4-79d138b7822e\") " pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-7v9ql"
Sep 08 15:09:16.475440 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:16.475315    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9b411fb8-9603-4919-80e4-79d138b7822e-proc\") pod \"perf-node-gather-daemonset-7v9ql\" (UID: \"9b411fb8-9603-4919-80e4-79d138b7822e\") " pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-7v9ql"
Sep 08 15:09:16.475440 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:16.475100    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b411fb8-9603-4919-80e4-79d138b7822e-sys\") pod \"perf-node-gather-daemonset-7v9ql\" (UID: \"9b411fb8-9603-4919-80e4-79d138b7822e\") " pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-7v9ql"
Sep 08 15:09:16.475440 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:16.475344    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9b411fb8-9603-4919-80e4-79d138b7822e-podres\") pod \"perf-node-gather-daemonset-7v9ql\" (UID: \"9b411fb8-9603-4919-80e4-79d138b7822e\") " pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-7v9ql"
Sep 08 15:09:16.475440 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:16.475390    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b411fb8-9603-4919-80e4-79d138b7822e-lib-modules\") pod \"perf-node-gather-daemonset-7v9ql\" (UID: \"9b411fb8-9603-4919-80e4-79d138b7822e\") " pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-7v9ql"
Sep 08 15:09:16.475615 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:16.475482    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9b411fb8-9603-4919-80e4-79d138b7822e-podres\") pod \"perf-node-gather-daemonset-7v9ql\" (UID: \"9b411fb8-9603-4919-80e4-79d138b7822e\") " pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-7v9ql"
Sep 08 15:09:16.475615 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:16.475522    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b411fb8-9603-4919-80e4-79d138b7822e-lib-modules\") pod \"perf-node-gather-daemonset-7v9ql\" (UID: \"9b411fb8-9603-4919-80e4-79d138b7822e\") " pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-7v9ql"
Sep 08 15:09:16.485149 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:16.485117    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg4pp\" (UniqueName: \"kubernetes.io/projected/9b411fb8-9603-4919-80e4-79d138b7822e-kube-api-access-cg4pp\") pod \"perf-node-gather-daemonset-7v9ql\" (UID: \"9b411fb8-9603-4919-80e4-79d138b7822e\") " pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-7v9ql"
Sep 08 15:09:16.528240 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:16.528204    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-7v9ql"
Sep 08 15:09:16.834530 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:16.834494    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gjjks/perf-node-gather-daemonset-7v9ql"]
Sep 08 15:09:17.067830 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:17.067800    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g9bkm_3f89e9ca-0539-4ef8-9ee4-fa19dd2e939d/node-ca/0.log"
Sep 08 15:09:17.515134 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:17.515104    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-7v9ql" event={"ID":"9b411fb8-9603-4919-80e4-79d138b7822e","Type":"ContainerStarted","Data":"9eafdeef8480982c3f4a4f6a2b7bb78439627c36077b91fa93571c10dec3cea9"}
Sep 08 15:09:17.515569 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:17.515155    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-7v9ql" event={"ID":"9b411fb8-9603-4919-80e4-79d138b7822e","Type":"ContainerStarted","Data":"9c5e03850a12a6c696aecf8c0e4f9a9f828f6a4c241e8f69085d249f48a49cce"}
Sep 08 15:09:17.515569 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:17.515307    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-7v9ql"
Sep 08 15:09:17.536072 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:17.536010    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-7v9ql" podStartSLOduration=1.535993383 podStartE2EDuration="1.535993383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:09:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:09:17.531740376 +0000 UTC m=+2118.570141302" watchObservedRunningTime="2026-09-08 15:09:17.535993383 +0000 UTC m=+2118.574394303"
Sep 08 15:09:18.574219 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:18.574189    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6dd8bb6964-vtpjp_6e7e0405-a415-4f24-a373-7b8e84a9ece6/kube-auth-proxy/0.log"
Sep 08 15:09:18.711116 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:18.711057    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-frbc8_ac63e955-806d-44b0-ba92-1e7c94474243/payload-processing/0.log"
Sep 08 15:09:19.604381 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:19.604350    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vvtk9_1b275d6c-b08b-43d0-9988-e35e6657baeb/serve-healthcheck-canary/0.log"
Sep 08 15:09:20.179492 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:20.179440    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nxh6k_767124fd-f9fe-4100-afd8-1a60106e384c/kube-rbac-proxy/0.log"
Sep 08 15:09:20.206961 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:20.206938    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nxh6k_767124fd-f9fe-4100-afd8-1a60106e384c/exporter/0.log"
Sep 08 15:09:20.231149 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:20.231126    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nxh6k_767124fd-f9fe-4100-afd8-1a60106e384c/extractor/0.log"
Sep 08 15:09:22.653294 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:22.653263    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-c4bll_1232051a-c7cd-47ee-8a03-e3bd498b80b5/manager/0.log"
Sep 08 15:09:22.867064 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:22.867021    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-knv7q_34d6fcec-2abe-4655-a088-48b5910ddca8/manager/0.log"
Sep 08 15:09:23.285601 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:23.285572    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-766f77f8db-99m64_fddac6a4-6507-4d7b-aa5d-3f9058f199ca/manager/0.log"
Sep 08 15:09:23.309560 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:23.309527    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-766f77f8db-99m64_fddac6a4-6507-4d7b-aa5d-3f9058f199ca/copy-manifests/0.log"
Sep 08 15:09:23.533963 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:23.533938    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gjjks/perf-node-gather-daemonset-7v9ql"
Sep 08 15:09:24.530530 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:24.530503    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-mns95_51d1db6b-4e42-4d00-9d7c-f245090fb18a/openshift-lws-operator/0.log"
Sep 08 15:09:24.551058 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:24.551031    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6dd8bb6964-vtpjp_6e7e0405-a415-4f24-a373-7b8e84a9ece6/kube-auth-proxy/0.log"
Sep 08 15:09:24.659364 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:24.659332    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-frbc8_ac63e955-806d-44b0-ba92-1e7c94474243/payload-processing/0.log"
Sep 08 15:09:26.870874 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:26.870807    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6dd8bb6964-vtpjp_6e7e0405-a415-4f24-a373-7b8e84a9ece6/kube-auth-proxy/0.log"
Sep 08 15:09:26.974042 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:26.974008    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-frbc8_ac63e955-806d-44b0-ba92-1e7c94474243/payload-processing/0.log"
Sep 08 15:09:29.730105 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:29.730074    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-ggxgg_4d5e40cf-4b1c-4b35-a663-71e8dff74215/migrator/0.log"
Sep 08 15:09:29.754170 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:29.754142    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-ggxgg_4d5e40cf-4b1c-4b35-a663-71e8dff74215/graceful-termination/0.log"
Sep 08 15:09:30.100928 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:30.100839    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-fhk8t_2abb23b6-32c5-4ac9-bdb1-94950de2206c/kube-storage-version-migrator-operator/1.log"
Sep 08 15:09:30.101830 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:30.101810    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-fhk8t_2abb23b6-32c5-4ac9-bdb1-94950de2206c/kube-storage-version-migrator-operator/0.log"
Sep 08 15:09:31.249628 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:31.249600    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bm4ll_dec62c8d-71a8-4b6c-b083-732017b99319/kube-multus-additional-cni-plugins/0.log"
Sep 08 15:09:31.273454 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:31.273431    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bm4ll_dec62c8d-71a8-4b6c-b083-732017b99319/egress-router-binary-copy/0.log"
Sep 08 15:09:31.298672 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:31.298649    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bm4ll_dec62c8d-71a8-4b6c-b083-732017b99319/cni-plugins/0.log"
Sep 08 15:09:31.322781 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:31.322753    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bm4ll_dec62c8d-71a8-4b6c-b083-732017b99319/bond-cni-plugin/0.log"
Sep 08 15:09:31.343610 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:31.343590    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bm4ll_dec62c8d-71a8-4b6c-b083-732017b99319/routeoverride-cni/0.log"
Sep 08 15:09:31.365259 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:31.365237    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bm4ll_dec62c8d-71a8-4b6c-b083-732017b99319/whereabouts-cni-bincopy/0.log"
Sep 08 15:09:31.384439 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:31.384420    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bm4ll_dec62c8d-71a8-4b6c-b083-732017b99319/whereabouts-cni/0.log"
Sep 08 15:09:31.668317 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:31.668285    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v7lbx_87b4044c-c2c8-437b-b227-79fd3821df6d/kube-multus/0.log"
Sep 08 15:09:31.791955 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:31.791928    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v6nc9_58b796b8-809f-4e12-8fba-b018a9af00c8/network-metrics-daemon/0.log"
Sep 08 15:09:31.808391 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:31.808364    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v6nc9_58b796b8-809f-4e12-8fba-b018a9af00c8/kube-rbac-proxy/0.log"
Sep 08 15:09:33.168497 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:33.168445    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trsml_52df79ef-8ace-4ac1-877c-15c9b70e7700/ovn-controller/0.log"
Sep 08 15:09:33.188211 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:33.188176    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trsml_52df79ef-8ace-4ac1-877c-15c9b70e7700/ovn-acl-logging/0.log"
Sep 08 15:09:33.214602 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:33.214567    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trsml_52df79ef-8ace-4ac1-877c-15c9b70e7700/kube-rbac-proxy-node/0.log"
Sep 08 15:09:33.238728 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:33.238699    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trsml_52df79ef-8ace-4ac1-877c-15c9b70e7700/kube-rbac-proxy-ovn-metrics/0.log"
Sep 08 15:09:33.256264 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:33.256240    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trsml_52df79ef-8ace-4ac1-877c-15c9b70e7700/northd/0.log"
Sep 08 15:09:33.276494 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:33.276446    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trsml_52df79ef-8ace-4ac1-877c-15c9b70e7700/nbdb/0.log"
Sep 08 15:09:33.297431 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:33.297409    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trsml_52df79ef-8ace-4ac1-877c-15c9b70e7700/sbdb/0.log"
Sep 08 15:09:33.369325 ip-10-0-142-20 kubenswrapper[2577]: I0908 15:09:33.369288    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-trsml_52df79ef-8ace-4ac1-877c-15c9b70e7700/ovnkube-controller/0.log"